Jul 24 17:15:32.478871 ip-10-0-139-113 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 24 17:15:32.478884 ip-10-0-139-113 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 24 17:15:32.478891 ip-10-0-139-113 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 24 17:15:32.479147 ip-10-0-139-113 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 24 17:15:43.680054 ip-10-0-139-113 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 24 17:15:43.680072 ip-10-0-139-113 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 094f1d3d2e3142c7a8a03c34952f8fe4 --
Jul 24 17:17:44.391254 ip-10-0-139-113 systemd[1]: Starting Kubernetes Kubelet...
Jul 24 17:17:44.865916 ip-10-0-139-113 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 17:17:44.865916 ip-10-0-139-113 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 24 17:17:44.865916 ip-10-0-139-113 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 17:17:44.865916 ip-10-0-139-113 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 24 17:17:44.865916 ip-10-0-139-113 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 17:17:44.867152 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.867053    2575 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 24 17:17:44.875064 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875033    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 17:17:44.875064 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875059    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 17:17:44.875064 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875064    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 17:17:44.875064 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875067    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 17:17:44.875064 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875071    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 17:17:44.875064 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875074    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 17:17:44.875322 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875078    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 17:17:44.875322 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875081    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 17:17:44.875322 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875084    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 17:17:44.875322 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875088    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 17:17:44.875322 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875091    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 17:17:44.875322 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875094    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 17:17:44.875322 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875097    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 17:17:44.875322 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875099    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 17:17:44.875322 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875102    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 17:17:44.875322 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875106    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 17:17:44.875322 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875108    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 17:17:44.875322 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875111    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 17:17:44.875322 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875114    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 17:17:44.875322 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875117    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 17:17:44.875322 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875120    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 17:17:44.875322 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875122    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 17:17:44.875322 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875125    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 17:17:44.875322 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875128    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 17:17:44.875322 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875131    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 17:17:44.875322 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875134    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 17:17:44.875876 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875136    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 17:17:44.875876 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875140    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 17:17:44.875876 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875142    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 17:17:44.875876 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875145    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 17:17:44.875876 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875148    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 17:17:44.875876 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875151    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 17:17:44.875876 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875153    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 17:17:44.875876 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875156    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 17:17:44.875876 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875159    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 17:17:44.875876 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875162    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 17:17:44.875876 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875165    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 17:17:44.875876 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875167    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 17:17:44.875876 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875170    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 17:17:44.875876 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875174    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 17:17:44.875876 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875177    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 17:17:44.875876 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875180    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 17:17:44.875876 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875183    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 17:17:44.875876 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875185    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 17:17:44.875876 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875188    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 17:17:44.875876 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875192    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 17:17:44.876427 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875195    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 17:17:44.876427 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875197    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 17:17:44.876427 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875200    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 17:17:44.876427 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875203    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 17:17:44.876427 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875208    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 17:17:44.876427 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875210    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 17:17:44.876427 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875213    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 17:17:44.876427 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875216    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 17:17:44.876427 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875219    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 17:17:44.876427 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875221    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 17:17:44.876427 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875224    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 17:17:44.876427 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875227    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 17:17:44.876427 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875230    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 17:17:44.876427 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875234    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 17:17:44.876427 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875239    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 17:17:44.876427 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875242    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 17:17:44.876427 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875245    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 17:17:44.876427 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875248    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 17:17:44.876427 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875251    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 17:17:44.876935 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875254    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 17:17:44.876935 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875257    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 17:17:44.876935 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875260    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 17:17:44.876935 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875263    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 17:17:44.876935 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875266    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 17:17:44.876935 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875269    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 17:17:44.876935 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875272    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 17:17:44.876935 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875276    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 17:17:44.876935 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875279    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 17:17:44.876935 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875282    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 17:17:44.876935 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875285    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 17:17:44.876935 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875289    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 17:17:44.876935 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875292    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 17:17:44.876935 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875296    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 17:17:44.876935 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875300    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 17:17:44.876935 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875303    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 17:17:44.876935 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875306    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 17:17:44.876935 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875309    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 17:17:44.876935 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875313    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 17:17:44.877484 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875316    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 17:17:44.877484 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875319    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 17:17:44.877484 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875322    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 17:17:44.877484 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875325    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 17:17:44.877484 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875328    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 17:17:44.877484 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875331    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 17:17:44.877484 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875334    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 17:17:44.877484 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875337    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 17:17:44.877484 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875339    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 17:17:44.877484 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875342    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 17:17:44.877484 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875345    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 17:17:44.877484 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875348    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 17:17:44.877484 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875351    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 17:17:44.877484 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875353    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 17:17:44.877484 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.875356    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 17:17:44.877484 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876161    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 17:17:44.877484 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876169    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 17:17:44.877484 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876173    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 17:17:44.877484 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876177    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 17:17:44.877484 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876180    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 17:17:44.877999 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876183    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 17:17:44.877999 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876186    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 17:17:44.877999 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876189    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 17:17:44.877999 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876192    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 17:17:44.877999 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876195    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 17:17:44.877999 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876198    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 17:17:44.877999 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876201    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 17:17:44.877999 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876204    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 17:17:44.877999 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876206    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 17:17:44.877999 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876209    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 17:17:44.877999 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876212    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 17:17:44.877999 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876215    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 17:17:44.877999 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876218    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 17:17:44.877999 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876221    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 17:17:44.877999 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876224    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 17:17:44.877999 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876227    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 17:17:44.877999 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876229    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 17:17:44.877999 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876232    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 17:17:44.877999 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876235    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 17:17:44.877999 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876238    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 17:17:44.878558 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876241    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 17:17:44.878558 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876243    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 17:17:44.878558 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876246    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 17:17:44.878558 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876249    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 17:17:44.878558 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876252    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 17:17:44.878558 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876254    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 17:17:44.878558 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876257    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 17:17:44.878558 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876260    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 17:17:44.878558 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876263    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 17:17:44.878558 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876266    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 17:17:44.878558 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876268    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 17:17:44.878558 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876275    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 17:17:44.878558 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876280    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 17:17:44.878558 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876284    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 17:17:44.878558 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876287    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 17:17:44.878558 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876290    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 17:17:44.878558 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876293    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 17:17:44.878558 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876296    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 17:17:44.878558 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876299    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 17:17:44.879089 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876302    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 17:17:44.879089 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876305    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 17:17:44.879089 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876308    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 17:17:44.879089 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876311    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 17:17:44.879089 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876315    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 17:17:44.879089 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876317    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 17:17:44.879089 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876321    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 17:17:44.879089 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876324    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 17:17:44.879089 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876327    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 17:17:44.879089 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876329    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 17:17:44.879089 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876332    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 17:17:44.879089 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876335    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 17:17:44.879089 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876337    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 17:17:44.879089 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876340    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 17:17:44.879089 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876343    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 17:17:44.879089 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876346    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 17:17:44.879089 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876348    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 17:17:44.879089 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876351    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 17:17:44.879089 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876354    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 17:17:44.879089 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876356    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 17:17:44.879613 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876359    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 17:17:44.879613 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876362    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 17:17:44.879613 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876364    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 17:17:44.879613 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876367    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 17:17:44.879613 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876370    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 17:17:44.879613 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876374    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 17:17:44.879613 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876377    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 17:17:44.879613 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876379    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 17:17:44.879613 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876382    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 17:17:44.879613 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876385    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 17:17:44.879613 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876387    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 17:17:44.879613 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876390    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 17:17:44.879613 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876393    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 17:17:44.879613 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876396    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 17:17:44.879613 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876400    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 17:17:44.879613 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876404    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 17:17:44.879613 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876408    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 17:17:44.879613 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876411    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 17:17:44.879613 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876414    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 17:17:44.880151 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876418    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 17:17:44.880151 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876421    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 17:17:44.880151 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876424    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 17:17:44.880151 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876427    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 17:17:44.880151 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876430    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 17:17:44.880151 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876433    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 17:17:44.880151 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876436    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 17:17:44.880151 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876439    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 17:17:44.880151 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876442    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 17:17:44.880151 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876445    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 17:17:44.880151 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876453    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 17:17:44.880151 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876456    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 17:17:44.880151 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876460    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 17:17:44.880151 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876464    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 17:17:44.880151 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876467    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 17:17:44.880151 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876470    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 17:17:44.880151 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876903    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 17:17:44.880151 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876909    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 17:17:44.880151 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876912    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 17:17:44.880648 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876915    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 17:17:44.880648 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876918    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 17:17:44.880648 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876921    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 17:17:44.880648 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876923    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 17:17:44.880648 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876926    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 17:17:44.880648 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876930    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 17:17:44.880648 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876932    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 17:17:44.880648 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876935    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 17:17:44.880648 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876939    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 17:17:44.880648 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876942    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 17:17:44.880648 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876945    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 17:17:44.880648 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876948    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 17:17:44.880648 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876951    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 17:17:44.880648 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876955    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 17:17:44.880648 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876958    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 17:17:44.880648 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876961    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 17:17:44.880648 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876964    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 17:17:44.880648 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876966    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 17:17:44.880648 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876969    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 17:17:44.880648 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876972    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 17:17:44.881192 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876975    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 17:17:44.881192 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876977    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 17:17:44.881192 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876981    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 17:17:44.881192 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876984    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 17:17:44.881192 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876987    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 17:17:44.881192 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876990    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 17:17:44.881192 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876993    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 17:17:44.881192 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876995    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 17:17:44.881192 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.876999    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 17:17:44.881192 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877001    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 17:17:44.881192 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877004    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 17:17:44.881192 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877007    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 17:17:44.881192 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877024    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 17:17:44.881192 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877027    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 17:17:44.881192 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877030    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 17:17:44.881192 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877033    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 17:17:44.881192 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877035    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 17:17:44.881192 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877038    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 17:17:44.881192 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877041    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 17:17:44.881762 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877044    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 17:17:44.881762 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877047    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 17:17:44.881762 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877050    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 17:17:44.881762 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877053    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 17:17:44.881762 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877056    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 17:17:44.881762 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877059    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 17:17:44.881762 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877062    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 17:17:44.881762 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877065    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 17:17:44.881762 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877068    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 17:17:44.881762 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877071    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 17:17:44.881762 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877074    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 17:17:44.881762 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877076    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 17:17:44.881762 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877079    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 17:17:44.881762 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877082    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 17:17:44.881762 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877084    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 17:17:44.881762 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877088    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 17:17:44.881762 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877090    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 17:17:44.881762 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877094    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 17:17:44.881762 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877096    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 17:17:44.882281 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877101    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 17:17:44.882281 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877105    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 17:17:44.882281 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877108    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 17:17:44.882281 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877112    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 17:17:44.882281 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877115    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 17:17:44.882281 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877121    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 17:17:44.882281 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877124    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 17:17:44.882281 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877127    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 17:17:44.882281 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877130    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 17:17:44.882281 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877133    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 17:17:44.882281 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877135    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 17:17:44.882281 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877138    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 17:17:44.882281 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877141    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 17:17:44.882281 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877143    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 17:17:44.882281 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877146    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 17:17:44.882281 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877149    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 17:17:44.882281 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877152    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 17:17:44.882281 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877155    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 17:17:44.882281 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877157    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 17:17:44.882281 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877161    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 17:17:44.882795 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877164    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 17:17:44.882795 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877168    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 17:17:44.882795 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877171    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 17:17:44.882795 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877174    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 17:17:44.882795 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877177    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 17:17:44.882795 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877181    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 17:17:44.882795 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877184    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 17:17:44.882795 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877187    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 17:17:44.882795 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877190    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 17:17:44.882795 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877193    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 17:17:44.882795 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877196    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 17:17:44.882795 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877200    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 17:17:44.882795 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877204    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 17:17:44.882795 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877207    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 17:17:44.882795 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877210    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 17:17:44.882795 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877213    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 17:17:44.882795 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877216    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 17:17:44.882795 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877221    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 17:17:44.882795 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877303    2575 flags.go:64] FLAG: --address="0.0.0.0"
Jul 24 17:17:44.882795 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877311    2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 24 17:17:44.883375 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877319    2575 flags.go:64] FLAG: --anonymous-auth="true"
Jul 24 17:17:44.883375 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877326    2575 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 24 17:17:44.883375 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877332    2575 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 24 17:17:44.883375 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877338    2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 24 17:17:44.883375 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877345    2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 24 17:17:44.883375 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877351    2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 24 17:17:44.883375 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877355    2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 24 17:17:44.883375 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877358    2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 24 17:17:44.883375 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877362    2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 24 17:17:44.883375 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877365    2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 24 17:17:44.883375 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877369    2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 24 17:17:44.883375 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877372    2575 flags.go:64] FLAG: --cgroup-root=""
Jul 24 17:17:44.883375 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877375    2575 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 24 17:17:44.883375 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877378    2575 flags.go:64] FLAG: --client-ca-file=""
Jul 24 17:17:44.883375 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877383    2575 flags.go:64] FLAG: --cloud-provider="external"
Jul 24 17:17:44.883375 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877386    2575 flags.go:64] FLAG: --cluster-dns="[]"
Jul 24 17:17:44.883375 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877391    2575 flags.go:64] FLAG: --cluster-domain=""
Jul 24 17:17:44.883375 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877394    2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 24 17:17:44.883375 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877397    2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 24 17:17:44.883375 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877400    2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 24 17:17:44.883375 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877404    2575 flags.go:64] FLAG: --container-log-max-files="5"
Jul 24 17:17:44.883375 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877409    2575 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 24 17:17:44.883375 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877412    2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 24 17:17:44.883978 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877415    2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 24 17:17:44.883978 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877419    2575 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 24 17:17:44.883978 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877422    2575 flags.go:64] FLAG: --contention-profiling="false"
Jul 24 17:17:44.883978 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877425    2575 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 24 17:17:44.883978 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877429    2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 24 17:17:44.883978 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877432    2575 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 24 17:17:44.883978 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877437    2575 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 24 17:17:44.883978 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877442    2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 24 17:17:44.883978 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877445    2575 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 24 17:17:44.883978 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877448    2575 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 24 17:17:44.883978 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877451    2575 flags.go:64] FLAG: --enable-load-reader="false"
Jul 24 17:17:44.883978 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877455    2575 flags.go:64] FLAG: --enable-server="true"
Jul 24 17:17:44.883978 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877458    2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 24 17:17:44.883978 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877464    2575 flags.go:64] FLAG: --event-burst="100"
Jul 24 17:17:44.883978 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877467    2575 flags.go:64] FLAG: --event-qps="50"
Jul 24 17:17:44.883978 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877470    2575 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 24 17:17:44.883978 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877473    2575 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 24 17:17:44.883978 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877476    2575 flags.go:64] FLAG: --eviction-hard=""
Jul 24 17:17:44.883978 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877480    2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 24 17:17:44.883978 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877484    2575 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 24 17:17:44.883978 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877487    2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 24 17:17:44.883978 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877491    2575 flags.go:64] FLAG: --eviction-soft=""
Jul 24 17:17:44.883978 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877494    2575 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 24 17:17:44.883978 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877497    2575 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 24 17:17:44.883978 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877501    2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 24 17:17:44.884670 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877505    2575 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 24 17:17:44.884670 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877508    2575 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 24 17:17:44.884670 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877511    2575 flags.go:64] FLAG: --fail-swap-on="true"
Jul 24 17:17:44.884670 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877514    2575 flags.go:64] FLAG: --feature-gates=""
Jul 24 17:17:44.884670 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877518    2575 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 24 17:17:44.884670 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877522    2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 24 17:17:44.884670 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877525    2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 24 17:17:44.884670 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877528    2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 24 17:17:44.884670 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877531    2575 flags.go:64] FLAG: --healthz-port="10248"
Jul 24 17:17:44.884670 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877535    2575 flags.go:64] FLAG: --help="false"
Jul 24 17:17:44.884670 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877537    2575 flags.go:64] FLAG: --hostname-override="ip-10-0-139-113.ec2.internal"
Jul 24 17:17:44.884670 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877541    2575 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 24 17:17:44.884670 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877544    2575 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 24 17:17:44.884670 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877548    2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 24 17:17:44.884670 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877551    2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 24 17:17:44.884670 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877555    2575 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 24 17:17:44.884670 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877558    2575 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 24 17:17:44.884670 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877561    2575 flags.go:64] FLAG: --image-service-endpoint=""
Jul 24 17:17:44.884670 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877564    2575 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 24 17:17:44.884670 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877567    2575 flags.go:64] FLAG: --kube-api-burst="100"
Jul 24 17:17:44.884670 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877570    2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 24 17:17:44.884670 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877574    2575 flags.go:64] FLAG: --kube-api-qps="50"
Jul 24 17:17:44.884670 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877576    2575 flags.go:64] FLAG: --kube-reserved=""
Jul 24 17:17:44.884670 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877579    2575 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 24 17:17:44.885349 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877582    2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 24 17:17:44.885349 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877586    2575 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 24 17:17:44.885349 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877589    2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 24 17:17:44.885349 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877591    2575 flags.go:64] FLAG: --lock-file=""
Jul 24 17:17:44.885349 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877594    2575 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 24 17:17:44.885349 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877598    2575 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 24 17:17:44.885349 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877601    2575 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 24 17:17:44.885349 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877606    2575 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 24 17:17:44.885349 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877610    2575 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 24 17:17:44.885349 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877613    2575 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 24 17:17:44.885349 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877616    2575 flags.go:64] FLAG: --logging-format="text"
Jul 24 17:17:44.885349 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877619    2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 24 17:17:44.885349 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877625    2575 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 24 17:17:44.885349 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877628    2575 flags.go:64] FLAG: --manifest-url=""
Jul 24 17:17:44.885349 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877631    2575 flags.go:64] FLAG: --manifest-url-header=""
Jul 24 17:17:44.885349 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877635    2575 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 24 17:17:44.885349 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877639    2575 flags.go:64] FLAG: --max-open-files="1000000"
Jul 24 17:17:44.885349 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877643    2575 flags.go:64] FLAG: --max-pods="110"
Jul 24 17:17:44.885349 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877646    2575 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 24 17:17:44.885349 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877649    2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 24 17:17:44.885349 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877653    2575 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 24 17:17:44.885349 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877656    2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 24 17:17:44.885349 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877660    2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 24 17:17:44.885349 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877663    2575 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 24 17:17:44.885349 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877667    2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 24 17:17:44.886032 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877675    2575 flags.go:64] FLAG: --node-status-max-images="50"
Jul 24 17:17:44.886032 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877678    2575 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 24 17:17:44.886032 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877682    2575 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 24 17:17:44.886032 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877685    2575 flags.go:64] FLAG: --pod-cidr=""
Jul 24 17:17:44.886032 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877688    2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 24 17:17:44.886032 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877695    2575 flags.go:64] FLAG: --pod-manifest-path=""
Jul 24 17:17:44.886032 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877698    2575 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 24 17:17:44.886032 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877701    2575 flags.go:64] FLAG: --pods-per-core="0"
Jul 24 17:17:44.886032 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877704    2575 flags.go:64] FLAG: --port="10250"
Jul 24 17:17:44.886032 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877708    2575 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 24 17:17:44.886032 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877711    2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03a212c258d74405a"
Jul 24 17:17:44.886032 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877714    2575 flags.go:64] FLAG: --qos-reserved=""
Jul 24 17:17:44.886032 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877718    2575 flags.go:64] FLAG: --read-only-port="10255"
Jul 24 17:17:44.886032 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877721    2575 flags.go:64] FLAG: --register-node="true"
Jul 24 17:17:44.886032 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877724    2575 flags.go:64] FLAG: --register-with-taints=""
Jul 24 17:17:44.886032 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877728    2575 flags.go:64] FLAG: --registry-burst="10"
Jul 24 17:17:44.886032 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877732    2575 flags.go:64] FLAG: --registry-qps="5"
Jul 24 17:17:44.886032 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877735    2575 flags.go:64] FLAG: --reserved-cpus=""
Jul 24 17:17:44.886032 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877739    2575 flags.go:64] FLAG: --reserved-memory=""
Jul 24 17:17:44.886032 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877742    2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 24 17:17:44.886032 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877747    2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 24 17:17:44.886032 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877750    2575 flags.go:64] FLAG: --rotate-certificates="false"
Jul 24 17:17:44.886032 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877753    2575 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 24 17:17:44.886032 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877757    2575 flags.go:64] FLAG: --runonce="false"
Jul 24 17:17:44.886032 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877760    2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 24 17:17:44.886733 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877763    2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 24 17:17:44.886733 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877766    2575 flags.go:64] FLAG: --seccomp-default="false"
Jul 24 17:17:44.886733 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877769    2575 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 24 17:17:44.886733 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877772    2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 24 17:17:44.886733 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877776    2575 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 24 17:17:44.886733 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877779    2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 24 17:17:44.886733 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877782    2575 flags.go:64] FLAG: --storage-driver-password="root"
Jul 24 17:17:44.886733 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877785    2575 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 24 17:17:44.886733 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877789    2575 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 24 17:17:44.886733 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877792    2575 flags.go:64] FLAG: --storage-driver-user="root"
Jul 24 17:17:44.886733 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877795    2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 24 17:17:44.886733 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877798    2575 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 24 17:17:44.886733 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877801    2575 flags.go:64] FLAG: --system-cgroups=""
Jul 24 17:17:44.886733 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877804    2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 24 17:17:44.886733 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877810    2575 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 24 17:17:44.886733 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877813    2575 flags.go:64] FLAG: --tls-cert-file=""
Jul 24 17:17:44.886733 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877816    2575 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 24 17:17:44.886733 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877820    2575 flags.go:64] FLAG: --tls-min-version=""
Jul 24 17:17:44.886733 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877823    2575 flags.go:64] FLAG: --tls-private-key-file=""
Jul 24 17:17:44.886733 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877826    2575 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 24 17:17:44.886733 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877829    2575 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 24 17:17:44.886733 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877832    2575 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 24 17:17:44.886733 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877836    2575 flags.go:64] FLAG: --v="2"
Jul 24 17:17:44.886733 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877840    2575 flags.go:64] FLAG: --version="false"
Jul 24 17:17:44.886733 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877852    2575 flags.go:64] FLAG: --vmodule=""
Jul 24 17:17:44.887411 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877856    2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 24 17:17:44.887411 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.877860    2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 24 17:17:44.887411 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877987    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 17:17:44.887411 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877991    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 17:17:44.887411 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877994    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 17:17:44.887411 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.877998    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 17:17:44.887411 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878001    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 17:17:44.887411 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878004    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 17:17:44.887411 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878008    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 17:17:44.887411 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878028    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 17:17:44.887411 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878031    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 17:17:44.887411 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878034    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 17:17:44.887411 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878038    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 17:17:44.887411 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878041    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 17:17:44.887411 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878044    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 17:17:44.887411 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878047    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 17:17:44.887411 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878050    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 17:17:44.887411 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878053    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 17:17:44.887411 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878057    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 17:17:44.887411 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878060    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 17:17:44.888097 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878062    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 17:17:44.888097 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878065    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 17:17:44.888097 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878068    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 17:17:44.888097 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878071    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 17:17:44.888097 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878074    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 17:17:44.888097 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878077    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 17:17:44.888097 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878080    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 17:17:44.888097 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878084    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 17:17:44.888097 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878087    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 17:17:44.888097 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878091    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 17:17:44.888097 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878094    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 17:17:44.888097 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878097    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 17:17:44.888097 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878101    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 17:17:44.888097 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878104    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 17:17:44.888097 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878108    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 17:17:44.888097 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878111    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 17:17:44.888097 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878114    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 17:17:44.888097 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878117    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 17:17:44.888097 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878120    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 17:17:44.888097 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878122    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 17:17:44.888638 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878125    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 17:17:44.888638 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878128    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 17:17:44.888638 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878132    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 17:17:44.888638 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878135    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 17:17:44.888638 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878138    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 17:17:44.888638 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878141    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 17:17:44.888638 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878144    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 17:17:44.888638 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878146    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 17:17:44.888638 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878149    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 17:17:44.888638 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878152    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 17:17:44.888638 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878155    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 17:17:44.888638 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878158    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 17:17:44.888638 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878162    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 17:17:44.888638 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878165    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 17:17:44.888638 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878169    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 17:17:44.888638 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878172    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 17:17:44.888638 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878175    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 17:17:44.888638 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878178    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 17:17:44.888638 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878181    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 17:17:44.889153 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878184    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 17:17:44.889153 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878187    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 17:17:44.889153 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878191    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 17:17:44.889153 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878194    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 17:17:44.889153 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878197    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 17:17:44.889153 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878200    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 17:17:44.889153 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878204    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 17:17:44.889153 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878208    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 17:17:44.889153 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878211    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 17:17:44.889153 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878214    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 17:17:44.889153 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878217    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 17:17:44.889153 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878220    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 17:17:44.889153 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878223    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 17:17:44.889153 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878226    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 17:17:44.889153 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878228    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 17:17:44.889153 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878232    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 17:17:44.889153 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878235    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 17:17:44.889153 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878238    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 17:17:44.889153 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878241    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 17:17:44.889674 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878244    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 17:17:44.889674 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878246    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 17:17:44.889674 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878250    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 17:17:44.889674 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878254    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 17:17:44.889674 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878257    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 17:17:44.889674 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878260    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 17:17:44.889674 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878263    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 17:17:44.889674 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878266    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 17:17:44.889674 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878269    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 17:17:44.889674 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878272    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 17:17:44.889674 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878274    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 17:17:44.889674 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878278    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 17:17:44.889674 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878281    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 17:17:44.889674 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878283    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 17:17:44.889674 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878286    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 17:17:44.889674 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878289    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 17:17:44.889674 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878292    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 17:17:44.889674 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878295    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 17:17:44.889674 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878297    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 17:17:44.890188 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878300    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 17:17:44.890188 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878305    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 17:17:44.890188 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878308    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 17:17:44.890188 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.878311    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 17:17:44.890188 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.878993    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 17:17:44.890188 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.886970    2575 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 24 17:17:44.890188 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.886991    2575 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 24 17:17:44.890188 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.887026    2575 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 24 17:17:44.890188 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.887032    2575 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 24 17:17:44.890188 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887123    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 17:17:44.890188 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887129    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 17:17:44.890188 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887132    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 17:17:44.890188 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887136    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 17:17:44.890188 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887139    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 17:17:44.890188 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887143    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 17:17:44.890603 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887146    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 17:17:44.890603 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887149    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 17:17:44.890603 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887152    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 17:17:44.890603 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887154    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 17:17:44.890603 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887158    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 17:17:44.890603 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887160    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 17:17:44.890603 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887163    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 17:17:44.890603 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887166    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 17:17:44.890603 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887169    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 17:17:44.890603 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887172    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 17:17:44.890603 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887175    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 17:17:44.890603 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887178    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 17:17:44.890603 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887181    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 17:17:44.890603 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887184    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 17:17:44.890603 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887186    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 17:17:44.890603 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887189    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 17:17:44.890603 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887192    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 17:17:44.890603 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887194    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 17:17:44.890603 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887198    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 17:17:44.890603 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887201    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 17:17:44.891153 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887204    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 17:17:44.891153 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887207    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 17:17:44.891153 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887212    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 17:17:44.891153 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887216    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 17:17:44.891153 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887220    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 17:17:44.891153 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887223    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 17:17:44.891153 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887227    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 17:17:44.891153 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887230    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 17:17:44.891153 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887232    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 17:17:44.891153 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887235    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 17:17:44.891153 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887238    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 17:17:44.891153 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887241    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 17:17:44.891153 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887244    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 17:17:44.891153 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887247    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 17:17:44.891153 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887250    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 17:17:44.891153 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887253    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 17:17:44.891153 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887255    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 17:17:44.891153 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887258    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 17:17:44.891153 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887261    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 17:17:44.891656 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887264    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 17:17:44.891656 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887267    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 17:17:44.891656 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887271    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 17:17:44.891656 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887274    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 17:17:44.891656 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887277    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 17:17:44.891656 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887280    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 17:17:44.891656 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887283    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 17:17:44.891656 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887286    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 17:17:44.891656 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887289    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 17:17:44.891656 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887292    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 17:17:44.891656 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887295    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 17:17:44.891656 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887298    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 17:17:44.891656 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887307    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 17:17:44.891656 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887310    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 17:17:44.891656 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887314    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 17:17:44.891656 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887317    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 17:17:44.891656 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887321    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 17:17:44.891656 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887324    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 17:17:44.891656 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887326    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 17:17:44.891656 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887329    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 17:17:44.892299 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887332    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 17:17:44.892299 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887335    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 17:17:44.892299 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887338    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 17:17:44.892299 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887341    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 17:17:44.892299 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887344    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 17:17:44.892299 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887355    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 17:17:44.892299 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887358    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 17:17:44.892299 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887360    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 17:17:44.892299 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887363    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 17:17:44.892299 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887366    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 17:17:44.892299 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887369    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 17:17:44.892299 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887372    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 17:17:44.892299 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887374    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 17:17:44.892299 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887377    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 17:17:44.892299 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887380    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 17:17:44.892299 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887383    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 17:17:44.892299 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887385    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 17:17:44.892299 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887389    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 17:17:44.892299 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887391    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 17:17:44.892299 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887394    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 17:17:44.892837 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887397    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 17:17:44.892837 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887400    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 17:17:44.892837 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887403    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 17:17:44.892837 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887406    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 17:17:44.892837 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887408    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 17:17:44.892837 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887417    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 17:17:44.892837 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887421    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 17:17:44.892837 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887424    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 17:17:44.892837 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887431    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 17:17:44.892837 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887435    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 17:17:44.892837 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887438    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 17:17:44.892837 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887442    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 17:17:44.892837 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887446    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 17:17:44.892837 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887449    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 17:17:44.893235 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.887454    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 17:17:44.893235 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887633    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 17:17:44.893235 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887639    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 17:17:44.893235 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887642    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 17:17:44.893235 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887645    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 17:17:44.893235 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887648    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 17:17:44.893235 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887651    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 17:17:44.893235 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887654    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 17:17:44.893235 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887657    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 17:17:44.893235 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887660    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 17:17:44.893235 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887663    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 17:17:44.893235 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887665    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 17:17:44.893235 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887668    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 17:17:44.893235 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887671    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 17:17:44.893235 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887674    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 17:17:44.893632 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887676    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 17:17:44.893632 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887679    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 17:17:44.893632 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887682    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 17:17:44.893632 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887685    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 17:17:44.893632 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887688    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 17:17:44.893632 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887691    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 17:17:44.893632 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887693    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 17:17:44.893632 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887696    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 17:17:44.893632 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887699    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 17:17:44.893632 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887708    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 17:17:44.893632 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887711    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 17:17:44.893632 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887714    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 17:17:44.893632 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887718    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 17:17:44.893632 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887720    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 17:17:44.893632 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887723    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 17:17:44.893632 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887726    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 17:17:44.893632 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887729    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 17:17:44.893632 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887732    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 17:17:44.893632 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887735    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 17:17:44.894158 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887737    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 17:17:44.894158 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887740    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 17:17:44.894158 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887744    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 17:17:44.894158 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887747    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 17:17:44.894158 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887749    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 17:17:44.894158 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887752    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 17:17:44.894158 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887754    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 17:17:44.894158 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887757    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 17:17:44.894158 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887760    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 17:17:44.894158 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887763    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 17:17:44.894158 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887765    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 17:17:44.894158 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887768    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 17:17:44.894158 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887772    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 17:17:44.894158 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887776    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 17:17:44.894158 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887779    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 17:17:44.894158 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887782    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 17:17:44.894158 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887785    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 17:17:44.894158 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887789    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 17:17:44.894158 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887792    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 17:17:44.894667 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887795    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 17:17:44.894667 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887797    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 17:17:44.894667 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887800    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 17:17:44.894667 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887803    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 17:17:44.894667 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887812    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 17:17:44.894667 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887815    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 17:17:44.894667 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887818    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 17:17:44.894667 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887822    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 17:17:44.894667 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887825    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 17:17:44.894667 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887828    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 17:17:44.894667 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887831    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 17:17:44.894667 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887834    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 17:17:44.894667 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887837    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 17:17:44.894667 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887840    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 17:17:44.894667 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887843    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 17:17:44.894667 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887846    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 17:17:44.894667 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887849    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 17:17:44.894667 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887852    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 17:17:44.894667 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887854    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 17:17:44.894667 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887857    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 17:17:44.895228 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887860    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 17:17:44.895228 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887863    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 17:17:44.895228 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887866    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 17:17:44.895228 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887868    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 17:17:44.895228 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887871    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 17:17:44.895228 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887874    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 17:17:44.895228 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887876    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 17:17:44.895228 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887879    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 17:17:44.895228 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887882    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 17:17:44.895228 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887885    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 17:17:44.895228 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887888    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 17:17:44.895228 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887890    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 17:17:44.895228 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887893    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 17:17:44.895228 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887896    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 17:17:44.895228 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887899    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 17:17:44.895228 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887901    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 17:17:44.895228 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887904    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 17:17:44.895228 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887914    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 17:17:44.895228 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887918    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 17:17:44.895228 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887921    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 17:17:44.895756 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887924    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 17:17:44.895756 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887926    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 17:17:44.895756 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887929    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 17:17:44.895756 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887932    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 17:17:44.895756 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887934    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 17:17:44.895756 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887937    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 17:17:44.895756 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:44.887940    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 17:17:44.895756 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.887945    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 17:17:44.895756 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.888125    2575 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 24 17:17:44.895756 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.890541    2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 24 17:17:44.895756 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.892093    2575 server.go:1019] "Starting client certificate rotation"
Jul 24 17:17:44.895756 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.892209    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 24 17:17:44.895756 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.892254    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 24 17:17:44.896232 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.895276    2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 24 17:17:44.896932 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.896900    2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 24 17:17:44.911749 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.911716    2575 log.go:25] "Validated CRI v1 runtime API"
Jul 24 17:17:44.914301 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.914272    2575 log.go:25] "Validated CRI v1 image API"
Jul 24 17:17:44.916273 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.916245    2575 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 24 17:17:44.919342 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.919319    2575 fs.go:135] Filesystem UUIDs: map[1b54613e-e1f0-43e5-849d-3b6797cec766:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 8031e1d1-64ce-445b-98e8-3f0ca849949f:/dev/nvme0n1p3]
Jul 24 17:17:44.919417 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.919342    2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 24 17:17:44.927686 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.927541    2575 manager.go:216] Machine: {Timestamp:2026-07-24 17:17:44.926037536 +0000 UTC m=+0.407413150 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099068 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec255459cc95bab70aba9d9b732629cd SystemUUID:ec255459-cc95-bab7-0aba-9d9b732629cd BootID:094f1d3d-2e31-42c7-a8a0-3c34952f8fe4 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ed:4b:5f:1b:91 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ed:4b:5f:1b:91 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1e:59:d3:ac:2e:32 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 24 17:17:44.927686 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.927679    2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 24 17:17:44.927813 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.927777    2575 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 24 17:17:44.928944 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.928903    2575 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 24 17:17:44.929168 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.928953    2575 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-113.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 24 17:17:44.930035 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.930005    2575 topology_manager.go:138] "Creating topology manager with none policy"
Jul 24 17:17:44.930072 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.930040    2575 container_manager_linux.go:309] "Creating device plugin manager"
Jul 24 17:17:44.930072 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.930048    2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 24 17:17:44.930858 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.930847    2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 24 17:17:44.931787 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.931776    2575 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 24 17:17:44.933876 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.933863    2575 state_mem.go:36] "Initialized new in-memory state store"
Jul 24 17:17:44.934087 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.934076    2575 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 24 17:17:44.935074 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.935060    2575 kubelet.go:486] "Attempting to sync node with API server"
Jul 24 17:17:44.935111 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.935082    2575 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 24 17:17:44.935111 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.935101    2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 24 17:17:44.935187 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.935116    2575 kubelet.go:398] "Adding apiserver pod source"
Jul 24 17:17:44.935187 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.935128    2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 24 17:17:44.935793 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.935777    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 24 17:17:44.935857 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.935816    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 24 17:17:44.938033 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.937987    2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 24 17:17:44.939914 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.939886    2575 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 24 17:17:44.943732 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.943706    2575 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 24 17:17:44.943846 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.943759    2575 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 24 17:17:44.945697 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.945676    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 24 17:17:44.945697 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.945698    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 24 17:17:44.945830 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.945704    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 24 17:17:44.945830 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.945711    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 24 17:17:44.945830 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.945719    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 24 17:17:44.945830 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.945725    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 24 17:17:44.945830 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.945734    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 24 17:17:44.945830 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.945739    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 24 17:17:44.945830 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.945747    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 24 17:17:44.945830 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.945753    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 24 17:17:44.945830 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.945771    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 24 17:17:44.945830 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.945777    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 24 17:17:44.946633 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:44.946607    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-113.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 24 17:17:44.946717 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.946705    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 24 17:17:44.946750 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.946719    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 24 17:17:44.946750 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:44.946723    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 24 17:17:44.949670 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.949651    2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-113.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 17:17:44.950358 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.950345    2575 server.go:1268] "Started kubelet"
Jul 24 17:17:44.950493 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.950418    2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 24 17:17:44.950604 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.950447    2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 24 17:17:44.950661 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.950621    2575 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 24 17:17:44.951332 ip-10-0-139-113 systemd[1]: Started Kubernetes Kubelet.
Jul 24 17:17:44.952241 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.952226    2575 server.go:310] "Adding debug handlers to kubelet server"
Jul 24 17:17:44.952522 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.952506    2575 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 24 17:17:44.957428 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:44.957394    2575 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 24 17:17:44.958877 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:44.957765    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-113.ec2.internal.18c54956e92cde99  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-113.ec2.internal,UID:ip-10-0-139-113.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-113.ec2.internal,},FirstTimestamp:2026-07-24 17:17:44.950316697 +0000 UTC m=+0.431692310,LastTimestamp:2026-07-24 17:17:44.950316697 +0000 UTC m=+0.431692310,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-113.ec2.internal,}"
Jul 24 17:17:44.960502 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.960487    2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 24 17:17:44.960554 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.960500    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 24 17:17:44.960664 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:44.960636    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-113.ec2.internal\" not found"
Jul 24 17:17:44.961227 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.961206    2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 24 17:17:44.961394 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.961371    2575 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 24 17:17:44.961394 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.961390    2575 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 24 17:17:44.963474 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.962661    2575 reconstruct.go:97] "Volume reconstruction finished"
Jul 24 17:17:44.963474 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.962673    2575 reconciler.go:29] "Reconciler: start to sync state"
Jul 24 17:17:44.963721 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.963647    2575 factory.go:55] Registering systemd factory
Jul 24 17:17:44.963721 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.963663    2575 factory.go:223] Registration of the systemd container factory successfully
Jul 24 17:17:44.964040 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.964005    2575 factory.go:153] Registering CRI-O factory
Jul 24 17:17:44.964040 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.964043    2575 factory.go:223] Registration of the crio container factory successfully
Jul 24 17:17:44.964184 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.964098    2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 24 17:17:44.964184 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.964123    2575 factory.go:103] Registering Raw factory
Jul 24 17:17:44.964184 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.964138    2575 manager.go:1196] Started watching for new ooms in manager
Jul 24 17:17:44.964460 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.964436    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2bv7x"
Jul 24 17:17:44.965226 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.965213    2575 manager.go:349] Starting recovery of all containers
Jul 24 17:17:44.965771 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:44.965747    2575 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-113.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 24 17:17:44.965913 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:44.965892    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 24 17:17:44.970117 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.970061    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 24 17:17:44.973409 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.973383    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2bv7x"
Jul 24 17:17:44.975379 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.974743    2575 manager.go:354] Recovery completed
Jul 24 17:17:44.979052 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:44.978815    2575 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 24 17:17:44.983123 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.983106    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 17:17:44.985600 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.985580    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-113.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 17:17:44.985670 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.985621    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-113.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 17:17:44.985670 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.985636    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-113.ec2.internal" event="NodeHasSufficientPID"
Jul 24 17:17:44.986245 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.986231    2575 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 24 17:17:44.986245 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.986244    2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 24 17:17:44.986352 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.986255    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 17:17:44.986352 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.986264    2575 state_mem.go:36] "Initialized new in-memory state store"
Jul 24 17:17:44.987048 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.986980    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-113.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 17:17:44.987133 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.987067    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-113.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 17:17:44.987133 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.987084    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-113.ec2.internal" event="NodeHasSufficientPID"
Jul 24 17:17:44.988452 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.988430    2575 policy_none.go:49] "None policy: Start"
Jul 24 17:17:44.988507 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.988457    2575 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 24 17:17:44.988507 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.988468    2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 24 17:17:44.988574 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:44.988465    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-113.ec2.internal.18c54956eb4745e9  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-113.ec2.internal,UID:ip-10-0-139-113.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-113.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-113.ec2.internal,},FirstTimestamp:2026-07-24 17:17:44.985601513 +0000 UTC m=+0.466977131,LastTimestamp:2026-07-24 17:17:44.985601513 +0000 UTC m=+0.466977131,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-113.ec2.internal,}"
Jul 24 17:17:44.990606 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:44.990586    2575 policy_none.go:47] "Start"
Jul 24 17:17:45.035183 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:45.035168    2575 manager.go:337] "Starting Device Plugin manager"
Jul 24 17:17:45.035271 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:45.035216    2575 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 24 17:17:45.035271 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:45.035231    2575 server.go:87] "Starting device plugin registration server"
Jul 24 17:17:45.035605 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:45.035587    2575 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 24 17:17:45.035643 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:45.035609    2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 24 17:17:45.035741 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:45.035715    2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 24 17:17:45.035849 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:45.035818    2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 24 17:17:45.035849 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:45.035826    2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 24 17:17:45.036477 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:45.036458    2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 24 17:17:45.036571 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:45.036506    2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-113.ec2.internal\" not found"
Jul 24 17:17:45.140582 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:45.140481    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 17:17:45.142053 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:45.141596    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-113.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 17:17:45.142053 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:45.141630    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-113.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 17:17:45.142053 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:45.141641    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-113.ec2.internal" event="NodeHasSufficientPID"
Jul 24 17:17:45.142053 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:45.141672    2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-113.ec2.internal"
Jul 24 17:17:45.157588 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:45.157562    2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-113.ec2.internal"
Jul 24 17:17:45.157588 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:45.157593    2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-113.ec2.internal\": node \"ip-10-0-139-113.ec2.internal\" not found"
Jul 24 17:17:45.182245 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:45.182214    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-113.ec2.internal\" not found"
Jul 24 17:17:45.195587 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:45.195560    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 24 17:17:45.195728 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:45.195601    2575 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 24 17:17:45.195728 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:45.195624    2575 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 24 17:17:45.195728 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:45.195663    2575 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 24 17:17:45.199831 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:45.199800    2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 17:17:45.283059 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:45.283025    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-113.ec2.internal\" not found"
Jul 24 17:17:45.296159 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:45.296121    2575 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-113.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-113.ec2.internal"]
Jul 24 17:17:45.296236 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:45.296216    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 17:17:45.297319 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:45.297298    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-113.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 17:17:45.297415 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:45.297334    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-113.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 17:17:45.297415 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:45.297349    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-113.ec2.internal" event="NodeHasSufficientPID"
Jul 24 17:17:45.298887 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:45.298872    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 17:17:45.299031 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:45.299012    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-113.ec2.internal"
Jul 24 17:17:45.299089 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:45.299060    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 17:17:45.299703 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:45.299680    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-113.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 17:17:45.299824 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:45.299713    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-113.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 17:17:45.299824 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:45.299729    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-113.ec2.internal" event="NodeHasSufficientPID"
Jul 24 17:17:45.299824 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:45.299687    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-113.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 17:17:45.299824 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:45.299782    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-113.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 17:17:45.299824 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:45.299793    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-113.ec2.internal" event="NodeHasSufficientPID"
Jul 24 17:17:45.301245 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:45.301228    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-113.ec2.internal"
Jul 24 17:17:45.301355 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:45.301260    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 17:17:45.301993 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:45.301977    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-113.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 17:17:45.302075 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:45.302006    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-113.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 17:17:45.302075 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:45.302034    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-113.ec2.internal" event="NodeHasSufficientPID"
Jul 24 17:17:45.322837 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:45.322812    2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-113.ec2.internal\" not found" node="ip-10-0-139-113.ec2.internal"
Jul 24 17:17:45.327572 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:45.327552    2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-113.ec2.internal\" not found" node="ip-10-0-139-113.ec2.internal"
Jul 24 17:17:45.364732 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:45.364687    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c18ae991b4af4fc40a66ddcd10c5c2c4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-113.ec2.internal\" (UID: \"c18ae991b4af4fc40a66ddcd10c5c2c4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-113.ec2.internal"
Jul 24 17:17:45.364732 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:45.364728    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c18ae991b4af4fc40a66ddcd10c5c2c4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-113.ec2.internal\" (UID: \"c18ae991b4af4fc40a66ddcd10c5c2c4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-113.ec2.internal"
Jul 24 17:17:45.364982 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:45.364754    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4461adb059f453352015b47510cb7325-config\") pod \"kube-apiserver-proxy-ip-10-0-139-113.ec2.internal\" (UID: \"4461adb059f453352015b47510cb7325\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-113.ec2.internal"
Jul 24 17:17:45.383707 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:45.383674    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-113.ec2.internal\" not found"
Jul 24 17:17:45.465779 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:45.465704    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c18ae991b4af4fc40a66ddcd10c5c2c4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-113.ec2.internal\" (UID: \"c18ae991b4af4fc40a66ddcd10c5c2c4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-113.ec2.internal"
Jul 24 17:17:45.465779 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:45.465751    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c18ae991b4af4fc40a66ddcd10c5c2c4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-113.ec2.internal\" (UID: \"c18ae991b4af4fc40a66ddcd10c5c2c4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-113.ec2.internal"
Jul 24 17:17:45.465779 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:45.465778    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4461adb059f453352015b47510cb7325-config\") pod \"kube-apiserver-proxy-ip-10-0-139-113.ec2.internal\" (UID: \"4461adb059f453352015b47510cb7325\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-113.ec2.internal"
Jul 24 17:17:45.466040 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:45.465709    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c18ae991b4af4fc40a66ddcd10c5c2c4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-113.ec2.internal\" (UID: \"c18ae991b4af4fc40a66ddcd10c5c2c4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-113.ec2.internal"
Jul 24 17:17:45.466040 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:45.465826    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4461adb059f453352015b47510cb7325-config\") pod \"kube-apiserver-proxy-ip-10-0-139-113.ec2.internal\" (UID: \"4461adb059f453352015b47510cb7325\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-113.ec2.internal"
Jul 24 17:17:45.466040 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:45.465854    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c18ae991b4af4fc40a66ddcd10c5c2c4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-113.ec2.internal\" (UID: \"c18ae991b4af4fc40a66ddcd10c5c2c4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-113.ec2.internal"
Jul 24 17:17:45.485284 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:45.485252    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-113.ec2.internal\" not found"
Jul 24 17:17:45.586107 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:45.586059    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-113.ec2.internal\" not found"
Jul 24 17:17:45.628483 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:45.628448    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-113.ec2.internal"
Jul 24 17:17:45.631211 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:45.631185    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-113.ec2.internal"
Jul 24 17:17:45.686578 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:45.686535    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-113.ec2.internal\" not found"
Jul 24 17:17:45.787653 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:45.787560    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-113.ec2.internal\" not found"
Jul 24 17:17:45.836355 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:45.836329    2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 17:17:45.888413 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:45.888372    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-113.ec2.internal\" not found"
Jul 24 17:17:45.891771 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:45.891745    2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 24 17:17:45.891951 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:45.891932    2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 24 17:17:45.891991 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:45.891967    2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 24 17:17:45.980574 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:45.980532    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-23 17:12:45 +0000 UTC" deadline="2028-03-31 19:46:52.136932038 +0000 UTC"
Jul 24 17:17:45.980574 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:45.980567    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14786h29m6.156368865s"
Jul 24 17:17:45.988685 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:45.988660    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-113.ec2.internal\" not found"
Jul 24 17:17:46.089237 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:46.089149    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-113.ec2.internal\" not found"
Jul 24 17:17:46.141693 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.141667    2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 17:17:46.161828 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.161794    2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-113.ec2.internal"
Jul 24 17:17:46.173047 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.173008    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 24 17:17:46.175552 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.175525    2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-113.ec2.internal"
Jul 24 17:17:46.184697 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.184669    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 24 17:17:46.234736 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.234712    2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 17:17:46.245071 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:46.245035    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc18ae991b4af4fc40a66ddcd10c5c2c4.slice/crio-4ad75a5bc7080170a8715eae0b93cdf0ac041ff99907e81fc326a95f18e1b529 WatchSource:0}: Error finding container 4ad75a5bc7080170a8715eae0b93cdf0ac041ff99907e81fc326a95f18e1b529: Status 404 returned error can't find the container with id 4ad75a5bc7080170a8715eae0b93cdf0ac041ff99907e81fc326a95f18e1b529
Jul 24 17:17:46.245497 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:46.245475    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4461adb059f453352015b47510cb7325.slice/crio-87f1e1077c4c2b45579cee748f7b8d9ac6440b054027985b8622e70b3912335c WatchSource:0}: Error finding container 87f1e1077c4c2b45579cee748f7b8d9ac6440b054027985b8622e70b3912335c: Status 404 returned error can't find the container with id 87f1e1077c4c2b45579cee748f7b8d9ac6440b054027985b8622e70b3912335c
Jul 24 17:17:46.253476 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.253451    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 17:17:46.936278 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.936244    2575 apiserver.go:52] "Watching apiserver"
Jul 24 17:17:46.950049 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.948763    2575 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 24 17:17:46.950049 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.949491    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-7q78n","openshift-multus/network-metrics-daemon-mbmql","openshift-network-diagnostics/network-check-target-smcsb","openshift-ovn-kubernetes/ovnkube-node-82s5l","kube-system/global-pull-secret-syncer-7wvn9","kube-system/konnectivity-agent-25crs","kube-system/kube-apiserver-proxy-ip-10-0-139-113.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnkn8","openshift-dns/node-resolver-zkp2w","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-113.ec2.internal","openshift-multus/multus-f275z","openshift-network-operator/iptables-alerter-q8p9j","openshift-cluster-node-tuning-operator/tuned-r488q","openshift-image-registry/node-ca-tctfm"]
Jul 24 17:17:46.951803 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.951663    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r488q"
Jul 24 17:17:46.954044 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.954001    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-bx54w\""
Jul 24 17:17:46.960262 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.954372    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 24 17:17:46.960262 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.954946    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 24 17:17:46.960262 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.955005    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbmql"
Jul 24 17:17:46.960262 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:46.955109    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbmql" podUID="cd3f02c9-192b-420b-9678-5ed4a7d251d8"
Jul 24 17:17:46.960262 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.955890    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-smcsb"
Jul 24 17:17:46.960262 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:46.956019    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-smcsb" podUID="daf55067-cec7-4749-bdae-ad2673094565"
Jul 24 17:17:46.960262 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.958357    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:17:46.960262 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.959546    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wvn9"
Jul 24 17:17:46.960262 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:46.959621    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wvn9" podUID="db784d54-1541-4c98-ae75-0f7234c48158"
Jul 24 17:17:46.963432 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.960981    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 24 17:17:46.963432 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.962288    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-25crs"
Jul 24 17:17:46.963432 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.962638    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7q78n"
Jul 24 17:17:46.969600 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.965727    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnkn8"
Jul 24 17:17:46.969600 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.966534    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zkp2w"
Jul 24 17:17:46.969600 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.967197    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 24 17:17:46.969600 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.967265    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 24 17:17:46.969600 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.967344    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 24 17:17:46.969600 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.967489    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 24 17:17:46.969600 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.967558    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bcqhl\""
Jul 24 17:17:46.969600 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.967670    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 24 17:17:46.969600 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.967747    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 24 17:17:46.969600 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.967983    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-mcqph\""
Jul 24 17:17:46.969600 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.968007    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 24 17:17:46.969600 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.968219    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 24 17:17:46.969600 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.968282    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 24 17:17:46.969600 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.968414    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 24 17:17:46.969600 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.968681    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 24 17:17:46.969600 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.968852    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tctfm"
Jul 24 17:17:46.969600 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.968859    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 24 17:17:46.969600 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.969052    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 24 17:17:46.969600 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.969230    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 24 17:17:46.969600 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.969404    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-98grh\""
Jul 24 17:17:46.970600 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.970125    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-f275z"
Jul 24 17:17:46.970660 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.970614    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 24 17:17:46.971716 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.970807    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8l7jr\""
Jul 24 17:17:46.971716 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.971015    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 24 17:17:46.971716 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.971344    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 24 17:17:46.971716 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.971432    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-q8p9j"
Jul 24 17:17:46.971716 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.971483    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 24 17:17:46.971716 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.971483    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-94ffq\""
Jul 24 17:17:46.972132 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.972067    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 24 17:17:46.972132 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.972094    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 24 17:17:46.972604 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.972583    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-j87t6\""
Jul 24 17:17:46.979399 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.972952    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 24 17:17:46.979399 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.973291    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-vq2kj\""
Jul 24 17:17:46.979399 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.973483    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 24 17:17:46.979399 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.973944    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 24 17:17:46.979399 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.974152    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 24 17:17:46.979399 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.974289    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-599f8\""
Jul 24 17:17:46.979399 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.974544    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/693c1bd3-2e67-417e-8f91-aac3759a07d8-konnectivity-ca\") pod \"konnectivity-agent-25crs\" (UID: \"693c1bd3-2e67-417e-8f91-aac3759a07d8\") " pod="kube-system/konnectivity-agent-25crs"
Jul 24 17:17:46.979399 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.974579    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ae06c81f-d11d-4d26-9dc5-721f14bb9f7a-os-release\") pod \"multus-additional-cni-plugins-7q78n\" (UID: \"ae06c81f-d11d-4d26-9dc5-721f14bb9f7a\") " pod="openshift-multus/multus-additional-cni-plugins-7q78n"
Jul 24 17:17:46.979399 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.974621    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ae06c81f-d11d-4d26-9dc5-721f14bb9f7a-cni-binary-copy\") pod \"multus-additional-cni-plugins-7q78n\" (UID: \"ae06c81f-d11d-4d26-9dc5-721f14bb9f7a\") " pod="openshift-multus/multus-additional-cni-plugins-7q78n"
Jul 24 17:17:46.979399 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.974667    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/010c8b81-c5f5-43c3-b1bb-c812fcde2d6f-run-openvswitch\") pod \"ovnkube-node-82s5l\" (UID: \"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:17:46.979399 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.974626    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 24 17:17:46.979399 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.977040    2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 24 17:17:46.979399 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.977351    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/010c8b81-c5f5-43c3-b1bb-c812fcde2d6f-ovnkube-config\") pod \"ovnkube-node-82s5l\" (UID: \"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:17:46.979399 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.977392    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1304b910-2d54-4e7c-a0c3-4e323a8638e6-etc-sysctl-conf\") pod \"tuned-r488q\" (UID: \"1304b910-2d54-4e7c-a0c3-4e323a8638e6\") " pod="openshift-cluster-node-tuning-operator/tuned-r488q"
Jul 24 17:17:46.979399 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.977418    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1304b910-2d54-4e7c-a0c3-4e323a8638e6-var-lib-kubelet\") pod \"tuned-r488q\" (UID: \"1304b910-2d54-4e7c-a0c3-4e323a8638e6\") " pod="openshift-cluster-node-tuning-operator/tuned-r488q"
Jul 24 17:17:46.979399 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.977452    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1304b910-2d54-4e7c-a0c3-4e323a8638e6-host\") pod \"tuned-r488q\" (UID: \"1304b910-2d54-4e7c-a0c3-4e323a8638e6\") " pod="openshift-cluster-node-tuning-operator/tuned-r488q"
Jul 24 17:17:46.979399 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.977518    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1304b910-2d54-4e7c-a0c3-4e323a8638e6-tmp\") pod \"tuned-r488q\" (UID: \"1304b910-2d54-4e7c-a0c3-4e323a8638e6\") " pod="openshift-cluster-node-tuning-operator/tuned-r488q"
Jul 24 17:17:46.979399 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.977543    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/010c8b81-c5f5-43c3-b1bb-c812fcde2d6f-host-kubelet\") pod \"ovnkube-node-82s5l\" (UID: \"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:17:46.979399 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.977568    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/010c8b81-c5f5-43c3-b1bb-c812fcde2d6f-host-slash\") pod \"ovnkube-node-82s5l\" (UID: \"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:17:46.979399 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.977591    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/010c8b81-c5f5-43c3-b1bb-c812fcde2d6f-run-systemd\") pod \"ovnkube-node-82s5l\" (UID: \"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:17:46.979399 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.977617    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/010c8b81-c5f5-43c3-b1bb-c812fcde2d6f-host-run-ovn-kubernetes\") pod \"ovnkube-node-82s5l\" (UID: \"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:17:46.980726 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.977641    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1304b910-2d54-4e7c-a0c3-4e323a8638e6-sys\") pod \"tuned-r488q\" (UID: \"1304b910-2d54-4e7c-a0c3-4e323a8638e6\") " pod="openshift-cluster-node-tuning-operator/tuned-r488q"
Jul 24 17:17:46.980726 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.977665    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ae06c81f-d11d-4d26-9dc5-721f14bb9f7a-system-cni-dir\") pod \"multus-additional-cni-plugins-7q78n\" (UID: \"ae06c81f-d11d-4d26-9dc5-721f14bb9f7a\") " pod="openshift-multus/multus-additional-cni-plugins-7q78n"
Jul 24 17:17:46.980726 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.977740    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd3f02c9-192b-420b-9678-5ed4a7d251d8-metrics-certs\") pod \"network-metrics-daemon-mbmql\" (UID: \"cd3f02c9-192b-420b-9678-5ed4a7d251d8\") " pod="openshift-multus/network-metrics-daemon-mbmql"
Jul 24 17:17:46.980726 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.977764    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/010c8b81-c5f5-43c3-b1bb-c812fcde2d6f-var-lib-openvswitch\") pod \"ovnkube-node-82s5l\" (UID: \"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:17:46.980726 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.977789    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/db784d54-1541-4c98-ae75-0f7234c48158-kubelet-config\") pod \"global-pull-secret-syncer-7wvn9\" (UID: \"db784d54-1541-4c98-ae75-0f7234c48158\") " pod="kube-system/global-pull-secret-syncer-7wvn9"
Jul 24 17:17:46.980726 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.977815    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1304b910-2d54-4e7c-a0c3-4e323a8638e6-etc-kubernetes\") pod \"tuned-r488q\" (UID: \"1304b910-2d54-4e7c-a0c3-4e323a8638e6\") " pod="openshift-cluster-node-tuning-operator/tuned-r488q"
Jul 24 17:17:46.980726 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.977840    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1304b910-2d54-4e7c-a0c3-4e323a8638e6-etc-systemd\") pod \"tuned-r488q\" (UID: \"1304b910-2d54-4e7c-a0c3-4e323a8638e6\") " pod="openshift-cluster-node-tuning-operator/tuned-r488q"
Jul 24 17:17:46.980726 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.977869    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/010c8b81-c5f5-43c3-b1bb-c812fcde2d6f-systemd-units\") pod \"ovnkube-node-82s5l\" (UID: \"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:17:46.980726 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.977946    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/010c8b81-c5f5-43c3-b1bb-c812fcde2d6f-etc-openvswitch\") pod \"ovnkube-node-82s5l\" (UID: \"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:17:46.980726 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.977972    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/010c8b81-c5f5-43c3-b1bb-c812fcde2d6f-run-ovn\") pod \"ovnkube-node-82s5l\" (UID: \"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:17:46.980726 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.978000    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/010c8b81-c5f5-43c3-b1bb-c812fcde2d6f-host-cni-bin\") pod \"ovnkube-node-82s5l\" (UID: \"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:17:46.980726 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.978043    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1304b910-2d54-4e7c-a0c3-4e323a8638e6-etc-modprobe-d\") pod \"tuned-r488q\" (UID: \"1304b910-2d54-4e7c-a0c3-4e323a8638e6\") " pod="openshift-cluster-node-tuning-operator/tuned-r488q"
Jul 24 17:17:46.980726 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.978068    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1304b910-2d54-4e7c-a0c3-4e323a8638e6-etc-sysctl-d\") pod \"tuned-r488q\" (UID: \"1304b910-2d54-4e7c-a0c3-4e323a8638e6\") " pod="openshift-cluster-node-tuning-operator/tuned-r488q"
Jul 24 17:17:46.980726 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.978095    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/693c1bd3-2e67-417e-8f91-aac3759a07d8-agent-certs\") pod \"konnectivity-agent-25crs\" (UID: \"693c1bd3-2e67-417e-8f91-aac3759a07d8\") " pod="kube-system/konnectivity-agent-25crs"
Jul 24 17:17:46.980726 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.978132    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ae06c81f-d11d-4d26-9dc5-721f14bb9f7a-cnibin\") pod \"multus-additional-cni-plugins-7q78n\" (UID: \"ae06c81f-d11d-4d26-9dc5-721f14bb9f7a\") " pod="openshift-multus/multus-additional-cni-plugins-7q78n"
Jul 24 17:17:46.980726 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.978159    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/010c8b81-c5f5-43c3-b1bb-c812fcde2d6f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-82s5l\" (UID: \"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:17:46.981950 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.978186    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/010c8b81-c5f5-43c3-b1bb-c812fcde2d6f-ovnkube-script-lib\") pod \"ovnkube-node-82s5l\" (UID: \"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:17:46.981950 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.978212    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1304b910-2d54-4e7c-a0c3-4e323a8638e6-lib-modules\") pod \"tuned-r488q\" (UID: \"1304b910-2d54-4e7c-a0c3-4e323a8638e6\") " pod="openshift-cluster-node-tuning-operator/tuned-r488q"
Jul 24 17:17:46.981950 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.978244    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1304b910-2d54-4e7c-a0c3-4e323a8638e6-etc-tuned\") pod \"tuned-r488q\" (UID: \"1304b910-2d54-4e7c-a0c3-4e323a8638e6\") " pod="openshift-cluster-node-tuning-operator/tuned-r488q"
Jul 24 17:17:46.981950 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.978271    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7tm2\" (UniqueName: \"kubernetes.io/projected/1304b910-2d54-4e7c-a0c3-4e323a8638e6-kube-api-access-l7tm2\") pod \"tuned-r488q\" (UID: \"1304b910-2d54-4e7c-a0c3-4e323a8638e6\") " pod="openshift-cluster-node-tuning-operator/tuned-r488q"
Jul 24 17:17:46.981950 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.978304    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ae06c81f-d11d-4d26-9dc5-721f14bb9f7a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7q78n\" (UID: \"ae06c81f-d11d-4d26-9dc5-721f14bb9f7a\") " pod="openshift-multus/multus-additional-cni-plugins-7q78n"
Jul 24 17:17:46.981950 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.978379    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ae06c81f-d11d-4d26-9dc5-721f14bb9f7a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7q78n\" (UID: \"ae06c81f-d11d-4d26-9dc5-721f14bb9f7a\") " pod="openshift-multus/multus-additional-cni-plugins-7q78n"
Jul 24 17:17:46.981950 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.978406    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8lpx\" (UniqueName: \"kubernetes.io/projected/cd3f02c9-192b-420b-9678-5ed4a7d251d8-kube-api-access-l8lpx\") pod \"network-metrics-daemon-mbmql\" (UID: \"cd3f02c9-192b-420b-9678-5ed4a7d251d8\") " pod="openshift-multus/network-metrics-daemon-mbmql"
Jul 24 17:17:46.981950 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.978435    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5w9dx\" (UniqueName: \"kubernetes.io/projected/010c8b81-c5f5-43c3-b1bb-c812fcde2d6f-kube-api-access-5w9dx\") pod \"ovnkube-node-82s5l\" (UID: \"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:17:46.981950 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.978473    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/010c8b81-c5f5-43c3-b1bb-c812fcde2d6f-host-run-netns\") pod \"ovnkube-node-82s5l\" (UID: \"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:17:46.981950 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.978501    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/010c8b81-c5f5-43c3-b1bb-c812fcde2d6f-host-cni-netd\") pod \"ovnkube-node-82s5l\" (UID: \"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:17:46.981950 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.978526    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/010c8b81-c5f5-43c3-b1bb-c812fcde2d6f-ovn-node-metrics-cert\") pod \"ovnkube-node-82s5l\" (UID: \"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:17:46.981950 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.978597    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5g9rk\" (UniqueName: \"kubernetes.io/projected/ae06c81f-d11d-4d26-9dc5-721f14bb9f7a-kube-api-access-5g9rk\") pod \"multus-additional-cni-plugins-7q78n\" (UID: \"ae06c81f-d11d-4d26-9dc5-721f14bb9f7a\") " pod="openshift-multus/multus-additional-cni-plugins-7q78n"
Jul 24 17:17:46.981950 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.978627    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cc2j4\" (UniqueName: \"kubernetes.io/projected/daf55067-cec7-4749-bdae-ad2673094565-kube-api-access-cc2j4\") pod \"network-check-target-smcsb\" (UID: \"daf55067-cec7-4749-bdae-ad2673094565\") " pod="openshift-network-diagnostics/network-check-target-smcsb"
Jul 24 17:17:46.981950 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.978653    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/010c8b81-c5f5-43c3-b1bb-c812fcde2d6f-node-log\") pod \"ovnkube-node-82s5l\" (UID: \"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:17:46.981950 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.978697    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/010c8b81-c5f5-43c3-b1bb-c812fcde2d6f-log-socket\") pod \"ovnkube-node-82s5l\" (UID: \"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:17:46.981950 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.978835    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/db784d54-1541-4c98-ae75-0f7234c48158-dbus\") pod \"global-pull-secret-syncer-7wvn9\" (UID: \"db784d54-1541-4c98-ae75-0f7234c48158\") " pod="kube-system/global-pull-secret-syncer-7wvn9"
Jul 24 17:17:46.982826 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.978939    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1304b910-2d54-4e7c-a0c3-4e323a8638e6-run\") pod \"tuned-r488q\" (UID: \"1304b910-2d54-4e7c-a0c3-4e323a8638e6\") " pod="openshift-cluster-node-tuning-operator/tuned-r488q"
Jul 24 17:17:46.982826 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.979031    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ae06c81f-d11d-4d26-9dc5-721f14bb9f7a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7q78n\" (UID: \"ae06c81f-d11d-4d26-9dc5-721f14bb9f7a\") " pod="openshift-multus/multus-additional-cni-plugins-7q78n"
Jul 24 17:17:46.982826 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.979067    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/010c8b81-c5f5-43c3-b1bb-c812fcde2d6f-env-overrides\") pod \"ovnkube-node-82s5l\" (UID: \"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:17:46.982826 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.979116    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db784d54-1541-4c98-ae75-0f7234c48158-original-pull-secret\") pod \"global-pull-secret-syncer-7wvn9\" (UID: \"db784d54-1541-4c98-ae75-0f7234c48158\") " pod="kube-system/global-pull-secret-syncer-7wvn9"
Jul 24 17:17:46.982826 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:46.979142    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1304b910-2d54-4e7c-a0c3-4e323a8638e6-etc-sysconfig\") pod \"tuned-r488q\" (UID: \"1304b910-2d54-4e7c-a0c3-4e323a8638e6\") " pod="openshift-cluster-node-tuning-operator/tuned-r488q"
Jul 24 17:17:47.002397 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.002197    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-gl2ct"
Jul 24 17:17:47.010449 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.010401    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-gl2ct"
Jul 24 17:17:47.048213 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.048189    2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 17:17:47.062239 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.062205    2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 24 17:17:47.080186 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.080139    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cfdea065-5a0b-47a4-b4e7-d3decf5b18f2-multus-cni-dir\") pod \"multus-f275z\" (UID: \"cfdea065-5a0b-47a4-b4e7-d3decf5b18f2\") " pod="openshift-multus/multus-f275z"
Jul 24 17:17:47.080402 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.080195    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cfdea065-5a0b-47a4-b4e7-d3decf5b18f2-host-var-lib-cni-multus\") pod \"multus-f275z\" (UID: \"cfdea065-5a0b-47a4-b4e7-d3decf5b18f2\") " pod="openshift-multus/multus-f275z"
Jul 24 17:17:47.080402 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.080224    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cfdea065-5a0b-47a4-b4e7-d3decf5b18f2-etc-kubernetes\") pod \"multus-f275z\" (UID: \"cfdea065-5a0b-47a4-b4e7-d3decf5b18f2\") " pod="openshift-multus/multus-f275z"
Jul 24 17:17:47.080402 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.080258    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w9dx\" (UniqueName: \"kubernetes.io/projected/010c8b81-c5f5-43c3-b1bb-c812fcde2d6f-kube-api-access-5w9dx\") pod \"ovnkube-node-82s5l\" (UID: \"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:17:47.080402 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.080285    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/010c8b81-c5f5-43c3-b1bb-c812fcde2d6f-host-run-netns\") pod \"ovnkube-node-82s5l\" (UID: \"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:17:47.080402 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.080311    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/010c8b81-c5f5-43c3-b1bb-c812fcde2d6f-host-cni-netd\") pod \"ovnkube-node-82s5l\" (UID: \"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:17:47.080402 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.080341    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsqv2\" (UniqueName: \"kubernetes.io/projected/3973a6c6-5e57-490f-a57d-6eed74df9217-kube-api-access-rsqv2\") pod \"node-ca-tctfm\" (UID: \"3973a6c6-5e57-490f-a57d-6eed74df9217\") " pod="openshift-image-registry/node-ca-tctfm"
Jul 24 17:17:47.080402 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.080367    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cfdea065-5a0b-47a4-b4e7-d3decf5b18f2-cnibin\") pod \"multus-f275z\" (UID: \"cfdea065-5a0b-47a4-b4e7-d3decf5b18f2\") " pod="openshift-multus/multus-f275z"
Jul 24 17:17:47.080402 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.080392    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cfdea065-5a0b-47a4-b4e7-d3decf5b18f2-host-var-lib-kubelet\") pod \"multus-f275z\" (UID: \"cfdea065-5a0b-47a4-b4e7-d3decf5b18f2\") " pod="openshift-multus/multus-f275z"
Jul 24 17:17:47.080840 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.080416    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/010c8b81-c5f5-43c3-b1bb-c812fcde2d6f-node-log\") pod \"ovnkube-node-82s5l\" (UID: \"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:17:47.080840 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.080441    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/db784d54-1541-4c98-ae75-0f7234c48158-dbus\") pod \"global-pull-secret-syncer-7wvn9\" (UID: \"db784d54-1541-4c98-ae75-0f7234c48158\") " pod="kube-system/global-pull-secret-syncer-7wvn9"
Jul 24 17:17:47.080840 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.080464    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1304b910-2d54-4e7c-a0c3-4e323a8638e6-run\") pod \"tuned-r488q\" (UID: \"1304b910-2d54-4e7c-a0c3-4e323a8638e6\") " pod="openshift-cluster-node-tuning-operator/tuned-r488q"
Jul 24 17:17:47.080840 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.080489    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ae06c81f-d11d-4d26-9dc5-721f14bb9f7a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7q78n\" (UID: \"ae06c81f-d11d-4d26-9dc5-721f14bb9f7a\") " pod="openshift-multus/multus-additional-cni-plugins-7q78n"
Jul 24 17:17:47.080840 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.080515    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ad858bfa-fc28-48fc-956e-607ae97a1d4a-socket-dir\") pod \"aws-ebs-csi-driver-node-rnkn8\" (UID: \"ad858bfa-fc28-48fc-956e-607ae97a1d4a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnkn8"
Jul 24 17:17:47.080840 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.080543    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/010c8b81-c5f5-43c3-b1bb-c812fcde2d6f-env-overrides\") pod \"ovnkube-node-82s5l\" (UID: \"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:17:47.080840 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.080568    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db784d54-1541-4c98-ae75-0f7234c48158-original-pull-secret\") pod \"global-pull-secret-syncer-7wvn9\" (UID: \"db784d54-1541-4c98-ae75-0f7234c48158\") " pod="kube-system/global-pull-secret-syncer-7wvn9"
Jul 24 17:17:47.080840 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.080593    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1304b910-2d54-4e7c-a0c3-4e323a8638e6-etc-sysconfig\") pod \"tuned-r488q\" (UID: \"1304b910-2d54-4e7c-a0c3-4e323a8638e6\") " pod="openshift-cluster-node-tuning-operator/tuned-r488q"
Jul 24 17:17:47.080840 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.080620    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ae06c81f-d11d-4d26-9dc5-721f14bb9f7a-cni-binary-copy\") pod \"multus-additional-cni-plugins-7q78n\" (UID: \"ae06c81f-d11d-4d26-9dc5-721f14bb9f7a\") " pod="openshift-multus/multus-additional-cni-plugins-7q78n"
Jul 24 17:17:47.080840 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.080646    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d278b8d-3bae-40ee-9eaa-ce1f87ae92b8-tmp-dir\") pod \"node-resolver-zkp2w\" (UID: \"7d278b8d-3bae-40ee-9eaa-ce1f87ae92b8\") " pod="openshift-dns/node-resolver-zkp2w"
Jul 24 17:17:47.080840 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.080681    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cfdea065-5a0b-47a4-b4e7-d3decf5b18f2-host-run-multus-certs\") pod \"multus-f275z\" (UID: \"cfdea065-5a0b-47a4-b4e7-d3decf5b18f2\") " pod="openshift-multus/multus-f275z"
Jul 24 17:17:47.080840 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.080708    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1304b910-2d54-4e7c-a0c3-4e323a8638e6-etc-sysctl-conf\") pod \"tuned-r488q\" (UID: \"1304b910-2d54-4e7c-a0c3-4e323a8638e6\") " pod="openshift-cluster-node-tuning-operator/tuned-r488q"
Jul 24 17:17:47.080840 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.080730    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1304b910-2d54-4e7c-a0c3-4e323a8638e6-host\") pod \"tuned-r488q\" (UID: \"1304b910-2d54-4e7c-a0c3-4e323a8638e6\") " pod="openshift-cluster-node-tuning-operator/tuned-r488q"
Jul 24 17:17:47.080840 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.080753    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cfdea065-5a0b-47a4-b4e7-d3decf5b18f2-multus-daemon-config\") pod \"multus-f275z\" (UID: \"cfdea065-5a0b-47a4-b4e7-d3decf5b18f2\") " pod="openshift-multus/multus-f275z"
Jul 24 17:17:47.080840 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.080758    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/010c8b81-c5f5-43c3-b1bb-c812fcde2d6f-node-log\") pod \"ovnkube-node-82s5l\" (UID: \"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:17:47.080840 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.080796    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kprfk\" (UniqueName: \"kubernetes.io/projected/ad858bfa-fc28-48fc-956e-607ae97a1d4a-kube-api-access-kprfk\") pod \"aws-ebs-csi-driver-node-rnkn8\" (UID: \"ad858bfa-fc28-48fc-956e-607ae97a1d4a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnkn8"
Jul 24 17:17:47.080840 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.080799    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/010c8b81-c5f5-43c3-b1bb-c812fcde2d6f-host-run-netns\") pod \"ovnkube-node-82s5l\" (UID: \"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:17:47.081749 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.080824    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/010c8b81-c5f5-43c3-b1bb-c812fcde2d6f-host-cni-netd\") pod \"ovnkube-node-82s5l\" (UID: \"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:17:47.081749 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.080839    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/911467b2-1015-4fec-a1ba-05ac34815af8-iptables-alerter-script\") pod \"iptables-alerter-q8p9j\" (UID: \"911467b2-1015-4fec-a1ba-05ac34815af8\") " pod="openshift-network-operator/iptables-alerter-q8p9j"
Jul 24 17:17:47.081749 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:47.080862    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 17:17:47.081749 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.080926    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1304b910-2d54-4e7c-a0c3-4e323a8638e6-etc-sysconfig\") pod \"tuned-r488q\" (UID: \"1304b910-2d54-4e7c-a0c3-4e323a8638e6\") " pod="openshift-cluster-node-tuning-operator/tuned-r488q"
Jul 24 17:17:47.081749 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:47.080950    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db784d54-1541-4c98-ae75-0f7234c48158-original-pull-secret podName:db784d54-1541-4c98-ae75-0f7234c48158 nodeName:}" failed. No retries permitted until 2026-07-24 17:17:47.580922681 +0000 UTC m=+3.062298287 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db784d54-1541-4c98-ae75-0f7234c48158-original-pull-secret") pod "global-pull-secret-syncer-7wvn9" (UID: "db784d54-1541-4c98-ae75-0f7234c48158") : object "kube-system"/"original-pull-secret" not registered
Jul 24 17:17:47.081749 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.080993    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cfdea065-5a0b-47a4-b4e7-d3decf5b18f2-cni-binary-copy\") pod \"multus-f275z\" (UID: \"cfdea065-5a0b-47a4-b4e7-d3decf5b18f2\") " pod="openshift-multus/multus-f275z"
Jul 24 17:17:47.081749 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.081031    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cfdea065-5a0b-47a4-b4e7-d3decf5b18f2-hostroot\") pod \"multus-f275z\" (UID: \"cfdea065-5a0b-47a4-b4e7-d3decf5b18f2\") " pod="openshift-multus/multus-f275z"
Jul 24 17:17:47.081749 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.081298    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1304b910-2d54-4e7c-a0c3-4e323a8638e6-host\") pod \"tuned-r488q\" (UID: \"1304b910-2d54-4e7c-a0c3-4e323a8638e6\") " pod="openshift-cluster-node-tuning-operator/tuned-r488q"
Jul 24 17:17:47.081749 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.081461    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1304b910-2d54-4e7c-a0c3-4e323a8638e6-etc-sysctl-conf\") pod \"tuned-r488q\" (UID: \"1304b910-2d54-4e7c-a0c3-4e323a8638e6\") " pod="openshift-cluster-node-tuning-operator/tuned-r488q"
Jul 24 17:17:47.081749 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.081500    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/010c8b81-c5f5-43c3-b1bb-c812fcde2d6f-var-lib-openvswitch\") pod \"ovnkube-node-82s5l\" (UID: \"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:17:47.081749 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.081528    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/db784d54-1541-4c98-ae75-0f7234c48158-kubelet-config\") pod \"global-pull-secret-syncer-7wvn9\" (UID: \"db784d54-1541-4c98-ae75-0f7234c48158\") " pod="kube-system/global-pull-secret-syncer-7wvn9"
Jul 24 17:17:47.081749 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.081548    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/db784d54-1541-4c98-ae75-0f7234c48158-dbus\") pod \"global-pull-secret-syncer-7wvn9\" (UID: \"db784d54-1541-4c98-ae75-0f7234c48158\") " pod="kube-system/global-pull-secret-syncer-7wvn9"
Jul 24 17:17:47.081749 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.081555    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1304b910-2d54-4e7c-a0c3-4e323a8638e6-etc-kubernetes\") pod \"tuned-r488q\" (UID: \"1304b910-2d54-4e7c-a0c3-4e323a8638e6\") " pod="openshift-cluster-node-tuning-operator/tuned-r488q"
Jul 24 17:17:47.081749 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.081569    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/010c8b81-c5f5-43c3-b1bb-c812fcde2d6f-env-overrides\") pod \"ovnkube-node-82s5l\" (UID: \"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:17:47.081749 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.081594    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1304b910-2d54-4e7c-a0c3-4e323a8638e6-etc-kubernetes\") pod \"tuned-r488q\" (UID: \"1304b910-2d54-4e7c-a0c3-4e323a8638e6\") " pod="openshift-cluster-node-tuning-operator/tuned-r488q"
Jul 24 17:17:47.081749 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.081627    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1304b910-2d54-4e7c-a0c3-4e323a8638e6-etc-systemd\") pod \"tuned-r488q\" (UID: \"1304b910-2d54-4e7c-a0c3-4e323a8638e6\") " pod="openshift-cluster-node-tuning-operator/tuned-r488q"
Jul 24 17:17:47.081749 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.081636    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ae06c81f-d11d-4d26-9dc5-721f14bb9f7a-cni-binary-copy\") pod \"multus-additional-cni-plugins-7q78n\" (UID: \"ae06c81f-d11d-4d26-9dc5-721f14bb9f7a\") " pod="openshift-multus/multus-additional-cni-plugins-7q78n"
Jul 24 17:17:47.082653 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.081651    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3973a6c6-5e57-490f-a57d-6eed74df9217-serviceca\") pod \"node-ca-tctfm\" (UID: \"3973a6c6-5e57-490f-a57d-6eed74df9217\") " pod="openshift-image-registry/node-ca-tctfm"
Jul 24 17:17:47.082653 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.081682    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cfdea065-5a0b-47a4-b4e7-d3decf5b18f2-multus-socket-dir-parent\") pod \"multus-f275z\" (UID: \"cfdea065-5a0b-47a4-b4e7-d3decf5b18f2\") " pod="openshift-multus/multus-f275z"
Jul 24 17:17:47.082653 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.081689    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/010c8b81-c5f5-43c3-b1bb-c812fcde2d6f-var-lib-openvswitch\") pod \"ovnkube-node-82s5l\" (UID: \"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:17:47.082653 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.081636    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ae06c81f-d11d-4d26-9dc5-721f14bb9f7a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7q78n\" (UID: \"ae06c81f-d11d-4d26-9dc5-721f14bb9f7a\") " pod="openshift-multus/multus-additional-cni-plugins-7q78n"
Jul 24 17:17:47.082653 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.081713    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/010c8b81-c5f5-43c3-b1bb-c812fcde2d6f-host-cni-bin\") pod \"ovnkube-node-82s5l\" (UID: \"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:17:47.082653 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.081706    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/db784d54-1541-4c98-ae75-0f7234c48158-kubelet-config\") pod \"global-pull-secret-syncer-7wvn9\" (UID: \"db784d54-1541-4c98-ae75-0f7234c48158\") " pod="kube-system/global-pull-secret-syncer-7wvn9"
Jul 24 17:17:47.082653 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.081752    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/010c8b81-c5f5-43c3-b1bb-c812fcde2d6f-host-cni-bin\") pod \"ovnkube-node-82s5l\" (UID: \"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:17:47.082653 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.081767    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1304b910-2d54-4e7c-a0c3-4e323a8638e6-etc-systemd\") pod \"tuned-r488q\" (UID: \"1304b910-2d54-4e7c-a0c3-4e323a8638e6\") " pod="openshift-cluster-node-tuning-operator/tuned-r488q"
Jul 24 17:17:47.082653 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.081774    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1304b910-2d54-4e7c-a0c3-4e323a8638e6-run\") pod \"tuned-r488q\" (UID: \"1304b910-2d54-4e7c-a0c3-4e323a8638e6\") " pod="openshift-cluster-node-tuning-operator/tuned-r488q"
Jul 24 17:17:47.082653 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.081810    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1304b910-2d54-4e7c-a0c3-4e323a8638e6-etc-modprobe-d\") pod \"tuned-r488q\" (UID: \"1304b910-2d54-4e7c-a0c3-4e323a8638e6\") " pod="openshift-cluster-node-tuning-operator/tuned-r488q"
Jul 24 17:17:47.082653 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.081867    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1304b910-2d54-4e7c-a0c3-4e323a8638e6-etc-sysctl-d\") pod \"tuned-r488q\" (UID: \"1304b910-2d54-4e7c-a0c3-4e323a8638e6\") " pod="openshift-cluster-node-tuning-operator/tuned-r488q"
Jul 24 17:17:47.082653 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.081964    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8lpx\" (UniqueName: \"kubernetes.io/projected/cd3f02c9-192b-420b-9678-5ed4a7d251d8-kube-api-access-l8lpx\") pod \"network-metrics-daemon-mbmql\" (UID: \"cd3f02c9-192b-420b-9678-5ed4a7d251d8\") " pod="openshift-multus/network-metrics-daemon-mbmql"
Jul 24 17:17:47.082653 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.081994    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1304b910-2d54-4e7c-a0c3-4e323a8638e6-etc-sysctl-d\") pod \"tuned-r488q\" (UID: \"1304b910-2d54-4e7c-a0c3-4e323a8638e6\") " pod="openshift-cluster-node-tuning-operator/tuned-r488q"
Jul 24 17:17:47.082653 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.082038    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzcvj\" (UniqueName: \"kubernetes.io/projected/7d278b8d-3bae-40ee-9eaa-ce1f87ae92b8-kube-api-access-wzcvj\") pod \"node-resolver-zkp2w\" (UID: \"7d278b8d-3bae-40ee-9eaa-ce1f87ae92b8\") " pod="openshift-dns/node-resolver-zkp2w"
Jul 24 17:17:47.082653 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.082072    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/010c8b81-c5f5-43c3-b1bb-c812fcde2d6f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-82s5l\" (UID: \"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:17:47.082653 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.081998    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1304b910-2d54-4e7c-a0c3-4e323a8638e6-etc-modprobe-d\") pod \"tuned-r488q\" (UID: \"1304b910-2d54-4e7c-a0c3-4e323a8638e6\") " pod="openshift-cluster-node-tuning-operator/tuned-r488q"
Jul 24 17:17:47.082653 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.082110    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/010c8b81-c5f5-43c3-b1bb-c812fcde2d6f-ovnkube-script-lib\") pod \"ovnkube-node-82s5l\" (UID: \"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:17:47.083633 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.082140    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1304b910-2d54-4e7c-a0c3-4e323a8638e6-lib-modules\") pod \"tuned-r488q\" (UID: \"1304b910-2d54-4e7c-a0c3-4e323a8638e6\") " pod="openshift-cluster-node-tuning-operator/tuned-r488q"
Jul 24 17:17:47.083633 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.082143    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/010c8b81-c5f5-43c3-b1bb-c812fcde2d6f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-82s5l\" (UID: \"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:17:47.083633 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.082177    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1304b910-2d54-4e7c-a0c3-4e323a8638e6-etc-tuned\") pod \"tuned-r488q\" (UID: \"1304b910-2d54-4e7c-a0c3-4e323a8638e6\") " pod="openshift-cluster-node-tuning-operator/tuned-r488q"
Jul 24 17:17:47.083633 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.082245    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/911467b2-1015-4fec-a1ba-05ac34815af8-host-slash\") pod \"iptables-alerter-q8p9j\" (UID: \"911467b2-1015-4fec-a1ba-05ac34815af8\") " pod="openshift-network-operator/iptables-alerter-q8p9j"
Jul 24 17:17:47.083633 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.082269    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1304b910-2d54-4e7c-a0c3-4e323a8638e6-lib-modules\") pod \"tuned-r488q\" (UID: \"1304b910-2d54-4e7c-a0c3-4e323a8638e6\") " pod="openshift-cluster-node-tuning-operator/tuned-r488q"
Jul 24 17:17:47.083633 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.082276    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cfdea065-5a0b-47a4-b4e7-d3decf5b18f2-system-cni-dir\") pod \"multus-f275z\" (UID: \"cfdea065-5a0b-47a4-b4e7-d3decf5b18f2\") " pod="openshift-multus/multus-f275z"
Jul 24 17:17:47.083633 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.082314    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cfdea065-5a0b-47a4-b4e7-d3decf5b18f2-host-run-netns\") pod \"multus-f275z\" (UID: \"cfdea065-5a0b-47a4-b4e7-d3decf5b18f2\") " pod="openshift-multus/multus-f275z"
Jul 24 17:17:47.083633 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.082341    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cfdea065-5a0b-47a4-b4e7-d3decf5b18f2-host-var-lib-cni-bin\") pod \"multus-f275z\" (UID: \"cfdea065-5a0b-47a4-b4e7-d3decf5b18f2\") " pod="openshift-multus/multus-f275z"
Jul 24 17:17:47.083633 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.082382    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/010c8b81-c5f5-43c3-b1bb-c812fcde2d6f-ovn-node-metrics-cert\") pod \"ovnkube-node-82s5l\" (UID: \"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:17:47.083633 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.082426    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5g9rk\" (UniqueName: \"kubernetes.io/projected/ae06c81f-d11d-4d26-9dc5-721f14bb9f7a-kube-api-access-5g9rk\") pod \"multus-additional-cni-plugins-7q78n\" (UID: \"ae06c81f-d11d-4d26-9dc5-721f14bb9f7a\") " pod="openshift-multus/multus-additional-cni-plugins-7q78n"
Jul 24 17:17:47.083633 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.082469    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cc2j4\" (UniqueName: \"kubernetes.io/projected/daf55067-cec7-4749-bdae-ad2673094565-kube-api-access-cc2j4\") pod \"network-check-target-smcsb\" (UID: \"daf55067-cec7-4749-bdae-ad2673094565\") " pod="openshift-network-diagnostics/network-check-target-smcsb"
Jul 24 17:17:47.083633 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.082497    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ad858bfa-fc28-48fc-956e-607ae97a1d4a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rnkn8\" (UID: \"ad858bfa-fc28-48fc-956e-607ae97a1d4a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnkn8"
Jul 24 17:17:47.083633 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.082542    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ad858bfa-fc28-48fc-956e-607ae97a1d4a-device-dir\") pod \"aws-ebs-csi-driver-node-rnkn8\" (UID: \"ad858bfa-fc28-48fc-956e-607ae97a1d4a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnkn8"
Jul 24 17:17:47.083633 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.082572    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqkhd\" (UniqueName: \"kubernetes.io/projected/cfdea065-5a0b-47a4-b4e7-d3decf5b18f2-kube-api-access-mqkhd\") pod \"multus-f275z\" (UID: \"cfdea065-5a0b-47a4-b4e7-d3decf5b18f2\") " pod="openshift-multus/multus-f275z"
Jul 24 17:17:47.083633 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.082608    2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 24 17:17:47.083633 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.082656    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/010c8b81-c5f5-43c3-b1bb-c812fcde2d6f-log-socket\") pod \"ovnkube-node-82s5l\" (UID: \"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:17:47.083633 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.082705    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/010c8b81-c5f5-43c3-b1bb-c812fcde2d6f-ovnkube-script-lib\") pod \"ovnkube-node-82s5l\" (UID: \"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:17:47.084513 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.082602    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/010c8b81-c5f5-43c3-b1bb-c812fcde2d6f-log-socket\") pod \"ovnkube-node-82s5l\" (UID: \"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:17:47.084513 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.082853    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3973a6c6-5e57-490f-a57d-6eed74df9217-host\") pod \"node-ca-tctfm\" (UID: \"3973a6c6-5e57-490f-a57d-6eed74df9217\") " pod="openshift-image-registry/node-ca-tctfm"
Jul 24 17:17:47.084513 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.082896    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/693c1bd3-2e67-417e-8f91-aac3759a07d8-konnectivity-ca\") pod \"konnectivity-agent-25crs\" (UID: \"693c1bd3-2e67-417e-8f91-aac3759a07d8\") " pod="kube-system/konnectivity-agent-25crs"
Jul 24 17:17:47.084513 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.082977    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ae06c81f-d11d-4d26-9dc5-721f14bb9f7a-os-release\") pod \"multus-additional-cni-plugins-7q78n\" (UID: \"ae06c81f-d11d-4d26-9dc5-721f14bb9f7a\") " pod="openshift-multus/multus-additional-cni-plugins-7q78n"
Jul 24 17:17:47.084513 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.083057    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ad858bfa-fc28-48fc-956e-607ae97a1d4a-etc-selinux\") pod \"aws-ebs-csi-driver-node-rnkn8\" (UID: \"ad858bfa-fc28-48fc-956e-607ae97a1d4a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnkn8"
Jul 24 17:17:47.084513 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.083105    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ae06c81f-d11d-4d26-9dc5-721f14bb9f7a-os-release\") pod \"multus-additional-cni-plugins-7q78n\" (UID: \"ae06c81f-d11d-4d26-9dc5-721f14bb9f7a\") " pod="openshift-multus/multus-additional-cni-plugins-7q78n"
Jul 24 17:17:47.084513 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.083135    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ad858bfa-fc28-48fc-956e-607ae97a1d4a-sys-fs\") pod \"aws-ebs-csi-driver-node-rnkn8\" (UID: \"ad858bfa-fc28-48fc-956e-607ae97a1d4a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnkn8"
Jul 24 17:17:47.084513 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.083163    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/010c8b81-c5f5-43c3-b1bb-c812fcde2d6f-run-openvswitch\") pod \"ovnkube-node-82s5l\" (UID: \"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:17:47.084513 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.083203    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/010c8b81-c5f5-43c3-b1bb-c812fcde2d6f-run-openvswitch\") pod \"ovnkube-node-82s5l\" (UID: \"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:17:47.084513 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.083230    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/010c8b81-c5f5-43c3-b1bb-c812fcde2d6f-ovnkube-config\") pod \"ovnkube-node-82s5l\" (UID: \"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:17:47.084513 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.083269    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1304b910-2d54-4e7c-a0c3-4e323a8638e6-var-lib-kubelet\") pod \"tuned-r488q\" (UID: \"1304b910-2d54-4e7c-a0c3-4e323a8638e6\") " pod="openshift-cluster-node-tuning-operator/tuned-r488q"
Jul 24 17:17:47.084513 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.083316    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1304b910-2d54-4e7c-a0c3-4e323a8638e6-tmp\") pod \"tuned-r488q\" (UID: \"1304b910-2d54-4e7c-a0c3-4e323a8638e6\") " pod="openshift-cluster-node-tuning-operator/tuned-r488q"
Jul 24 17:17:47.084513 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.083359    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1304b910-2d54-4e7c-a0c3-4e323a8638e6-var-lib-kubelet\") pod \"tuned-r488q\" (UID: \"1304b910-2d54-4e7c-a0c3-4e323a8638e6\") " pod="openshift-cluster-node-tuning-operator/tuned-r488q"
Jul 24 17:17:47.084513 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.083403    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7d278b8d-3bae-40ee-9eaa-ce1f87ae92b8-hosts-file\") pod \"node-resolver-zkp2w\" (UID: \"7d278b8d-3bae-40ee-9eaa-ce1f87ae92b8\") " pod="openshift-dns/node-resolver-zkp2w"
Jul 24 17:17:47.084513 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.083435    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/010c8b81-c5f5-43c3-b1bb-c812fcde2d6f-host-kubelet\") pod \"ovnkube-node-82s5l\" (UID: \"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:17:47.084513 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.083526    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/010c8b81-c5f5-43c3-b1bb-c812fcde2d6f-host-kubelet\") pod \"ovnkube-node-82s5l\" (UID: \"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:17:47.084513 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.083558    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/010c8b81-c5f5-43c3-b1bb-c812fcde2d6f-host-slash\") pod \"ovnkube-node-82s5l\" (UID: \"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:17:47.085402 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.083582    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/010c8b81-c5f5-43c3-b1bb-c812fcde2d6f-run-systemd\") pod \"ovnkube-node-82s5l\" (UID: \"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:17:47.085402 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.083625    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/010c8b81-c5f5-43c3-b1bb-c812fcde2d6f-host-run-ovn-kubernetes\") pod \"ovnkube-node-82s5l\" (UID: \"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:17:47.085402 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.083648    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1304b910-2d54-4e7c-a0c3-4e323a8638e6-sys\") pod \"tuned-r488q\" (UID: \"1304b910-2d54-4e7c-a0c3-4e323a8638e6\") " pod="openshift-cluster-node-tuning-operator/tuned-r488q"
Jul 24 17:17:47.085402 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.083652    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/693c1bd3-2e67-417e-8f91-aac3759a07d8-konnectivity-ca\") pod \"konnectivity-agent-25crs\" (UID: \"693c1bd3-2e67-417e-8f91-aac3759a07d8\") " pod="kube-system/konnectivity-agent-25crs"
Jul 24 17:17:47.085402 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.083718    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ae06c81f-d11d-4d26-9dc5-721f14bb9f7a-system-cni-dir\") pod \"multus-additional-cni-plugins-7q78n\" (UID: \"ae06c81f-d11d-4d26-9dc5-721f14bb9f7a\") " pod="openshift-multus/multus-additional-cni-plugins-7q78n"
Jul 24 17:17:47.085402 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.083715    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/010c8b81-c5f5-43c3-b1bb-c812fcde2d6f-host-slash\") pod \"ovnkube-node-82s5l\" (UID: \"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:17:47.085402 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.083760    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/010c8b81-c5f5-43c3-b1bb-c812fcde2d6f-ovnkube-config\") pod \"ovnkube-node-82s5l\" (UID: \"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:17:47.085402 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.083778    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/010c8b81-c5f5-43c3-b1bb-c812fcde2d6f-run-systemd\") pod \"ovnkube-node-82s5l\" (UID: \"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:17:47.085402 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.083835    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd3f02c9-192b-420b-9678-5ed4a7d251d8-metrics-certs\") pod \"network-metrics-daemon-mbmql\" (UID: \"cd3f02c9-192b-420b-9678-5ed4a7d251d8\") " pod="openshift-multus/network-metrics-daemon-mbmql"
Jul 24 17:17:47.085402 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.083866    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cfdea065-5a0b-47a4-b4e7-d3decf5b18f2-os-release\") pod \"multus-f275z\" (UID: \"cfdea065-5a0b-47a4-b4e7-d3decf5b18f2\") " pod="openshift-multus/multus-f275z"
Jul 24 17:17:47.085402 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.083910    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvznn\" (UniqueName: \"kubernetes.io/projected/911467b2-1015-4fec-a1ba-05ac34815af8-kube-api-access-vvznn\") pod \"iptables-alerter-q8p9j\" (UID: \"911467b2-1015-4fec-a1ba-05ac34815af8\") " pod="openshift-network-operator/iptables-alerter-q8p9j"
Jul 24 17:17:47.085402 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.083922    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/010c8b81-c5f5-43c3-b1bb-c812fcde2d6f-host-run-ovn-kubernetes\") pod \"ovnkube-node-82s5l\" (UID: \"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:17:47.085402 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.083962    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/010c8b81-c5f5-43c3-b1bb-c812fcde2d6f-systemd-units\") pod \"ovnkube-node-82s5l\" (UID: \"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:17:47.085402 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.083991    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/010c8b81-c5f5-43c3-b1bb-c812fcde2d6f-etc-openvswitch\") pod \"ovnkube-node-82s5l\" (UID: \"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:17:47.085402 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:47.083996    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:17:47.085402 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.084017    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/010c8b81-c5f5-43c3-b1bb-c812fcde2d6f-run-ovn\") pod \"ovnkube-node-82s5l\" (UID: \"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:17:47.085402 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:47.084060    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd3f02c9-192b-420b-9678-5ed4a7d251d8-metrics-certs podName:cd3f02c9-192b-420b-9678-5ed4a7d251d8 nodeName:}" failed. No retries permitted until 2026-07-24 17:17:47.584037042 +0000 UTC m=+3.065412654 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd3f02c9-192b-420b-9678-5ed4a7d251d8-metrics-certs") pod "network-metrics-daemon-mbmql" (UID: "cd3f02c9-192b-420b-9678-5ed4a7d251d8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:17:47.086278 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.084084    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/693c1bd3-2e67-417e-8f91-aac3759a07d8-agent-certs\") pod \"konnectivity-agent-25crs\" (UID: \"693c1bd3-2e67-417e-8f91-aac3759a07d8\") " pod="kube-system/konnectivity-agent-25crs"
Jul 24 17:17:47.086278 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.084088    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/010c8b81-c5f5-43c3-b1bb-c812fcde2d6f-run-ovn\") pod \"ovnkube-node-82s5l\" (UID: \"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:17:47.086278 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.084110    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ae06c81f-d11d-4d26-9dc5-721f14bb9f7a-cnibin\") pod \"multus-additional-cni-plugins-7q78n\" (UID: \"ae06c81f-d11d-4d26-9dc5-721f14bb9f7a\") " pod="openshift-multus/multus-additional-cni-plugins-7q78n"
Jul 24 17:17:47.086278 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.084136    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ae06c81f-d11d-4d26-9dc5-721f14bb9f7a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7q78n\" (UID: \"ae06c81f-d11d-4d26-9dc5-721f14bb9f7a\") " pod="openshift-multus/multus-additional-cni-plugins-7q78n"
Jul 24 17:17:47.086278 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.084156    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cfdea065-5a0b-47a4-b4e7-d3decf5b18f2-host-run-k8s-cni-cncf-io\") pod \"multus-f275z\" (UID: \"cfdea065-5a0b-47a4-b4e7-d3decf5b18f2\") " pod="openshift-multus/multus-f275z"
Jul 24 17:17:47.086278 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.084156    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/010c8b81-c5f5-43c3-b1bb-c812fcde2d6f-etc-openvswitch\") pod \"ovnkube-node-82s5l\" (UID: \"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:17:47.086278 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.084173    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cfdea065-5a0b-47a4-b4e7-d3decf5b18f2-multus-conf-dir\") pod \"multus-f275z\" (UID: \"cfdea065-5a0b-47a4-b4e7-d3decf5b18f2\") " pod="openshift-multus/multus-f275z"
Jul 24 17:17:47.086278 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.084190    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7tm2\" (UniqueName: \"kubernetes.io/projected/1304b910-2d54-4e7c-a0c3-4e323a8638e6-kube-api-access-l7tm2\") pod \"tuned-r488q\" (UID: \"1304b910-2d54-4e7c-a0c3-4e323a8638e6\") " pod="openshift-cluster-node-tuning-operator/tuned-r488q"
Jul 24 17:17:47.086278 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.084208    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ae06c81f-d11d-4d26-9dc5-721f14bb9f7a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7q78n\" (UID: \"ae06c81f-d11d-4d26-9dc5-721f14bb9f7a\") " pod="openshift-multus/multus-additional-cni-plugins-7q78n"
Jul 24 17:17:47.086278 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.084226    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ad858bfa-fc28-48fc-956e-607ae97a1d4a-registration-dir\") pod \"aws-ebs-csi-driver-node-rnkn8\" (UID: \"ad858bfa-fc28-48fc-956e-607ae97a1d4a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnkn8"
Jul 24 17:17:47.086278 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.084291    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ae06c81f-d11d-4d26-9dc5-721f14bb9f7a-system-cni-dir\") pod \"multus-additional-cni-plugins-7q78n\" (UID: \"ae06c81f-d11d-4d26-9dc5-721f14bb9f7a\") " pod="openshift-multus/multus-additional-cni-plugins-7q78n"
Jul 24 17:17:47.086278 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.084357    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1304b910-2d54-4e7c-a0c3-4e323a8638e6-sys\") pod \"tuned-r488q\" (UID: \"1304b910-2d54-4e7c-a0c3-4e323a8638e6\") " pod="openshift-cluster-node-tuning-operator/tuned-r488q"
Jul 24 17:17:47.086278 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.084682    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/010c8b81-c5f5-43c3-b1bb-c812fcde2d6f-systemd-units\") pod \"ovnkube-node-82s5l\" (UID: \"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:17:47.086278 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.084730    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ae06c81f-d11d-4d26-9dc5-721f14bb9f7a-cnibin\") pod \"multus-additional-cni-plugins-7q78n\" (UID: \"ae06c81f-d11d-4d26-9dc5-721f14bb9f7a\") " pod="openshift-multus/multus-additional-cni-plugins-7q78n"
Jul 24 17:17:47.086278 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.084821    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ae06c81f-d11d-4d26-9dc5-721f14bb9f7a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7q78n\" (UID: \"ae06c81f-d11d-4d26-9dc5-721f14bb9f7a\") " pod="openshift-multus/multus-additional-cni-plugins-7q78n"
Jul 24 17:17:47.086278 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.085482    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ae06c81f-d11d-4d26-9dc5-721f14bb9f7a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7q78n\" (UID: \"ae06c81f-d11d-4d26-9dc5-721f14bb9f7a\") " pod="openshift-multus/multus-additional-cni-plugins-7q78n"
Jul 24 17:17:47.087250 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.087226    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/693c1bd3-2e67-417e-8f91-aac3759a07d8-agent-certs\") pod \"konnectivity-agent-25crs\" (UID: \"693c1bd3-2e67-417e-8f91-aac3759a07d8\") " pod="kube-system/konnectivity-agent-25crs"
Jul 24 17:17:47.088339 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.088309    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/010c8b81-c5f5-43c3-b1bb-c812fcde2d6f-ovn-node-metrics-cert\") pod \"ovnkube-node-82s5l\" (UID: \"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:17:47.089250 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.089222    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1304b910-2d54-4e7c-a0c3-4e323a8638e6-etc-tuned\") pod \"tuned-r488q\" (UID: \"1304b910-2d54-4e7c-a0c3-4e323a8638e6\") " pod="openshift-cluster-node-tuning-operator/tuned-r488q"
Jul 24 17:17:47.090352 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.090303    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1304b910-2d54-4e7c-a0c3-4e323a8638e6-tmp\") pod \"tuned-r488q\" (UID: \"1304b910-2d54-4e7c-a0c3-4e323a8638e6\") " pod="openshift-cluster-node-tuning-operator/tuned-r488q"
Jul 24 17:17:47.092127 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.092108    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5g9rk\" (UniqueName: \"kubernetes.io/projected/ae06c81f-d11d-4d26-9dc5-721f14bb9f7a-kube-api-access-5g9rk\") pod \"multus-additional-cni-plugins-7q78n\" (UID: \"ae06c81f-d11d-4d26-9dc5-721f14bb9f7a\") " pod="openshift-multus/multus-additional-cni-plugins-7q78n"
Jul 24 17:17:47.092440 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.092411    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w9dx\" (UniqueName: \"kubernetes.io/projected/010c8b81-c5f5-43c3-b1bb-c812fcde2d6f-kube-api-access-5w9dx\") pod \"ovnkube-node-82s5l\" (UID: \"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f\") " pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:17:47.094189 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:47.093890    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 17:17:47.094189 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:47.093917    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 17:17:47.094189 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:47.093933    2575 projected.go:196] Error preparing data for projected volume kube-api-access-cc2j4 for pod openshift-network-diagnostics/network-check-target-smcsb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:17:47.094189 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:47.094018    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/daf55067-cec7-4749-bdae-ad2673094565-kube-api-access-cc2j4 podName:daf55067-cec7-4749-bdae-ad2673094565 nodeName:}" failed. No retries permitted until 2026-07-24 17:17:47.59399779 +0000 UTC m=+3.075373393 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-cc2j4" (UniqueName: "kubernetes.io/projected/daf55067-cec7-4749-bdae-ad2673094565-kube-api-access-cc2j4") pod "network-check-target-smcsb" (UID: "daf55067-cec7-4749-bdae-ad2673094565") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:17:47.095464 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.095441    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8lpx\" (UniqueName: \"kubernetes.io/projected/cd3f02c9-192b-420b-9678-5ed4a7d251d8-kube-api-access-l8lpx\") pod \"network-metrics-daemon-mbmql\" (UID: \"cd3f02c9-192b-420b-9678-5ed4a7d251d8\") " pod="openshift-multus/network-metrics-daemon-mbmql"
Jul 24 17:17:47.097774 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.097750    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7tm2\" (UniqueName: \"kubernetes.io/projected/1304b910-2d54-4e7c-a0c3-4e323a8638e6-kube-api-access-l7tm2\") pod \"tuned-r488q\" (UID: \"1304b910-2d54-4e7c-a0c3-4e323a8638e6\") " pod="openshift-cluster-node-tuning-operator/tuned-r488q"
Jul 24 17:17:47.184620 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.184581    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ad858bfa-fc28-48fc-956e-607ae97a1d4a-socket-dir\") pod \"aws-ebs-csi-driver-node-rnkn8\" (UID: \"ad858bfa-fc28-48fc-956e-607ae97a1d4a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnkn8"
Jul 24 17:17:47.184813 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.184636    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d278b8d-3bae-40ee-9eaa-ce1f87ae92b8-tmp-dir\") pod \"node-resolver-zkp2w\" (UID: \"7d278b8d-3bae-40ee-9eaa-ce1f87ae92b8\") " pod="openshift-dns/node-resolver-zkp2w"
Jul 24 17:17:47.184813 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.184763    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cfdea065-5a0b-47a4-b4e7-d3decf5b18f2-host-run-multus-certs\") pod \"multus-f275z\" (UID: \"cfdea065-5a0b-47a4-b4e7-d3decf5b18f2\") " pod="openshift-multus/multus-f275z"
Jul 24 17:17:47.184813 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.184782    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ad858bfa-fc28-48fc-956e-607ae97a1d4a-socket-dir\") pod \"aws-ebs-csi-driver-node-rnkn8\" (UID: \"ad858bfa-fc28-48fc-956e-607ae97a1d4a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnkn8"
Jul 24 17:17:47.184989 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.184819    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cfdea065-5a0b-47a4-b4e7-d3decf5b18f2-multus-daemon-config\") pod \"multus-f275z\" (UID: \"cfdea065-5a0b-47a4-b4e7-d3decf5b18f2\") " pod="openshift-multus/multus-f275z"
Jul 24 17:17:47.184989 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.184845    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cfdea065-5a0b-47a4-b4e7-d3decf5b18f2-host-run-multus-certs\") pod \"multus-f275z\" (UID: \"cfdea065-5a0b-47a4-b4e7-d3decf5b18f2\") " pod="openshift-multus/multus-f275z"
Jul 24 17:17:47.184989 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.184852    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kprfk\" (UniqueName: \"kubernetes.io/projected/ad858bfa-fc28-48fc-956e-607ae97a1d4a-kube-api-access-kprfk\") pod \"aws-ebs-csi-driver-node-rnkn8\" (UID: \"ad858bfa-fc28-48fc-956e-607ae97a1d4a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnkn8"
Jul 24 17:17:47.184989 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.184882    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/911467b2-1015-4fec-a1ba-05ac34815af8-iptables-alerter-script\") pod \"iptables-alerter-q8p9j\" (UID: \"911467b2-1015-4fec-a1ba-05ac34815af8\") " pod="openshift-network-operator/iptables-alerter-q8p9j"
Jul 24 17:17:47.184989 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.184911    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d278b8d-3bae-40ee-9eaa-ce1f87ae92b8-tmp-dir\") pod \"node-resolver-zkp2w\" (UID: \"7d278b8d-3bae-40ee-9eaa-ce1f87ae92b8\") " pod="openshift-dns/node-resolver-zkp2w"
Jul 24 17:17:47.184989 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.184913    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cfdea065-5a0b-47a4-b4e7-d3decf5b18f2-cni-binary-copy\") pod \"multus-f275z\" (UID: \"cfdea065-5a0b-47a4-b4e7-d3decf5b18f2\") " pod="openshift-multus/multus-f275z"
Jul 24 17:17:47.184989 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.184966    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cfdea065-5a0b-47a4-b4e7-d3decf5b18f2-hostroot\") pod \"multus-f275z\" (UID: \"cfdea065-5a0b-47a4-b4e7-d3decf5b18f2\") " pod="openshift-multus/multus-f275z"
Jul 24 17:17:47.185362 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.185029    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3973a6c6-5e57-490f-a57d-6eed74df9217-serviceca\") pod \"node-ca-tctfm\" (UID: \"3973a6c6-5e57-490f-a57d-6eed74df9217\") " pod="openshift-image-registry/node-ca-tctfm"
Jul 24 17:17:47.185362 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.185056    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cfdea065-5a0b-47a4-b4e7-d3decf5b18f2-multus-socket-dir-parent\") pod \"multus-f275z\" (UID: \"cfdea065-5a0b-47a4-b4e7-d3decf5b18f2\") " pod="openshift-multus/multus-f275z"
Jul 24 17:17:47.185362 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.185084    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzcvj\" (UniqueName: \"kubernetes.io/projected/7d278b8d-3bae-40ee-9eaa-ce1f87ae92b8-kube-api-access-wzcvj\") pod \"node-resolver-zkp2w\" (UID: \"7d278b8d-3bae-40ee-9eaa-ce1f87ae92b8\") " pod="openshift-dns/node-resolver-zkp2w"
Jul 24 17:17:47.185362 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.185089    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cfdea065-5a0b-47a4-b4e7-d3decf5b18f2-hostroot\") pod \"multus-f275z\" (UID: \"cfdea065-5a0b-47a4-b4e7-d3decf5b18f2\") " pod="openshift-multus/multus-f275z"
Jul 24 17:17:47.185362 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.185111    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/911467b2-1015-4fec-a1ba-05ac34815af8-host-slash\") pod \"iptables-alerter-q8p9j\" (UID: \"911467b2-1015-4fec-a1ba-05ac34815af8\") " pod="openshift-network-operator/iptables-alerter-q8p9j"
Jul 24 17:17:47.185362 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.185162    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/911467b2-1015-4fec-a1ba-05ac34815af8-host-slash\") pod \"iptables-alerter-q8p9j\" (UID: \"911467b2-1015-4fec-a1ba-05ac34815af8\") " pod="openshift-network-operator/iptables-alerter-q8p9j"
Jul 24 17:17:47.185362 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.185167    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cfdea065-5a0b-47a4-b4e7-d3decf5b18f2-multus-socket-dir-parent\") pod \"multus-f275z\" (UID: \"cfdea065-5a0b-47a4-b4e7-d3decf5b18f2\") " pod="openshift-multus/multus-f275z"
Jul 24 17:17:47.185362 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.185201    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cfdea065-5a0b-47a4-b4e7-d3decf5b18f2-system-cni-dir\") pod \"multus-f275z\" (UID: \"cfdea065-5a0b-47a4-b4e7-d3decf5b18f2\") " pod="openshift-multus/multus-f275z"
Jul 24 17:17:47.185362 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.185257    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cfdea065-5a0b-47a4-b4e7-d3decf5b18f2-system-cni-dir\") pod \"multus-f275z\" (UID: \"cfdea065-5a0b-47a4-b4e7-d3decf5b18f2\") " pod="openshift-multus/multus-f275z"
Jul 24 17:17:47.185704 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.185394    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cfdea065-5a0b-47a4-b4e7-d3decf5b18f2-multus-daemon-config\") pod \"multus-f275z\" (UID: \"cfdea065-5a0b-47a4-b4e7-d3decf5b18f2\") " pod="openshift-multus/multus-f275z"
Jul 24 17:17:47.185704 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.185434    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cfdea065-5a0b-47a4-b4e7-d3decf5b18f2-host-run-netns\") pod \"multus-f275z\" (UID: \"cfdea065-5a0b-47a4-b4e7-d3decf5b18f2\") " pod="openshift-multus/multus-f275z"
Jul 24 17:17:47.185704 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.185460    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cfdea065-5a0b-47a4-b4e7-d3decf5b18f2-host-var-lib-cni-bin\") pod \"multus-f275z\" (UID: \"cfdea065-5a0b-47a4-b4e7-d3decf5b18f2\") " pod="openshift-multus/multus-f275z"
Jul 24 17:17:47.185704 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.185505    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cfdea065-5a0b-47a4-b4e7-d3decf5b18f2-host-run-netns\") pod \"multus-f275z\" (UID: \"cfdea065-5a0b-47a4-b4e7-d3decf5b18f2\") " pod="openshift-multus/multus-f275z"
Jul 24 17:17:47.185704 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.185505    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ad858bfa-fc28-48fc-956e-607ae97a1d4a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rnkn8\" (UID: \"ad858bfa-fc28-48fc-956e-607ae97a1d4a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnkn8"
Jul 24 17:17:47.185704 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.185553    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ad858bfa-fc28-48fc-956e-607ae97a1d4a-device-dir\") pod \"aws-ebs-csi-driver-node-rnkn8\" (UID: \"ad858bfa-fc28-48fc-956e-607ae97a1d4a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnkn8"
Jul 24 17:17:47.185704 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.185579    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqkhd\" (UniqueName: \"kubernetes.io/projected/cfdea065-5a0b-47a4-b4e7-d3decf5b18f2-kube-api-access-mqkhd\") pod \"multus-f275z\" (UID: \"cfdea065-5a0b-47a4-b4e7-d3decf5b18f2\") " pod="openshift-multus/multus-f275z"
Jul 24 17:17:47.185704 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.185595    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ad858bfa-fc28-48fc-956e-607ae97a1d4a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rnkn8\" (UID: \"ad858bfa-fc28-48fc-956e-607ae97a1d4a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnkn8"
Jul 24 17:17:47.185704 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.185553    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cfdea065-5a0b-47a4-b4e7-d3decf5b18f2-host-var-lib-cni-bin\") pod \"multus-f275z\" (UID: \"cfdea065-5a0b-47a4-b4e7-d3decf5b18f2\") " pod="openshift-multus/multus-f275z"
Jul 24 17:17:47.185704 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.185606    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3973a6c6-5e57-490f-a57d-6eed74df9217-host\") pod \"node-ca-tctfm\" (UID: \"3973a6c6-5e57-490f-a57d-6eed74df9217\") " pod="openshift-image-registry/node-ca-tctfm"
Jul 24 17:17:47.185704 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.185612    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3973a6c6-5e57-490f-a57d-6eed74df9217-serviceca\") pod \"node-ca-tctfm\" (UID: \"3973a6c6-5e57-490f-a57d-6eed74df9217\") " pod="openshift-image-registry/node-ca-tctfm"
Jul 24 17:17:47.185704 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.185642    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ad858bfa-fc28-48fc-956e-607ae97a1d4a-etc-selinux\") pod \"aws-ebs-csi-driver-node-rnkn8\" (UID: \"ad858bfa-fc28-48fc-956e-607ae97a1d4a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnkn8"
Jul 24 17:17:47.185704 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.185653    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ad858bfa-fc28-48fc-956e-607ae97a1d4a-device-dir\") pod \"aws-ebs-csi-driver-node-rnkn8\" (UID: \"ad858bfa-fc28-48fc-956e-607ae97a1d4a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnkn8"
Jul 24 17:17:47.185704 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.185656    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cfdea065-5a0b-47a4-b4e7-d3decf5b18f2-cni-binary-copy\") pod \"multus-f275z\" (UID: \"cfdea065-5a0b-47a4-b4e7-d3decf5b18f2\") " pod="openshift-multus/multus-f275z"
Jul 24 17:17:47.185704 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.185668    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ad858bfa-fc28-48fc-956e-607ae97a1d4a-sys-fs\") pod \"aws-ebs-csi-driver-node-rnkn8\" (UID: \"ad858bfa-fc28-48fc-956e-607ae97a1d4a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnkn8"
Jul 24 17:17:47.185704 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.185696    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7d278b8d-3bae-40ee-9eaa-ce1f87ae92b8-hosts-file\") pod \"node-resolver-zkp2w\" (UID: \"7d278b8d-3bae-40ee-9eaa-ce1f87ae92b8\") " pod="openshift-dns/node-resolver-zkp2w"
Jul 24 17:17:47.186473 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.185715    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ad858bfa-fc28-48fc-956e-607ae97a1d4a-sys-fs\") pod \"aws-ebs-csi-driver-node-rnkn8\" (UID: \"ad858bfa-fc28-48fc-956e-607ae97a1d4a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnkn8"
Jul 24 17:17:47.186473 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.185727    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cfdea065-5a0b-47a4-b4e7-d3decf5b18f2-os-release\") pod \"multus-f275z\" (UID: \"cfdea065-5a0b-47a4-b4e7-d3decf5b18f2\") " pod="openshift-multus/multus-f275z"
Jul 24 17:17:47.186473 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.185751    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvznn\" (UniqueName: \"kubernetes.io/projected/911467b2-1015-4fec-a1ba-05ac34815af8-kube-api-access-vvznn\") pod \"iptables-alerter-q8p9j\" (UID: \"911467b2-1015-4fec-a1ba-05ac34815af8\") " pod="openshift-network-operator/iptables-alerter-q8p9j"
Jul 24 17:17:47.186473 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.185767    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7d278b8d-3bae-40ee-9eaa-ce1f87ae92b8-hosts-file\") pod \"node-resolver-zkp2w\" (UID: \"7d278b8d-3bae-40ee-9eaa-ce1f87ae92b8\") " pod="openshift-dns/node-resolver-zkp2w"
Jul 24 17:17:47.186473 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.185784    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cfdea065-5a0b-47a4-b4e7-d3decf5b18f2-host-run-k8s-cni-cncf-io\") pod \"multus-f275z\" (UID: \"cfdea065-5a0b-47a4-b4e7-d3decf5b18f2\") " pod="openshift-multus/multus-f275z"
Jul 24 17:17:47.186473 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.185814    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cfdea065-5a0b-47a4-b4e7-d3decf5b18f2-multus-conf-dir\") pod \"multus-f275z\" (UID: \"cfdea065-5a0b-47a4-b4e7-d3decf5b18f2\") " pod="openshift-multus/multus-f275z"
Jul 24 17:17:47.186473 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.185840    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ad858bfa-fc28-48fc-956e-607ae97a1d4a-registration-dir\") pod \"aws-ebs-csi-driver-node-rnkn8\" (UID: \"ad858bfa-fc28-48fc-956e-607ae97a1d4a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnkn8"
Jul 24 17:17:47.186473 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.185860    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cfdea065-5a0b-47a4-b4e7-d3decf5b18f2-multus-cni-dir\") pod \"multus-f275z\" (UID: \"cfdea065-5a0b-47a4-b4e7-d3decf5b18f2\") " pod="openshift-multus/multus-f275z"
Jul 24 17:17:47.186473 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.185906    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cfdea065-5a0b-47a4-b4e7-d3decf5b18f2-multus-conf-dir\") pod \"multus-f275z\" (UID: \"cfdea065-5a0b-47a4-b4e7-d3decf5b18f2\") " pod="openshift-multus/multus-f275z"
Jul 24 17:17:47.186473 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.185918    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cfdea065-5a0b-47a4-b4e7-d3decf5b18f2-host-var-lib-cni-multus\") pod \"multus-f275z\" (UID: \"cfdea065-5a0b-47a4-b4e7-d3decf5b18f2\") " pod="openshift-multus/multus-f275z"
Jul 24 17:17:47.186473 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.185811    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cfdea065-5a0b-47a4-b4e7-d3decf5b18f2-os-release\") pod \"multus-f275z\" (UID: \"cfdea065-5a0b-47a4-b4e7-d3decf5b18f2\") " pod="openshift-multus/multus-f275z"
Jul 24 17:17:47.186473 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.185945    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cfdea065-5a0b-47a4-b4e7-d3decf5b18f2-etc-kubernetes\") pod \"multus-f275z\" (UID: \"cfdea065-5a0b-47a4-b4e7-d3decf5b18f2\") " pod="openshift-multus/multus-f275z"
Jul 24 17:17:47.186473 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.185917    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ad858bfa-fc28-48fc-956e-607ae97a1d4a-etc-selinux\") pod \"aws-ebs-csi-driver-node-rnkn8\" (UID: \"ad858bfa-fc28-48fc-956e-607ae97a1d4a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnkn8"
Jul 24 17:17:47.186473 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.185963    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cfdea065-5a0b-47a4-b4e7-d3decf5b18f2-host-run-k8s-cni-cncf-io\") pod \"multus-f275z\" (UID: \"cfdea065-5a0b-47a4-b4e7-d3decf5b18f2\") " pod="openshift-multus/multus-f275z"
Jul 24 17:17:47.186473 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.185980    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsqv2\" (UniqueName: \"kubernetes.io/projected/3973a6c6-5e57-490f-a57d-6eed74df9217-kube-api-access-rsqv2\") pod \"node-ca-tctfm\" (UID: \"3973a6c6-5e57-490f-a57d-6eed74df9217\") " pod="openshift-image-registry/node-ca-tctfm"
Jul 24 17:17:47.186473 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.185999    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3973a6c6-5e57-490f-a57d-6eed74df9217-host\") pod \"node-ca-tctfm\" (UID: \"3973a6c6-5e57-490f-a57d-6eed74df9217\") " pod="openshift-image-registry/node-ca-tctfm"
Jul 24 17:17:47.186473 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.186013    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cfdea065-5a0b-47a4-b4e7-d3decf5b18f2-cnibin\") pod \"multus-f275z\" (UID: \"cfdea065-5a0b-47a4-b4e7-d3decf5b18f2\") " pod="openshift-multus/multus-f275z"
Jul 24 17:17:47.186473 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.186043    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cfdea065-5a0b-47a4-b4e7-d3decf5b18f2-host-var-lib-kubelet\") pod \"multus-f275z\" (UID: \"cfdea065-5a0b-47a4-b4e7-d3decf5b18f2\") " pod="openshift-multus/multus-f275z"
Jul 24 17:17:47.187404 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.186045    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cfdea065-5a0b-47a4-b4e7-d3decf5b18f2-multus-cni-dir\") pod \"multus-f275z\" (UID: \"cfdea065-5a0b-47a4-b4e7-d3decf5b18f2\") " pod="openshift-multus/multus-f275z"
Jul 24 17:17:47.187404 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.186067    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ad858bfa-fc28-48fc-956e-607ae97a1d4a-registration-dir\") pod \"aws-ebs-csi-driver-node-rnkn8\" (UID: \"ad858bfa-fc28-48fc-956e-607ae97a1d4a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnkn8"
Jul 24 17:17:47.187404 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.186102    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cfdea065-5a0b-47a4-b4e7-d3decf5b18f2-etc-kubernetes\") pod \"multus-f275z\" (UID: \"cfdea065-5a0b-47a4-b4e7-d3decf5b18f2\") " pod="openshift-multus/multus-f275z"
Jul 24 17:17:47.187404 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.186124    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cfdea065-5a0b-47a4-b4e7-d3decf5b18f2-cnibin\") pod \"multus-f275z\" (UID: \"cfdea065-5a0b-47a4-b4e7-d3decf5b18f2\") " pod="openshift-multus/multus-f275z"
Jul 24 17:17:47.187404 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.186083    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cfdea065-5a0b-47a4-b4e7-d3decf5b18f2-host-var-lib-cni-multus\") pod \"multus-f275z\" (UID: \"cfdea065-5a0b-47a4-b4e7-d3decf5b18f2\") " pod="openshift-multus/multus-f275z"
Jul 24 17:17:47.187404 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.186146    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cfdea065-5a0b-47a4-b4e7-d3decf5b18f2-host-var-lib-kubelet\") pod \"multus-f275z\" (UID: \"cfdea065-5a0b-47a4-b4e7-d3decf5b18f2\") " pod="openshift-multus/multus-f275z"
Jul 24 17:17:47.187404 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.186151    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/911467b2-1015-4fec-a1ba-05ac34815af8-iptables-alerter-script\") pod \"iptables-alerter-q8p9j\" (UID: \"911467b2-1015-4fec-a1ba-05ac34815af8\") " pod="openshift-network-operator/iptables-alerter-q8p9j"
Jul 24 17:17:47.194573 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.194492    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzcvj\" (UniqueName: \"kubernetes.io/projected/7d278b8d-3bae-40ee-9eaa-ce1f87ae92b8-kube-api-access-wzcvj\") pod \"node-resolver-zkp2w\" (UID: \"7d278b8d-3bae-40ee-9eaa-ce1f87ae92b8\") " pod="openshift-dns/node-resolver-zkp2w"
Jul 24 17:17:47.194739 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.194582    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsqv2\" (UniqueName: \"kubernetes.io/projected/3973a6c6-5e57-490f-a57d-6eed74df9217-kube-api-access-rsqv2\") pod \"node-ca-tctfm\" (UID: \"3973a6c6-5e57-490f-a57d-6eed74df9217\") " pod="openshift-image-registry/node-ca-tctfm"
Jul 24 17:17:47.194739 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.194723    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kprfk\" (UniqueName: \"kubernetes.io/projected/ad858bfa-fc28-48fc-956e-607ae97a1d4a-kube-api-access-kprfk\") pod \"aws-ebs-csi-driver-node-rnkn8\" (UID: \"ad858bfa-fc28-48fc-956e-607ae97a1d4a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnkn8"
Jul 24 17:17:47.194982 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.194938    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvznn\" (UniqueName: \"kubernetes.io/projected/911467b2-1015-4fec-a1ba-05ac34815af8-kube-api-access-vvznn\") pod \"iptables-alerter-q8p9j\" (UID: \"911467b2-1015-4fec-a1ba-05ac34815af8\") " pod="openshift-network-operator/iptables-alerter-q8p9j"
Jul 24 17:17:47.195346 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.195327    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqkhd\" (UniqueName: \"kubernetes.io/projected/cfdea065-5a0b-47a4-b4e7-d3decf5b18f2-kube-api-access-mqkhd\") pod \"multus-f275z\" (UID: \"cfdea065-5a0b-47a4-b4e7-d3decf5b18f2\") " pod="openshift-multus/multus-f275z"
Jul 24 17:17:47.200992 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.200914    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-113.ec2.internal" event={"ID":"c18ae991b4af4fc40a66ddcd10c5c2c4","Type":"ContainerStarted","Data":"4ad75a5bc7080170a8715eae0b93cdf0ac041ff99907e81fc326a95f18e1b529"}
Jul 24 17:17:47.202741 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.202710    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-113.ec2.internal" event={"ID":"4461adb059f453352015b47510cb7325","Type":"ContainerStarted","Data":"87f1e1077c4c2b45579cee748f7b8d9ac6440b054027985b8622e70b3912335c"}
Jul 24 17:17:47.280046 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.280008    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r488q"
Jul 24 17:17:47.293768 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.293729    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-f275z"
Jul 24 17:17:47.303025 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.302981    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:17:47.309240 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.309212    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-25crs"
Jul 24 17:17:47.317446 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.317413    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7q78n"
Jul 24 17:17:47.326108 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.326079    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnkn8"
Jul 24 17:17:47.334461 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.334432    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zkp2w"
Jul 24 17:17:47.344876 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.344848    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tctfm"
Jul 24 17:17:47.352130 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.352105    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-q8p9j"
Jul 24 17:17:47.575815 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.575725    2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 17:17:47.589235 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.589203    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd3f02c9-192b-420b-9678-5ed4a7d251d8-metrics-certs\") pod \"network-metrics-daemon-mbmql\" (UID: \"cd3f02c9-192b-420b-9678-5ed4a7d251d8\") " pod="openshift-multus/network-metrics-daemon-mbmql"
Jul 24 17:17:47.589432 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.589251    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db784d54-1541-4c98-ae75-0f7234c48158-original-pull-secret\") pod \"global-pull-secret-syncer-7wvn9\" (UID: \"db784d54-1541-4c98-ae75-0f7234c48158\") " pod="kube-system/global-pull-secret-syncer-7wvn9"
Jul 24 17:17:47.589432 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:47.589380    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 17:17:47.589432 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:47.589386    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:17:47.589561 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:47.589459    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db784d54-1541-4c98-ae75-0f7234c48158-original-pull-secret podName:db784d54-1541-4c98-ae75-0f7234c48158 nodeName:}" failed. No retries permitted until 2026-07-24 17:17:48.589424323 +0000 UTC m=+4.070799926 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db784d54-1541-4c98-ae75-0f7234c48158-original-pull-secret") pod "global-pull-secret-syncer-7wvn9" (UID: "db784d54-1541-4c98-ae75-0f7234c48158") : object "kube-system"/"original-pull-secret" not registered
Jul 24 17:17:47.589561 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:47.589475    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd3f02c9-192b-420b-9678-5ed4a7d251d8-metrics-certs podName:cd3f02c9-192b-420b-9678-5ed4a7d251d8 nodeName:}" failed. No retries permitted until 2026-07-24 17:17:48.589466818 +0000 UTC m=+4.070842417 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd3f02c9-192b-420b-9678-5ed4a7d251d8-metrics-certs") pod "network-metrics-daemon-mbmql" (UID: "cd3f02c9-192b-420b-9678-5ed4a7d251d8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:17:47.690264 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:47.690221    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cc2j4\" (UniqueName: \"kubernetes.io/projected/daf55067-cec7-4749-bdae-ad2673094565-kube-api-access-cc2j4\") pod \"network-check-target-smcsb\" (UID: \"daf55067-cec7-4749-bdae-ad2673094565\") " pod="openshift-network-diagnostics/network-check-target-smcsb"
Jul 24 17:17:47.690503 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:47.690448    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 17:17:47.690503 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:47.690474    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 17:17:47.690503 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:47.690490    2575 projected.go:196] Error preparing data for projected volume kube-api-access-cc2j4 for pod openshift-network-diagnostics/network-check-target-smcsb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:17:47.690631 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:47.690567    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/daf55067-cec7-4749-bdae-ad2673094565-kube-api-access-cc2j4 podName:daf55067-cec7-4749-bdae-ad2673094565 nodeName:}" failed. No retries permitted until 2026-07-24 17:17:48.69054838 +0000 UTC m=+4.171923999 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-cc2j4" (UniqueName: "kubernetes.io/projected/daf55067-cec7-4749-bdae-ad2673094565-kube-api-access-cc2j4") pod "network-check-target-smcsb" (UID: "daf55067-cec7-4749-bdae-ad2673094565") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:17:48.014761 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:48.014709    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 17:12:47 +0000 UTC" deadline="2027-12-31 18:25:39.476548648 +0000 UTC"
Jul 24 17:17:48.014761 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:48.014754    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12601h7m51.461799544s"
Jul 24 17:17:48.196591 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:48.196513    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wvn9"
Jul 24 17:17:48.196745 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:48.196637    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wvn9" podUID="db784d54-1541-4c98-ae75-0f7234c48158"
Jul 24 17:17:48.318166 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:48.318063    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3973a6c6_5e57_490f_a57d_6eed74df9217.slice/crio-a30fbe7f78f2aff8c063ad59f8c2643b9813a94ac68aa25118fb838a38965dfd WatchSource:0}: Error finding container a30fbe7f78f2aff8c063ad59f8c2643b9813a94ac68aa25118fb838a38965dfd: Status 404 returned error can't find the container with id a30fbe7f78f2aff8c063ad59f8c2643b9813a94ac68aa25118fb838a38965dfd
Jul 24 17:17:48.320884 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:48.320819    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1304b910_2d54_4e7c_a0c3_4e323a8638e6.slice/crio-4c548203e7dbcc776817cebf91887088dec12b352c2d136a9aafbce5edf1f8ec WatchSource:0}: Error finding container 4c548203e7dbcc776817cebf91887088dec12b352c2d136a9aafbce5edf1f8ec: Status 404 returned error can't find the container with id 4c548203e7dbcc776817cebf91887088dec12b352c2d136a9aafbce5edf1f8ec
Jul 24 17:17:48.324346 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:48.324319    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfdea065_5a0b_47a4_b4e7_d3decf5b18f2.slice/crio-79fb364e4772916d4227e98c21a6281d06acfd5f1a04b719d2755f0d6fb3ca91 WatchSource:0}: Error finding container 79fb364e4772916d4227e98c21a6281d06acfd5f1a04b719d2755f0d6fb3ca91: Status 404 returned error can't find the container with id 79fb364e4772916d4227e98c21a6281d06acfd5f1a04b719d2755f0d6fb3ca91
Jul 24 17:17:48.325207 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:48.325185    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod911467b2_1015_4fec_a1ba_05ac34815af8.slice/crio-5dda58d4ddf5ac2320981f4d76d2ac11456d124298c5d002e3d1e8c223a8aac8 WatchSource:0}: Error finding container 5dda58d4ddf5ac2320981f4d76d2ac11456d124298c5d002e3d1e8c223a8aac8: Status 404 returned error can't find the container with id 5dda58d4ddf5ac2320981f4d76d2ac11456d124298c5d002e3d1e8c223a8aac8
Jul 24 17:17:48.326829 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:48.326803    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d278b8d_3bae_40ee_9eaa_ce1f87ae92b8.slice/crio-e4976e95fc2432520c55d953378de00721d4db216aa3215f61d794bb951bcac4 WatchSource:0}: Error finding container e4976e95fc2432520c55d953378de00721d4db216aa3215f61d794bb951bcac4: Status 404 returned error can't find the container with id e4976e95fc2432520c55d953378de00721d4db216aa3215f61d794bb951bcac4
Jul 24 17:17:48.345863 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:48.345822    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod693c1bd3_2e67_417e_8f91_aac3759a07d8.slice/crio-fb1ad9c2a4130d66d775bc86566d6516fe471418801c1b3bcf9b908e93bd7d1e WatchSource:0}: Error finding container fb1ad9c2a4130d66d775bc86566d6516fe471418801c1b3bcf9b908e93bd7d1e: Status 404 returned error can't find the container with id fb1ad9c2a4130d66d775bc86566d6516fe471418801c1b3bcf9b908e93bd7d1e
Jul 24 17:17:48.346462 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:48.346336    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae06c81f_d11d_4d26_9dc5_721f14bb9f7a.slice/crio-5f7c3f47081691366888c68bbea85d40b0318e922d812e9903761e82e824be9f WatchSource:0}: Error finding container 5f7c3f47081691366888c68bbea85d40b0318e922d812e9903761e82e824be9f: Status 404 returned error can't find the container with id 5f7c3f47081691366888c68bbea85d40b0318e922d812e9903761e82e824be9f
Jul 24 17:17:48.347313 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:17:48.347269    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod010c8b81_c5f5_43c3_b1bb_c812fcde2d6f.slice/crio-65b35e70db79c86b016de9e725ba4135d73c14f60fb3cc0fa032f0e315384435 WatchSource:0}: Error finding container 65b35e70db79c86b016de9e725ba4135d73c14f60fb3cc0fa032f0e315384435: Status 404 returned error can't find the container with id 65b35e70db79c86b016de9e725ba4135d73c14f60fb3cc0fa032f0e315384435
Jul 24 17:17:48.597669 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:48.597430    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db784d54-1541-4c98-ae75-0f7234c48158-original-pull-secret\") pod \"global-pull-secret-syncer-7wvn9\" (UID: \"db784d54-1541-4c98-ae75-0f7234c48158\") " pod="kube-system/global-pull-secret-syncer-7wvn9"
Jul 24 17:17:48.597831 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:48.597620    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 17:17:48.597895 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:48.597848    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:17:48.597895 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:48.597861    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db784d54-1541-4c98-ae75-0f7234c48158-original-pull-secret podName:db784d54-1541-4c98-ae75-0f7234c48158 nodeName:}" failed. No retries permitted until 2026-07-24 17:17:50.597836664 +0000 UTC m=+6.079212271 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db784d54-1541-4c98-ae75-0f7234c48158-original-pull-secret") pod "global-pull-secret-syncer-7wvn9" (UID: "db784d54-1541-4c98-ae75-0f7234c48158") : object "kube-system"/"original-pull-secret" not registered
Jul 24 17:17:48.597895 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:48.597758    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd3f02c9-192b-420b-9678-5ed4a7d251d8-metrics-certs\") pod \"network-metrics-daemon-mbmql\" (UID: \"cd3f02c9-192b-420b-9678-5ed4a7d251d8\") " pod="openshift-multus/network-metrics-daemon-mbmql"
Jul 24 17:17:48.598063 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:48.597916    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd3f02c9-192b-420b-9678-5ed4a7d251d8-metrics-certs podName:cd3f02c9-192b-420b-9678-5ed4a7d251d8 nodeName:}" failed. No retries permitted until 2026-07-24 17:17:50.597900289 +0000 UTC m=+6.079275890 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd3f02c9-192b-420b-9678-5ed4a7d251d8-metrics-certs") pod "network-metrics-daemon-mbmql" (UID: "cd3f02c9-192b-420b-9678-5ed4a7d251d8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:17:48.699222 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:48.699177    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cc2j4\" (UniqueName: \"kubernetes.io/projected/daf55067-cec7-4749-bdae-ad2673094565-kube-api-access-cc2j4\") pod \"network-check-target-smcsb\" (UID: \"daf55067-cec7-4749-bdae-ad2673094565\") " pod="openshift-network-diagnostics/network-check-target-smcsb"
Jul 24 17:17:48.699425 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:48.699403    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 17:17:48.699497 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:48.699426    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 17:17:48.699497 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:48.699441    2575 projected.go:196] Error preparing data for projected volume kube-api-access-cc2j4 for pod openshift-network-diagnostics/network-check-target-smcsb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:17:48.699594 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:48.699515    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/daf55067-cec7-4749-bdae-ad2673094565-kube-api-access-cc2j4 podName:daf55067-cec7-4749-bdae-ad2673094565 nodeName:}" failed. No retries permitted until 2026-07-24 17:17:50.699493441 +0000 UTC m=+6.180869040 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-cc2j4" (UniqueName: "kubernetes.io/projected/daf55067-cec7-4749-bdae-ad2673094565-kube-api-access-cc2j4") pod "network-check-target-smcsb" (UID: "daf55067-cec7-4749-bdae-ad2673094565") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:17:49.015782 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:49.015712    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 17:12:47 +0000 UTC" deadline="2028-04-30 20:24:35.16967578 +0000 UTC"
Jul 24 17:17:49.015782 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:49.015763    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15507h6m46.153917204s"
Jul 24 17:17:49.211923 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:49.210200    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbmql"
Jul 24 17:17:49.211923 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:49.210453    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbmql" podUID="cd3f02c9-192b-420b-9678-5ed4a7d251d8"
Jul 24 17:17:49.211923 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:49.211052    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-smcsb"
Jul 24 17:17:49.211923 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:49.211188    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-smcsb" podUID="daf55067-cec7-4749-bdae-ad2673094565"
Jul 24 17:17:49.232308 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:49.232270    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnkn8" event={"ID":"ad858bfa-fc28-48fc-956e-607ae97a1d4a","Type":"ContainerStarted","Data":"97eaf8ffdc285d8168e3e3f9a67711e4bc5c031b5e7d2cb1f7d984d6316b1ba2"}
Jul 24 17:17:49.239280 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:49.239220    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-25crs" event={"ID":"693c1bd3-2e67-417e-8f91-aac3759a07d8","Type":"ContainerStarted","Data":"fb1ad9c2a4130d66d775bc86566d6516fe471418801c1b3bcf9b908e93bd7d1e"}
Jul 24 17:17:49.256511 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:49.256452    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zkp2w" event={"ID":"7d278b8d-3bae-40ee-9eaa-ce1f87ae92b8","Type":"ContainerStarted","Data":"e4976e95fc2432520c55d953378de00721d4db216aa3215f61d794bb951bcac4"}
Jul 24 17:17:49.262699 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:49.262662    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-q8p9j" event={"ID":"911467b2-1015-4fec-a1ba-05ac34815af8","Type":"ContainerStarted","Data":"5dda58d4ddf5ac2320981f4d76d2ac11456d124298c5d002e3d1e8c223a8aac8"}
Jul 24 17:17:49.264719 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:49.264691    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tctfm" event={"ID":"3973a6c6-5e57-490f-a57d-6eed74df9217","Type":"ContainerStarted","Data":"a30fbe7f78f2aff8c063ad59f8c2643b9813a94ac68aa25118fb838a38965dfd"}
Jul 24 17:17:49.273457 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:49.273422    2575 generic.go:356] "Generic (PLEG): container finished" podID="c18ae991b4af4fc40a66ddcd10c5c2c4" containerID="920db28f89f99af5a487d976eda437b1171fd58b907274e1d71cf19bd895c7c7" exitCode=0
Jul 24 17:17:49.273816 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:49.273766    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-113.ec2.internal" event={"ID":"c18ae991b4af4fc40a66ddcd10c5c2c4","Type":"ContainerDied","Data":"920db28f89f99af5a487d976eda437b1171fd58b907274e1d71cf19bd895c7c7"}
Jul 24 17:17:49.296809 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:49.296761    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-113.ec2.internal" event={"ID":"4461adb059f453352015b47510cb7325","Type":"ContainerStarted","Data":"5c9c8addf3f7835edd4c0a881b898a3325dbd324e5fbf1d20964e8eb9469a920"}
Jul 24 17:17:49.310856 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:49.310779    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-f275z" event={"ID":"cfdea065-5a0b-47a4-b4e7-d3decf5b18f2","Type":"ContainerStarted","Data":"79fb364e4772916d4227e98c21a6281d06acfd5f1a04b719d2755f0d6fb3ca91"}
Jul 24 17:17:49.329777 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:49.329738    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r488q" event={"ID":"1304b910-2d54-4e7c-a0c3-4e323a8638e6","Type":"ContainerStarted","Data":"4c548203e7dbcc776817cebf91887088dec12b352c2d136a9aafbce5edf1f8ec"}
Jul 24 17:17:49.347578 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:49.347535    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-82s5l" event={"ID":"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f","Type":"ContainerStarted","Data":"65b35e70db79c86b016de9e725ba4135d73c14f60fb3cc0fa032f0e315384435"}
Jul 24 17:17:49.370911 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:49.370866    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7q78n" event={"ID":"ae06c81f-d11d-4d26-9dc5-721f14bb9f7a","Type":"ContainerStarted","Data":"5f7c3f47081691366888c68bbea85d40b0318e922d812e9903761e82e824be9f"}
Jul 24 17:17:50.195948 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:50.195870    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wvn9"
Jul 24 17:17:50.196445 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:50.196040    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wvn9" podUID="db784d54-1541-4c98-ae75-0f7234c48158"
Jul 24 17:17:50.391032 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:50.390436    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-113.ec2.internal" event={"ID":"c18ae991b4af4fc40a66ddcd10c5c2c4","Type":"ContainerStarted","Data":"b678174bb42f67bd5a5fa723e40a4dd0f8ec2b216afd5eb1f6b5c1cc2d7de04c"}
Jul 24 17:17:50.413898 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:50.413249    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-113.ec2.internal" podStartSLOduration=4.413223195 podStartE2EDuration="4.413223195s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:17:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:17:49.321050794 +0000 UTC m=+4.802426421" watchObservedRunningTime="2026-07-24 17:17:50.413223195 +0000 UTC m=+5.894598822"
Jul 24 17:17:50.625775 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:50.625682    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd3f02c9-192b-420b-9678-5ed4a7d251d8-metrics-certs\") pod \"network-metrics-daemon-mbmql\" (UID: \"cd3f02c9-192b-420b-9678-5ed4a7d251d8\") " pod="openshift-multus/network-metrics-daemon-mbmql"
Jul 24 17:17:50.625775 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:50.625752    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db784d54-1541-4c98-ae75-0f7234c48158-original-pull-secret\") pod \"global-pull-secret-syncer-7wvn9\" (UID: \"db784d54-1541-4c98-ae75-0f7234c48158\") " pod="kube-system/global-pull-secret-syncer-7wvn9"
Jul 24 17:17:50.626053 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:50.625909    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 17:17:50.626053 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:50.625980    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db784d54-1541-4c98-ae75-0f7234c48158-original-pull-secret podName:db784d54-1541-4c98-ae75-0f7234c48158 nodeName:}" failed. No retries permitted until 2026-07-24 17:17:54.625960126 +0000 UTC m=+10.107335756 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db784d54-1541-4c98-ae75-0f7234c48158-original-pull-secret") pod "global-pull-secret-syncer-7wvn9" (UID: "db784d54-1541-4c98-ae75-0f7234c48158") : object "kube-system"/"original-pull-secret" not registered
Jul 24 17:17:50.626439 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:50.626415    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:17:50.626525 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:50.626484    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd3f02c9-192b-420b-9678-5ed4a7d251d8-metrics-certs podName:cd3f02c9-192b-420b-9678-5ed4a7d251d8 nodeName:}" failed. No retries permitted until 2026-07-24 17:17:54.626465589 +0000 UTC m=+10.107841197 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd3f02c9-192b-420b-9678-5ed4a7d251d8-metrics-certs") pod "network-metrics-daemon-mbmql" (UID: "cd3f02c9-192b-420b-9678-5ed4a7d251d8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:17:50.727182 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:50.726380    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cc2j4\" (UniqueName: \"kubernetes.io/projected/daf55067-cec7-4749-bdae-ad2673094565-kube-api-access-cc2j4\") pod \"network-check-target-smcsb\" (UID: \"daf55067-cec7-4749-bdae-ad2673094565\") " pod="openshift-network-diagnostics/network-check-target-smcsb"
Jul 24 17:17:50.727182 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:50.726644    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 17:17:50.727182 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:50.726669    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 17:17:50.727182 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:50.726686    2575 projected.go:196] Error preparing data for projected volume kube-api-access-cc2j4 for pod openshift-network-diagnostics/network-check-target-smcsb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:17:50.727182 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:50.726753    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/daf55067-cec7-4749-bdae-ad2673094565-kube-api-access-cc2j4 podName:daf55067-cec7-4749-bdae-ad2673094565 nodeName:}" failed. No retries permitted until 2026-07-24 17:17:54.726732037 +0000 UTC m=+10.208107659 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-cc2j4" (UniqueName: "kubernetes.io/projected/daf55067-cec7-4749-bdae-ad2673094565-kube-api-access-cc2j4") pod "network-check-target-smcsb" (UID: "daf55067-cec7-4749-bdae-ad2673094565") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:17:51.199137 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:51.198419    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbmql"
Jul 24 17:17:51.199137 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:51.198572    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbmql" podUID="cd3f02c9-192b-420b-9678-5ed4a7d251d8"
Jul 24 17:17:51.199137 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:51.198974    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-smcsb"
Jul 24 17:17:51.199137 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:51.199085    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-smcsb" podUID="daf55067-cec7-4749-bdae-ad2673094565"
Jul 24 17:17:52.196440 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:52.196401    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wvn9"
Jul 24 17:17:52.196678 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:52.196560    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wvn9" podUID="db784d54-1541-4c98-ae75-0f7234c48158"
Jul 24 17:17:53.197747 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:53.197106    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbmql"
Jul 24 17:17:53.197747 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:53.197121    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-smcsb"
Jul 24 17:17:53.197747 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:53.197283    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbmql" podUID="cd3f02c9-192b-420b-9678-5ed4a7d251d8"
Jul 24 17:17:53.197747 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:53.197418    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-smcsb" podUID="daf55067-cec7-4749-bdae-ad2673094565"
Jul 24 17:17:54.196643 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:54.196127    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wvn9"
Jul 24 17:17:54.196643 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:54.196258    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wvn9" podUID="db784d54-1541-4c98-ae75-0f7234c48158"
Jul 24 17:17:54.665537 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:54.665443    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db784d54-1541-4c98-ae75-0f7234c48158-original-pull-secret\") pod \"global-pull-secret-syncer-7wvn9\" (UID: \"db784d54-1541-4c98-ae75-0f7234c48158\") " pod="kube-system/global-pull-secret-syncer-7wvn9"
Jul 24 17:17:54.665998 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:54.665620    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd3f02c9-192b-420b-9678-5ed4a7d251d8-metrics-certs\") pod \"network-metrics-daemon-mbmql\" (UID: \"cd3f02c9-192b-420b-9678-5ed4a7d251d8\") " pod="openshift-multus/network-metrics-daemon-mbmql"
Jul 24 17:17:54.665998 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:54.665640    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 17:17:54.665998 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:54.665720    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db784d54-1541-4c98-ae75-0f7234c48158-original-pull-secret podName:db784d54-1541-4c98-ae75-0f7234c48158 nodeName:}" failed. No retries permitted until 2026-07-24 17:18:02.665698957 +0000 UTC m=+18.147074578 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db784d54-1541-4c98-ae75-0f7234c48158-original-pull-secret") pod "global-pull-secret-syncer-7wvn9" (UID: "db784d54-1541-4c98-ae75-0f7234c48158") : object "kube-system"/"original-pull-secret" not registered
Jul 24 17:17:54.665998 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:54.665732    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:17:54.665998 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:54.665779    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd3f02c9-192b-420b-9678-5ed4a7d251d8-metrics-certs podName:cd3f02c9-192b-420b-9678-5ed4a7d251d8 nodeName:}" failed. No retries permitted until 2026-07-24 17:18:02.665763359 +0000 UTC m=+18.147138971 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd3f02c9-192b-420b-9678-5ed4a7d251d8-metrics-certs") pod "network-metrics-daemon-mbmql" (UID: "cd3f02c9-192b-420b-9678-5ed4a7d251d8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:17:54.766377 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:54.766339    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cc2j4\" (UniqueName: \"kubernetes.io/projected/daf55067-cec7-4749-bdae-ad2673094565-kube-api-access-cc2j4\") pod \"network-check-target-smcsb\" (UID: \"daf55067-cec7-4749-bdae-ad2673094565\") " pod="openshift-network-diagnostics/network-check-target-smcsb"
Jul 24 17:17:54.766739 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:54.766537    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 17:17:54.766739 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:54.766572    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 17:17:54.766739 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:54.766587    2575 projected.go:196] Error preparing data for projected volume kube-api-access-cc2j4 for pod openshift-network-diagnostics/network-check-target-smcsb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:17:54.766739 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:54.766657    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/daf55067-cec7-4749-bdae-ad2673094565-kube-api-access-cc2j4 podName:daf55067-cec7-4749-bdae-ad2673094565 nodeName:}" failed. No retries permitted until 2026-07-24 17:18:02.766638606 +0000 UTC m=+18.248014231 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-cc2j4" (UniqueName: "kubernetes.io/projected/daf55067-cec7-4749-bdae-ad2673094565-kube-api-access-cc2j4") pod "network-check-target-smcsb" (UID: "daf55067-cec7-4749-bdae-ad2673094565") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:17:55.198362 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:55.197671    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbmql"
Jul 24 17:17:55.198362 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:55.197822    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbmql" podUID="cd3f02c9-192b-420b-9678-5ed4a7d251d8"
Jul 24 17:17:55.198362 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:55.198216    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-smcsb"
Jul 24 17:17:55.198362 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:55.198313    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-smcsb" podUID="daf55067-cec7-4749-bdae-ad2673094565"
Jul 24 17:17:56.196005 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:56.195953    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wvn9"
Jul 24 17:17:56.196557 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:56.196097    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wvn9" podUID="db784d54-1541-4c98-ae75-0f7234c48158"
Jul 24 17:17:57.196852 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:57.196815    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbmql"
Jul 24 17:17:57.197340 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:57.196993    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbmql" podUID="cd3f02c9-192b-420b-9678-5ed4a7d251d8"
Jul 24 17:17:57.197607 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:57.197466    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-smcsb"
Jul 24 17:17:57.197607 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:57.197567    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-smcsb" podUID="daf55067-cec7-4749-bdae-ad2673094565"
Jul 24 17:17:58.196208 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:58.196164    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wvn9"
Jul 24 17:17:58.196457 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:58.196307    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wvn9" podUID="db784d54-1541-4c98-ae75-0f7234c48158"
Jul 24 17:17:59.196951 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:59.196898    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbmql"
Jul 24 17:17:59.197410 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:17:59.196898    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-smcsb"
Jul 24 17:17:59.197410 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:59.197075    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbmql" podUID="cd3f02c9-192b-420b-9678-5ed4a7d251d8"
Jul 24 17:17:59.197410 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:17:59.197125    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-smcsb" podUID="daf55067-cec7-4749-bdae-ad2673094565"
Jul 24 17:18:00.196788 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:00.196751    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wvn9"
Jul 24 17:18:00.196994 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:18:00.196894    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wvn9" podUID="db784d54-1541-4c98-ae75-0f7234c48158"
Jul 24 17:18:01.196688 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:01.196651    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbmql"
Jul 24 17:18:01.196688 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:01.196690    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-smcsb"
Jul 24 17:18:01.196961 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:18:01.196810    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbmql" podUID="cd3f02c9-192b-420b-9678-5ed4a7d251d8"
Jul 24 17:18:01.197018 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:18:01.196974    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-smcsb" podUID="daf55067-cec7-4749-bdae-ad2673094565"
Jul 24 17:18:02.196578 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:02.196535    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wvn9"
Jul 24 17:18:02.196793 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:18:02.196669    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wvn9" podUID="db784d54-1541-4c98-ae75-0f7234c48158"
Jul 24 17:18:02.734542 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:02.734515    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db784d54-1541-4c98-ae75-0f7234c48158-original-pull-secret\") pod \"global-pull-secret-syncer-7wvn9\" (UID: \"db784d54-1541-4c98-ae75-0f7234c48158\") " pod="kube-system/global-pull-secret-syncer-7wvn9"
Jul 24 17:18:02.734899 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:02.734580    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd3f02c9-192b-420b-9678-5ed4a7d251d8-metrics-certs\") pod \"network-metrics-daemon-mbmql\" (UID: \"cd3f02c9-192b-420b-9678-5ed4a7d251d8\") " pod="openshift-multus/network-metrics-daemon-mbmql"
Jul 24 17:18:02.734899 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:18:02.734656    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 17:18:02.734899 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:18:02.734673    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:18:02.734899 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:18:02.734726    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db784d54-1541-4c98-ae75-0f7234c48158-original-pull-secret podName:db784d54-1541-4c98-ae75-0f7234c48158 nodeName:}" failed. No retries permitted until 2026-07-24 17:18:18.734702805 +0000 UTC m=+34.216078424 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db784d54-1541-4c98-ae75-0f7234c48158-original-pull-secret") pod "global-pull-secret-syncer-7wvn9" (UID: "db784d54-1541-4c98-ae75-0f7234c48158") : object "kube-system"/"original-pull-secret" not registered
Jul 24 17:18:02.734899 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:18:02.734741    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd3f02c9-192b-420b-9678-5ed4a7d251d8-metrics-certs podName:cd3f02c9-192b-420b-9678-5ed4a7d251d8 nodeName:}" failed. No retries permitted until 2026-07-24 17:18:18.734734962 +0000 UTC m=+34.216110565 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd3f02c9-192b-420b-9678-5ed4a7d251d8-metrics-certs") pod "network-metrics-daemon-mbmql" (UID: "cd3f02c9-192b-420b-9678-5ed4a7d251d8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:18:02.835180 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:02.835139    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cc2j4\" (UniqueName: \"kubernetes.io/projected/daf55067-cec7-4749-bdae-ad2673094565-kube-api-access-cc2j4\") pod \"network-check-target-smcsb\" (UID: \"daf55067-cec7-4749-bdae-ad2673094565\") " pod="openshift-network-diagnostics/network-check-target-smcsb"
Jul 24 17:18:02.835350 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:18:02.835271    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 17:18:02.835350 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:18:02.835292    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 17:18:02.835350 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:18:02.835302    2575 projected.go:196] Error preparing data for projected volume kube-api-access-cc2j4 for pod openshift-network-diagnostics/network-check-target-smcsb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:18:02.835469 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:18:02.835358    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/daf55067-cec7-4749-bdae-ad2673094565-kube-api-access-cc2j4 podName:daf55067-cec7-4749-bdae-ad2673094565 nodeName:}" failed. No retries permitted until 2026-07-24 17:18:18.835341354 +0000 UTC m=+34.316716958 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-cc2j4" (UniqueName: "kubernetes.io/projected/daf55067-cec7-4749-bdae-ad2673094565-kube-api-access-cc2j4") pod "network-check-target-smcsb" (UID: "daf55067-cec7-4749-bdae-ad2673094565") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:18:03.196857 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:03.196816    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbmql"
Jul 24 17:18:03.197063 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:03.196863    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-smcsb"
Jul 24 17:18:03.197063 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:18:03.196966    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbmql" podUID="cd3f02c9-192b-420b-9678-5ed4a7d251d8"
Jul 24 17:18:03.197179 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:18:03.197110    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-smcsb" podUID="daf55067-cec7-4749-bdae-ad2673094565"
Jul 24 17:18:04.196459 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:04.196422    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wvn9"
Jul 24 17:18:04.196899 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:18:04.196548    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wvn9" podUID="db784d54-1541-4c98-ae75-0f7234c48158"
Jul 24 17:18:05.197439 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:05.197403    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbmql"
Jul 24 17:18:05.197908 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:18:05.197530    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbmql" podUID="cd3f02c9-192b-420b-9678-5ed4a7d251d8"
Jul 24 17:18:05.197908 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:05.197589    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-smcsb"
Jul 24 17:18:05.197908 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:18:05.197683    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-smcsb" podUID="daf55067-cec7-4749-bdae-ad2673094565"
Jul 24 17:18:06.196382 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:06.196341    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wvn9"
Jul 24 17:18:06.196560 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:18:06.196492    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wvn9" podUID="db784d54-1541-4c98-ae75-0f7234c48158"
Jul 24 17:18:07.196173 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:07.196126    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbmql"
Jul 24 17:18:07.196564 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:07.196125    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-smcsb"
Jul 24 17:18:07.196564 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:18:07.196273    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbmql" podUID="cd3f02c9-192b-420b-9678-5ed4a7d251d8"
Jul 24 17:18:07.196564 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:18:07.196305    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-smcsb" podUID="daf55067-cec7-4749-bdae-ad2673094565"
Jul 24 17:18:07.427229 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:07.426995    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-f275z" event={"ID":"cfdea065-5a0b-47a4-b4e7-d3decf5b18f2","Type":"ContainerStarted","Data":"09ffc6dc7efd60d0636d78fa2ade92bb4c2f18368888d3e4b7fb408343a5a11d"}
Jul 24 17:18:07.428673 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:07.428641    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r488q" event={"ID":"1304b910-2d54-4e7c-a0c3-4e323a8638e6","Type":"ContainerStarted","Data":"15bda4239820bd1a8970c7baec2207e4f495b9a6ef33a6d797e4b910d23b1177"}
Jul 24 17:18:07.430256 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:07.430222    2575 generic.go:356] "Generic (PLEG): container finished" podID="ae06c81f-d11d-4d26-9dc5-721f14bb9f7a" containerID="92b11848dd5b377ebf2b684f774d142bd71dca8597df8df56d0b210444ffd979" exitCode=0
Jul 24 17:18:07.430356 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:07.430320    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7q78n" event={"ID":"ae06c81f-d11d-4d26-9dc5-721f14bb9f7a","Type":"ContainerDied","Data":"92b11848dd5b377ebf2b684f774d142bd71dca8597df8df56d0b210444ffd979"}
Jul 24 17:18:07.431930 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:07.431902    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnkn8" event={"ID":"ad858bfa-fc28-48fc-956e-607ae97a1d4a","Type":"ContainerStarted","Data":"9b99ee7974b5f6c0948741b6bffacde052617a6bb85170258ca87d7e1025c04d"}
Jul 24 17:18:07.433668 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:07.433644    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-25crs" event={"ID":"693c1bd3-2e67-417e-8f91-aac3759a07d8","Type":"ContainerStarted","Data":"a80761c4996450b9e7219c840f9eeb4a7f8584cb1f684f8017288e0db16943e6"}
Jul 24 17:18:07.435073 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:07.435053    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zkp2w" event={"ID":"7d278b8d-3bae-40ee-9eaa-ce1f87ae92b8","Type":"ContainerStarted","Data":"7ba4698ceaf5c915db1474a35479dfd1fada16b2b54a19b3bf6016320b8f028b"}
Jul 24 17:18:07.447294 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:07.447243    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-113.ec2.internal" podStartSLOduration=21.447226974 podStartE2EDuration="21.447226974s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:17:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:17:50.41387924 +0000 UTC m=+5.895254865" watchObservedRunningTime="2026-07-24 17:18:07.447226974 +0000 UTC m=+22.928602593"
Jul 24 17:18:07.447441 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:07.447322    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-f275z" podStartSLOduration=3.685793905 podStartE2EDuration="22.44731667s" totalImagesPullingTime="18.761522765s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:17:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:18:07.446771907 +0000 UTC m=+22.928147528" watchObservedRunningTime="2026-07-24 17:18:07.44731667 +0000 UTC m=+22.928692289"
Jul 24 17:18:07.462251 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:07.462202    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-zkp2w" podStartSLOduration=3.749641581 podStartE2EDuration="22.46218519s" totalImagesPullingTime="18.712543609s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:17:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:18:07.461671809 +0000 UTC m=+22.943047429" watchObservedRunningTime="2026-07-24 17:18:07.46218519 +0000 UTC m=+22.943560809"
Jul 24 17:18:07.483581 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:07.483532    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-r488q" podStartSLOduration=3.751837038 podStartE2EDuration="22.483515105s" totalImagesPullingTime="18.731678067s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:17:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:18:07.483446667 +0000 UTC m=+22.964822335" watchObservedRunningTime="2026-07-24 17:18:07.483515105 +0000 UTC m=+22.964890724"
Jul 24 17:18:07.498006 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:07.497962    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-25crs" podStartSLOduration=8.122618754 podStartE2EDuration="22.497923691s" totalImagesPullingTime="14.375304937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:17:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:18:07.497299472 +0000 UTC m=+22.978675182" watchObservedRunningTime="2026-07-24 17:18:07.497923691 +0000 UTC m=+22.979299311"
Jul 24 17:18:07.627085 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:07.627053    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:18:07.703028 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:07.702802    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:18:08.196258 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:08.196222    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wvn9"
Jul 24 17:18:08.196994 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:18:08.196334    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wvn9" podUID="db784d54-1541-4c98-ae75-0f7234c48158"
Jul 24 17:18:08.439618 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:08.439580    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-q8p9j" event={"ID":"911467b2-1015-4fec-a1ba-05ac34815af8","Type":"ContainerStarted","Data":"decc397f5370042dbc7c89418c1e278fe73894d3b1256dbe86c68d8dfe6a48d5"}
Jul 24 17:18:08.441288 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:08.441251    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tctfm" event={"ID":"3973a6c6-5e57-490f-a57d-6eed74df9217","Type":"ContainerStarted","Data":"71c7be54b58c5e5bac1693efff3242e2bbc3784567adb6cb6a0ba8e1d0c7a3cf"}
Jul 24 17:18:08.444512 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:08.444488    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82s5l_010c8b81-c5f5-43c3-b1bb-c812fcde2d6f/ovn-acl-logging/0.log"
Jul 24 17:18:08.444993 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:08.444963    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-82s5l" event={"ID":"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f","Type":"ContainerStarted","Data":"13d1be409a79738a5c097aae9c212402e47bc500b56f85b1117c9530e3dcaf65"}
Jul 24 17:18:08.445127 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:08.445039    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-82s5l" event={"ID":"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f","Type":"ContainerStarted","Data":"ab7a819608ea3c27e8877339a2ddd989c48bb6ee919b9f61b517c23f39e40fe2"}
Jul 24 17:18:08.445127 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:08.444963    2575 generic.go:356] "Generic (PLEG): container finished" podID="010c8b81-c5f5-43c3-b1bb-c812fcde2d6f" containerID="98bdaaa56e6a4ab1ce70eb2caff3aed60e3d205c7931fb5f1d977936a0348df9" exitCode=1
Jul 24 17:18:08.445127 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:08.445069    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-82s5l" event={"ID":"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f","Type":"ContainerStarted","Data":"284601956f92bd594635f7d748752c31b0a1da1893733b038a977aebc034b3d4"}
Jul 24 17:18:08.445127 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:08.445112    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-82s5l" event={"ID":"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f","Type":"ContainerStarted","Data":"b72fab35c62ef9a1de2d7918d1001a399627419c588ea453813c89308a0b9bc9"}
Jul 24 17:18:08.445332 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:08.445160    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-82s5l" event={"ID":"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f","Type":"ContainerDied","Data":"98bdaaa56e6a4ab1ce70eb2caff3aed60e3d205c7931fb5f1d977936a0348df9"}
Jul 24 17:18:08.445332 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:08.445208    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-82s5l" event={"ID":"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f","Type":"ContainerStarted","Data":"d911a794d20de002106da513eb2498ee200f5f9bdd7cfb26e613460632b05c72"}
Jul 24 17:18:08.455855 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:08.455790    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-q8p9j" podStartSLOduration=4.786118166 podStartE2EDuration="23.455776912s" totalImagesPullingTime="18.669658746s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:17:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:18:08.455559143 +0000 UTC m=+23.936934762" watchObservedRunningTime="2026-07-24 17:18:08.455776912 +0000 UTC m=+23.937152541"
Jul 24 17:18:08.469917 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:08.469870    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-tctfm" podStartSLOduration=4.738943795 podStartE2EDuration="23.469854693s" totalImagesPullingTime="18.730910898s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:17:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:18:08.469845554 +0000 UTC m=+23.951221174" watchObservedRunningTime="2026-07-24 17:18:08.469854693 +0000 UTC m=+23.951230313"
Jul 24 17:18:08.559126 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:08.559083    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:18:08.634213 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:08.634188    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:18:08.664257 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:08.664228    2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 24 17:18:09.051346 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:09.051203    2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-24T17:18:08.664249628Z","UUID":"ae5500c1-fbc0-4442-8af1-62077cfaa37a","Handler":null,"Name":"","Endpoint":""}
Jul 24 17:18:09.056688 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:09.056652    2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 24 17:18:09.056868 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:09.056710    2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 24 17:18:09.196612 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:09.196572    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbmql"
Jul 24 17:18:09.196612 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:09.196608    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-smcsb"
Jul 24 17:18:09.197238 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:18:09.196739    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbmql" podUID="cd3f02c9-192b-420b-9678-5ed4a7d251d8"
Jul 24 17:18:09.197238 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:18:09.196847    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-smcsb" podUID="daf55067-cec7-4749-bdae-ad2673094565"
Jul 24 17:18:09.450969 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:09.450830    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnkn8" event={"ID":"ad858bfa-fc28-48fc-956e-607ae97a1d4a","Type":"ContainerStarted","Data":"4fe06ad2de7ebd3125e2d07c7bf7bf4325f3679f2a2f053de7569704d0196276"}
Jul 24 17:18:10.196132 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:10.196100    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wvn9"
Jul 24 17:18:10.196311 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:18:10.196222    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wvn9" podUID="db784d54-1541-4c98-ae75-0f7234c48158"
Jul 24 17:18:10.457201 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:10.457121    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82s5l_010c8b81-c5f5-43c3-b1bb-c812fcde2d6f/ovn-acl-logging/0.log"
Jul 24 17:18:10.457644 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:10.457528    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-82s5l" event={"ID":"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f","Type":"ContainerStarted","Data":"e1f734e0f799aad6691496e5c2543f26fe72414aad500b9d8ce33ee55ede222c"}
Jul 24 17:18:10.459808 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:10.459779    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnkn8" event={"ID":"ad858bfa-fc28-48fc-956e-607ae97a1d4a","Type":"ContainerStarted","Data":"9dc926bb8ac80e74df76c6bd8686c10bc107f021ea577677ca60d5aee049cb93"}
Jul 24 17:18:10.477871 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:10.477814    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rnkn8" podStartSLOduration=8.391414209 podStartE2EDuration="25.477796692s" totalImagesPullingTime="17.086382483s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:17:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:18:10.476306926 +0000 UTC m=+25.957682580" watchObservedRunningTime="2026-07-24 17:18:10.477796692 +0000 UTC m=+25.959172311"
Jul 24 17:18:11.196116 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:11.195849    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbmql"
Jul 24 17:18:11.196301 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:11.195901    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-smcsb"
Jul 24 17:18:11.196301 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:18:11.196231    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbmql" podUID="cd3f02c9-192b-420b-9678-5ed4a7d251d8"
Jul 24 17:18:11.196387 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:18:11.196296    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-smcsb" podUID="daf55067-cec7-4749-bdae-ad2673094565"
Jul 24 17:18:12.113610 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:12.113568    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-25crs"
Jul 24 17:18:12.114236 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:12.114212    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-25crs"
Jul 24 17:18:12.196648 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:12.196611    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wvn9"
Jul 24 17:18:12.196840 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:18:12.196737    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wvn9" podUID="db784d54-1541-4c98-ae75-0f7234c48158"
Jul 24 17:18:12.464411 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:12.464324    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-25crs"
Jul 24 17:18:12.464839 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:12.464813    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-25crs"
Jul 24 17:18:12.523613 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:12.523573    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:18:13.197392 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:13.196832    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbmql"
Jul 24 17:18:13.197392 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:18:13.197238    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbmql" podUID="cd3f02c9-192b-420b-9678-5ed4a7d251d8"
Jul 24 17:18:13.198254 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:13.197026    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-smcsb"
Jul 24 17:18:13.198254 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:18:13.197689    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-smcsb" podUID="daf55067-cec7-4749-bdae-ad2673094565"
Jul 24 17:18:13.470127 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:13.470100    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82s5l_010c8b81-c5f5-43c3-b1bb-c812fcde2d6f/ovn-acl-logging/0.log"
Jul 24 17:18:13.470504 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:13.470475    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-82s5l" event={"ID":"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f","Type":"ContainerStarted","Data":"5fc4275283c86a013378204d177b25e436abbebce8def8f22f367e6a954676b2"}
Jul 24 17:18:13.470759 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:13.470743    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:18:13.470976 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:13.470955    2575 scope.go:117] "RemoveContainer" containerID="98bdaaa56e6a4ab1ce70eb2caff3aed60e3d205c7931fb5f1d977936a0348df9"
Jul 24 17:18:13.472486 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:13.472434    2575 generic.go:356] "Generic (PLEG): container finished" podID="ae06c81f-d11d-4d26-9dc5-721f14bb9f7a" containerID="afc3f9ad092bffe99173c0d0b7a85dd8beb59a46e1b8ad6608102d5b5fcaea87" exitCode=0
Jul 24 17:18:13.472627 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:13.472512    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7q78n" event={"ID":"ae06c81f-d11d-4d26-9dc5-721f14bb9f7a","Type":"ContainerDied","Data":"afc3f9ad092bffe99173c0d0b7a85dd8beb59a46e1b8ad6608102d5b5fcaea87"}
Jul 24 17:18:13.488970 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:13.488925    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:18:14.197615 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:14.196182    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wvn9"
Jul 24 17:18:14.197615 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:18:14.196330    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wvn9" podUID="db784d54-1541-4c98-ae75-0f7234c48158"
Jul 24 17:18:14.479242 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:14.479221    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82s5l_010c8b81-c5f5-43c3-b1bb-c812fcde2d6f/ovn-acl-logging/0.log"
Jul 24 17:18:14.479743 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:14.479700    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-82s5l" event={"ID":"010c8b81-c5f5-43c3-b1bb-c812fcde2d6f","Type":"ContainerStarted","Data":"b68786b8a2d61a36840785ed729f8812df876bf06ec085be1530366ee5e62047"}
Jul 24 17:18:14.480268 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:14.480246    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:18:14.480472 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:14.480453    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:18:14.498632 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:14.498589    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:18:14.510155 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:14.510106    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-82s5l" podStartSLOduration=10.557607136 podStartE2EDuration="29.510091819s" totalImagesPullingTime="18.952484683s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:17:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:18:14.509631337 +0000 UTC m=+29.991006998" watchObservedRunningTime="2026-07-24 17:18:14.510091819 +0000 UTC m=+29.991467438"
Jul 24 17:18:14.918421 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:14.918389    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-smcsb"]
Jul 24 17:18:14.918584 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:14.918523    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-smcsb"
Jul 24 17:18:14.918659 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:18:14.918634    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-smcsb" podUID="daf55067-cec7-4749-bdae-ad2673094565"
Jul 24 17:18:14.921960 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:14.921910    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7wvn9"]
Jul 24 17:18:14.922110 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:14.922036    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wvn9"
Jul 24 17:18:14.922171 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:18:14.922121    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wvn9" podUID="db784d54-1541-4c98-ae75-0f7234c48158"
Jul 24 17:18:14.922871 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:14.922837    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mbmql"]
Jul 24 17:18:14.923021 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:14.922964    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbmql"
Jul 24 17:18:14.923094 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:18:14.923067    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbmql" podUID="cd3f02c9-192b-420b-9678-5ed4a7d251d8"
Jul 24 17:18:15.484486 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:15.484444    2575 generic.go:356] "Generic (PLEG): container finished" podID="ae06c81f-d11d-4d26-9dc5-721f14bb9f7a" containerID="e400883297e89c916d3bb62cb52b4c8a2ab124e28d897e7122d28f0bc0d0f112" exitCode=0
Jul 24 17:18:15.485000 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:15.484533    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7q78n" event={"ID":"ae06c81f-d11d-4d26-9dc5-721f14bb9f7a","Type":"ContainerDied","Data":"e400883297e89c916d3bb62cb52b4c8a2ab124e28d897e7122d28f0bc0d0f112"}
Jul 24 17:18:16.196708 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:16.196664    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wvn9"
Jul 24 17:18:16.196888 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:18:16.196784    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wvn9" podUID="db784d54-1541-4c98-ae75-0f7234c48158"
Jul 24 17:18:17.196746 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:17.196558    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-smcsb"
Jul 24 17:18:17.197233 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:17.196558    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbmql"
Jul 24 17:18:17.197233 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:18:17.196853    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-smcsb" podUID="daf55067-cec7-4749-bdae-ad2673094565"
Jul 24 17:18:17.197233 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:18:17.196923    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbmql" podUID="cd3f02c9-192b-420b-9678-5ed4a7d251d8"
Jul 24 17:18:17.492042 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:17.491957    2575 generic.go:356] "Generic (PLEG): container finished" podID="ae06c81f-d11d-4d26-9dc5-721f14bb9f7a" containerID="d44a3091104b52a0ab20a6eac0956ea72d921c20dee9b714960a4330ca7f005a" exitCode=0
Jul 24 17:18:17.492042 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:17.492022    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7q78n" event={"ID":"ae06c81f-d11d-4d26-9dc5-721f14bb9f7a","Type":"ContainerDied","Data":"d44a3091104b52a0ab20a6eac0956ea72d921c20dee9b714960a4330ca7f005a"}
Jul 24 17:18:18.196766 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:18.196731    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wvn9"
Jul 24 17:18:18.197211 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:18:18.196868    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wvn9" podUID="db784d54-1541-4c98-ae75-0f7234c48158"
Jul 24 17:18:18.751696 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:18.751652    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd3f02c9-192b-420b-9678-5ed4a7d251d8-metrics-certs\") pod \"network-metrics-daemon-mbmql\" (UID: \"cd3f02c9-192b-420b-9678-5ed4a7d251d8\") " pod="openshift-multus/network-metrics-daemon-mbmql"
Jul 24 17:18:18.751901 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:18.751723    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db784d54-1541-4c98-ae75-0f7234c48158-original-pull-secret\") pod \"global-pull-secret-syncer-7wvn9\" (UID: \"db784d54-1541-4c98-ae75-0f7234c48158\") " pod="kube-system/global-pull-secret-syncer-7wvn9"
Jul 24 17:18:18.751901 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:18:18.751827    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:18:18.751901 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:18:18.751860    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 17:18:18.752097 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:18:18.751904    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd3f02c9-192b-420b-9678-5ed4a7d251d8-metrics-certs podName:cd3f02c9-192b-420b-9678-5ed4a7d251d8 nodeName:}" failed. No retries permitted until 2026-07-24 17:18:50.751884171 +0000 UTC m=+66.233259769 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd3f02c9-192b-420b-9678-5ed4a7d251d8-metrics-certs") pod "network-metrics-daemon-mbmql" (UID: "cd3f02c9-192b-420b-9678-5ed4a7d251d8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 17:18:18.752097 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:18:18.751924    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db784d54-1541-4c98-ae75-0f7234c48158-original-pull-secret podName:db784d54-1541-4c98-ae75-0f7234c48158 nodeName:}" failed. No retries permitted until 2026-07-24 17:18:50.751915541 +0000 UTC m=+66.233291138 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db784d54-1541-4c98-ae75-0f7234c48158-original-pull-secret") pod "global-pull-secret-syncer-7wvn9" (UID: "db784d54-1541-4c98-ae75-0f7234c48158") : object "kube-system"/"original-pull-secret" not registered
Jul 24 17:18:18.852502 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:18.852466    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cc2j4\" (UniqueName: \"kubernetes.io/projected/daf55067-cec7-4749-bdae-ad2673094565-kube-api-access-cc2j4\") pod \"network-check-target-smcsb\" (UID: \"daf55067-cec7-4749-bdae-ad2673094565\") " pod="openshift-network-diagnostics/network-check-target-smcsb"
Jul 24 17:18:18.852658 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:18:18.852609    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 17:18:18.852658 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:18:18.852629    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 17:18:18.852658 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:18:18.852642    2575 projected.go:196] Error preparing data for projected volume kube-api-access-cc2j4 for pod openshift-network-diagnostics/network-check-target-smcsb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:18:18.852832 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:18:18.852713    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/daf55067-cec7-4749-bdae-ad2673094565-kube-api-access-cc2j4 podName:daf55067-cec7-4749-bdae-ad2673094565 nodeName:}" failed. No retries permitted until 2026-07-24 17:18:50.852693151 +0000 UTC m=+66.334068775 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-cc2j4" (UniqueName: "kubernetes.io/projected/daf55067-cec7-4749-bdae-ad2673094565-kube-api-access-cc2j4") pod "network-check-target-smcsb" (UID: "daf55067-cec7-4749-bdae-ad2673094565") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 17:18:19.196139 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:19.196053    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbmql"
Jul 24 17:18:19.196322 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:18:19.196203    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mbmql" podUID="cd3f02c9-192b-420b-9678-5ed4a7d251d8"
Jul 24 17:18:19.196395 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:19.196053    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-smcsb"
Jul 24 17:18:19.196523 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:18:19.196500    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-smcsb" podUID="daf55067-cec7-4749-bdae-ad2673094565"
Jul 24 17:18:19.220162 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:19.220121    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:18:19.285156 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:19.285121    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:18:19.792404 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:19.792373    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-113.ec2.internal" event="NodeReady"
Jul 24 17:18:19.792574 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:19.792511    2575 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 24 17:18:19.844523 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:19.844490    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5zr4j"]
Jul 24 17:18:19.846684 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:19.846655    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5zr4j"
Jul 24 17:18:19.847137 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:19.847114    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-pk8tw"]
Jul 24 17:18:19.848897 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:19.848867    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 24 17:18:19.849071 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:19.849008    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pk8tw"
Jul 24 17:18:19.849195 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:19.849152    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-r2b86\""
Jul 24 17:18:19.849493 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:19.849478    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 24 17:18:19.851467 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:19.851440    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-tlf5h\""
Jul 24 17:18:19.851467 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:19.851448    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 24 17:18:19.851641 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:19.851615    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 24 17:18:19.852670 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:19.852651    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 24 17:18:19.858734 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:19.858709    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pk8tw"]
Jul 24 17:18:19.863642 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:19.862298    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5zr4j"]
Jul 24 17:18:19.960394 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:19.960306    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pv6vl\" (UniqueName: \"kubernetes.io/projected/a19606e2-4b58-418c-a6ad-8e70eb8ab5f5-kube-api-access-pv6vl\") pod \"dns-default-5zr4j\" (UID: \"a19606e2-4b58-418c-a6ad-8e70eb8ab5f5\") " pod="openshift-dns/dns-default-5zr4j"
Jul 24 17:18:19.960394 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:19.960355    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a19606e2-4b58-418c-a6ad-8e70eb8ab5f5-config-volume\") pod \"dns-default-5zr4j\" (UID: \"a19606e2-4b58-418c-a6ad-8e70eb8ab5f5\") " pod="openshift-dns/dns-default-5zr4j"
Jul 24 17:18:19.960577 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:19.960445    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/04c5443f-c66f-4640-9773-2ffeed796fe6-cert\") pod \"ingress-canary-pk8tw\" (UID: \"04c5443f-c66f-4640-9773-2ffeed796fe6\") " pod="openshift-ingress-canary/ingress-canary-pk8tw"
Jul 24 17:18:19.960577 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:19.960489    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a19606e2-4b58-418c-a6ad-8e70eb8ab5f5-tmp-dir\") pod \"dns-default-5zr4j\" (UID: \"a19606e2-4b58-418c-a6ad-8e70eb8ab5f5\") " pod="openshift-dns/dns-default-5zr4j"
Jul 24 17:18:19.960577 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:19.960534    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xslbq\" (UniqueName: \"kubernetes.io/projected/04c5443f-c66f-4640-9773-2ffeed796fe6-kube-api-access-xslbq\") pod \"ingress-canary-pk8tw\" (UID: \"04c5443f-c66f-4640-9773-2ffeed796fe6\") " pod="openshift-ingress-canary/ingress-canary-pk8tw"
Jul 24 17:18:19.960577 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:19.960577    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a19606e2-4b58-418c-a6ad-8e70eb8ab5f5-metrics-tls\") pod \"dns-default-5zr4j\" (UID: \"a19606e2-4b58-418c-a6ad-8e70eb8ab5f5\") " pod="openshift-dns/dns-default-5zr4j"
Jul 24 17:18:19.988530 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:19.988494    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:18:20.048636 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:20.048596    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:18:20.061826 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:20.061789    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a19606e2-4b58-418c-a6ad-8e70eb8ab5f5-metrics-tls\") pod \"dns-default-5zr4j\" (UID: \"a19606e2-4b58-418c-a6ad-8e70eb8ab5f5\") " pod="openshift-dns/dns-default-5zr4j"
Jul 24 17:18:20.062056 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:20.061863    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pv6vl\" (UniqueName: \"kubernetes.io/projected/a19606e2-4b58-418c-a6ad-8e70eb8ab5f5-kube-api-access-pv6vl\") pod \"dns-default-5zr4j\" (UID: \"a19606e2-4b58-418c-a6ad-8e70eb8ab5f5\") " pod="openshift-dns/dns-default-5zr4j"
Jul 24 17:18:20.062056 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:20.061899    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a19606e2-4b58-418c-a6ad-8e70eb8ab5f5-config-volume\") pod \"dns-default-5zr4j\" (UID: \"a19606e2-4b58-418c-a6ad-8e70eb8ab5f5\") " pod="openshift-dns/dns-default-5zr4j"
Jul 24 17:18:20.062056 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:18:20.061919    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 17:18:20.062056 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:18:20.062007    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a19606e2-4b58-418c-a6ad-8e70eb8ab5f5-metrics-tls podName:a19606e2-4b58-418c-a6ad-8e70eb8ab5f5 nodeName:}" failed. No retries permitted until 2026-07-24 17:18:20.561988677 +0000 UTC m=+36.043364275 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a19606e2-4b58-418c-a6ad-8e70eb8ab5f5-metrics-tls") pod "dns-default-5zr4j" (UID: "a19606e2-4b58-418c-a6ad-8e70eb8ab5f5") : secret "dns-default-metrics-tls" not found
Jul 24 17:18:20.062279 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:20.061926    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/04c5443f-c66f-4640-9773-2ffeed796fe6-cert\") pod \"ingress-canary-pk8tw\" (UID: \"04c5443f-c66f-4640-9773-2ffeed796fe6\") " pod="openshift-ingress-canary/ingress-canary-pk8tw"
Jul 24 17:18:20.062279 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:20.062145    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a19606e2-4b58-418c-a6ad-8e70eb8ab5f5-tmp-dir\") pod \"dns-default-5zr4j\" (UID: \"a19606e2-4b58-418c-a6ad-8e70eb8ab5f5\") " pod="openshift-dns/dns-default-5zr4j"
Jul 24 17:18:20.062279 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:20.062173    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xslbq\" (UniqueName: \"kubernetes.io/projected/04c5443f-c66f-4640-9773-2ffeed796fe6-kube-api-access-xslbq\") pod \"ingress-canary-pk8tw\" (UID: \"04c5443f-c66f-4640-9773-2ffeed796fe6\") " pod="openshift-ingress-canary/ingress-canary-pk8tw"
Jul 24 17:18:20.062475 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:20.062449    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a19606e2-4b58-418c-a6ad-8e70eb8ab5f5-tmp-dir\") pod \"dns-default-5zr4j\" (UID: \"a19606e2-4b58-418c-a6ad-8e70eb8ab5f5\") " pod="openshift-dns/dns-default-5zr4j"
Jul 24 17:18:20.062714 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:20.062685    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a19606e2-4b58-418c-a6ad-8e70eb8ab5f5-config-volume\") pod \"dns-default-5zr4j\" (UID: \"a19606e2-4b58-418c-a6ad-8e70eb8ab5f5\") " pod="openshift-dns/dns-default-5zr4j"
Jul 24 17:18:20.067046 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:20.067021    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/04c5443f-c66f-4640-9773-2ffeed796fe6-cert\") pod \"ingress-canary-pk8tw\" (UID: \"04c5443f-c66f-4640-9773-2ffeed796fe6\") " pod="openshift-ingress-canary/ingress-canary-pk8tw"
Jul 24 17:18:20.070926 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:20.070899    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xslbq\" (UniqueName: \"kubernetes.io/projected/04c5443f-c66f-4640-9773-2ffeed796fe6-kube-api-access-xslbq\") pod \"ingress-canary-pk8tw\" (UID: \"04c5443f-c66f-4640-9773-2ffeed796fe6\") " pod="openshift-ingress-canary/ingress-canary-pk8tw"
Jul 24 17:18:20.071249 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:20.071226    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pv6vl\" (UniqueName: \"kubernetes.io/projected/a19606e2-4b58-418c-a6ad-8e70eb8ab5f5-kube-api-access-pv6vl\") pod \"dns-default-5zr4j\" (UID: \"a19606e2-4b58-418c-a6ad-8e70eb8ab5f5\") " pod="openshift-dns/dns-default-5zr4j"
Jul 24 17:18:20.167292 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:20.167257    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pk8tw"
Jul 24 17:18:20.196655 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:20.196620    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wvn9"
Jul 24 17:18:20.202842 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:20.200851    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 24 17:18:20.335417 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:20.335179    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pk8tw"]
Jul 24 17:18:20.567286 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:20.567173    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a19606e2-4b58-418c-a6ad-8e70eb8ab5f5-metrics-tls\") pod \"dns-default-5zr4j\" (UID: \"a19606e2-4b58-418c-a6ad-8e70eb8ab5f5\") " pod="openshift-dns/dns-default-5zr4j"
Jul 24 17:18:20.567452 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:18:20.567323    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 17:18:20.567452 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:18:20.567395    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a19606e2-4b58-418c-a6ad-8e70eb8ab5f5-metrics-tls podName:a19606e2-4b58-418c-a6ad-8e70eb8ab5f5 nodeName:}" failed. No retries permitted until 2026-07-24 17:18:21.567375978 +0000 UTC m=+37.048751576 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a19606e2-4b58-418c-a6ad-8e70eb8ab5f5-metrics-tls") pod "dns-default-5zr4j" (UID: "a19606e2-4b58-418c-a6ad-8e70eb8ab5f5") : secret "dns-default-metrics-tls" not found
Jul 24 17:18:21.196804 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:21.196765    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbmql"
Jul 24 17:18:21.197001 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:21.196816    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-smcsb"
Jul 24 17:18:21.207820 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:21.207799    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 24 17:18:21.211873 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:21.211852    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 24 17:18:21.212573 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:21.212551    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-t6c84\""
Jul 24 17:18:21.212678 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:21.212641    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 24 17:18:21.212723 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:21.212676    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ntfrz\""
Jul 24 17:18:21.573901 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:21.573810    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a19606e2-4b58-418c-a6ad-8e70eb8ab5f5-metrics-tls\") pod \"dns-default-5zr4j\" (UID: \"a19606e2-4b58-418c-a6ad-8e70eb8ab5f5\") " pod="openshift-dns/dns-default-5zr4j"
Jul 24 17:18:21.574340 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:18:21.573996    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 17:18:21.574340 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:18:21.574072    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a19606e2-4b58-418c-a6ad-8e70eb8ab5f5-metrics-tls podName:a19606e2-4b58-418c-a6ad-8e70eb8ab5f5 nodeName:}" failed. No retries permitted until 2026-07-24 17:18:23.574049206 +0000 UTC m=+39.055424821 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a19606e2-4b58-418c-a6ad-8e70eb8ab5f5-metrics-tls") pod "dns-default-5zr4j" (UID: "a19606e2-4b58-418c-a6ad-8e70eb8ab5f5") : secret "dns-default-metrics-tls" not found
Jul 24 17:18:21.805515 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:18:21.805484    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04c5443f_c66f_4640_9773_2ffeed796fe6.slice/crio-5b5c221db1dbb1f80ad2eed6b603dfc916576b717b6053d7206c9d7b48e65c27 WatchSource:0}: Error finding container 5b5c221db1dbb1f80ad2eed6b603dfc916576b717b6053d7206c9d7b48e65c27: Status 404 returned error can't find the container with id 5b5c221db1dbb1f80ad2eed6b603dfc916576b717b6053d7206c9d7b48e65c27
Jul 24 17:18:22.505426 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:22.505390    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pk8tw" event={"ID":"04c5443f-c66f-4640-9773-2ffeed796fe6","Type":"ContainerStarted","Data":"5b5c221db1dbb1f80ad2eed6b603dfc916576b717b6053d7206c9d7b48e65c27"}
Jul 24 17:18:22.508094 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:22.508070    2575 generic.go:356] "Generic (PLEG): container finished" podID="ae06c81f-d11d-4d26-9dc5-721f14bb9f7a" containerID="b2fd7be86d1644507a1dadfd024783b864e9dfe42a2b46f3e206225ac404dd71" exitCode=0
Jul 24 17:18:22.508183 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:22.508111    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7q78n" event={"ID":"ae06c81f-d11d-4d26-9dc5-721f14bb9f7a","Type":"ContainerDied","Data":"b2fd7be86d1644507a1dadfd024783b864e9dfe42a2b46f3e206225ac404dd71"}
Jul 24 17:18:23.514774 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:23.514741    2575 generic.go:356] "Generic (PLEG): container finished" podID="ae06c81f-d11d-4d26-9dc5-721f14bb9f7a" containerID="c11afe568903e6211fd30da3ff251ebd02b2d66cc6508270e1ab0ffc51a2269c" exitCode=0
Jul 24 17:18:23.515265 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:23.514783    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7q78n" event={"ID":"ae06c81f-d11d-4d26-9dc5-721f14bb9f7a","Type":"ContainerDied","Data":"c11afe568903e6211fd30da3ff251ebd02b2d66cc6508270e1ab0ffc51a2269c"}
Jul 24 17:18:23.589475 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:23.589442    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a19606e2-4b58-418c-a6ad-8e70eb8ab5f5-metrics-tls\") pod \"dns-default-5zr4j\" (UID: \"a19606e2-4b58-418c-a6ad-8e70eb8ab5f5\") " pod="openshift-dns/dns-default-5zr4j"
Jul 24 17:18:23.589666 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:18:23.589627    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 17:18:23.589731 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:18:23.589714    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a19606e2-4b58-418c-a6ad-8e70eb8ab5f5-metrics-tls podName:a19606e2-4b58-418c-a6ad-8e70eb8ab5f5 nodeName:}" failed. No retries permitted until 2026-07-24 17:18:27.589689718 +0000 UTC m=+43.071065341 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a19606e2-4b58-418c-a6ad-8e70eb8ab5f5-metrics-tls") pod "dns-default-5zr4j" (UID: "a19606e2-4b58-418c-a6ad-8e70eb8ab5f5") : secret "dns-default-metrics-tls" not found
Jul 24 17:18:24.474744 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:24.474558    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:18:24.520586 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:24.520555    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7q78n" event={"ID":"ae06c81f-d11d-4d26-9dc5-721f14bb9f7a","Type":"ContainerStarted","Data":"bb2f6ec83a8223b24750517eb11c3d26c22ac2e796a6e92449193a44e9855c3a"}
Jul 24 17:18:24.559189 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:24.559160    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:18:24.567083 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:24.567037    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7q78n" podStartSLOduration=8.808840351 podStartE2EDuration="39.567018291s" totalImagesPullingTime="30.75817794s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:17:45 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:18:24.565806295 +0000 UTC m=+40.047181916" watchObservedRunningTime="2026-07-24 17:18:24.567018291 +0000 UTC m=+40.048393911"
Jul 24 17:18:24.692037 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:24.692004    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:18:24.784530 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:24.784494    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:18:25.271358 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:25.271283    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:18:25.338548 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:25.338516    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:18:25.524312 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:25.524225    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pk8tw" event={"ID":"04c5443f-c66f-4640-9773-2ffeed796fe6","Type":"ContainerStarted","Data":"328d34ed78da910c850707ed83f9009c174c8a87e01b20a85d927688e7224a50"}
Jul 24 17:18:25.541047 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:25.540994    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-pk8tw" podStartSLOduration=3.8881985119999998 podStartE2EDuration="6.540977623s" totalImagesPullingTime="2.652779111s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:18:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:18:25.539877627 +0000 UTC m=+41.021253248" watchObservedRunningTime="2026-07-24 17:18:25.540977623 +0000 UTC m=+41.022353242"
Jul 24 17:18:27.622693 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:27.622643    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a19606e2-4b58-418c-a6ad-8e70eb8ab5f5-metrics-tls\") pod \"dns-default-5zr4j\" (UID: \"a19606e2-4b58-418c-a6ad-8e70eb8ab5f5\") " pod="openshift-dns/dns-default-5zr4j"
Jul 24 17:18:27.623107 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:18:27.622790    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 17:18:27.623107 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:18:27.622854    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a19606e2-4b58-418c-a6ad-8e70eb8ab5f5-metrics-tls podName:a19606e2-4b58-418c-a6ad-8e70eb8ab5f5 nodeName:}" failed. No retries permitted until 2026-07-24 17:18:35.622838951 +0000 UTC m=+51.104214549 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a19606e2-4b58-418c-a6ad-8e70eb8ab5f5-metrics-tls") pod "dns-default-5zr4j" (UID: "a19606e2-4b58-418c-a6ad-8e70eb8ab5f5") : secret "dns-default-metrics-tls" not found
Jul 24 17:18:35.684678 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:35.684635    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a19606e2-4b58-418c-a6ad-8e70eb8ab5f5-metrics-tls\") pod \"dns-default-5zr4j\" (UID: \"a19606e2-4b58-418c-a6ad-8e70eb8ab5f5\") " pod="openshift-dns/dns-default-5zr4j"
Jul 24 17:18:35.685158 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:18:35.684744    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 17:18:35.685158 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:18:35.684797    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a19606e2-4b58-418c-a6ad-8e70eb8ab5f5-metrics-tls podName:a19606e2-4b58-418c-a6ad-8e70eb8ab5f5 nodeName:}" failed. No retries permitted until 2026-07-24 17:18:51.684782773 +0000 UTC m=+67.166158371 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a19606e2-4b58-418c-a6ad-8e70eb8ab5f5-metrics-tls") pod "dns-default-5zr4j" (UID: "a19606e2-4b58-418c-a6ad-8e70eb8ab5f5") : secret "dns-default-metrics-tls" not found
Jul 24 17:18:46.506214 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:46.506187    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-82s5l"
Jul 24 17:18:46.641306 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:46.641272    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:18:46.739735 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:46.739699    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:18:50.800360 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:50.800299    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db784d54-1541-4c98-ae75-0f7234c48158-original-pull-secret\") pod \"global-pull-secret-syncer-7wvn9\" (UID: \"db784d54-1541-4c98-ae75-0f7234c48158\") " pod="kube-system/global-pull-secret-syncer-7wvn9"
Jul 24 17:18:50.800793 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:50.800391    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd3f02c9-192b-420b-9678-5ed4a7d251d8-metrics-certs\") pod \"network-metrics-daemon-mbmql\" (UID: \"cd3f02c9-192b-420b-9678-5ed4a7d251d8\") " pod="openshift-multus/network-metrics-daemon-mbmql"
Jul 24 17:18:50.804217 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:50.804193    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 24 17:18:50.804334 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:50.804287    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 24 17:18:50.810892 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:18:50.810871    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 24 17:18:50.811044 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:18:50.810991    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd3f02c9-192b-420b-9678-5ed4a7d251d8-metrics-certs podName:cd3f02c9-192b-420b-9678-5ed4a7d251d8 nodeName:}" failed. No retries permitted until 2026-07-24 17:19:54.810929204 +0000 UTC m=+130.292304817 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd3f02c9-192b-420b-9678-5ed4a7d251d8-metrics-certs") pod "network-metrics-daemon-mbmql" (UID: "cd3f02c9-192b-420b-9678-5ed4a7d251d8") : secret "metrics-daemon-secret" not found
Jul 24 17:18:50.814627 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:50.814606    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db784d54-1541-4c98-ae75-0f7234c48158-original-pull-secret\") pod \"global-pull-secret-syncer-7wvn9\" (UID: \"db784d54-1541-4c98-ae75-0f7234c48158\") " pod="kube-system/global-pull-secret-syncer-7wvn9"
Jul 24 17:18:50.901295 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:50.901244    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cc2j4\" (UniqueName: \"kubernetes.io/projected/daf55067-cec7-4749-bdae-ad2673094565-kube-api-access-cc2j4\") pod \"network-check-target-smcsb\" (UID: \"daf55067-cec7-4749-bdae-ad2673094565\") " pod="openshift-network-diagnostics/network-check-target-smcsb"
Jul 24 17:18:50.904152 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:50.904128    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 24 17:18:50.917420 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:50.917392    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 24 17:18:50.925275 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:50.925242    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cc2j4\" (UniqueName: \"kubernetes.io/projected/daf55067-cec7-4749-bdae-ad2673094565-kube-api-access-cc2j4\") pod \"network-check-target-smcsb\" (UID: \"daf55067-cec7-4749-bdae-ad2673094565\") " pod="openshift-network-diagnostics/network-check-target-smcsb"
Jul 24 17:18:51.113848 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:51.113740    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wvn9"
Jul 24 17:18:51.217033 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:51.217007    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-t6c84\""
Jul 24 17:18:51.225029 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:51.224995    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-smcsb"
Jul 24 17:18:51.245321 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:51.245289    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7wvn9"]
Jul 24 17:18:51.248667 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:18:51.248642    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb784d54_1541_4c98_ae75_0f7234c48158.slice/crio-66b4bd440a13249b57a65dfbc5a227a292eee13d6afaf808cdab4fa11158e78d WatchSource:0}: Error finding container 66b4bd440a13249b57a65dfbc5a227a292eee13d6afaf808cdab4fa11158e78d: Status 404 returned error can't find the container with id 66b4bd440a13249b57a65dfbc5a227a292eee13d6afaf808cdab4fa11158e78d
Jul 24 17:18:51.359014 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:51.358970    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-smcsb"]
Jul 24 17:18:51.362301 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:18:51.362266    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddaf55067_cec7_4749_bdae_ad2673094565.slice/crio-ec2a115399843c9a1a07b11877d793995d99e5f224ac67c1a31313a25efe3162 WatchSource:0}: Error finding container ec2a115399843c9a1a07b11877d793995d99e5f224ac67c1a31313a25efe3162: Status 404 returned error can't find the container with id ec2a115399843c9a1a07b11877d793995d99e5f224ac67c1a31313a25efe3162
Jul 24 17:18:51.582451 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:51.582408    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7wvn9" event={"ID":"db784d54-1541-4c98-ae75-0f7234c48158","Type":"ContainerStarted","Data":"66b4bd440a13249b57a65dfbc5a227a292eee13d6afaf808cdab4fa11158e78d"}
Jul 24 17:18:51.583447 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:51.583424    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-smcsb" event={"ID":"daf55067-cec7-4749-bdae-ad2673094565","Type":"ContainerStarted","Data":"ec2a115399843c9a1a07b11877d793995d99e5f224ac67c1a31313a25efe3162"}
Jul 24 17:18:51.708012 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:51.707853    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a19606e2-4b58-418c-a6ad-8e70eb8ab5f5-metrics-tls\") pod \"dns-default-5zr4j\" (UID: \"a19606e2-4b58-418c-a6ad-8e70eb8ab5f5\") " pod="openshift-dns/dns-default-5zr4j"
Jul 24 17:18:51.708260 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:18:51.708097    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 17:18:51.708260 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:18:51.708212    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a19606e2-4b58-418c-a6ad-8e70eb8ab5f5-metrics-tls podName:a19606e2-4b58-418c-a6ad-8e70eb8ab5f5 nodeName:}" failed. No retries permitted until 2026-07-24 17:19:23.708189891 +0000 UTC m=+99.189565506 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a19606e2-4b58-418c-a6ad-8e70eb8ab5f5-metrics-tls") pod "dns-default-5zr4j" (UID: "a19606e2-4b58-418c-a6ad-8e70eb8ab5f5") : secret "dns-default-metrics-tls" not found
Jul 24 17:18:56.598813 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:56.598773    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7wvn9" event={"ID":"db784d54-1541-4c98-ae75-0f7234c48158","Type":"ContainerStarted","Data":"ae00cef2c8f338425d18dc62745b6de308dee381dfcae4c7cfe0cc2e2604e118"}
Jul 24 17:18:56.600293 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:56.600266    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-smcsb" event={"ID":"daf55067-cec7-4749-bdae-ad2673094565","Type":"ContainerStarted","Data":"81f1a482088bd439f3aa8789a27490c0ce55b4b8f77f3344fc227ed3212d3067"}
Jul 24 17:18:56.600425 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:56.600408    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-smcsb"
Jul 24 17:18:56.614248 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:56.614194    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-7wvn9" podStartSLOduration=66.663742889 podStartE2EDuration="1m11.614178796s" totalImagesPullingTime="4.950435907s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:17:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:18:56.613519487 +0000 UTC m=+72.094895108" watchObservedRunningTime="2026-07-24 17:18:56.614178796 +0000 UTC m=+72.095554417"
Jul 24 17:18:56.628928 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:56.628828    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-smcsb" podStartSLOduration=66.796461367 podStartE2EDuration="1m11.628808436s" totalImagesPullingTime="4.832347069s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:17:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:18:56.628367578 +0000 UTC m=+72.109743197" watchObservedRunningTime="2026-07-24 17:18:56.628808436 +0000 UTC m=+72.110184056"
Jul 24 17:18:59.198875 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:18:59.198845    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:19:05.758166 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:19:05.758051    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c785b6f8-s6kvx"]
Jul 24 17:19:05.760148 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:19:05.760131    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c785b6f8-s6kvx"
Jul 24 17:19:05.763876 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:19:05.763851    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 24 17:19:05.763876 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:19:05.763868    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 24 17:19:05.764110 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:19:05.763919    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-cn87b\""
Jul 24 17:19:05.764110 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:19:05.763970    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 24 17:19:05.764110 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:19:05.764011    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 24 17:19:05.765611 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:19:05.765591    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564f976b54-x5g4z"]
Jul 24 17:19:05.769149 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:19:05.768058    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564f976b54-x5g4z"
Jul 24 17:19:05.771598 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:19:05.770738    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c785b6f8-s6kvx"]
Jul 24 17:19:05.771598 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:19:05.771195    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 24 17:19:05.771598 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:19:05.771303    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 24 17:19:05.771598 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:19:05.771406    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 24 17:19:05.771598 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:19:05.771477    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 24 17:19:05.781424 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:19:05.781400    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564f976b54-x5g4z"]
Jul 24 17:19:05.814821 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:19:05.814783    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bf1cfd3e-5e2e-49ee-92fc-82bd588dde39-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-59c785b6f8-s6kvx\" (UID: \"bf1cfd3e-5e2e-49ee-92fc-82bd588dde39\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c785b6f8-s6kvx"
Jul 24 17:19:05.815005 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:19:05.814844    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ftbv\" (UniqueName: \"kubernetes.io/projected/bf1cfd3e-5e2e-49ee-92fc-82bd588dde39-kube-api-access-2ftbv\") pod \"managed-serviceaccount-addon-agent-59c785b6f8-s6kvx\" (UID: \"bf1cfd3e-5e2e-49ee-92fc-82bd588dde39\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c785b6f8-s6kvx"
Jul 24 17:19:05.916098 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:19:05.916055    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/12bb855a-2280-42c8-ba23-daa21c406a01-additional-service-ca\") pod \"cluster-proxy-proxy-agent-564f976b54-x5g4z\" (UID: \"12bb855a-2280-42c8-ba23-daa21c406a01\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564f976b54-x5g4z"
Jul 24 17:19:05.916274 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:19:05.916110    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ftbv\" (UniqueName: \"kubernetes.io/projected/bf1cfd3e-5e2e-49ee-92fc-82bd588dde39-kube-api-access-2ftbv\") pod \"managed-serviceaccount-addon-agent-59c785b6f8-s6kvx\" (UID: \"bf1cfd3e-5e2e-49ee-92fc-82bd588dde39\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c785b6f8-s6kvx"
Jul 24 17:19:05.916274 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:19:05.916141    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwwz7\" (UniqueName: \"kubernetes.io/projected/12bb855a-2280-42c8-ba23-daa21c406a01-kube-api-access-dwwz7\") pod \"cluster-proxy-proxy-agent-564f976b54-x5g4z\" (UID: \"12bb855a-2280-42c8-ba23-daa21c406a01\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564f976b54-x5g4z"
Jul 24 17:19:05.916274 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:19:05.916163    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/12bb855a-2280-42c8-ba23-daa21c406a01-ca\") pod \"cluster-proxy-proxy-agent-564f976b54-x5g4z\" (UID: \"12bb855a-2280-42c8-ba23-daa21c406a01\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564f976b54-x5g4z"
Jul 24 17:19:05.916274 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:19:05.916208    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bf1cfd3e-5e2e-49ee-92fc-82bd588dde39-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-59c785b6f8-s6kvx\" (UID: \"bf1cfd3e-5e2e-49ee-92fc-82bd588dde39\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c785b6f8-s6kvx"
Jul 24 17:19:05.916274 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:19:05.916236    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/12bb855a-2280-42c8-ba23-daa21c406a01-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-564f976b54-x5g4z\" (UID: \"12bb855a-2280-42c8-ba23-daa21c406a01\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564f976b54-x5g4z"
Jul 24 17:19:05.916274 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:19:05.916263    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/12bb855a-2280-42c8-ba23-daa21c406a01-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-564f976b54-x5g4z\" (UID: \"12bb855a-2280-42c8-ba23-daa21c406a01\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564f976b54-x5g4z"
Jul 24 17:19:05.916462 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:19:05.916303    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/12bb855a-2280-42c8-ba23-daa21c406a01-hub\") pod \"cluster-proxy-proxy-agent-564f976b54-x5g4z\" (UID: \"12bb855a-2280-42c8-ba23-daa21c406a01\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564f976b54-x5g4z"
Jul 24 17:19:05.918612 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:19:05.918586    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bf1cfd3e-5e2e-49ee-92fc-82bd588dde39-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-59c785b6f8-s6kvx\" (UID: \"bf1cfd3e-5e2e-49ee-92fc-82bd588dde39\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c785b6f8-s6kvx"
Jul 24 17:19:05.924506 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:19:05.924473    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ftbv\" (UniqueName: \"kubernetes.io/projected/bf1cfd3e-5e2e-49ee-92fc-82bd588dde39-kube-api-access-2ftbv\") pod \"managed-serviceaccount-addon-agent-59c785b6f8-s6kvx\" (UID: \"bf1cfd3e-5e2e-49ee-92fc-82bd588dde39\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c785b6f8-s6kvx"
Jul 24 17:19:06.017622 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:19:06.017533    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/12bb855a-2280-42c8-ba23-daa21c406a01-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-564f976b54-x5g4z\" (UID: \"12bb855a-2280-42c8-ba23-daa21c406a01\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564f976b54-x5g4z"
Jul 24 17:19:06.017622 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:19:06.017575    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/12bb855a-2280-42c8-ba23-daa21c406a01-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-564f976b54-x5g4z\" (UID: \"12bb855a-2280-42c8-ba23-daa21c406a01\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564f976b54-x5g4z"
Jul 24 17:19:06.017622 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:19:06.017597    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/12bb855a-2280-42c8-ba23-daa21c406a01-hub\") pod \"cluster-proxy-proxy-agent-564f976b54-x5g4z\" (UID: \"12bb855a-2280-42c8-ba23-daa21c406a01\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564f976b54-x5g4z"
Jul 24 17:19:06.017622 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:19:06.017617    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/12bb855a-2280-42c8-ba23-daa21c406a01-additional-service-ca\") pod \"cluster-proxy-proxy-agent-564f976b54-x5g4z\" (UID: \"12bb855a-2280-42c8-ba23-daa21c406a01\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564f976b54-x5g4z"
Jul 24 17:19:06.017926 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:19:06.017664    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwwz7\" (UniqueName: \"kubernetes.io/projected/12bb855a-2280-42c8-ba23-daa21c406a01-kube-api-access-dwwz7\") pod \"cluster-proxy-proxy-agent-564f976b54-x5g4z\" (UID: \"12bb855a-2280-42c8-ba23-daa21c406a01\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564f976b54-x5g4z"
Jul 24 17:19:06.017926 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:19:06.017696    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/12bb855a-2280-42c8-ba23-daa21c406a01-ca\") pod \"cluster-proxy-proxy-agent-564f976b54-x5g4z\" (UID: \"12bb855a-2280-42c8-ba23-daa21c406a01\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564f976b54-x5g4z"
Jul 24 17:19:06.018381 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:19:06.018360    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/12bb855a-2280-42c8-ba23-daa21c406a01-additional-service-ca\") pod \"cluster-proxy-proxy-agent-564f976b54-x5g4z\" (UID: \"12bb855a-2280-42c8-ba23-daa21c406a01\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564f976b54-x5g4z"
Jul 24 17:19:06.020212 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:19:06.020180    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/12bb855a-2280-42c8-ba23-daa21c406a01-ca\") pod \"cluster-proxy-proxy-agent-564f976b54-x5g4z\" (UID: \"12bb855a-2280-42c8-ba23-daa21c406a01\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564f976b54-x5g4z"
Jul 24 17:19:06.020299 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:19:06.020239    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/12bb855a-2280-42c8-ba23-daa21c406a01-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-564f976b54-x5g4z\" (UID: \"12bb855a-2280-42c8-ba23-daa21c406a01\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564f976b54-x5g4z"
Jul 24 17:19:06.020469 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:19:06.020451    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/12bb855a-2280-42c8-ba23-daa21c406a01-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-564f976b54-x5g4z\" (UID: \"12bb855a-2280-42c8-ba23-daa21c406a01\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564f976b54-x5g4z"
Jul 24 17:19:06.020508 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:19:06.020459    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/12bb855a-2280-42c8-ba23-daa21c406a01-hub\") pod \"cluster-proxy-proxy-agent-564f976b54-x5g4z\" (UID: \"12bb855a-2280-42c8-ba23-daa21c406a01\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564f976b54-x5g4z"
Jul 24 17:19:06.026192 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:19:06.026166    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwwz7\" (UniqueName: \"kubernetes.io/projected/12bb855a-2280-42c8-ba23-daa21c406a01-kube-api-access-dwwz7\") pod \"cluster-proxy-proxy-agent-564f976b54-x5g4z\" (UID: \"12bb855a-2280-42c8-ba23-daa21c406a01\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564f976b54-x5g4z"
Jul 24 17:19:06.078744 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:19:06.078697    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c785b6f8-s6kvx"
Jul 24 17:19:06.087983 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:19:06.087959    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564f976b54-x5g4z"
Jul 24 17:19:06.214242 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:19:06.214208    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c785b6f8-s6kvx"]
Jul 24 17:19:06.217340 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:19:06.217307    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbf1cfd3e_5e2e_49ee_92fc_82bd588dde39.slice/crio-781a1a45622d4a114745e68d7b78fcaf6c7ec2eb191ea2a563818c70962608e8 WatchSource:0}: Error finding container 781a1a45622d4a114745e68d7b78fcaf6c7ec2eb191ea2a563818c70962608e8: Status 404 returned error can't find the container with id 781a1a45622d4a114745e68d7b78fcaf6c7ec2eb191ea2a563818c70962608e8
Jul 24 17:19:06.228334 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:19:06.228306    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564f976b54-x5g4z"]
Jul 24 17:19:06.231470 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:19:06.231446    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod12bb855a_2280_42c8_ba23_daa21c406a01.slice/crio-e26c69460130f461e2e82dbf9d9f5ed7006f6de43fe58814867243f2ca97a48e WatchSource:0}: Error finding container e26c69460130f461e2e82dbf9d9f5ed7006f6de43fe58814867243f2ca97a48e: Status 404 returned error can't find the container with id e26c69460130f461e2e82dbf9d9f5ed7006f6de43fe58814867243f2ca97a48e
Jul 24 17:19:06.623590 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:19:06.623550    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564f976b54-x5g4z" event={"ID":"12bb855a-2280-42c8-ba23-daa21c406a01","Type":"ContainerStarted","Data":"e26c69460130f461e2e82dbf9d9f5ed7006f6de43fe58814867243f2ca97a48e"}
Jul 24 17:19:06.624604 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:19:06.624574    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c785b6f8-s6kvx" event={"ID":"bf1cfd3e-5e2e-49ee-92fc-82bd588dde39","Type":"ContainerStarted","Data":"781a1a45622d4a114745e68d7b78fcaf6c7ec2eb191ea2a563818c70962608e8"}
Jul 24 17:19:10.639749 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:19:10.639641    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564f976b54-x5g4z" event={"ID":"12bb855a-2280-42c8-ba23-daa21c406a01","Type":"ContainerStarted","Data":"e52229fcb04f0bdfccb00dcb2d46f8759186f1473aa4c88bc433cf6a2406d015"}
Jul 24 17:19:10.639749 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:19:10.639689    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564f976b54-x5g4z" event={"ID":"12bb855a-2280-42c8-ba23-daa21c406a01","Type":"ContainerStarted","Data":"db631a2cd6ff542c35fbed38c34857491382b59aeb18531853047c82e233b6db"}
Jul 24 17:19:10.639749 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:19:10.639706    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564f976b54-x5g4z" event={"ID":"12bb855a-2280-42c8-ba23-daa21c406a01","Type":"ContainerStarted","Data":"bc5f1da7cd83df6f3cc5d18d2835019a3b551453098ee50a2cde5205476929b0"}
Jul 24 17:19:10.641217 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:19:10.641189    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c785b6f8-s6kvx" event={"ID":"bf1cfd3e-5e2e-49ee-92fc-82bd588dde39","Type":"ContainerStarted","Data":"c1b723a5391e262c2acb7500a548e900c3a14779e718889bfb8cad4e6a8fa9ce"}
Jul 24 17:19:10.696643 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:19:10.696585    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c785b6f8-s6kvx" podStartSLOduration=1.6309283190000001 podStartE2EDuration="5.696569628s" totalImagesPullingTime="4.065641309s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:19:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:19:10.695446477 +0000 UTC m=+86.176822100" watchObservedRunningTime="2026-07-24 17:19:10.696569628 +0000 UTC m=+86.177945248"
Jul 24 17:19:10.696824 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:19:10.696668    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564f976b54-x5g4z" podStartSLOduration=1.5992566080000001 podStartE2EDuration="5.696662419s" totalImagesPullingTime="4.097405811s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:19:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:19:10.664328314 +0000 UTC m=+86.145703938" watchObservedRunningTime="2026-07-24 17:19:10.696662419 +0000 UTC m=+86.178038042"
Jul 24 17:19:20.944378 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:19:20.944334    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:19:23.747860 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:19:23.747823    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a19606e2-4b58-418c-a6ad-8e70eb8ab5f5-metrics-tls\") pod \"dns-default-5zr4j\" (UID: \"a19606e2-4b58-418c-a6ad-8e70eb8ab5f5\") " pod="openshift-dns/dns-default-5zr4j"
Jul 24 17:19:23.748384 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:19:23.748010    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 17:19:23.748384 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:19:23.748092    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a19606e2-4b58-418c-a6ad-8e70eb8ab5f5-metrics-tls podName:a19606e2-4b58-418c-a6ad-8e70eb8ab5f5 nodeName:}" failed. No retries permitted until 2026-07-24 17:20:27.748070916 +0000 UTC m=+163.229446532 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a19606e2-4b58-418c-a6ad-8e70eb8ab5f5-metrics-tls") pod "dns-default-5zr4j" (UID: "a19606e2-4b58-418c-a6ad-8e70eb8ab5f5") : secret "dns-default-metrics-tls" not found
Jul 24 17:19:27.604809 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:19:27.604778    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-smcsb"
Jul 24 17:19:54.874954 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:19:54.874874    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd3f02c9-192b-420b-9678-5ed4a7d251d8-metrics-certs\") pod \"network-metrics-daemon-mbmql\" (UID: \"cd3f02c9-192b-420b-9678-5ed4a7d251d8\") " pod="openshift-multus/network-metrics-daemon-mbmql"
Jul 24 17:19:54.875550 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:19:54.875070    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 24 17:19:54.875550 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:19:54.875159    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd3f02c9-192b-420b-9678-5ed4a7d251d8-metrics-certs podName:cd3f02c9-192b-420b-9678-5ed4a7d251d8 nodeName:}" failed. No retries permitted until 2026-07-24 17:21:56.875136356 +0000 UTC m=+252.356511974 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd3f02c9-192b-420b-9678-5ed4a7d251d8-metrics-certs") pod "network-metrics-daemon-mbmql" (UID: "cd3f02c9-192b-420b-9678-5ed4a7d251d8") : secret "metrics-daemon-secret" not found
Jul 24 17:20:22.859081 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:20:22.859034    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-5zr4j" podUID="a19606e2-4b58-418c-a6ad-8e70eb8ab5f5"
Jul 24 17:20:23.855487 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:20:23.855453    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5zr4j"
Jul 24 17:20:24.208207 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:20:24.208107    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-mbmql" podUID="cd3f02c9-192b-420b-9678-5ed4a7d251d8"
Jul 24 17:20:27.812030 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:20:27.811969    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a19606e2-4b58-418c-a6ad-8e70eb8ab5f5-metrics-tls\") pod \"dns-default-5zr4j\" (UID: \"a19606e2-4b58-418c-a6ad-8e70eb8ab5f5\") " pod="openshift-dns/dns-default-5zr4j"
Jul 24 17:20:27.812555 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:20:27.812122    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 17:20:27.812555 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:20:27.812207    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a19606e2-4b58-418c-a6ad-8e70eb8ab5f5-metrics-tls podName:a19606e2-4b58-418c-a6ad-8e70eb8ab5f5 nodeName:}" failed. No retries permitted until 2026-07-24 17:22:29.812189224 +0000 UTC m=+285.293564822 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a19606e2-4b58-418c-a6ad-8e70eb8ab5f5-metrics-tls") pod "dns-default-5zr4j" (UID: "a19606e2-4b58-418c-a6ad-8e70eb8ab5f5") : secret "dns-default-metrics-tls" not found
Jul 24 17:20:37.196641 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:20:37.196551    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbmql"
Jul 24 17:21:10.988868 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:10.988826    2575 generic.go:356] "Generic (PLEG): container finished" podID="bf1cfd3e-5e2e-49ee-92fc-82bd588dde39" containerID="c1b723a5391e262c2acb7500a548e900c3a14779e718889bfb8cad4e6a8fa9ce" exitCode=255
Jul 24 17:21:10.989451 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:10.988873    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c785b6f8-s6kvx" event={"ID":"bf1cfd3e-5e2e-49ee-92fc-82bd588dde39","Type":"ContainerDied","Data":"c1b723a5391e262c2acb7500a548e900c3a14779e718889bfb8cad4e6a8fa9ce"}
Jul 24 17:21:10.989451 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:10.989289    2575 scope.go:117] "RemoveContainer" containerID="c1b723a5391e262c2acb7500a548e900c3a14779e718889bfb8cad4e6a8fa9ce"
Jul 24 17:21:11.993111 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:11.993078    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c785b6f8-s6kvx" event={"ID":"bf1cfd3e-5e2e-49ee-92fc-82bd588dde39","Type":"ContainerStarted","Data":"41c5750ffb63409c4adc67415a135dc61f85a8b2f5451a11cf9ef3e44d72254c"}
Jul 24 17:21:13.113364 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:13.113325    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:21:38.580489 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:38.580455    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:21:38.678483 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:38.678447    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:21:40.763554 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:40.763515    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:21:40.821635 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:40.821606    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:21:43.353859 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:43.353821    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:21:43.440115 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:43.440074    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:21:43.501667 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:43.501631    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:21:44.206419 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:44.206385    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6sxsj"]
Jul 24 17:21:44.208728 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:44.208703    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6sxsj"
Jul 24 17:21:44.211183 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:44.211156    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 24 17:21:44.211183 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:44.211174    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-bstvq\""
Jul 24 17:21:44.211895 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:44.211868    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 24 17:21:44.211895 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:44.211884    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 24 17:21:44.211895 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:44.211891    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 24 17:21:44.224772 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:44.224742    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6sxsj"]
Jul 24 17:21:44.243139 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:44.243103    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/04439a3e-ccd9-435d-925f-aaca4fbc2faf-data-volume\") pod \"insights-runtime-extractor-6sxsj\" (UID: \"04439a3e-ccd9-435d-925f-aaca4fbc2faf\") " pod="openshift-insights/insights-runtime-extractor-6sxsj"
Jul 24 17:21:44.243139 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:44.243141    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/04439a3e-ccd9-435d-925f-aaca4fbc2faf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6sxsj\" (UID: \"04439a3e-ccd9-435d-925f-aaca4fbc2faf\") " pod="openshift-insights/insights-runtime-extractor-6sxsj"
Jul 24 17:21:44.243395 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:44.243180    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/04439a3e-ccd9-435d-925f-aaca4fbc2faf-crio-socket\") pod \"insights-runtime-extractor-6sxsj\" (UID: \"04439a3e-ccd9-435d-925f-aaca4fbc2faf\") " pod="openshift-insights/insights-runtime-extractor-6sxsj"
Jul 24 17:21:44.243395 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:44.243204    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/04439a3e-ccd9-435d-925f-aaca4fbc2faf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6sxsj\" (UID: \"04439a3e-ccd9-435d-925f-aaca4fbc2faf\") " pod="openshift-insights/insights-runtime-extractor-6sxsj"
Jul 24 17:21:44.243395 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:44.243328    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbx6k\" (UniqueName: \"kubernetes.io/projected/04439a3e-ccd9-435d-925f-aaca4fbc2faf-kube-api-access-qbx6k\") pod \"insights-runtime-extractor-6sxsj\" (UID: \"04439a3e-ccd9-435d-925f-aaca4fbc2faf\") " pod="openshift-insights/insights-runtime-extractor-6sxsj"
Jul 24 17:21:44.253078 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:44.253046    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:21:44.315083 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:44.315042    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:21:44.344140 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:44.344108    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbx6k\" (UniqueName: \"kubernetes.io/projected/04439a3e-ccd9-435d-925f-aaca4fbc2faf-kube-api-access-qbx6k\") pod \"insights-runtime-extractor-6sxsj\" (UID: \"04439a3e-ccd9-435d-925f-aaca4fbc2faf\") " pod="openshift-insights/insights-runtime-extractor-6sxsj"
Jul 24 17:21:44.344236 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:44.344161    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/04439a3e-ccd9-435d-925f-aaca4fbc2faf-data-volume\") pod \"insights-runtime-extractor-6sxsj\" (UID: \"04439a3e-ccd9-435d-925f-aaca4fbc2faf\") " pod="openshift-insights/insights-runtime-extractor-6sxsj"
Jul 24 17:21:44.344236 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:44.344188    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/04439a3e-ccd9-435d-925f-aaca4fbc2faf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6sxsj\" (UID: \"04439a3e-ccd9-435d-925f-aaca4fbc2faf\") " pod="openshift-insights/insights-runtime-extractor-6sxsj"
Jul 24 17:21:44.344236 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:44.344224    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/04439a3e-ccd9-435d-925f-aaca4fbc2faf-crio-socket\") pod \"insights-runtime-extractor-6sxsj\" (UID: \"04439a3e-ccd9-435d-925f-aaca4fbc2faf\") " pod="openshift-insights/insights-runtime-extractor-6sxsj"
Jul 24 17:21:44.344438 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:44.344251    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/04439a3e-ccd9-435d-925f-aaca4fbc2faf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6sxsj\" (UID: \"04439a3e-ccd9-435d-925f-aaca4fbc2faf\") " pod="openshift-insights/insights-runtime-extractor-6sxsj"
Jul 24 17:21:44.344438 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:44.344366    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/04439a3e-ccd9-435d-925f-aaca4fbc2faf-crio-socket\") pod \"insights-runtime-extractor-6sxsj\" (UID: \"04439a3e-ccd9-435d-925f-aaca4fbc2faf\") " pod="openshift-insights/insights-runtime-extractor-6sxsj"
Jul 24 17:21:44.344438 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:21:44.344381    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 17:21:44.344585 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:21:44.344450    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04439a3e-ccd9-435d-925f-aaca4fbc2faf-insights-runtime-extractor-tls podName:04439a3e-ccd9-435d-925f-aaca4fbc2faf nodeName:}" failed. No retries permitted until 2026-07-24 17:21:44.844433923 +0000 UTC m=+240.325809521 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/04439a3e-ccd9-435d-925f-aaca4fbc2faf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6sxsj" (UID: "04439a3e-ccd9-435d-925f-aaca4fbc2faf") : secret "insights-runtime-extractor-tls" not found
Jul 24 17:21:44.344585 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:21:44.344463    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 17:21:44.344585 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:44.344474    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/04439a3e-ccd9-435d-925f-aaca4fbc2faf-data-volume\") pod \"insights-runtime-extractor-6sxsj\" (UID: \"04439a3e-ccd9-435d-925f-aaca4fbc2faf\") " pod="openshift-insights/insights-runtime-extractor-6sxsj"
Jul 24 17:21:44.344585 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:21:44.344552    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/04439a3e-ccd9-435d-925f-aaca4fbc2faf-kube-rbac-proxy-cm podName:04439a3e-ccd9-435d-925f-aaca4fbc2faf nodeName:}" failed. No retries permitted until 2026-07-24 17:21:44.844532525 +0000 UTC m=+240.325908138 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/04439a3e-ccd9-435d-925f-aaca4fbc2faf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6sxsj" (UID: "04439a3e-ccd9-435d-925f-aaca4fbc2faf") : configmap "kube-rbac-proxy" not found
Jul 24 17:21:44.352550 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:44.352520    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbx6k\" (UniqueName: \"kubernetes.io/projected/04439a3e-ccd9-435d-925f-aaca4fbc2faf-kube-api-access-qbx6k\") pod \"insights-runtime-extractor-6sxsj\" (UID: \"04439a3e-ccd9-435d-925f-aaca4fbc2faf\") " pod="openshift-insights/insights-runtime-extractor-6sxsj"
Jul 24 17:21:44.507820 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:44.507732    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:21:44.576701 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:44.576670    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:21:44.848519 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:44.848482    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/04439a3e-ccd9-435d-925f-aaca4fbc2faf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6sxsj\" (UID: \"04439a3e-ccd9-435d-925f-aaca4fbc2faf\") " pod="openshift-insights/insights-runtime-extractor-6sxsj"
Jul 24 17:21:44.848704 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:44.848532    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/04439a3e-ccd9-435d-925f-aaca4fbc2faf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6sxsj\" (UID: \"04439a3e-ccd9-435d-925f-aaca4fbc2faf\") " pod="openshift-insights/insights-runtime-extractor-6sxsj"
Jul 24 17:21:44.848704 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:21:44.848610    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 17:21:44.848704 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:21:44.848623    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 17:21:44.848704 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:21:44.848675    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04439a3e-ccd9-435d-925f-aaca4fbc2faf-insights-runtime-extractor-tls podName:04439a3e-ccd9-435d-925f-aaca4fbc2faf nodeName:}" failed. No retries permitted until 2026-07-24 17:21:45.848661392 +0000 UTC m=+241.330036991 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/04439a3e-ccd9-435d-925f-aaca4fbc2faf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6sxsj" (UID: "04439a3e-ccd9-435d-925f-aaca4fbc2faf") : secret "insights-runtime-extractor-tls" not found
Jul 24 17:21:44.848704 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:21:44.848689    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/04439a3e-ccd9-435d-925f-aaca4fbc2faf-kube-rbac-proxy-cm podName:04439a3e-ccd9-435d-925f-aaca4fbc2faf nodeName:}" failed. No retries permitted until 2026-07-24 17:21:45.848683365 +0000 UTC m=+241.330058963 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/04439a3e-ccd9-435d-925f-aaca4fbc2faf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6sxsj" (UID: "04439a3e-ccd9-435d-925f-aaca4fbc2faf") : configmap "kube-rbac-proxy" not found
Jul 24 17:21:44.930925 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:44.930893    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:21:45.032912 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:45.032881    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:21:45.302501 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:45.302468    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:21:45.402322 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:45.402286    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:21:45.753479 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:45.753398    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:21:45.809133 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:45.809107    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:21:45.858214 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:45.858186    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/04439a3e-ccd9-435d-925f-aaca4fbc2faf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6sxsj\" (UID: \"04439a3e-ccd9-435d-925f-aaca4fbc2faf\") " pod="openshift-insights/insights-runtime-extractor-6sxsj"
Jul 24 17:21:45.858321 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:45.858228    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/04439a3e-ccd9-435d-925f-aaca4fbc2faf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6sxsj\" (UID: \"04439a3e-ccd9-435d-925f-aaca4fbc2faf\") " pod="openshift-insights/insights-runtime-extractor-6sxsj"
Jul 24 17:21:45.858363 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:21:45.858317    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 17:21:45.858363 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:21:45.858341    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 17:21:45.858424 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:21:45.858385    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/04439a3e-ccd9-435d-925f-aaca4fbc2faf-kube-rbac-proxy-cm podName:04439a3e-ccd9-435d-925f-aaca4fbc2faf nodeName:}" failed. No retries permitted until 2026-07-24 17:21:47.858369472 +0000 UTC m=+243.339745069 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/04439a3e-ccd9-435d-925f-aaca4fbc2faf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6sxsj" (UID: "04439a3e-ccd9-435d-925f-aaca4fbc2faf") : configmap "kube-rbac-proxy" not found
Jul 24 17:21:45.858424 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:21:45.858400    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04439a3e-ccd9-435d-925f-aaca4fbc2faf-insights-runtime-extractor-tls podName:04439a3e-ccd9-435d-925f-aaca4fbc2faf nodeName:}" failed. No retries permitted until 2026-07-24 17:21:47.858394293 +0000 UTC m=+243.339769891 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/04439a3e-ccd9-435d-925f-aaca4fbc2faf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6sxsj" (UID: "04439a3e-ccd9-435d-925f-aaca4fbc2faf") : secret "insights-runtime-extractor-tls" not found
Jul 24 17:21:46.840628 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:46.840593    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:21:46.941157 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:46.941124    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:21:47.199519 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:47.199445    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zkp2w_7d278b8d-3bae-40ee-9eaa-ce1f87ae92b8/dns-node-resolver/0.log"
Jul 24 17:21:47.825501 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:47.825469    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:21:47.875024 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:47.874991    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/04439a3e-ccd9-435d-925f-aaca4fbc2faf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6sxsj\" (UID: \"04439a3e-ccd9-435d-925f-aaca4fbc2faf\") " pod="openshift-insights/insights-runtime-extractor-6sxsj"
Jul 24 17:21:47.875349 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:47.875063    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/04439a3e-ccd9-435d-925f-aaca4fbc2faf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6sxsj\" (UID: \"04439a3e-ccd9-435d-925f-aaca4fbc2faf\") " pod="openshift-insights/insights-runtime-extractor-6sxsj"
Jul 24 17:21:47.875349 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:21:47.875130    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 17:21:47.875349 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:21:47.875139    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 17:21:47.875349 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:21:47.875184    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/04439a3e-ccd9-435d-925f-aaca4fbc2faf-kube-rbac-proxy-cm podName:04439a3e-ccd9-435d-925f-aaca4fbc2faf nodeName:}" failed. No retries permitted until 2026-07-24 17:21:51.875170397 +0000 UTC m=+247.356545995 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/04439a3e-ccd9-435d-925f-aaca4fbc2faf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6sxsj" (UID: "04439a3e-ccd9-435d-925f-aaca4fbc2faf") : configmap "kube-rbac-proxy" not found
Jul 24 17:21:47.875349 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:21:47.875196    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04439a3e-ccd9-435d-925f-aaca4fbc2faf-insights-runtime-extractor-tls podName:04439a3e-ccd9-435d-925f-aaca4fbc2faf nodeName:}" failed. No retries permitted until 2026-07-24 17:21:51.875190401 +0000 UTC m=+247.356565998 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/04439a3e-ccd9-435d-925f-aaca4fbc2faf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6sxsj" (UID: "04439a3e-ccd9-435d-925f-aaca4fbc2faf") : secret "insights-runtime-extractor-tls" not found
Jul 24 17:21:48.005313 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:48.005287    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tctfm_3973a6c6-5e57-490f-a57d-6eed74df9217/node-ca/0.log"
Jul 24 17:21:48.088063 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:48.087978    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:21:48.229139 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:48.229104    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:21:48.334605 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:48.334570    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:21:48.429881 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:48.429760    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:21:48.529905 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:48.529849    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:21:48.771054 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:48.770931    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:21:48.999470 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:48.999440    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pk8tw_04c5443f-c66f-4640-9773-2ffeed796fe6/serve-healthcheck-canary/0.log"
Jul 24 17:21:49.767573 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:49.767537    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:21:50.159368 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:50.159331    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:21:50.358495 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:50.358462    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:21:50.556711 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:50.556685    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:21:50.763702 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:50.763671    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:21:51.223090 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:51.223058    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:21:51.837180 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:51.837149    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:21:51.909188 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:51.909150    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/04439a3e-ccd9-435d-925f-aaca4fbc2faf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6sxsj\" (UID: \"04439a3e-ccd9-435d-925f-aaca4fbc2faf\") " pod="openshift-insights/insights-runtime-extractor-6sxsj"
Jul 24 17:21:51.909302 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:51.909196    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/04439a3e-ccd9-435d-925f-aaca4fbc2faf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6sxsj\" (UID: \"04439a3e-ccd9-435d-925f-aaca4fbc2faf\") " pod="openshift-insights/insights-runtime-extractor-6sxsj"
Jul 24 17:21:51.909302 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:21:51.909273    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 17:21:51.909302 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:21:51.909297    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 17:21:51.909423 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:21:51.909339    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/04439a3e-ccd9-435d-925f-aaca4fbc2faf-kube-rbac-proxy-cm podName:04439a3e-ccd9-435d-925f-aaca4fbc2faf nodeName:}" failed. No retries permitted until 2026-07-24 17:21:59.909320497 +0000 UTC m=+255.390696094 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/04439a3e-ccd9-435d-925f-aaca4fbc2faf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6sxsj" (UID: "04439a3e-ccd9-435d-925f-aaca4fbc2faf") : configmap "kube-rbac-proxy" not found
Jul 24 17:21:51.909423 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:21:51.909353    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04439a3e-ccd9-435d-925f-aaca4fbc2faf-insights-runtime-extractor-tls podName:04439a3e-ccd9-435d-925f-aaca4fbc2faf nodeName:}" failed. No retries permitted until 2026-07-24 17:21:59.909346956 +0000 UTC m=+255.390722554 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/04439a3e-ccd9-435d-925f-aaca4fbc2faf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6sxsj" (UID: "04439a3e-ccd9-435d-925f-aaca4fbc2faf") : secret "insights-runtime-extractor-tls" not found
Jul 24 17:21:51.975056 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:51.975018    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:21:52.079188 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:52.079156    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:21:52.176814 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:52.176728    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:21:52.368654 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:52.368621    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:21:52.569634 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:52.569598    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:21:52.752919 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:52.752882    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:21:53.760389 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:53.760354    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:21:54.160021 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:54.159982    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:21:54.358899 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:54.358860    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:21:54.538294 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:54.538262    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:21:54.593355 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:54.593320    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:21:54.950315 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:54.950227    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:21:55.558232 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:55.558196    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:21:56.156286 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:56.156252    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:21:56.356033 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:56.356002    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:21:56.576572 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:56.576540    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:21:56.750954 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:56.750916    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:21:56.947883 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:56.947794    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd3f02c9-192b-420b-9678-5ed4a7d251d8-metrics-certs\") pod \"network-metrics-daemon-mbmql\" (UID: \"cd3f02c9-192b-420b-9678-5ed4a7d251d8\") " pod="openshift-multus/network-metrics-daemon-mbmql"
Jul 24 17:21:56.950123 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:56.950096    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd3f02c9-192b-420b-9678-5ed4a7d251d8-metrics-certs\") pod \"network-metrics-daemon-mbmql\" (UID: \"cd3f02c9-192b-420b-9678-5ed4a7d251d8\") " pod="openshift-multus/network-metrics-daemon-mbmql"
Jul 24 17:21:56.955661 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:56.955631    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:21:56.999769 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:56.999735    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ntfrz\""
Jul 24 17:21:57.008480 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:57.008454    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mbmql"
Jul 24 17:21:57.135540 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:57.135509    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mbmql"]
Jul 24 17:21:57.138568 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:21:57.138543    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd3f02c9_192b_420b_9678_5ed4a7d251d8.slice/crio-d8ce558e8832c4ca2ac7698f644402d937620b4628bbf42a382fb3da3c7971d8 WatchSource:0}: Error finding container d8ce558e8832c4ca2ac7698f644402d937620b4628bbf42a382fb3da3c7971d8: Status 404 returned error can't find the container with id d8ce558e8832c4ca2ac7698f644402d937620b4628bbf42a382fb3da3c7971d8
Jul 24 17:21:57.362178 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:57.362146    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:21:58.126346 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:58.126316    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mbmql" event={"ID":"cd3f02c9-192b-420b-9678-5ed4a7d251d8","Type":"ContainerStarted","Data":"d8ce558e8832c4ca2ac7698f644402d937620b4628bbf42a382fb3da3c7971d8"}
Jul 24 17:21:58.166594 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:58.166539    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:21:58.361641 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:58.361554    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:21:58.555538 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:58.555491    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:21:58.754553 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:58.754458    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:21:59.131066 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:59.131031    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mbmql" event={"ID":"cd3f02c9-192b-420b-9678-5ed4a7d251d8","Type":"ContainerStarted","Data":"699cf48fd21aa8b8989a54ee426d661ff200f0ef937f52bf65f41bf81a61de27"}
Jul 24 17:21:59.131242 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:59.131100    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mbmql" event={"ID":"cd3f02c9-192b-420b-9678-5ed4a7d251d8","Type":"ContainerStarted","Data":"ad63b4b57e866abd3116af86003b55e6d1c5af2e2e968d17800c94ecd87c9de8"}
Jul 24 17:21:59.150426 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:59.150375    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-mbmql" podStartSLOduration=253.218858848 podStartE2EDuration="4m14.150358487s" totalImagesPullingTime="931.499639ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:17:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:21:59.148909996 +0000 UTC m=+254.630285616" watchObservedRunningTime="2026-07-24 17:21:59.150358487 +0000 UTC m=+254.631734108"
Jul 24 17:21:59.779384 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:59.779355    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:21:59.972059 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:59.972026    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/04439a3e-ccd9-435d-925f-aaca4fbc2faf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6sxsj\" (UID: \"04439a3e-ccd9-435d-925f-aaca4fbc2faf\") " pod="openshift-insights/insights-runtime-extractor-6sxsj"
Jul 24 17:21:59.972236 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:59.972070    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/04439a3e-ccd9-435d-925f-aaca4fbc2faf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6sxsj\" (UID: \"04439a3e-ccd9-435d-925f-aaca4fbc2faf\") " pod="openshift-insights/insights-runtime-extractor-6sxsj"
Jul 24 17:21:59.972586 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:59.972566    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/04439a3e-ccd9-435d-925f-aaca4fbc2faf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6sxsj\" (UID: \"04439a3e-ccd9-435d-925f-aaca4fbc2faf\") " pod="openshift-insights/insights-runtime-extractor-6sxsj"
Jul 24 17:21:59.974365 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:21:59.974341    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/04439a3e-ccd9-435d-925f-aaca4fbc2faf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6sxsj\" (UID: \"04439a3e-ccd9-435d-925f-aaca4fbc2faf\") " pod="openshift-insights/insights-runtime-extractor-6sxsj"
Jul 24 17:22:00.119916 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:00.119884    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-bstvq\""
Jul 24 17:22:00.127799 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:00.127776    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6sxsj"
Jul 24 17:22:00.261885 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:00.261855    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6sxsj"]
Jul 24 17:22:00.266095 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:22:00.266066    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04439a3e_ccd9_435d_925f_aaca4fbc2faf.slice/crio-774a4adbca792e7e6d5c480ce424d2007c84c468c366009c04d34d8272aca4ef WatchSource:0}: Error finding container 774a4adbca792e7e6d5c480ce424d2007c84c468c366009c04d34d8272aca4ef: Status 404 returned error can't find the container with id 774a4adbca792e7e6d5c480ce424d2007c84c468c366009c04d34d8272aca4ef
Jul 24 17:22:01.140757 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:01.140665    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6sxsj" event={"ID":"04439a3e-ccd9-435d-925f-aaca4fbc2faf","Type":"ContainerStarted","Data":"774a4adbca792e7e6d5c480ce424d2007c84c468c366009c04d34d8272aca4ef"}
Jul 24 17:22:04.360290 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:04.360255    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:04.461420 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:04.461385    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:06.159690 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:06.159596    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6sxsj" event={"ID":"04439a3e-ccd9-435d-925f-aaca4fbc2faf","Type":"ContainerStarted","Data":"d02b3b0577426d77b4a1babfc1be2dc978cfa1ae8415a9b123289254d82bc8f0"}
Jul 24 17:22:09.172365 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:09.172323    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6sxsj" event={"ID":"04439a3e-ccd9-435d-925f-aaca4fbc2faf","Type":"ContainerStarted","Data":"b935134ff77c55196d464a4867454233130137ea722c29b3e2effc24c63a09f6"}
Jul 24 17:22:10.444467 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:10.444424    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-75f447c5bc-ntvsq"]
Jul 24 17:22:10.447892 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:10.447835    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75f447c5bc-ntvsq"
Jul 24 17:22:10.450991 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:10.450958    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 24 17:22:10.450991 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:10.450989    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 24 17:22:10.451281 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:10.451255    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 24 17:22:10.451678 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:10.451658    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-p7fvc\""
Jul 24 17:22:10.463360 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:10.463282    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 24 17:22:10.463360 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:10.463304    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-75f447c5bc-ntvsq"]
Jul 24 17:22:10.508954 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:10.508902    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:10.556275 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:10.556221    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eea8a5dd-2177-4fab-ac03-57889c896c57-image-registry-private-configuration\") pod \"image-registry-75f447c5bc-ntvsq\" (UID: \"eea8a5dd-2177-4fab-ac03-57889c896c57\") " pod="openshift-image-registry/image-registry-75f447c5bc-ntvsq"
Jul 24 17:22:10.556275 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:10.556280    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eea8a5dd-2177-4fab-ac03-57889c896c57-trusted-ca\") pod \"image-registry-75f447c5bc-ntvsq\" (UID: \"eea8a5dd-2177-4fab-ac03-57889c896c57\") " pod="openshift-image-registry/image-registry-75f447c5bc-ntvsq"
Jul 24 17:22:10.556508 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:10.556303    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eea8a5dd-2177-4fab-ac03-57889c896c57-registry-certificates\") pod \"image-registry-75f447c5bc-ntvsq\" (UID: \"eea8a5dd-2177-4fab-ac03-57889c896c57\") " pod="openshift-image-registry/image-registry-75f447c5bc-ntvsq"
Jul 24 17:22:10.556508 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:10.556338    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eea8a5dd-2177-4fab-ac03-57889c896c57-ca-trust-extracted\") pod \"image-registry-75f447c5bc-ntvsq\" (UID: \"eea8a5dd-2177-4fab-ac03-57889c896c57\") " pod="openshift-image-registry/image-registry-75f447c5bc-ntvsq"
Jul 24 17:22:10.556508 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:10.556370    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eea8a5dd-2177-4fab-ac03-57889c896c57-registry-tls\") pod \"image-registry-75f447c5bc-ntvsq\" (UID: \"eea8a5dd-2177-4fab-ac03-57889c896c57\") " pod="openshift-image-registry/image-registry-75f447c5bc-ntvsq"
Jul 24 17:22:10.556508 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:10.556397    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eea8a5dd-2177-4fab-ac03-57889c896c57-bound-sa-token\") pod \"image-registry-75f447c5bc-ntvsq\" (UID: \"eea8a5dd-2177-4fab-ac03-57889c896c57\") " pod="openshift-image-registry/image-registry-75f447c5bc-ntvsq"
Jul 24 17:22:10.556508 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:10.556427    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eea8a5dd-2177-4fab-ac03-57889c896c57-installation-pull-secrets\") pod \"image-registry-75f447c5bc-ntvsq\" (UID: \"eea8a5dd-2177-4fab-ac03-57889c896c57\") " pod="openshift-image-registry/image-registry-75f447c5bc-ntvsq"
Jul 24 17:22:10.556508 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:10.556474    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tj6mz\" (UniqueName: \"kubernetes.io/projected/eea8a5dd-2177-4fab-ac03-57889c896c57-kube-api-access-tj6mz\") pod \"image-registry-75f447c5bc-ntvsq\" (UID: \"eea8a5dd-2177-4fab-ac03-57889c896c57\") " pod="openshift-image-registry/image-registry-75f447c5bc-ntvsq"
Jul 24 17:22:10.605764 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:10.605718    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:10.657153 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:10.657111    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eea8a5dd-2177-4fab-ac03-57889c896c57-image-registry-private-configuration\") pod \"image-registry-75f447c5bc-ntvsq\" (UID: \"eea8a5dd-2177-4fab-ac03-57889c896c57\") " pod="openshift-image-registry/image-registry-75f447c5bc-ntvsq"
Jul 24 17:22:10.657337 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:10.657164    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eea8a5dd-2177-4fab-ac03-57889c896c57-trusted-ca\") pod \"image-registry-75f447c5bc-ntvsq\" (UID: \"eea8a5dd-2177-4fab-ac03-57889c896c57\") " pod="openshift-image-registry/image-registry-75f447c5bc-ntvsq"
Jul 24 17:22:10.657337 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:10.657191    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eea8a5dd-2177-4fab-ac03-57889c896c57-registry-certificates\") pod \"image-registry-75f447c5bc-ntvsq\" (UID: \"eea8a5dd-2177-4fab-ac03-57889c896c57\") " pod="openshift-image-registry/image-registry-75f447c5bc-ntvsq"
Jul 24 17:22:10.657337 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:10.657225    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eea8a5dd-2177-4fab-ac03-57889c896c57-ca-trust-extracted\") pod \"image-registry-75f447c5bc-ntvsq\" (UID: \"eea8a5dd-2177-4fab-ac03-57889c896c57\") " pod="openshift-image-registry/image-registry-75f447c5bc-ntvsq"
Jul 24 17:22:10.657337 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:10.657255    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eea8a5dd-2177-4fab-ac03-57889c896c57-registry-tls\") pod \"image-registry-75f447c5bc-ntvsq\" (UID: \"eea8a5dd-2177-4fab-ac03-57889c896c57\") " pod="openshift-image-registry/image-registry-75f447c5bc-ntvsq"
Jul 24 17:22:10.657337 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:10.657283    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eea8a5dd-2177-4fab-ac03-57889c896c57-bound-sa-token\") pod \"image-registry-75f447c5bc-ntvsq\" (UID: \"eea8a5dd-2177-4fab-ac03-57889c896c57\") " pod="openshift-image-registry/image-registry-75f447c5bc-ntvsq"
Jul 24 17:22:10.657337 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:10.657308    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eea8a5dd-2177-4fab-ac03-57889c896c57-installation-pull-secrets\") pod \"image-registry-75f447c5bc-ntvsq\" (UID: \"eea8a5dd-2177-4fab-ac03-57889c896c57\") " pod="openshift-image-registry/image-registry-75f447c5bc-ntvsq"
Jul 24 17:22:10.657644 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:10.657349    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tj6mz\" (UniqueName: \"kubernetes.io/projected/eea8a5dd-2177-4fab-ac03-57889c896c57-kube-api-access-tj6mz\") pod \"image-registry-75f447c5bc-ntvsq\" (UID: \"eea8a5dd-2177-4fab-ac03-57889c896c57\") " pod="openshift-image-registry/image-registry-75f447c5bc-ntvsq"
Jul 24 17:22:10.657932 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:10.657902    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eea8a5dd-2177-4fab-ac03-57889c896c57-ca-trust-extracted\") pod \"image-registry-75f447c5bc-ntvsq\" (UID: \"eea8a5dd-2177-4fab-ac03-57889c896c57\") " pod="openshift-image-registry/image-registry-75f447c5bc-ntvsq"
Jul 24 17:22:10.658256 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:10.658201    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eea8a5dd-2177-4fab-ac03-57889c896c57-registry-certificates\") pod \"image-registry-75f447c5bc-ntvsq\" (UID: \"eea8a5dd-2177-4fab-ac03-57889c896c57\") " pod="openshift-image-registry/image-registry-75f447c5bc-ntvsq"
Jul 24 17:22:10.658256 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:10.658212    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eea8a5dd-2177-4fab-ac03-57889c896c57-trusted-ca\") pod \"image-registry-75f447c5bc-ntvsq\" (UID: \"eea8a5dd-2177-4fab-ac03-57889c896c57\") " pod="openshift-image-registry/image-registry-75f447c5bc-ntvsq"
Jul 24 17:22:10.660122 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:10.660094    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eea8a5dd-2177-4fab-ac03-57889c896c57-image-registry-private-configuration\") pod \"image-registry-75f447c5bc-ntvsq\" (UID: \"eea8a5dd-2177-4fab-ac03-57889c896c57\") " pod="openshift-image-registry/image-registry-75f447c5bc-ntvsq"
Jul 24 17:22:10.660721 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:10.660690    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eea8a5dd-2177-4fab-ac03-57889c896c57-registry-tls\") pod \"image-registry-75f447c5bc-ntvsq\" (UID: \"eea8a5dd-2177-4fab-ac03-57889c896c57\") " pod="openshift-image-registry/image-registry-75f447c5bc-ntvsq"
Jul 24 17:22:10.660809 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:10.660743    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eea8a5dd-2177-4fab-ac03-57889c896c57-installation-pull-secrets\") pod \"image-registry-75f447c5bc-ntvsq\" (UID: \"eea8a5dd-2177-4fab-ac03-57889c896c57\") " pod="openshift-image-registry/image-registry-75f447c5bc-ntvsq"
Jul 24 17:22:10.667304 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:10.667271    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tj6mz\" (UniqueName: \"kubernetes.io/projected/eea8a5dd-2177-4fab-ac03-57889c896c57-kube-api-access-tj6mz\") pod \"image-registry-75f447c5bc-ntvsq\" (UID: \"eea8a5dd-2177-4fab-ac03-57889c896c57\") " pod="openshift-image-registry/image-registry-75f447c5bc-ntvsq"
Jul 24 17:22:10.667662 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:10.667641    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eea8a5dd-2177-4fab-ac03-57889c896c57-bound-sa-token\") pod \"image-registry-75f447c5bc-ntvsq\" (UID: \"eea8a5dd-2177-4fab-ac03-57889c896c57\") " pod="openshift-image-registry/image-registry-75f447c5bc-ntvsq"
Jul 24 17:22:10.705425 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:10.705326    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:10.759185 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:10.759154    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75f447c5bc-ntvsq"
Jul 24 17:22:10.835050 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:10.835001    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:10.892021 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:10.891974    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:12.087275 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:12.087236    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-75f447c5bc-ntvsq"]
Jul 24 17:22:12.090389 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:22:12.090359    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeea8a5dd_2177_4fab_ac03_57889c896c57.slice/crio-64865f53228695b179f0534847b9f035348ca326f2eaed4203777b12daa253cf WatchSource:0}: Error finding container 64865f53228695b179f0534847b9f035348ca326f2eaed4203777b12daa253cf: Status 404 returned error can't find the container with id 64865f53228695b179f0534847b9f035348ca326f2eaed4203777b12daa253cf
Jul 24 17:22:12.183577 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:12.183540    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75f447c5bc-ntvsq" event={"ID":"eea8a5dd-2177-4fab-ac03-57889c896c57","Type":"ContainerStarted","Data":"dc6cb594e0e214f63ec1968b6093ae266bf51e64075d26b9ae2ed2a10fac9bef"}
Jul 24 17:22:12.183777 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:12.183596    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75f447c5bc-ntvsq" event={"ID":"eea8a5dd-2177-4fab-ac03-57889c896c57","Type":"ContainerStarted","Data":"64865f53228695b179f0534847b9f035348ca326f2eaed4203777b12daa253cf"}
Jul 24 17:22:12.183777 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:12.183619    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-75f447c5bc-ntvsq"
Jul 24 17:22:12.187625 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:12.187600    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6sxsj" event={"ID":"04439a3e-ccd9-435d-925f-aaca4fbc2faf","Type":"ContainerStarted","Data":"33553c7ddc3b34e6b3019342c37dfa3a2e74d58fb0fd5424927265eccb3e8039"}
Jul 24 17:22:12.203191 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:12.203131    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-75f447c5bc-ntvsq" podStartSLOduration=2.203081604 podStartE2EDuration="2.203081604s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:22:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:22:12.202017875 +0000 UTC m=+267.683393495" watchObservedRunningTime="2026-07-24 17:22:12.203081604 +0000 UTC m=+267.684457225"
Jul 24 17:22:12.219794 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:12.219524    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6sxsj" podStartSLOduration=16.607435141 podStartE2EDuration="28.219504867s" totalImagesPullingTime="11.612069726s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:21:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:22:12.219263916 +0000 UTC m=+267.700639529" watchObservedRunningTime="2026-07-24 17:22:12.219504867 +0000 UTC m=+267.700880487"
Jul 24 17:22:14.819951 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:14.819914    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:14.917877 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:14.917841    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:14.981482 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:14.981438    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:15.324594 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:15.324565    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:18.014325 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:18.014293    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:18.115235 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:18.115195    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:18.215591 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:18.215555    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:20.181765 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:20.181728    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:22.159164 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:22.159128    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:22.262654 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:22.262615    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:22.378099 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:22.378063    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:22.421546 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:22.421460    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fnl4m"]
Jul 24 17:22:22.425143 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:22.425125    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fnl4m"
Jul 24 17:22:22.427957 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:22.427921    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 24 17:22:22.428073 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:22.428037    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 24 17:22:22.428311 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:22.428298    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 24 17:22:22.428725 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:22.428694    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 24 17:22:22.428830 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:22.428726    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2zddw\""
Jul 24 17:22:22.428830 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:22.428760    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 24 17:22:22.428830 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:22.428706    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 24 17:22:22.466820 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:22.466774    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:22.528928 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:22.528898    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:22.545007 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:22.544972    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/79f06248-787f-439a-95a6-5ffa04758581-node-exporter-textfile\") pod \"node-exporter-fnl4m\" (UID: \"79f06248-787f-439a-95a6-5ffa04758581\") " pod="openshift-monitoring/node-exporter-fnl4m"
Jul 24 17:22:22.545007 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:22.545006    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/79f06248-787f-439a-95a6-5ffa04758581-node-exporter-tls\") pod \"node-exporter-fnl4m\" (UID: \"79f06248-787f-439a-95a6-5ffa04758581\") " pod="openshift-monitoring/node-exporter-fnl4m"
Jul 24 17:22:22.545207 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:22.545025    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/79f06248-787f-439a-95a6-5ffa04758581-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fnl4m\" (UID: \"79f06248-787f-439a-95a6-5ffa04758581\") " pod="openshift-monitoring/node-exporter-fnl4m"
Jul 24 17:22:22.545207 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:22.545053    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/79f06248-787f-439a-95a6-5ffa04758581-node-exporter-accelerators-collector-config\") pod \"node-exporter-fnl4m\" (UID: \"79f06248-787f-439a-95a6-5ffa04758581\") " pod="openshift-monitoring/node-exporter-fnl4m"
Jul 24 17:22:22.545207 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:22.545116    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79f06248-787f-439a-95a6-5ffa04758581-metrics-client-ca\") pod \"node-exporter-fnl4m\" (UID: \"79f06248-787f-439a-95a6-5ffa04758581\") " pod="openshift-monitoring/node-exporter-fnl4m"
Jul 24 17:22:22.545207 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:22.545188    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/79f06248-787f-439a-95a6-5ffa04758581-node-exporter-wtmp\") pod \"node-exporter-fnl4m\" (UID: \"79f06248-787f-439a-95a6-5ffa04758581\") " pod="openshift-monitoring/node-exporter-fnl4m"
Jul 24 17:22:22.545359 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:22.545210    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/79f06248-787f-439a-95a6-5ffa04758581-sys\") pod \"node-exporter-fnl4m\" (UID: \"79f06248-787f-439a-95a6-5ffa04758581\") " pod="openshift-monitoring/node-exporter-fnl4m"
Jul 24 17:22:22.545359 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:22.545225    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xwd5\" (UniqueName: \"kubernetes.io/projected/79f06248-787f-439a-95a6-5ffa04758581-kube-api-access-8xwd5\") pod \"node-exporter-fnl4m\" (UID: \"79f06248-787f-439a-95a6-5ffa04758581\") " pod="openshift-monitoring/node-exporter-fnl4m"
Jul 24 17:22:22.545359 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:22.545261    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/79f06248-787f-439a-95a6-5ffa04758581-root\") pod \"node-exporter-fnl4m\" (UID: \"79f06248-787f-439a-95a6-5ffa04758581\") " pod="openshift-monitoring/node-exporter-fnl4m"
Jul 24 17:22:22.627177 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:22.627148    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:22.646566 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:22.646509    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/79f06248-787f-439a-95a6-5ffa04758581-node-exporter-tls\") pod \"node-exporter-fnl4m\" (UID: \"79f06248-787f-439a-95a6-5ffa04758581\") " pod="openshift-monitoring/node-exporter-fnl4m"
Jul 24 17:22:22.646737 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:22.646570    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/79f06248-787f-439a-95a6-5ffa04758581-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fnl4m\" (UID: \"79f06248-787f-439a-95a6-5ffa04758581\") " pod="openshift-monitoring/node-exporter-fnl4m"
Jul 24 17:22:22.646737 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:22.646600    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/79f06248-787f-439a-95a6-5ffa04758581-node-exporter-accelerators-collector-config\") pod \"node-exporter-fnl4m\" (UID: \"79f06248-787f-439a-95a6-5ffa04758581\") " pod="openshift-monitoring/node-exporter-fnl4m"
Jul 24 17:22:22.646737 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:22.646640    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79f06248-787f-439a-95a6-5ffa04758581-metrics-client-ca\") pod \"node-exporter-fnl4m\" (UID: \"79f06248-787f-439a-95a6-5ffa04758581\") " pod="openshift-monitoring/node-exporter-fnl4m"
Jul 24 17:22:22.646737 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:22.646699    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/79f06248-787f-439a-95a6-5ffa04758581-node-exporter-wtmp\") pod \"node-exporter-fnl4m\" (UID: \"79f06248-787f-439a-95a6-5ffa04758581\") " pod="openshift-monitoring/node-exporter-fnl4m"
Jul 24 17:22:22.646737 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:22.646725    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/79f06248-787f-439a-95a6-5ffa04758581-sys\") pod \"node-exporter-fnl4m\" (UID: \"79f06248-787f-439a-95a6-5ffa04758581\") " pod="openshift-monitoring/node-exporter-fnl4m"
Jul 24 17:22:22.647028 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:22.646750    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xwd5\" (UniqueName: \"kubernetes.io/projected/79f06248-787f-439a-95a6-5ffa04758581-kube-api-access-8xwd5\") pod \"node-exporter-fnl4m\" (UID: \"79f06248-787f-439a-95a6-5ffa04758581\") " pod="openshift-monitoring/node-exporter-fnl4m"
Jul 24 17:22:22.647028 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:22.646789    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/79f06248-787f-439a-95a6-5ffa04758581-root\") pod \"node-exporter-fnl4m\" (UID: \"79f06248-787f-439a-95a6-5ffa04758581\") " pod="openshift-monitoring/node-exporter-fnl4m"
Jul 24 17:22:22.647028 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:22.646819    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/79f06248-787f-439a-95a6-5ffa04758581-node-exporter-textfile\") pod \"node-exporter-fnl4m\" (UID: \"79f06248-787f-439a-95a6-5ffa04758581\") " pod="openshift-monitoring/node-exporter-fnl4m"
Jul 24 17:22:22.647028 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:22.646864    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/79f06248-787f-439a-95a6-5ffa04758581-node-exporter-wtmp\") pod \"node-exporter-fnl4m\" (UID: \"79f06248-787f-439a-95a6-5ffa04758581\") " pod="openshift-monitoring/node-exporter-fnl4m"
Jul 24 17:22:22.647028 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:22.646972    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/79f06248-787f-439a-95a6-5ffa04758581-root\") pod \"node-exporter-fnl4m\" (UID: \"79f06248-787f-439a-95a6-5ffa04758581\") " pod="openshift-monitoring/node-exporter-fnl4m"
Jul 24 17:22:22.647028 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:22.647017    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/79f06248-787f-439a-95a6-5ffa04758581-sys\") pod \"node-exporter-fnl4m\" (UID: \"79f06248-787f-439a-95a6-5ffa04758581\") " pod="openshift-monitoring/node-exporter-fnl4m"
Jul 24 17:22:22.647296 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:22.647219    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/79f06248-787f-439a-95a6-5ffa04758581-node-exporter-textfile\") pod \"node-exporter-fnl4m\" (UID: \"79f06248-787f-439a-95a6-5ffa04758581\") " pod="openshift-monitoring/node-exporter-fnl4m"
Jul 24 17:22:22.647368 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:22.647345    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79f06248-787f-439a-95a6-5ffa04758581-metrics-client-ca\") pod \"node-exporter-fnl4m\" (UID: \"79f06248-787f-439a-95a6-5ffa04758581\") " pod="openshift-monitoring/node-exporter-fnl4m"
Jul 24 17:22:22.647443 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:22.647422    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/79f06248-787f-439a-95a6-5ffa04758581-node-exporter-accelerators-collector-config\") pod \"node-exporter-fnl4m\" (UID: \"79f06248-787f-439a-95a6-5ffa04758581\") " pod="openshift-monitoring/node-exporter-fnl4m"
Jul 24 17:22:22.649105 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:22.649080    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/79f06248-787f-439a-95a6-5ffa04758581-node-exporter-tls\") pod \"node-exporter-fnl4m\" (UID: \"79f06248-787f-439a-95a6-5ffa04758581\") " pod="openshift-monitoring/node-exporter-fnl4m"
Jul 24 17:22:22.649214 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:22.649082    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/79f06248-787f-439a-95a6-5ffa04758581-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fnl4m\" (UID: \"79f06248-787f-439a-95a6-5ffa04758581\") " pod="openshift-monitoring/node-exporter-fnl4m"
Jul 24 17:22:22.656089 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:22.656064    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xwd5\" (UniqueName: \"kubernetes.io/projected/79f06248-787f-439a-95a6-5ffa04758581-kube-api-access-8xwd5\") pod \"node-exporter-fnl4m\" (UID: \"79f06248-787f-439a-95a6-5ffa04758581\") " pod="openshift-monitoring/node-exporter-fnl4m"
Jul 24 17:22:22.727995 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:22.727890    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:22.734611 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:22.734595    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fnl4m"
Jul 24 17:22:22.743681 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:22:22.743656    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79f06248_787f_439a_95a6_5ffa04758581.slice/crio-969c24a860bde427a6b16fe8e7203bfb6f23f1417489862a9d542dda24704032 WatchSource:0}: Error finding container 969c24a860bde427a6b16fe8e7203bfb6f23f1417489862a9d542dda24704032: Status 404 returned error can't find the container with id 969c24a860bde427a6b16fe8e7203bfb6f23f1417489862a9d542dda24704032
Jul 24 17:22:22.845877 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:22.845845    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:22.928989 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:22.928955    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:23.223303 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:23.223263    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fnl4m" event={"ID":"79f06248-787f-439a-95a6-5ffa04758581","Type":"ContainerStarted","Data":"969c24a860bde427a6b16fe8e7203bfb6f23f1417489862a9d542dda24704032"}
Jul 24 17:22:23.383994 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:23.383953    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:23.468316 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:23.468283    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:23.541601 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:23.541564    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:24.228133 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:24.228100    2575 generic.go:356] "Generic (PLEG): container finished" podID="79f06248-787f-439a-95a6-5ffa04758581" containerID="06ef89b490ee20cf81b3124ca05f17299128d607e7c22dd9865fc5f659ff7647" exitCode=0
Jul 24 17:22:24.228538 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:24.228167    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fnl4m" event={"ID":"79f06248-787f-439a-95a6-5ffa04758581","Type":"ContainerDied","Data":"06ef89b490ee20cf81b3124ca05f17299128d607e7c22dd9865fc5f659ff7647"}
Jul 24 17:22:24.397124 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:24.397085    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:24.498577 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:24.498474    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:24.897222 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:24.897188    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:24.967002 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:24.966964    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:25.024539 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:25.024508    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:25.199671 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:25.199574    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:25.237020 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:25.236988    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fnl4m" event={"ID":"79f06248-787f-439a-95a6-5ffa04758581","Type":"ContainerStarted","Data":"9148a45e5537353364f4571474f9abda2a6d6d1a810394bc6b1f919628f9aef8"}
Jul 24 17:22:25.237399 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:25.237073    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fnl4m" event={"ID":"79f06248-787f-439a-95a6-5ffa04758581","Type":"ContainerStarted","Data":"d2ea2e4821c68c2262ee7bb6d2b64a7a1b91c4ebef6fe01208b50b90268386ad"}
Jul 24 17:22:25.257417 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:25.257367    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fnl4m" podStartSLOduration=2.321560209 podStartE2EDuration="3.257352986s" totalImagesPullingTime="870.538429ms" totalInitContainerRuntime="65.254348ms" isStatefulPod=true podCreationTimestamp="2026-07-24 17:22:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:22:25.256300155 +0000 UTC m=+280.737675775" watchObservedRunningTime="2026-07-24 17:22:25.257352986 +0000 UTC m=+280.738728606"
Jul 24 17:22:25.346075 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:25.346043    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:25.433406 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:25.433377    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:25.556171 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:25.556138    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:25.656818 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:25.656787    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:25.757241 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:25.757207    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:25.867913 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:25.867823    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:25.966679 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:25.966645    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:26.025780 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:26.025740    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:26.355662 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:26.355630    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:26.471250 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:26.471214    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:26.567143 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:26.567111    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:26.668466 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:26.668371    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:26.704441 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:26.704409    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-644697c47d-zr5lx"]
Jul 24 17:22:26.706493 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:26.706477    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-644697c47d-zr5lx"
Jul 24 17:22:26.708900 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:26.708879    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 24 17:22:26.709041 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:26.708879    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-aqusrodd9ntvv\""
Jul 24 17:22:26.709989 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:26.709893    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-ddllj\""
Jul 24 17:22:26.709989 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:26.709902    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 24 17:22:26.709989 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:26.709978    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 24 17:22:26.710167 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:26.709994    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 24 17:22:26.718120 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:26.718098    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-644697c47d-zr5lx"]
Jul 24 17:22:26.770592 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:26.770564    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:26.777679 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:26.777659    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e74f0e6b-c2ad-4e3a-b27c-838bf43ae58c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-644697c47d-zr5lx\" (UID: \"e74f0e6b-c2ad-4e3a-b27c-838bf43ae58c\") " pod="openshift-monitoring/metrics-server-644697c47d-zr5lx"
Jul 24 17:22:26.777770 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:26.777692    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e74f0e6b-c2ad-4e3a-b27c-838bf43ae58c-metrics-server-audit-profiles\") pod \"metrics-server-644697c47d-zr5lx\" (UID: \"e74f0e6b-c2ad-4e3a-b27c-838bf43ae58c\") " pod="openshift-monitoring/metrics-server-644697c47d-zr5lx"
Jul 24 17:22:26.777770 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:26.777718    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e74f0e6b-c2ad-4e3a-b27c-838bf43ae58c-client-ca-bundle\") pod \"metrics-server-644697c47d-zr5lx\" (UID: \"e74f0e6b-c2ad-4e3a-b27c-838bf43ae58c\") " pod="openshift-monitoring/metrics-server-644697c47d-zr5lx"
Jul 24 17:22:26.777856 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:26.777771    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e74f0e6b-c2ad-4e3a-b27c-838bf43ae58c-audit-log\") pod \"metrics-server-644697c47d-zr5lx\" (UID: \"e74f0e6b-c2ad-4e3a-b27c-838bf43ae58c\") " pod="openshift-monitoring/metrics-server-644697c47d-zr5lx"
Jul 24 17:22:26.777856 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:26.777800    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htpr2\" (UniqueName: \"kubernetes.io/projected/e74f0e6b-c2ad-4e3a-b27c-838bf43ae58c-kube-api-access-htpr2\") pod \"metrics-server-644697c47d-zr5lx\" (UID: \"e74f0e6b-c2ad-4e3a-b27c-838bf43ae58c\") " pod="openshift-monitoring/metrics-server-644697c47d-zr5lx"
Jul 24 17:22:26.777856 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:26.777828    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e74f0e6b-c2ad-4e3a-b27c-838bf43ae58c-secret-metrics-server-client-certs\") pod \"metrics-server-644697c47d-zr5lx\" (UID: \"e74f0e6b-c2ad-4e3a-b27c-838bf43ae58c\") " pod="openshift-monitoring/metrics-server-644697c47d-zr5lx"
Jul 24 17:22:26.777856 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:26.777848    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e74f0e6b-c2ad-4e3a-b27c-838bf43ae58c-secret-metrics-server-tls\") pod \"metrics-server-644697c47d-zr5lx\" (UID: \"e74f0e6b-c2ad-4e3a-b27c-838bf43ae58c\") " pod="openshift-monitoring/metrics-server-644697c47d-zr5lx"
Jul 24 17:22:26.824761 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:26.824738    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:26.856793 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:22:26.856754    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-5zr4j" podUID="a19606e2-4b58-418c-a6ad-8e70eb8ab5f5"
Jul 24 17:22:26.878562 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:26.878531    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e74f0e6b-c2ad-4e3a-b27c-838bf43ae58c-secret-metrics-server-client-certs\") pod \"metrics-server-644697c47d-zr5lx\" (UID: \"e74f0e6b-c2ad-4e3a-b27c-838bf43ae58c\") " pod="openshift-monitoring/metrics-server-644697c47d-zr5lx"
Jul 24 17:22:26.878681 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:26.878567    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e74f0e6b-c2ad-4e3a-b27c-838bf43ae58c-secret-metrics-server-tls\") pod \"metrics-server-644697c47d-zr5lx\" (UID: \"e74f0e6b-c2ad-4e3a-b27c-838bf43ae58c\") " pod="openshift-monitoring/metrics-server-644697c47d-zr5lx"
Jul 24 17:22:26.878681 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:26.878621    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e74f0e6b-c2ad-4e3a-b27c-838bf43ae58c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-644697c47d-zr5lx\" (UID: \"e74f0e6b-c2ad-4e3a-b27c-838bf43ae58c\") " pod="openshift-monitoring/metrics-server-644697c47d-zr5lx"
Jul 24 17:22:26.878681 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:26.878641    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e74f0e6b-c2ad-4e3a-b27c-838bf43ae58c-metrics-server-audit-profiles\") pod \"metrics-server-644697c47d-zr5lx\" (UID: \"e74f0e6b-c2ad-4e3a-b27c-838bf43ae58c\") " pod="openshift-monitoring/metrics-server-644697c47d-zr5lx"
Jul 24 17:22:26.878681 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:26.878657    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e74f0e6b-c2ad-4e3a-b27c-838bf43ae58c-client-ca-bundle\") pod \"metrics-server-644697c47d-zr5lx\" (UID: \"e74f0e6b-c2ad-4e3a-b27c-838bf43ae58c\") " pod="openshift-monitoring/metrics-server-644697c47d-zr5lx"
Jul 24 17:22:26.878866 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:26.878712    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e74f0e6b-c2ad-4e3a-b27c-838bf43ae58c-audit-log\") pod \"metrics-server-644697c47d-zr5lx\" (UID: \"e74f0e6b-c2ad-4e3a-b27c-838bf43ae58c\") " pod="openshift-monitoring/metrics-server-644697c47d-zr5lx"
Jul 24 17:22:26.878866 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:26.878763    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htpr2\" (UniqueName: \"kubernetes.io/projected/e74f0e6b-c2ad-4e3a-b27c-838bf43ae58c-kube-api-access-htpr2\") pod \"metrics-server-644697c47d-zr5lx\" (UID: \"e74f0e6b-c2ad-4e3a-b27c-838bf43ae58c\") " pod="openshift-monitoring/metrics-server-644697c47d-zr5lx"
Jul 24 17:22:26.879247 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:26.879223    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e74f0e6b-c2ad-4e3a-b27c-838bf43ae58c-audit-log\") pod \"metrics-server-644697c47d-zr5lx\" (UID: \"e74f0e6b-c2ad-4e3a-b27c-838bf43ae58c\") " pod="openshift-monitoring/metrics-server-644697c47d-zr5lx"
Jul 24 17:22:26.879507 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:26.879477    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e74f0e6b-c2ad-4e3a-b27c-838bf43ae58c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-644697c47d-zr5lx\" (UID: \"e74f0e6b-c2ad-4e3a-b27c-838bf43ae58c\") " pod="openshift-monitoring/metrics-server-644697c47d-zr5lx"
Jul 24 17:22:26.879797 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:26.879778    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e74f0e6b-c2ad-4e3a-b27c-838bf43ae58c-metrics-server-audit-profiles\") pod \"metrics-server-644697c47d-zr5lx\" (UID: \"e74f0e6b-c2ad-4e3a-b27c-838bf43ae58c\") " pod="openshift-monitoring/metrics-server-644697c47d-zr5lx"
Jul 24 17:22:26.881081 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:26.881054    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e74f0e6b-c2ad-4e3a-b27c-838bf43ae58c-secret-metrics-server-tls\") pod \"metrics-server-644697c47d-zr5lx\" (UID: \"e74f0e6b-c2ad-4e3a-b27c-838bf43ae58c\") " pod="openshift-monitoring/metrics-server-644697c47d-zr5lx"
Jul 24 17:22:26.881171 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:26.881116    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e74f0e6b-c2ad-4e3a-b27c-838bf43ae58c-client-ca-bundle\") pod \"metrics-server-644697c47d-zr5lx\" (UID: \"e74f0e6b-c2ad-4e3a-b27c-838bf43ae58c\") " pod="openshift-monitoring/metrics-server-644697c47d-zr5lx"
Jul 24 17:22:26.881216 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:26.881188    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e74f0e6b-c2ad-4e3a-b27c-838bf43ae58c-secret-metrics-server-client-certs\") pod \"metrics-server-644697c47d-zr5lx\" (UID: \"e74f0e6b-c2ad-4e3a-b27c-838bf43ae58c\") " pod="openshift-monitoring/metrics-server-644697c47d-zr5lx"
Jul 24 17:22:26.886854 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:26.886819    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htpr2\" (UniqueName: \"kubernetes.io/projected/e74f0e6b-c2ad-4e3a-b27c-838bf43ae58c-kube-api-access-htpr2\") pod \"metrics-server-644697c47d-zr5lx\" (UID: \"e74f0e6b-c2ad-4e3a-b27c-838bf43ae58c\") " pod="openshift-monitoring/metrics-server-644697c47d-zr5lx"
Jul 24 17:22:26.959281 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:26.959192    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:27.015966 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:27.015918    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-644697c47d-zr5lx"
Jul 24 17:22:27.146125 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:27.146092    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-644697c47d-zr5lx"]
Jul 24 17:22:27.150913 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:22:27.150888    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode74f0e6b_c2ad_4e3a_b27c_838bf43ae58c.slice/crio-667ed3710adf68c9ca4cf50cdcf889c285f9462e0bc5cdbe7b00150f9c5afa3f WatchSource:0}: Error finding container 667ed3710adf68c9ca4cf50cdcf889c285f9462e0bc5cdbe7b00150f9c5afa3f: Status 404 returned error can't find the container with id 667ed3710adf68c9ca4cf50cdcf889c285f9462e0bc5cdbe7b00150f9c5afa3f
Jul 24 17:22:27.170274 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:27.170246    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:27.177114 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:27.177086    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-qtgkx"]
Jul 24 17:22:27.179662 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:27.179645    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-qtgkx"
Jul 24 17:22:27.181780 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:27.181756    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 24 17:22:27.181879 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:27.181852    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-hdf4x\""
Jul 24 17:22:27.187186 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:27.187160    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-qtgkx"]
Jul 24 17:22:27.225890 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:27.225805    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:27.243526 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:27.243502    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5zr4j"
Jul 24 17:22:27.243652 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:27.243532    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-644697c47d-zr5lx" event={"ID":"e74f0e6b-c2ad-4e3a-b27c-838bf43ae58c","Type":"ContainerStarted","Data":"667ed3710adf68c9ca4cf50cdcf889c285f9462e0bc5cdbe7b00150f9c5afa3f"}
Jul 24 17:22:27.281094 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:27.281065    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1a74d77f-95a5-48ec-be94-3e103e31db64-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-qtgkx\" (UID: \"1a74d77f-95a5-48ec-be94-3e103e31db64\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-qtgkx"
Jul 24 17:22:27.281236 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:27.281217    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghkbc\" (UniqueName: \"kubernetes.io/projected/1a74d77f-95a5-48ec-be94-3e103e31db64-kube-api-access-ghkbc\") pod \"monitoring-plugin-68b7fc9574-qtgkx\" (UID: \"1a74d77f-95a5-48ec-be94-3e103e31db64\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-qtgkx"
Jul 24 17:22:27.359787 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:27.359755    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:27.381926 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:27.381898    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghkbc\" (UniqueName: \"kubernetes.io/projected/1a74d77f-95a5-48ec-be94-3e103e31db64-kube-api-access-ghkbc\") pod \"monitoring-plugin-68b7fc9574-qtgkx\" (UID: \"1a74d77f-95a5-48ec-be94-3e103e31db64\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-qtgkx"
Jul 24 17:22:27.382065 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:27.381954    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1a74d77f-95a5-48ec-be94-3e103e31db64-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-qtgkx\" (UID: \"1a74d77f-95a5-48ec-be94-3e103e31db64\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-qtgkx"
Jul 24 17:22:27.384312 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:27.384286    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1a74d77f-95a5-48ec-be94-3e103e31db64-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-qtgkx\" (UID: \"1a74d77f-95a5-48ec-be94-3e103e31db64\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-qtgkx"
Jul 24 17:22:27.390736 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:27.390713    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghkbc\" (UniqueName: \"kubernetes.io/projected/1a74d77f-95a5-48ec-be94-3e103e31db64-kube-api-access-ghkbc\") pod \"monitoring-plugin-68b7fc9574-qtgkx\" (UID: \"1a74d77f-95a5-48ec-be94-3e103e31db64\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-qtgkx"
Jul 24 17:22:27.488959 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:27.488857    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-qtgkx"
Jul 24 17:22:27.610501 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:27.610468    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:27.621902 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:27.621869    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-qtgkx"]
Jul 24 17:22:27.625226 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:22:27.625199    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a74d77f_95a5_48ec_be94_3e103e31db64.slice/crio-4a1ea32f9b0475aea9ad44193ca5cb92988959402f36603addc2ed421367d1c4 WatchSource:0}: Error finding container 4a1ea32f9b0475aea9ad44193ca5cb92988959402f36603addc2ed421367d1c4: Status 404 returned error can't find the container with id 4a1ea32f9b0475aea9ad44193ca5cb92988959402f36603addc2ed421367d1c4
Jul 24 17:22:27.692996 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:27.692964    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-c55578b9d-ll8r9"]
Jul 24 17:22:27.695615 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:27.695597    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-c55578b9d-ll8r9"
Jul 24 17:22:27.699083 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:27.699058    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-rw76w\""
Jul 24 17:22:27.699214 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:27.699112    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 24 17:22:27.699338 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:27.699326    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 24 17:22:27.699432 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:27.699413    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 24 17:22:27.699711 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:27.699695    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 24 17:22:27.700117 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:27.700101    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 24 17:22:27.708555 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:27.705492    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 24 17:22:27.714838 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:27.714794    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-c55578b9d-ll8r9"]
Jul 24 17:22:27.785066 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:27.785033    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/90ed21d0-7d00-4791-8f71-d1df1f9b28c8-telemeter-client-tls\") pod \"telemeter-client-c55578b9d-ll8r9\" (UID: \"90ed21d0-7d00-4791-8f71-d1df1f9b28c8\") " pod="openshift-monitoring/telemeter-client-c55578b9d-ll8r9"
Jul 24 17:22:27.785266 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:27.785071    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90ed21d0-7d00-4791-8f71-d1df1f9b28c8-serving-certs-ca-bundle\") pod \"telemeter-client-c55578b9d-ll8r9\" (UID: \"90ed21d0-7d00-4791-8f71-d1df1f9b28c8\") " pod="openshift-monitoring/telemeter-client-c55578b9d-ll8r9"
Jul 24 17:22:27.785266 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:27.785101    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m94qf\" (UniqueName: \"kubernetes.io/projected/90ed21d0-7d00-4791-8f71-d1df1f9b28c8-kube-api-access-m94qf\") pod \"telemeter-client-c55578b9d-ll8r9\" (UID: \"90ed21d0-7d00-4791-8f71-d1df1f9b28c8\") " pod="openshift-monitoring/telemeter-client-c55578b9d-ll8r9"
Jul 24 17:22:27.785266 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:27.785128    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90ed21d0-7d00-4791-8f71-d1df1f9b28c8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-c55578b9d-ll8r9\" (UID: \"90ed21d0-7d00-4791-8f71-d1df1f9b28c8\") " pod="openshift-monitoring/telemeter-client-c55578b9d-ll8r9"
Jul 24 17:22:27.785266 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:27.785175    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/90ed21d0-7d00-4791-8f71-d1df1f9b28c8-federate-client-tls\") pod \"telemeter-client-c55578b9d-ll8r9\" (UID: \"90ed21d0-7d00-4791-8f71-d1df1f9b28c8\") " pod="openshift-monitoring/telemeter-client-c55578b9d-ll8r9"
Jul 24 17:22:27.785266 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:27.785235    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/90ed21d0-7d00-4791-8f71-d1df1f9b28c8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-c55578b9d-ll8r9\" (UID: \"90ed21d0-7d00-4791-8f71-d1df1f9b28c8\") " pod="openshift-monitoring/telemeter-client-c55578b9d-ll8r9"
Jul 24 17:22:27.785468 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:27.785354    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/90ed21d0-7d00-4791-8f71-d1df1f9b28c8-secret-telemeter-client\") pod \"telemeter-client-c55578b9d-ll8r9\" (UID: \"90ed21d0-7d00-4791-8f71-d1df1f9b28c8\") " pod="openshift-monitoring/telemeter-client-c55578b9d-ll8r9"
Jul 24 17:22:27.785468 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:27.785382    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90ed21d0-7d00-4791-8f71-d1df1f9b28c8-metrics-client-ca\") pod \"telemeter-client-c55578b9d-ll8r9\" (UID: \"90ed21d0-7d00-4791-8f71-d1df1f9b28c8\") " pod="openshift-monitoring/telemeter-client-c55578b9d-ll8r9"
Jul 24 17:22:27.886292 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:27.886251    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/90ed21d0-7d00-4791-8f71-d1df1f9b28c8-secret-telemeter-client\") pod \"telemeter-client-c55578b9d-ll8r9\" (UID: \"90ed21d0-7d00-4791-8f71-d1df1f9b28c8\") " pod="openshift-monitoring/telemeter-client-c55578b9d-ll8r9"
Jul 24 17:22:27.886470 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:27.886302    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90ed21d0-7d00-4791-8f71-d1df1f9b28c8-metrics-client-ca\") pod \"telemeter-client-c55578b9d-ll8r9\" (UID: \"90ed21d0-7d00-4791-8f71-d1df1f9b28c8\") " pod="openshift-monitoring/telemeter-client-c55578b9d-ll8r9"
Jul 24 17:22:27.886470 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:27.886344    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/90ed21d0-7d00-4791-8f71-d1df1f9b28c8-telemeter-client-tls\") pod \"telemeter-client-c55578b9d-ll8r9\" (UID: \"90ed21d0-7d00-4791-8f71-d1df1f9b28c8\") " pod="openshift-monitoring/telemeter-client-c55578b9d-ll8r9"
Jul 24 17:22:27.886675 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:27.886647    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90ed21d0-7d00-4791-8f71-d1df1f9b28c8-serving-certs-ca-bundle\") pod \"telemeter-client-c55578b9d-ll8r9\" (UID: \"90ed21d0-7d00-4791-8f71-d1df1f9b28c8\") " pod="openshift-monitoring/telemeter-client-c55578b9d-ll8r9"
Jul 24 17:22:27.886799 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:27.886693    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m94qf\" (UniqueName: \"kubernetes.io/projected/90ed21d0-7d00-4791-8f71-d1df1f9b28c8-kube-api-access-m94qf\") pod \"telemeter-client-c55578b9d-ll8r9\" (UID: \"90ed21d0-7d00-4791-8f71-d1df1f9b28c8\") " pod="openshift-monitoring/telemeter-client-c55578b9d-ll8r9"
Jul 24 17:22:27.887020 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:27.886996    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90ed21d0-7d00-4791-8f71-d1df1f9b28c8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-c55578b9d-ll8r9\" (UID: \"90ed21d0-7d00-4791-8f71-d1df1f9b28c8\") " pod="openshift-monitoring/telemeter-client-c55578b9d-ll8r9"
Jul 24 17:22:27.887091 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:27.887053    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/90ed21d0-7d00-4791-8f71-d1df1f9b28c8-federate-client-tls\") pod \"telemeter-client-c55578b9d-ll8r9\" (UID: \"90ed21d0-7d00-4791-8f71-d1df1f9b28c8\") " pod="openshift-monitoring/telemeter-client-c55578b9d-ll8r9"
Jul 24 17:22:27.887091 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:27.887084    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/90ed21d0-7d00-4791-8f71-d1df1f9b28c8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-c55578b9d-ll8r9\" (UID: \"90ed21d0-7d00-4791-8f71-d1df1f9b28c8\") " pod="openshift-monitoring/telemeter-client-c55578b9d-ll8r9"
Jul 24 17:22:27.887360 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:27.887203    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90ed21d0-7d00-4791-8f71-d1df1f9b28c8-metrics-client-ca\") pod \"telemeter-client-c55578b9d-ll8r9\" (UID: \"90ed21d0-7d00-4791-8f71-d1df1f9b28c8\") " pod="openshift-monitoring/telemeter-client-c55578b9d-ll8r9"
Jul 24 17:22:27.887503 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:27.887379    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90ed21d0-7d00-4791-8f71-d1df1f9b28c8-serving-certs-ca-bundle\") pod \"telemeter-client-c55578b9d-ll8r9\" (UID: \"90ed21d0-7d00-4791-8f71-d1df1f9b28c8\") " pod="openshift-monitoring/telemeter-client-c55578b9d-ll8r9"
Jul 24 17:22:27.887865 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:27.887811    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90ed21d0-7d00-4791-8f71-d1df1f9b28c8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-c55578b9d-ll8r9\" (UID: \"90ed21d0-7d00-4791-8f71-d1df1f9b28c8\") " pod="openshift-monitoring/telemeter-client-c55578b9d-ll8r9"
Jul 24 17:22:27.889347 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:27.889298    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/90ed21d0-7d00-4791-8f71-d1df1f9b28c8-telemeter-client-tls\") pod \"telemeter-client-c55578b9d-ll8r9\" (UID: \"90ed21d0-7d00-4791-8f71-d1df1f9b28c8\") " pod="openshift-monitoring/telemeter-client-c55578b9d-ll8r9"
Jul 24 17:22:27.889518 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:27.889495    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/90ed21d0-7d00-4791-8f71-d1df1f9b28c8-secret-telemeter-client\") pod \"telemeter-client-c55578b9d-ll8r9\" (UID: \"90ed21d0-7d00-4791-8f71-d1df1f9b28c8\") " pod="openshift-monitoring/telemeter-client-c55578b9d-ll8r9"
Jul 24 17:22:27.889782 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:27.889745    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/90ed21d0-7d00-4791-8f71-d1df1f9b28c8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-c55578b9d-ll8r9\" (UID: \"90ed21d0-7d00-4791-8f71-d1df1f9b28c8\") " pod="openshift-monitoring/telemeter-client-c55578b9d-ll8r9"
Jul 24 17:22:27.890084 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:27.890066    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/90ed21d0-7d00-4791-8f71-d1df1f9b28c8-federate-client-tls\") pod \"telemeter-client-c55578b9d-ll8r9\" (UID: \"90ed21d0-7d00-4791-8f71-d1df1f9b28c8\") " pod="openshift-monitoring/telemeter-client-c55578b9d-ll8r9"
Jul 24 17:22:27.895121 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:27.895098    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m94qf\" (UniqueName: \"kubernetes.io/projected/90ed21d0-7d00-4791-8f71-d1df1f9b28c8-kube-api-access-m94qf\") pod \"telemeter-client-c55578b9d-ll8r9\" (UID: \"90ed21d0-7d00-4791-8f71-d1df1f9b28c8\") " pod="openshift-monitoring/telemeter-client-c55578b9d-ll8r9"
Jul 24 17:22:27.983652 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:27.983614    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:28.004640 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.004614    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-c55578b9d-ll8r9"
Jul 24 17:22:28.162611 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.162103    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-c55578b9d-ll8r9"]
Jul 24 17:22:28.249739 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.249703    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-qtgkx" event={"ID":"1a74d77f-95a5-48ec-be94-3e103e31db64","Type":"ContainerStarted","Data":"4a1ea32f9b0475aea9ad44193ca5cb92988959402f36603addc2ed421367d1c4"}
Jul 24 17:22:28.596510 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.596472    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 17:22:28.599712 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.599683    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:28.613404 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.613381    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:22:28.640849 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.640731    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 17:22:28.642871 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.641998    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 24 17:22:28.642871 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.642061    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 24 17:22:28.642871 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.642277    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 24 17:22:28.642871 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.642284    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 24 17:22:28.642871 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.642301    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-xbvp7\""
Jul 24 17:22:28.642871 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.642279    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 24 17:22:28.642871 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.642588    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 24 17:22:28.642871 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.642668    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 24 17:22:28.642871 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.642849    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 24 17:22:28.643318 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.642924    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 24 17:22:28.643318 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.642927    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 24 17:22:28.643318 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.643045    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 24 17:22:28.643318 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.643152    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-eq40iv97hq7q2\""
Jul 24 17:22:28.643318 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.643288    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 24 17:22:28.643560 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.643355    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 24 17:22:28.645399 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.645376    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 24 17:22:28.694073 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.694040    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/695ce553-fc1a-4987-8bd7-5ca80fb4336c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:22:28.694238 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.694106    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/695ce553-fc1a-4987-8bd7-5ca80fb4336c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:22:28.694238 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.694137    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/695ce553-fc1a-4987-8bd7-5ca80fb4336c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:22:28.694238 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.694164    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/695ce553-fc1a-4987-8bd7-5ca80fb4336c-web-config\") pod \"prometheus-k8s-0\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:22:28.694238 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.694208    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/695ce553-fc1a-4987-8bd7-5ca80fb4336c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:22:28.694238 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.694233    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/695ce553-fc1a-4987-8bd7-5ca80fb4336c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:22:28.694419 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.694256    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/695ce553-fc1a-4987-8bd7-5ca80fb4336c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:22:28.694419 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.694326    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/695ce553-fc1a-4987-8bd7-5ca80fb4336c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:22:28.694419 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.694390    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/695ce553-fc1a-4987-8bd7-5ca80fb4336c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:22:28.694419 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.694411    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/695ce553-fc1a-4987-8bd7-5ca80fb4336c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:22:28.694569 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.694439    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/695ce553-fc1a-4987-8bd7-5ca80fb4336c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:22:28.694569 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.694459    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/695ce553-fc1a-4987-8bd7-5ca80fb4336c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:22:28.694569 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.694506    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/695ce553-fc1a-4987-8bd7-5ca80fb4336c-config\") pod \"prometheus-k8s-0\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:22:28.694569 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.694546    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7h6m\" (UniqueName: \"kubernetes.io/projected/695ce553-fc1a-4987-8bd7-5ca80fb4336c-kube-api-access-h7h6m\") pod \"prometheus-k8s-0\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:22:28.694710 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.694584    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/695ce553-fc1a-4987-8bd7-5ca80fb4336c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:22:28.694710 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.694613    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/695ce553-fc1a-4987-8bd7-5ca80fb4336c-config-out\") pod \"prometheus-k8s-0\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:22:28.694710 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.694639    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/695ce553-fc1a-4987-8bd7-5ca80fb4336c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:22:28.694710 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.694662    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/695ce553-fc1a-4987-8bd7-5ca80fb4336c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:22:28.694710 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.694697    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/695ce553-fc1a-4987-8bd7-5ca80fb4336c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:22:28.694889 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.694720    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/695ce553-fc1a-4987-8bd7-5ca80fb4336c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:22:28.795305 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.795268    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/695ce553-fc1a-4987-8bd7-5ca80fb4336c-config-out\") pod \"prometheus-k8s-0\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:22:28.795490 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.795312    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/695ce553-fc1a-4987-8bd7-5ca80fb4336c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:22:28.795490 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.795339    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/695ce553-fc1a-4987-8bd7-5ca80fb4336c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:22:28.795490 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.795374    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/695ce553-fc1a-4987-8bd7-5ca80fb4336c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:22:28.795490 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.795394    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/695ce553-fc1a-4987-8bd7-5ca80fb4336c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:22:28.796256 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.795731    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/695ce553-fc1a-4987-8bd7-5ca80fb4336c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:22:28.797130 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.795825    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/695ce553-fc1a-4987-8bd7-5ca80fb4336c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:22:28.797130 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.796526    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/695ce553-fc1a-4987-8bd7-5ca80fb4336c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:22:28.797130 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.796191    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/695ce553-fc1a-4987-8bd7-5ca80fb4336c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:22:28.797130 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.796563    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/695ce553-fc1a-4987-8bd7-5ca80fb4336c-web-config\") pod \"prometheus-k8s-0\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:22:28.797130 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.796587    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/695ce553-fc1a-4987-8bd7-5ca80fb4336c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:22:28.797130 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.796609    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/695ce553-fc1a-4987-8bd7-5ca80fb4336c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:22:28.797130 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.796429    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/695ce553-fc1a-4987-8bd7-5ca80fb4336c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:22:28.797130 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.796639    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/695ce553-fc1a-4987-8bd7-5ca80fb4336c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:22:28.797130 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.796666    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/695ce553-fc1a-4987-8bd7-5ca80fb4336c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:22:28.797130 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.796696    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/695ce553-fc1a-4987-8bd7-5ca80fb4336c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:22:28.797130 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.796707    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/695ce553-fc1a-4987-8bd7-5ca80fb4336c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:22:28.797130 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.796727    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/695ce553-fc1a-4987-8bd7-5ca80fb4336c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:22:28.797130 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.796756    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/695ce553-fc1a-4987-8bd7-5ca80fb4336c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:22:28.797130 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.796798    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/695ce553-fc1a-4987-8bd7-5ca80fb4336c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:22:28.797130 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.796820    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/695ce553-fc1a-4987-8bd7-5ca80fb4336c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:22:28.797130 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.796848    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/695ce553-fc1a-4987-8bd7-5ca80fb4336c-config\") pod \"prometheus-k8s-0\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:22:28.797130 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.796880    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7h6m\" (UniqueName: \"kubernetes.io/projected/695ce553-fc1a-4987-8bd7-5ca80fb4336c-kube-api-access-h7h6m\") pod \"prometheus-k8s-0\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:22:28.798154 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.796906    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/695ce553-fc1a-4987-8bd7-5ca80fb4336c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:22:28.798154 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.797621    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/695ce553-fc1a-4987-8bd7-5ca80fb4336c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:22:28.799023 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.799000    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/695ce553-fc1a-4987-8bd7-5ca80fb4336c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:22:28.799241 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.799162    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/695ce553-fc1a-4987-8bd7-5ca80fb4336c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:22:28.799359 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.799235    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/695ce553-fc1a-4987-8bd7-5ca80fb4336c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:22:28.799359 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.799327    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/695ce553-fc1a-4987-8bd7-5ca80fb4336c-config-out\") pod \"prometheus-k8s-0\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:22:28.800056 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.799982    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/695ce553-fc1a-4987-8bd7-5ca80fb4336c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:22:28.800175 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.800151    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/695ce553-fc1a-4987-8bd7-5ca80fb4336c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:22:28.800846 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.800801    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/695ce553-fc1a-4987-8bd7-5ca80fb4336c-web-config\") pod \"prometheus-k8s-0\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:22:28.801165 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.801143    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/695ce553-fc1a-4987-8bd7-5ca80fb4336c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:22:28.801672 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.801630    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/695ce553-fc1a-4987-8bd7-5ca80fb4336c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:22:28.801978 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.801956    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/695ce553-fc1a-4987-8bd7-5ca80fb4336c-config\") pod \"prometheus-k8s-0\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:22:28.802119 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.802099    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/695ce553-fc1a-4987-8bd7-5ca80fb4336c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:22:28.802187 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.802146    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/695ce553-fc1a-4987-8bd7-5ca80fb4336c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:22:28.802479 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.802462    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/695ce553-fc1a-4987-8bd7-5ca80fb4336c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:22:28.802525 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.802509    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/695ce553-fc1a-4987-8bd7-5ca80fb4336c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:22:28.808306 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.808286    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7h6m\" (UniqueName: \"kubernetes.io/projected/695ce553-fc1a-4987-8bd7-5ca80fb4336c-kube-api-access-h7h6m\") pod \"prometheus-k8s-0\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:22:28.951869 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:28.951788    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:22:29.254624 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:29.254549    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-c55578b9d-ll8r9" event={"ID":"90ed21d0-7d00-4791-8f71-d1df1f9b28c8","Type":"ContainerStarted","Data":"78de5bb15e73bf8c4ba8f30ed942133ac37a55489b6dcf5df798e918b7946e8c"}
Jul 24 17:22:29.459636 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:29.459558    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 17:22:29.463204 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:22:29.463166    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod695ce553_fc1a_4987_8bd7_5ca80fb4336c.slice/crio-8bf28a4c825c1c6bcb5b2618a226a6d363deabc831fbeab244296e8729bd83df WatchSource:0}: Error finding container 8bf28a4c825c1c6bcb5b2618a226a6d363deabc831fbeab244296e8729bd83df: Status 404 returned error can't find the container with id 8bf28a4c825c1c6bcb5b2618a226a6d363deabc831fbeab244296e8729bd83df
Jul 24 17:22:29.904539 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:29.904492    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a19606e2-4b58-418c-a6ad-8e70eb8ab5f5-metrics-tls\") pod \"dns-default-5zr4j\" (UID: \"a19606e2-4b58-418c-a6ad-8e70eb8ab5f5\") " pod="openshift-dns/dns-default-5zr4j"
Jul 24 17:22:29.907987 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:29.907956    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a19606e2-4b58-418c-a6ad-8e70eb8ab5f5-metrics-tls\") pod \"dns-default-5zr4j\" (UID: \"a19606e2-4b58-418c-a6ad-8e70eb8ab5f5\") " pod="openshift-dns/dns-default-5zr4j"
Jul 24 17:22:29.946797 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:29.946759    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-r2b86\""
Jul 24 17:22:29.954890 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:29.954858    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5zr4j"
Jul 24 17:22:30.104849 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:30.104738    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5zr4j"]
Jul 24 17:22:30.109623 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:22:30.109593    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda19606e2_4b58_418c_a6ad_8e70eb8ab5f5.slice/crio-4a7ab592c20cfa25445128a5e66939ac16584b596c673ab548dbb28bc35bfeaa WatchSource:0}: Error finding container 4a7ab592c20cfa25445128a5e66939ac16584b596c673ab548dbb28bc35bfeaa: Status 404 returned error can't find the container with id 4a7ab592c20cfa25445128a5e66939ac16584b596c673ab548dbb28bc35bfeaa
Jul 24 17:22:30.260716 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:30.260593    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-644697c47d-zr5lx" event={"ID":"e74f0e6b-c2ad-4e3a-b27c-838bf43ae58c","Type":"ContainerStarted","Data":"67a5c85ed215406c8808e5e38df5279af5baa114eefc2d45e4856fd65134f540"}
Jul 24 17:22:30.262652 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:30.262597    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-qtgkx" event={"ID":"1a74d77f-95a5-48ec-be94-3e103e31db64","Type":"ContainerStarted","Data":"742568bd135acb26d7a054d6b9fbd7b737a80d7e1256ad526bf57fc809e4f42b"}
Jul 24 17:22:30.262799 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:30.262784    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-qtgkx"
Jul 24 17:22:30.264115 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:30.264081    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"695ce553-fc1a-4987-8bd7-5ca80fb4336c","Type":"ContainerStarted","Data":"8bf28a4c825c1c6bcb5b2618a226a6d363deabc831fbeab244296e8729bd83df"}
Jul 24 17:22:30.265877 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:30.265830    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5zr4j" event={"ID":"a19606e2-4b58-418c-a6ad-8e70eb8ab5f5","Type":"ContainerStarted","Data":"4a7ab592c20cfa25445128a5e66939ac16584b596c673ab548dbb28bc35bfeaa"}
Jul 24 17:22:30.268789 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:30.268769    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-qtgkx"
Jul 24 17:22:30.278831 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:30.278772    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-644697c47d-zr5lx" podStartSLOduration=2.117370001 podStartE2EDuration="4.278753699s" totalImagesPullingTime="2.161383698s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:22:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:22:30.277313024 +0000 UTC m=+285.758688648" watchObservedRunningTime="2026-07-24 17:22:30.278753699 +0000 UTC m=+285.760129320"
Jul 24 17:22:30.293169 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:30.293094    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-qtgkx" podStartSLOduration=1.602521378 podStartE2EDuration="3.293071738s" totalImagesPullingTime="1.69055036s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:22:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:22:30.292660821 +0000 UTC m=+285.774036437" watchObservedRunningTime="2026-07-24 17:22:30.293071738 +0000 UTC m=+285.774447359"
Jul 24 17:22:32.273741 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:32.273705    2575 generic.go:356] "Generic (PLEG): container finished" podID="695ce553-fc1a-4987-8bd7-5ca80fb4336c" containerID="285088680ad9fb705a0d741a38a33293441c76cf4fac02919c6e1e3470485f6c" exitCode=0
Jul 24 17:22:32.274265 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:32.273796    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"695ce553-fc1a-4987-8bd7-5ca80fb4336c","Type":"ContainerDied","Data":"285088680ad9fb705a0d741a38a33293441c76cf4fac02919c6e1e3470485f6c"}
Jul 24 17:22:32.278020 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:32.277996    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-c55578b9d-ll8r9" event={"ID":"90ed21d0-7d00-4791-8f71-d1df1f9b28c8","Type":"ContainerStarted","Data":"95517bcc08c64cb54486bbdf74ffa41a4ee17ec9384bdb3626b926a5167c28e2"}
Jul 24 17:22:32.278129 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:32.278049    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-c55578b9d-ll8r9" event={"ID":"90ed21d0-7d00-4791-8f71-d1df1f9b28c8","Type":"ContainerStarted","Data":"b001c15b0e45c5092b1086aa33cd4b8ca8c4b1c9b6437d1c4b25291cc2f2a9f9"}
Jul 24 17:22:32.278129 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:32.278078    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-c55578b9d-ll8r9" event={"ID":"90ed21d0-7d00-4791-8f71-d1df1f9b28c8","Type":"ContainerStarted","Data":"f9dee226c09cabda18e3509a51098adace900a50c59faa006b50b07cce44cf84"}
Jul 24 17:22:32.327844 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:32.327793    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-c55578b9d-ll8r9" podStartSLOduration=2.466895156 podStartE2EDuration="5.327776626s" totalImagesPullingTime="2.86088147s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:22:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:22:32.327536882 +0000 UTC m=+287.808912496" watchObservedRunningTime="2026-07-24 17:22:32.327776626 +0000 UTC m=+287.809152245"
Jul 24 17:22:33.200283 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:33.200256    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-75f447c5bc-ntvsq"
Jul 24 17:22:33.327416 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:33.327380    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:33.426648 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:33.426590    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:34.288531 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:34.288495    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5zr4j" event={"ID":"a19606e2-4b58-418c-a6ad-8e70eb8ab5f5","Type":"ContainerStarted","Data":"eb542e7086639c729fd25e55074070849666ad6c9695c3d4216b8d5fee3cd43e"}
Jul 24 17:22:34.288722 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:34.288550    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5zr4j" event={"ID":"a19606e2-4b58-418c-a6ad-8e70eb8ab5f5","Type":"ContainerStarted","Data":"3b600d7a07ec97ef2b86f4af4d77420a7ffae16a8150bbbff76f5b10bcef61d4"}
Jul 24 17:22:34.288722 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:34.288611    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5zr4j"
Jul 24 17:22:34.307487 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:34.307428    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5zr4j" podStartSLOduration=252.154958983 podStartE2EDuration="4m15.307406529s" totalImagesPullingTime="3.152447546s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:18:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:22:34.306992807 +0000 UTC m=+289.788368429" watchObservedRunningTime="2026-07-24 17:22:34.307406529 +0000 UTC m=+289.788782150"
Jul 24 17:22:34.399795 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:34.399756    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:34.467714 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:34.467660    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:36.299721 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:36.299681    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"695ce553-fc1a-4987-8bd7-5ca80fb4336c","Type":"ContainerStarted","Data":"f417f20f39e0696d7709665218228421f38757226276f2f6573aa911c6d164c6"}
Jul 24 17:22:36.300160 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:36.299796    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"695ce553-fc1a-4987-8bd7-5ca80fb4336c","Type":"ContainerStarted","Data":"ce629ffc7d2ec242bef12a076c13cddd18e1f6c39c2c7fa66e748f520acbc2fd"}
Jul 24 17:22:38.204542 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:38.204470    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:38.272061 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:38.272033    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:38.310109 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:38.310078    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"695ce553-fc1a-4987-8bd7-5ca80fb4336c","Type":"ContainerStarted","Data":"a615acae28043cd1fd8c89f67e64db42e1740ee0400d1dd5551ca367b992191b"}
Jul 24 17:22:38.310257 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:38.310148    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"695ce553-fc1a-4987-8bd7-5ca80fb4336c","Type":"ContainerStarted","Data":"0f3f059feb586f2a25dc4e495150642dd3020d19b04a17edefebc4be1bcbd2c2"}
Jul 24 17:22:39.187564 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:39.187519    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:39.316523 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:39.316489    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"695ce553-fc1a-4987-8bd7-5ca80fb4336c","Type":"ContainerStarted","Data":"cf3f0401a8e2ea561209e50dde788716d4c336da04653c6fa001378ced0d577a"}
Jul 24 17:22:39.316907 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:39.316554    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"695ce553-fc1a-4987-8bd7-5ca80fb4336c","Type":"ContainerStarted","Data":"605b86da77698c09b4ebe43199e8f3b255c1edb9bdabb6eca8d7bcc7b3208dea"}
Jul 24 17:22:39.965392 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:39.965363    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:40.023945 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:40.023906    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:42.793318 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:42.793281    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:43.181482 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:43.181401    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:43.283724 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:43.283693    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:43.952436 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:43.952403    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:22:44.295383 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:44.295357    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5zr4j"
Jul 24 17:22:44.313620 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:44.313575    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=8.504277022 podStartE2EDuration="16.31355843s" totalImagesPullingTime="7.79985358s" totalInitContainerRuntime="9.427828ms" isStatefulPod=false podCreationTimestamp="2026-07-24 17:22:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:22:39.366967006 +0000 UTC m=+294.848342626" watchObservedRunningTime="2026-07-24 17:22:44.31355843 +0000 UTC m=+299.794934111"
Jul 24 17:22:44.986249 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:44.986225    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82s5l_010c8b81-c5f5-43c3-b1bb-c812fcde2d6f/ovn-acl-logging/0.log"
Jul 24 17:22:44.987708 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:44.987686    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82s5l_010c8b81-c5f5-43c3-b1bb-c812fcde2d6f/ovn-acl-logging/0.log"
Jul 24 17:22:44.994796 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:44.994771    2575 kubelet.go:1648] "Image garbage collection succeeded"
Jul 24 17:22:47.016587 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:47.016551    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-644697c47d-zr5lx"
Jul 24 17:22:47.018325 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:47.016611    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-644697c47d-zr5lx"
Jul 24 17:22:48.800810 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:48.800749    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:48.865444 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:48.865388    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:49.368419 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:49.368382    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:49.421210 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:49.421181    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:51.387015 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:51.386977    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:51.488636 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:51.488591    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:51.982660 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:51.982634    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-644697c47d-zr5lx_e74f0e6b-c2ad-4e3a-b27c-838bf43ae58c/metrics-server/0.log"
Jul 24 17:22:52.181966 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:52.181910    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-qtgkx_1a74d77f-95a5-48ec-be94-3e103e31db64/monitoring-plugin/0.log"
Jul 24 17:22:52.981617 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:52.981545    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fnl4m_79f06248-787f-439a-95a6-5ffa04758581/init-textfile/0.log"
Jul 24 17:22:53.183129 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:53.183090    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fnl4m_79f06248-787f-439a-95a6-5ffa04758581/node-exporter/0.log"
Jul 24 17:22:53.384637 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:53.384609    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fnl4m_79f06248-787f-439a-95a6-5ffa04758581/kube-rbac-proxy/0.log"
Jul 24 17:22:53.448926 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:53.448895    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:53.512206 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:53.512178    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:22:54.782556 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:54.782526    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_695ce553-fc1a-4987-8bd7-5ca80fb4336c/init-config-reloader/0.log"
Jul 24 17:22:54.984027 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:54.983994    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_695ce553-fc1a-4987-8bd7-5ca80fb4336c/prometheus/0.log"
Jul 24 17:22:55.186170 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:55.186096    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_695ce553-fc1a-4987-8bd7-5ca80fb4336c/config-reloader/0.log"
Jul 24 17:22:55.383282 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:55.383255    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_695ce553-fc1a-4987-8bd7-5ca80fb4336c/thanos-sidecar/0.log"
Jul 24 17:22:55.582236 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:55.582211    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_695ce553-fc1a-4987-8bd7-5ca80fb4336c/kube-rbac-proxy-web/0.log"
Jul 24 17:22:55.781567 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:55.781544    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_695ce553-fc1a-4987-8bd7-5ca80fb4336c/kube-rbac-proxy/0.log"
Jul 24 17:22:55.986572 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:55.986494    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_695ce553-fc1a-4987-8bd7-5ca80fb4336c/kube-rbac-proxy-thanos/0.log"
Jul 24 17:22:56.089591 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:56.089549    2575 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564f976b54-x5g4z" podUID="12bb855a-2280-42c8-ba23-daa21c406a01" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 24 17:22:56.782438 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:56.782410    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-c55578b9d-ll8r9_90ed21d0-7d00-4791-8f71-d1df1f9b28c8/telemeter-client/0.log"
Jul 24 17:22:56.981955 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:56.981916    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-c55578b9d-ll8r9_90ed21d0-7d00-4791-8f71-d1df1f9b28c8/reload/0.log"
Jul 24 17:22:57.183216 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:22:57.183152    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-c55578b9d-ll8r9_90ed21d0-7d00-4791-8f71-d1df1f9b28c8/kube-rbac-proxy/0.log"
Jul 24 17:23:04.353515 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:04.353480    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:23:04.402984 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:04.402929    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:23:06.089465 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:06.089426    2575 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564f976b54-x5g4z" podUID="12bb855a-2280-42c8-ba23-daa21c406a01" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 24 17:23:07.022788 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:07.022759    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-644697c47d-zr5lx"
Jul 24 17:23:07.031125 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:07.031097    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-644697c47d-zr5lx"
Jul 24 17:23:16.089225 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:16.089185    2575 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564f976b54-x5g4z" podUID="12bb855a-2280-42c8-ba23-daa21c406a01" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 24 17:23:16.089694 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:16.089253    2575 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564f976b54-x5g4z"
Jul 24 17:23:16.089761 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:16.089732    2575 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"e52229fcb04f0bdfccb00dcb2d46f8759186f1473aa4c88bc433cf6a2406d015"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564f976b54-x5g4z" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jul 24 17:23:16.089797 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:16.089781    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564f976b54-x5g4z" podUID="12bb855a-2280-42c8-ba23-daa21c406a01" containerName="service-proxy" containerID="cri-o://e52229fcb04f0bdfccb00dcb2d46f8759186f1473aa4c88bc433cf6a2406d015" gracePeriod=30
Jul 24 17:23:16.459859 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:16.459773    2575 generic.go:356] "Generic (PLEG): container finished" podID="12bb855a-2280-42c8-ba23-daa21c406a01" containerID="e52229fcb04f0bdfccb00dcb2d46f8759186f1473aa4c88bc433cf6a2406d015" exitCode=2
Jul 24 17:23:16.459859 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:16.459846    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564f976b54-x5g4z" event={"ID":"12bb855a-2280-42c8-ba23-daa21c406a01","Type":"ContainerDied","Data":"e52229fcb04f0bdfccb00dcb2d46f8759186f1473aa4c88bc433cf6a2406d015"}
Jul 24 17:23:16.460064 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:16.459884    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-564f976b54-x5g4z" event={"ID":"12bb855a-2280-42c8-ba23-daa21c406a01","Type":"ContainerStarted","Data":"d2ecffca098c34fa507622bd6cdbb8f241f89940991257b70f2424c988742fdc"}
Jul 24 17:23:28.952339 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:28.952305    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:23:28.971557 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:28.971530    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:23:29.520208 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:29.520184    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:23:34.262130 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:34.262088    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:23:34.360503 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:34.360467    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:23:38.519654 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:38.519542    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:23:38.575682 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:38.575641    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:23:40.296614 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:40.296577    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:23:40.353671 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:40.353636    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:23:46.265693 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:46.265661    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:23:46.366144 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:46.366107    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:23:46.466689 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:46.466636    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:23:46.992626 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:46.992598    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:23:47.225679 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.225640    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 17:23:47.226049 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.226005    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="695ce553-fc1a-4987-8bd7-5ca80fb4336c" containerName="prometheus" containerID="cri-o://ce629ffc7d2ec242bef12a076c13cddd18e1f6c39c2c7fa66e748f520acbc2fd" gracePeriod=600
Jul 24 17:23:47.226049 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.226035    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="695ce553-fc1a-4987-8bd7-5ca80fb4336c" containerName="config-reloader" containerID="cri-o://f417f20f39e0696d7709665218228421f38757226276f2f6573aa911c6d164c6" gracePeriod=600
Jul 24 17:23:47.226227 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.226063    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="695ce553-fc1a-4987-8bd7-5ca80fb4336c" containerName="kube-rbac-proxy-thanos" containerID="cri-o://cf3f0401a8e2ea561209e50dde788716d4c336da04653c6fa001378ced0d577a" gracePeriod=600
Jul 24 17:23:47.226227 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.226037    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="695ce553-fc1a-4987-8bd7-5ca80fb4336c" containerName="thanos-sidecar" containerID="cri-o://0f3f059feb586f2a25dc4e495150642dd3020d19b04a17edefebc4be1bcbd2c2" gracePeriod=600
Jul 24 17:23:47.226227 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.226195    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="695ce553-fc1a-4987-8bd7-5ca80fb4336c" containerName="kube-rbac-proxy" containerID="cri-o://605b86da77698c09b4ebe43199e8f3b255c1edb9bdabb6eca8d7bcc7b3208dea" gracePeriod=600
Jul 24 17:23:47.226377 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.226332    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="695ce553-fc1a-4987-8bd7-5ca80fb4336c" containerName="kube-rbac-proxy-web" containerID="cri-o://a615acae28043cd1fd8c89f67e64db42e1740ee0400d1dd5551ca367b992191b" gracePeriod=600
Jul 24 17:23:47.561817 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.561788    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:23:47.574568 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.574538    2575 generic.go:356] "Generic (PLEG): container finished" podID="695ce553-fc1a-4987-8bd7-5ca80fb4336c" containerID="cf3f0401a8e2ea561209e50dde788716d4c336da04653c6fa001378ced0d577a" exitCode=0
Jul 24 17:23:47.574568 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.574563    2575 generic.go:356] "Generic (PLEG): container finished" podID="695ce553-fc1a-4987-8bd7-5ca80fb4336c" containerID="605b86da77698c09b4ebe43199e8f3b255c1edb9bdabb6eca8d7bcc7b3208dea" exitCode=0
Jul 24 17:23:47.574568 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.574573    2575 generic.go:356] "Generic (PLEG): container finished" podID="695ce553-fc1a-4987-8bd7-5ca80fb4336c" containerID="a615acae28043cd1fd8c89f67e64db42e1740ee0400d1dd5551ca367b992191b" exitCode=0
Jul 24 17:23:47.574772 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.574582    2575 generic.go:356] "Generic (PLEG): container finished" podID="695ce553-fc1a-4987-8bd7-5ca80fb4336c" containerID="0f3f059feb586f2a25dc4e495150642dd3020d19b04a17edefebc4be1bcbd2c2" exitCode=0
Jul 24 17:23:47.574772 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.574589    2575 generic.go:356] "Generic (PLEG): container finished" podID="695ce553-fc1a-4987-8bd7-5ca80fb4336c" containerID="f417f20f39e0696d7709665218228421f38757226276f2f6573aa911c6d164c6" exitCode=0
Jul 24 17:23:47.574772 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.574597    2575 generic.go:356] "Generic (PLEG): container finished" podID="695ce553-fc1a-4987-8bd7-5ca80fb4336c" containerID="ce629ffc7d2ec242bef12a076c13cddd18e1f6c39c2c7fa66e748f520acbc2fd" exitCode=0
Jul 24 17:23:47.574772 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.574621    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"695ce553-fc1a-4987-8bd7-5ca80fb4336c","Type":"ContainerDied","Data":"cf3f0401a8e2ea561209e50dde788716d4c336da04653c6fa001378ced0d577a"}
Jul 24 17:23:47.574772 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.574691    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"695ce553-fc1a-4987-8bd7-5ca80fb4336c","Type":"ContainerDied","Data":"605b86da77698c09b4ebe43199e8f3b255c1edb9bdabb6eca8d7bcc7b3208dea"}
Jul 24 17:23:47.574772 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.574631    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 17:23:47.574772 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.574719    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"695ce553-fc1a-4987-8bd7-5ca80fb4336c","Type":"ContainerDied","Data":"a615acae28043cd1fd8c89f67e64db42e1740ee0400d1dd5551ca367b992191b"}
Jul 24 17:23:47.574772 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.574744    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"695ce553-fc1a-4987-8bd7-5ca80fb4336c","Type":"ContainerDied","Data":"0f3f059feb586f2a25dc4e495150642dd3020d19b04a17edefebc4be1bcbd2c2"}
Jul 24 17:23:47.574772 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.574769    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"695ce553-fc1a-4987-8bd7-5ca80fb4336c","Type":"ContainerDied","Data":"f417f20f39e0696d7709665218228421f38757226276f2f6573aa911c6d164c6"}
Jul 24 17:23:47.575070 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.574793    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"695ce553-fc1a-4987-8bd7-5ca80fb4336c","Type":"ContainerDied","Data":"ce629ffc7d2ec242bef12a076c13cddd18e1f6c39c2c7fa66e748f520acbc2fd"}
Jul 24 17:23:47.575070 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.574818    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"695ce553-fc1a-4987-8bd7-5ca80fb4336c","Type":"ContainerDied","Data":"8bf28a4c825c1c6bcb5b2618a226a6d363deabc831fbeab244296e8729bd83df"}
Jul 24 17:23:47.576228 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.576215    2575 scope.go:117] "RemoveContainer" containerID="cf3f0401a8e2ea561209e50dde788716d4c336da04653c6fa001378ced0d577a"
Jul 24 17:23:47.583663 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.583647    2575 scope.go:117] "RemoveContainer" containerID="605b86da77698c09b4ebe43199e8f3b255c1edb9bdabb6eca8d7bcc7b3208dea"
Jul 24 17:23:47.591097 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.591067    2575 scope.go:117] "RemoveContainer" containerID="a615acae28043cd1fd8c89f67e64db42e1740ee0400d1dd5551ca367b992191b"
Jul 24 17:23:47.599617 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.599570    2575 scope.go:117] "RemoveContainer" containerID="0f3f059feb586f2a25dc4e495150642dd3020d19b04a17edefebc4be1bcbd2c2"
Jul 24 17:23:47.608515 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.608495    2575 scope.go:117] "RemoveContainer" containerID="f417f20f39e0696d7709665218228421f38757226276f2f6573aa911c6d164c6"
Jul 24 17:23:47.616669 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.616647    2575 scope.go:117] "RemoveContainer" containerID="ce629ffc7d2ec242bef12a076c13cddd18e1f6c39c2c7fa66e748f520acbc2fd"
Jul 24 17:23:47.623783 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.623762    2575 scope.go:117] "RemoveContainer" containerID="285088680ad9fb705a0d741a38a33293441c76cf4fac02919c6e1e3470485f6c"
Jul 24 17:23:47.631460 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.631444    2575 scope.go:117] "RemoveContainer" containerID="cf3f0401a8e2ea561209e50dde788716d4c336da04653c6fa001378ced0d577a"
Jul 24 17:23:47.631726 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:23:47.631706    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf3f0401a8e2ea561209e50dde788716d4c336da04653c6fa001378ced0d577a\": container with ID starting with cf3f0401a8e2ea561209e50dde788716d4c336da04653c6fa001378ced0d577a not found: ID does not exist" containerID="cf3f0401a8e2ea561209e50dde788716d4c336da04653c6fa001378ced0d577a"
Jul 24 17:23:47.631795 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.631737    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf3f0401a8e2ea561209e50dde788716d4c336da04653c6fa001378ced0d577a"} err="failed to get container status \"cf3f0401a8e2ea561209e50dde788716d4c336da04653c6fa001378ced0d577a\": rpc error: code = NotFound desc = could not find container \"cf3f0401a8e2ea561209e50dde788716d4c336da04653c6fa001378ced0d577a\": container with ID starting with cf3f0401a8e2ea561209e50dde788716d4c336da04653c6fa001378ced0d577a not found: ID does not exist"
Jul 24 17:23:47.631795 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.631761    2575 scope.go:117] "RemoveContainer" containerID="605b86da77698c09b4ebe43199e8f3b255c1edb9bdabb6eca8d7bcc7b3208dea"
Jul 24 17:23:47.632104 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:23:47.632086    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"605b86da77698c09b4ebe43199e8f3b255c1edb9bdabb6eca8d7bcc7b3208dea\": container with ID starting with 605b86da77698c09b4ebe43199e8f3b255c1edb9bdabb6eca8d7bcc7b3208dea not found: ID does not exist" containerID="605b86da77698c09b4ebe43199e8f3b255c1edb9bdabb6eca8d7bcc7b3208dea"
Jul 24 17:23:47.632149 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.632112    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"605b86da77698c09b4ebe43199e8f3b255c1edb9bdabb6eca8d7bcc7b3208dea"} err="failed to get container status \"605b86da77698c09b4ebe43199e8f3b255c1edb9bdabb6eca8d7bcc7b3208dea\": rpc error: code = NotFound desc = could not find container \"605b86da77698c09b4ebe43199e8f3b255c1edb9bdabb6eca8d7bcc7b3208dea\": container with ID starting with 605b86da77698c09b4ebe43199e8f3b255c1edb9bdabb6eca8d7bcc7b3208dea not found: ID does not exist"
Jul 24 17:23:47.632149 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.632126    2575 scope.go:117] "RemoveContainer" containerID="a615acae28043cd1fd8c89f67e64db42e1740ee0400d1dd5551ca367b992191b"
Jul 24 17:23:47.632340 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:23:47.632322    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a615acae28043cd1fd8c89f67e64db42e1740ee0400d1dd5551ca367b992191b\": container with ID starting with a615acae28043cd1fd8c89f67e64db42e1740ee0400d1dd5551ca367b992191b not found: ID does not exist" containerID="a615acae28043cd1fd8c89f67e64db42e1740ee0400d1dd5551ca367b992191b"
Jul 24 17:23:47.632382 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.632347    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a615acae28043cd1fd8c89f67e64db42e1740ee0400d1dd5551ca367b992191b"} err="failed to get container status \"a615acae28043cd1fd8c89f67e64db42e1740ee0400d1dd5551ca367b992191b\": rpc error: code = NotFound desc = could not find container \"a615acae28043cd1fd8c89f67e64db42e1740ee0400d1dd5551ca367b992191b\": container with ID starting with a615acae28043cd1fd8c89f67e64db42e1740ee0400d1dd5551ca367b992191b not found: ID does not exist"
Jul 24 17:23:47.632382 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.632360    2575 scope.go:117] "RemoveContainer" containerID="0f3f059feb586f2a25dc4e495150642dd3020d19b04a17edefebc4be1bcbd2c2"
Jul 24 17:23:47.632586 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:23:47.632570    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f3f059feb586f2a25dc4e495150642dd3020d19b04a17edefebc4be1bcbd2c2\": container with ID starting with 0f3f059feb586f2a25dc4e495150642dd3020d19b04a17edefebc4be1bcbd2c2 not found: ID does not exist" containerID="0f3f059feb586f2a25dc4e495150642dd3020d19b04a17edefebc4be1bcbd2c2"
Jul 24 17:23:47.632651 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.632591    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f3f059feb586f2a25dc4e495150642dd3020d19b04a17edefebc4be1bcbd2c2"} err="failed to get container status \"0f3f059feb586f2a25dc4e495150642dd3020d19b04a17edefebc4be1bcbd2c2\": rpc error: code = NotFound desc = could not find container \"0f3f059feb586f2a25dc4e495150642dd3020d19b04a17edefebc4be1bcbd2c2\": container with ID starting with 0f3f059feb586f2a25dc4e495150642dd3020d19b04a17edefebc4be1bcbd2c2 not found: ID does not exist"
Jul 24 17:23:47.632651 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.632610    2575 scope.go:117] "RemoveContainer" containerID="f417f20f39e0696d7709665218228421f38757226276f2f6573aa911c6d164c6"
Jul 24 17:23:47.632868 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:23:47.632852    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f417f20f39e0696d7709665218228421f38757226276f2f6573aa911c6d164c6\": container with ID starting with f417f20f39e0696d7709665218228421f38757226276f2f6573aa911c6d164c6 not found: ID does not exist" containerID="f417f20f39e0696d7709665218228421f38757226276f2f6573aa911c6d164c6"
Jul 24 17:23:47.632910 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.632878    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f417f20f39e0696d7709665218228421f38757226276f2f6573aa911c6d164c6"} err="failed to get container status \"f417f20f39e0696d7709665218228421f38757226276f2f6573aa911c6d164c6\": rpc error: code = NotFound desc = could not find container \"f417f20f39e0696d7709665218228421f38757226276f2f6573aa911c6d164c6\": container with ID starting with f417f20f39e0696d7709665218228421f38757226276f2f6573aa911c6d164c6 not found: ID does not exist"
Jul 24 17:23:47.632910 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.632893    2575 scope.go:117] "RemoveContainer" containerID="ce629ffc7d2ec242bef12a076c13cddd18e1f6c39c2c7fa66e748f520acbc2fd"
Jul 24 17:23:47.633151 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:23:47.633134    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce629ffc7d2ec242bef12a076c13cddd18e1f6c39c2c7fa66e748f520acbc2fd\": container with ID starting with ce629ffc7d2ec242bef12a076c13cddd18e1f6c39c2c7fa66e748f520acbc2fd not found: ID does not exist" containerID="ce629ffc7d2ec242bef12a076c13cddd18e1f6c39c2c7fa66e748f520acbc2fd"
Jul 24 17:23:47.633200 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.633154    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce629ffc7d2ec242bef12a076c13cddd18e1f6c39c2c7fa66e748f520acbc2fd"} err="failed to get container status \"ce629ffc7d2ec242bef12a076c13cddd18e1f6c39c2c7fa66e748f520acbc2fd\": rpc error: code = NotFound desc = could not find container \"ce629ffc7d2ec242bef12a076c13cddd18e1f6c39c2c7fa66e748f520acbc2fd\": container with ID starting with ce629ffc7d2ec242bef12a076c13cddd18e1f6c39c2c7fa66e748f520acbc2fd not found: ID does not exist"
Jul 24 17:23:47.633200 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.633170    2575 scope.go:117] "RemoveContainer" containerID="285088680ad9fb705a0d741a38a33293441c76cf4fac02919c6e1e3470485f6c"
Jul 24 17:23:47.633385 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:23:47.633369    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"285088680ad9fb705a0d741a38a33293441c76cf4fac02919c6e1e3470485f6c\": container with ID starting with 285088680ad9fb705a0d741a38a33293441c76cf4fac02919c6e1e3470485f6c not found: ID does not exist" containerID="285088680ad9fb705a0d741a38a33293441c76cf4fac02919c6e1e3470485f6c"
Jul 24 17:23:47.633455 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.633390    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"285088680ad9fb705a0d741a38a33293441c76cf4fac02919c6e1e3470485f6c"} err="failed to get container status \"285088680ad9fb705a0d741a38a33293441c76cf4fac02919c6e1e3470485f6c\": rpc error: code = NotFound desc = could not find container \"285088680ad9fb705a0d741a38a33293441c76cf4fac02919c6e1e3470485f6c\": container with ID starting with 285088680ad9fb705a0d741a38a33293441c76cf4fac02919c6e1e3470485f6c not found: ID does not exist"
Jul 24 17:23:47.633455 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.633411    2575 scope.go:117] "RemoveContainer" containerID="cf3f0401a8e2ea561209e50dde788716d4c336da04653c6fa001378ced0d577a"
Jul 24 17:23:47.633627 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.633610    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf3f0401a8e2ea561209e50dde788716d4c336da04653c6fa001378ced0d577a"} err="failed to get container status \"cf3f0401a8e2ea561209e50dde788716d4c336da04653c6fa001378ced0d577a\": rpc error: code = NotFound desc = could not find container \"cf3f0401a8e2ea561209e50dde788716d4c336da04653c6fa001378ced0d577a\": container with ID starting with cf3f0401a8e2ea561209e50dde788716d4c336da04653c6fa001378ced0d577a not found: ID does not exist"
Jul 24 17:23:47.633667 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.633627    2575 scope.go:117] "RemoveContainer" containerID="605b86da77698c09b4ebe43199e8f3b255c1edb9bdabb6eca8d7bcc7b3208dea"
Jul 24 17:23:47.633818 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.633801    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"605b86da77698c09b4ebe43199e8f3b255c1edb9bdabb6eca8d7bcc7b3208dea"} err="failed to get container status \"605b86da77698c09b4ebe43199e8f3b255c1edb9bdabb6eca8d7bcc7b3208dea\": rpc error: code = NotFound desc = could not find container \"605b86da77698c09b4ebe43199e8f3b255c1edb9bdabb6eca8d7bcc7b3208dea\": container with ID starting with 605b86da77698c09b4ebe43199e8f3b255c1edb9bdabb6eca8d7bcc7b3208dea not found: ID does not exist"
Jul 24 17:23:47.633889 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.633819    2575 scope.go:117] "RemoveContainer" containerID="a615acae28043cd1fd8c89f67e64db42e1740ee0400d1dd5551ca367b992191b"
Jul 24 17:23:47.634047 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.634030    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a615acae28043cd1fd8c89f67e64db42e1740ee0400d1dd5551ca367b992191b"} err="failed to get container status \"a615acae28043cd1fd8c89f67e64db42e1740ee0400d1dd5551ca367b992191b\": rpc error: code = NotFound desc = could not find container \"a615acae28043cd1fd8c89f67e64db42e1740ee0400d1dd5551ca367b992191b\": container with ID starting with a615acae28043cd1fd8c89f67e64db42e1740ee0400d1dd5551ca367b992191b not found: ID does not exist"
Jul 24 17:23:47.634117 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.634047    2575 scope.go:117] "RemoveContainer" containerID="0f3f059feb586f2a25dc4e495150642dd3020d19b04a17edefebc4be1bcbd2c2"
Jul 24 17:23:47.634274 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.634255    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f3f059feb586f2a25dc4e495150642dd3020d19b04a17edefebc4be1bcbd2c2"} err="failed to get container status \"0f3f059feb586f2a25dc4e495150642dd3020d19b04a17edefebc4be1bcbd2c2\": rpc error: code = NotFound desc = could not find container \"0f3f059feb586f2a25dc4e495150642dd3020d19b04a17edefebc4be1bcbd2c2\": container with ID starting with 0f3f059feb586f2a25dc4e495150642dd3020d19b04a17edefebc4be1bcbd2c2 not found: ID does not exist"
Jul 24 17:23:47.634343 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.634275    2575 scope.go:117] "RemoveContainer" containerID="f417f20f39e0696d7709665218228421f38757226276f2f6573aa911c6d164c6"
Jul 24 17:23:47.634493 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.634476    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f417f20f39e0696d7709665218228421f38757226276f2f6573aa911c6d164c6"} err="failed to get container status \"f417f20f39e0696d7709665218228421f38757226276f2f6573aa911c6d164c6\": rpc error: code = NotFound desc = could not find container \"f417f20f39e0696d7709665218228421f38757226276f2f6573aa911c6d164c6\": container with ID starting with f417f20f39e0696d7709665218228421f38757226276f2f6573aa911c6d164c6 not found: ID does not exist"
Jul 24 17:23:47.634558 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.634495    2575 scope.go:117] "RemoveContainer" containerID="ce629ffc7d2ec242bef12a076c13cddd18e1f6c39c2c7fa66e748f520acbc2fd"
Jul 24 17:23:47.634702 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.634686    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce629ffc7d2ec242bef12a076c13cddd18e1f6c39c2c7fa66e748f520acbc2fd"} err="failed to get container status \"ce629ffc7d2ec242bef12a076c13cddd18e1f6c39c2c7fa66e748f520acbc2fd\": rpc error: code = NotFound desc = could not find container \"ce629ffc7d2ec242bef12a076c13cddd18e1f6c39c2c7fa66e748f520acbc2fd\": container with ID starting with ce629ffc7d2ec242bef12a076c13cddd18e1f6c39c2c7fa66e748f520acbc2fd not found: ID does not exist"
Jul 24 17:23:47.634768 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.634703    2575 scope.go:117] "RemoveContainer" containerID="285088680ad9fb705a0d741a38a33293441c76cf4fac02919c6e1e3470485f6c"
Jul 24 17:23:47.634904 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.634884    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"285088680ad9fb705a0d741a38a33293441c76cf4fac02919c6e1e3470485f6c"} err="failed to get container status \"285088680ad9fb705a0d741a38a33293441c76cf4fac02919c6e1e3470485f6c\": rpc error: code = NotFound desc = could not find container \"285088680ad9fb705a0d741a38a33293441c76cf4fac02919c6e1e3470485f6c\": container with ID starting with 285088680ad9fb705a0d741a38a33293441c76cf4fac02919c6e1e3470485f6c not found: ID does not exist"
Jul 24 17:23:47.634904 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.634901    2575 scope.go:117] "RemoveContainer" containerID="cf3f0401a8e2ea561209e50dde788716d4c336da04653c6fa001378ced0d577a"
Jul 24 17:23:47.635108 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.635091    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf3f0401a8e2ea561209e50dde788716d4c336da04653c6fa001378ced0d577a"} err="failed to get container status \"cf3f0401a8e2ea561209e50dde788716d4c336da04653c6fa001378ced0d577a\": rpc error: code = NotFound desc = could not find container \"cf3f0401a8e2ea561209e50dde788716d4c336da04653c6fa001378ced0d577a\": container with ID starting with cf3f0401a8e2ea561209e50dde788716d4c336da04653c6fa001378ced0d577a not found: ID does not exist"
Jul 24 17:23:47.635108 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.635108    2575 scope.go:117] "RemoveContainer" containerID="605b86da77698c09b4ebe43199e8f3b255c1edb9bdabb6eca8d7bcc7b3208dea"
Jul 24 17:23:47.635365 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.635350    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"605b86da77698c09b4ebe43199e8f3b255c1edb9bdabb6eca8d7bcc7b3208dea"} err="failed to get container status \"605b86da77698c09b4ebe43199e8f3b255c1edb9bdabb6eca8d7bcc7b3208dea\": rpc error: code = NotFound desc = could not find container \"605b86da77698c09b4ebe43199e8f3b255c1edb9bdabb6eca8d7bcc7b3208dea\": container with ID starting with 605b86da77698c09b4ebe43199e8f3b255c1edb9bdabb6eca8d7bcc7b3208dea not found: ID does not exist"
Jul 24 17:23:47.635441 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.635364    2575 scope.go:117] "RemoveContainer" containerID="a615acae28043cd1fd8c89f67e64db42e1740ee0400d1dd5551ca367b992191b"
Jul 24 17:23:47.635558 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.635541    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a615acae28043cd1fd8c89f67e64db42e1740ee0400d1dd5551ca367b992191b"} err="failed to get container status \"a615acae28043cd1fd8c89f67e64db42e1740ee0400d1dd5551ca367b992191b\": rpc error: code = NotFound desc = could not find container \"a615acae28043cd1fd8c89f67e64db42e1740ee0400d1dd5551ca367b992191b\": container with ID starting with a615acae28043cd1fd8c89f67e64db42e1740ee0400d1dd5551ca367b992191b not found: ID does not exist"
Jul 24 17:23:47.635558 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.635557    2575 scope.go:117] "RemoveContainer" containerID="0f3f059feb586f2a25dc4e495150642dd3020d19b04a17edefebc4be1bcbd2c2"
Jul 24 17:23:47.635737 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.635721    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f3f059feb586f2a25dc4e495150642dd3020d19b04a17edefebc4be1bcbd2c2"} err="failed to get container status \"0f3f059feb586f2a25dc4e495150642dd3020d19b04a17edefebc4be1bcbd2c2\": rpc error: code = NotFound desc = could not find container \"0f3f059feb586f2a25dc4e495150642dd3020d19b04a17edefebc4be1bcbd2c2\": container with ID starting with 0f3f059feb586f2a25dc4e495150642dd3020d19b04a17edefebc4be1bcbd2c2 not found: ID does not exist"
Jul 24 17:23:47.635793 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.635737    2575 scope.go:117] "RemoveContainer" containerID="f417f20f39e0696d7709665218228421f38757226276f2f6573aa911c6d164c6"
Jul 24 17:23:47.635961 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.635918    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f417f20f39e0696d7709665218228421f38757226276f2f6573aa911c6d164c6"} err="failed to get container status \"f417f20f39e0696d7709665218228421f38757226276f2f6573aa911c6d164c6\": rpc error: code = NotFound desc = could not find container \"f417f20f39e0696d7709665218228421f38757226276f2f6573aa911c6d164c6\": container with ID starting with f417f20f39e0696d7709665218228421f38757226276f2f6573aa911c6d164c6 not found: ID does not exist"
Jul 24 17:23:47.635961 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.635954    2575 scope.go:117] "RemoveContainer" containerID="ce629ffc7d2ec242bef12a076c13cddd18e1f6c39c2c7fa66e748f520acbc2fd"
Jul 24 17:23:47.636233 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.636216    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce629ffc7d2ec242bef12a076c13cddd18e1f6c39c2c7fa66e748f520acbc2fd"} err="failed to get container status \"ce629ffc7d2ec242bef12a076c13cddd18e1f6c39c2c7fa66e748f520acbc2fd\": rpc error: code = NotFound desc = could not find container \"ce629ffc7d2ec242bef12a076c13cddd18e1f6c39c2c7fa66e748f520acbc2fd\": container with ID starting with ce629ffc7d2ec242bef12a076c13cddd18e1f6c39c2c7fa66e748f520acbc2fd not found: ID does not exist"
Jul 24 17:23:47.636295 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.636233    2575 scope.go:117] "RemoveContainer" containerID="285088680ad9fb705a0d741a38a33293441c76cf4fac02919c6e1e3470485f6c"
Jul 24 17:23:47.636470 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.636453    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"285088680ad9fb705a0d741a38a33293441c76cf4fac02919c6e1e3470485f6c"} err="failed to get container status \"285088680ad9fb705a0d741a38a33293441c76cf4fac02919c6e1e3470485f6c\": rpc error: code = NotFound desc = could not find container \"285088680ad9fb705a0d741a38a33293441c76cf4fac02919c6e1e3470485f6c\": container with ID starting with 285088680ad9fb705a0d741a38a33293441c76cf4fac02919c6e1e3470485f6c not found: ID does not exist"
Jul 24 17:23:47.636528 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.636471    2575 scope.go:117] "RemoveContainer" containerID="cf3f0401a8e2ea561209e50dde788716d4c336da04653c6fa001378ced0d577a"
Jul 24 17:23:47.636703 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.636685    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf3f0401a8e2ea561209e50dde788716d4c336da04653c6fa001378ced0d577a"} err="failed to get container status \"cf3f0401a8e2ea561209e50dde788716d4c336da04653c6fa001378ced0d577a\": rpc error: code = NotFound desc = could not find container \"cf3f0401a8e2ea561209e50dde788716d4c336da04653c6fa001378ced0d577a\": container with ID starting with cf3f0401a8e2ea561209e50dde788716d4c336da04653c6fa001378ced0d577a not found: ID does not exist"
Jul 24 17:23:47.636772 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.636703    2575 scope.go:117] "RemoveContainer" containerID="605b86da77698c09b4ebe43199e8f3b255c1edb9bdabb6eca8d7bcc7b3208dea"
Jul 24 17:23:47.636923 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.636908    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"605b86da77698c09b4ebe43199e8f3b255c1edb9bdabb6eca8d7bcc7b3208dea"} err="failed to get container status \"605b86da77698c09b4ebe43199e8f3b255c1edb9bdabb6eca8d7bcc7b3208dea\": rpc error: code = NotFound desc = could not find container \"605b86da77698c09b4ebe43199e8f3b255c1edb9bdabb6eca8d7bcc7b3208dea\": container with ID starting with 605b86da77698c09b4ebe43199e8f3b255c1edb9bdabb6eca8d7bcc7b3208dea not found: ID does not exist"
Jul 24 17:23:47.637014 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.636923    2575 scope.go:117] "RemoveContainer" containerID="a615acae28043cd1fd8c89f67e64db42e1740ee0400d1dd5551ca367b992191b"
Jul 24 17:23:47.637126 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.637108    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a615acae28043cd1fd8c89f67e64db42e1740ee0400d1dd5551ca367b992191b"} err="failed to get container status \"a615acae28043cd1fd8c89f67e64db42e1740ee0400d1dd5551ca367b992191b\": rpc error: code = NotFound desc = could not find container \"a615acae28043cd1fd8c89f67e64db42e1740ee0400d1dd5551ca367b992191b\": container with ID starting with a615acae28043cd1fd8c89f67e64db42e1740ee0400d1dd5551ca367b992191b not found: ID does not exist"
Jul 24 17:23:47.637185 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.637127    2575 scope.go:117] "RemoveContainer" containerID="0f3f059feb586f2a25dc4e495150642dd3020d19b04a17edefebc4be1bcbd2c2"
Jul 24 17:23:47.637334 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.637319    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f3f059feb586f2a25dc4e495150642dd3020d19b04a17edefebc4be1bcbd2c2"} err="failed to get container status \"0f3f059feb586f2a25dc4e495150642dd3020d19b04a17edefebc4be1bcbd2c2\": rpc error: code = NotFound desc = could not find container \"0f3f059feb586f2a25dc4e495150642dd3020d19b04a17edefebc4be1bcbd2c2\": container with ID starting with 0f3f059feb586f2a25dc4e495150642dd3020d19b04a17edefebc4be1bcbd2c2 not found: ID does not exist"
Jul 24 17:23:47.637334 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.637334    2575 scope.go:117] "RemoveContainer" containerID="f417f20f39e0696d7709665218228421f38757226276f2f6573aa911c6d164c6"
Jul 24 17:23:47.637534 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.637519    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f417f20f39e0696d7709665218228421f38757226276f2f6573aa911c6d164c6"} err="failed to get container status \"f417f20f39e0696d7709665218228421f38757226276f2f6573aa911c6d164c6\": rpc error: code = NotFound desc = could not find container \"f417f20f39e0696d7709665218228421f38757226276f2f6573aa911c6d164c6\": container with ID starting with f417f20f39e0696d7709665218228421f38757226276f2f6573aa911c6d164c6 not found: ID does not exist"
Jul 24 17:23:47.637590 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.637534    2575 scope.go:117] "RemoveContainer" containerID="ce629ffc7d2ec242bef12a076c13cddd18e1f6c39c2c7fa66e748f520acbc2fd"
Jul 24 17:23:47.637735 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.637714    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce629ffc7d2ec242bef12a076c13cddd18e1f6c39c2c7fa66e748f520acbc2fd"} err="failed to get container status \"ce629ffc7d2ec242bef12a076c13cddd18e1f6c39c2c7fa66e748f520acbc2fd\": rpc error: code = NotFound desc = could not find container \"ce629ffc7d2ec242bef12a076c13cddd18e1f6c39c2c7fa66e748f520acbc2fd\": container with ID starting with ce629ffc7d2ec242bef12a076c13cddd18e1f6c39c2c7fa66e748f520acbc2fd not found: ID does not exist"
Jul 24 17:23:47.637793 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.637736    2575 scope.go:117] "RemoveContainer" containerID="285088680ad9fb705a0d741a38a33293441c76cf4fac02919c6e1e3470485f6c"
Jul 24 17:23:47.637951 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.637920    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"285088680ad9fb705a0d741a38a33293441c76cf4fac02919c6e1e3470485f6c"} err="failed to get container status \"285088680ad9fb705a0d741a38a33293441c76cf4fac02919c6e1e3470485f6c\": rpc error: code = NotFound desc = could not find container \"285088680ad9fb705a0d741a38a33293441c76cf4fac02919c6e1e3470485f6c\": container with ID starting with 285088680ad9fb705a0d741a38a33293441c76cf4fac02919c6e1e3470485f6c not found: ID does not exist"
Jul 24 17:23:47.637951 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.637949    2575 scope.go:117] "RemoveContainer" containerID="cf3f0401a8e2ea561209e50dde788716d4c336da04653c6fa001378ced0d577a"
Jul 24 17:23:47.638158 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.638137    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf3f0401a8e2ea561209e50dde788716d4c336da04653c6fa001378ced0d577a"} err="failed to get container status \"cf3f0401a8e2ea561209e50dde788716d4c336da04653c6fa001378ced0d577a\": rpc error: code = NotFound desc = could not find container \"cf3f0401a8e2ea561209e50dde788716d4c336da04653c6fa001378ced0d577a\": container with ID starting with cf3f0401a8e2ea561209e50dde788716d4c336da04653c6fa001378ced0d577a not found: ID does not exist"
Jul 24 17:23:47.638158 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.638156    2575 scope.go:117] "RemoveContainer" containerID="605b86da77698c09b4ebe43199e8f3b255c1edb9bdabb6eca8d7bcc7b3208dea"
Jul 24 17:23:47.638402 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.638386    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"605b86da77698c09b4ebe43199e8f3b255c1edb9bdabb6eca8d7bcc7b3208dea"} err="failed to get container status \"605b86da77698c09b4ebe43199e8f3b255c1edb9bdabb6eca8d7bcc7b3208dea\": rpc error: code = NotFound desc = could not find container \"605b86da77698c09b4ebe43199e8f3b255c1edb9bdabb6eca8d7bcc7b3208dea\": container with ID starting with 605b86da77698c09b4ebe43199e8f3b255c1edb9bdabb6eca8d7bcc7b3208dea not found: ID does not exist"
Jul 24 17:23:47.638461 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.638403    2575 scope.go:117] "RemoveContainer" containerID="a615acae28043cd1fd8c89f67e64db42e1740ee0400d1dd5551ca367b992191b"
Jul 24 17:23:47.638635 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.638616    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a615acae28043cd1fd8c89f67e64db42e1740ee0400d1dd5551ca367b992191b"} err="failed to get container status \"a615acae28043cd1fd8c89f67e64db42e1740ee0400d1dd5551ca367b992191b\": rpc error: code = NotFound desc = could not find container \"a615acae28043cd1fd8c89f67e64db42e1740ee0400d1dd5551ca367b992191b\": container with ID starting with a615acae28043cd1fd8c89f67e64db42e1740ee0400d1dd5551ca367b992191b not found: ID does not exist"
Jul 24 17:23:47.638635 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.638635    2575 scope.go:117] "RemoveContainer" containerID="0f3f059feb586f2a25dc4e495150642dd3020d19b04a17edefebc4be1bcbd2c2"
Jul 24 17:23:47.638802 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.638781    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f3f059feb586f2a25dc4e495150642dd3020d19b04a17edefebc4be1bcbd2c2"} err="failed to get container status \"0f3f059feb586f2a25dc4e495150642dd3020d19b04a17edefebc4be1bcbd2c2\": rpc error: code = NotFound desc = could not find container \"0f3f059feb586f2a25dc4e495150642dd3020d19b04a17edefebc4be1bcbd2c2\": container with ID starting with 0f3f059feb586f2a25dc4e495150642dd3020d19b04a17edefebc4be1bcbd2c2 not found: ID does not exist"
Jul 24 17:23:47.638802 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.638797    2575 scope.go:117] "RemoveContainer" containerID="f417f20f39e0696d7709665218228421f38757226276f2f6573aa911c6d164c6"
Jul 24 17:23:47.639043 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.639025    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f417f20f39e0696d7709665218228421f38757226276f2f6573aa911c6d164c6"} err="failed to get container status \"f417f20f39e0696d7709665218228421f38757226276f2f6573aa911c6d164c6\": rpc error: code = NotFound desc = could not find container \"f417f20f39e0696d7709665218228421f38757226276f2f6573aa911c6d164c6\": container with ID starting with f417f20f39e0696d7709665218228421f38757226276f2f6573aa911c6d164c6 not found: ID does not exist"
Jul 24 17:23:47.639095 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.639044    2575 scope.go:117] "RemoveContainer" containerID="ce629ffc7d2ec242bef12a076c13cddd18e1f6c39c2c7fa66e748f520acbc2fd"
Jul 24 17:23:47.639241 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.639226    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce629ffc7d2ec242bef12a076c13cddd18e1f6c39c2c7fa66e748f520acbc2fd"} err="failed to get container status \"ce629ffc7d2ec242bef12a076c13cddd18e1f6c39c2c7fa66e748f520acbc2fd\": rpc error: code = NotFound desc = could not find container \"ce629ffc7d2ec242bef12a076c13cddd18e1f6c39c2c7fa66e748f520acbc2fd\": container with ID starting with ce629ffc7d2ec242bef12a076c13cddd18e1f6c39c2c7fa66e748f520acbc2fd not found: ID does not exist"
Jul 24 17:23:47.639286 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.639241    2575 scope.go:117] "RemoveContainer" containerID="285088680ad9fb705a0d741a38a33293441c76cf4fac02919c6e1e3470485f6c"
Jul 24 17:23:47.639469 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.639455    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"285088680ad9fb705a0d741a38a33293441c76cf4fac02919c6e1e3470485f6c"} err="failed to get container status \"285088680ad9fb705a0d741a38a33293441c76cf4fac02919c6e1e3470485f6c\": rpc error: code = NotFound desc = could not find container \"285088680ad9fb705a0d741a38a33293441c76cf4fac02919c6e1e3470485f6c\": container with ID starting with 285088680ad9fb705a0d741a38a33293441c76cf4fac02919c6e1e3470485f6c not found: ID does not exist"
Jul 24 17:23:47.639516 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.639468    2575 scope.go:117] "RemoveContainer" containerID="cf3f0401a8e2ea561209e50dde788716d4c336da04653c6fa001378ced0d577a"
Jul 24 17:23:47.639673 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.639659    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf3f0401a8e2ea561209e50dde788716d4c336da04653c6fa001378ced0d577a"} err="failed to get container status \"cf3f0401a8e2ea561209e50dde788716d4c336da04653c6fa001378ced0d577a\": rpc error: code = NotFound desc = could not find container \"cf3f0401a8e2ea561209e50dde788716d4c336da04653c6fa001378ced0d577a\": container with ID starting with cf3f0401a8e2ea561209e50dde788716d4c336da04653c6fa001378ced0d577a not found: ID does not exist"
Jul 24 17:23:47.639673 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.639673    2575 scope.go:117] "RemoveContainer" containerID="605b86da77698c09b4ebe43199e8f3b255c1edb9bdabb6eca8d7bcc7b3208dea"
Jul 24 17:23:47.639885 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.639866    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"605b86da77698c09b4ebe43199e8f3b255c1edb9bdabb6eca8d7bcc7b3208dea"} err="failed to get container status \"605b86da77698c09b4ebe43199e8f3b255c1edb9bdabb6eca8d7bcc7b3208dea\": rpc error: code = NotFound desc = could not find container \"605b86da77698c09b4ebe43199e8f3b255c1edb9bdabb6eca8d7bcc7b3208dea\": container with ID starting with 605b86da77698c09b4ebe43199e8f3b255c1edb9bdabb6eca8d7bcc7b3208dea not found: ID does not exist"
Jul 24 17:23:47.639965 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.639885    2575 scope.go:117] "RemoveContainer" containerID="a615acae28043cd1fd8c89f67e64db42e1740ee0400d1dd5551ca367b992191b"
Jul 24 17:23:47.640094 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.640079    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a615acae28043cd1fd8c89f67e64db42e1740ee0400d1dd5551ca367b992191b"} err="failed to get container status \"a615acae28043cd1fd8c89f67e64db42e1740ee0400d1dd5551ca367b992191b\": rpc error: code = NotFound desc = could not find container \"a615acae28043cd1fd8c89f67e64db42e1740ee0400d1dd5551ca367b992191b\": container with ID starting with a615acae28043cd1fd8c89f67e64db42e1740ee0400d1dd5551ca367b992191b not found: ID does not exist"
Jul 24 17:23:47.640094 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.640093    2575 scope.go:117] "RemoveContainer" containerID="0f3f059feb586f2a25dc4e495150642dd3020d19b04a17edefebc4be1bcbd2c2"
Jul 24 17:23:47.640299 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.640281    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f3f059feb586f2a25dc4e495150642dd3020d19b04a17edefebc4be1bcbd2c2"} err="failed to get container status \"0f3f059feb586f2a25dc4e495150642dd3020d19b04a17edefebc4be1bcbd2c2\": rpc error: code = NotFound desc = could not find container \"0f3f059feb586f2a25dc4e495150642dd3020d19b04a17edefebc4be1bcbd2c2\": container with ID starting with 0f3f059feb586f2a25dc4e495150642dd3020d19b04a17edefebc4be1bcbd2c2 not found: ID does not exist"
Jul 24 17:23:47.640368 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.640301    2575 scope.go:117] "RemoveContainer" containerID="f417f20f39e0696d7709665218228421f38757226276f2f6573aa911c6d164c6"
Jul 24 17:23:47.640534 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.640518    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f417f20f39e0696d7709665218228421f38757226276f2f6573aa911c6d164c6"} err="failed to get container status \"f417f20f39e0696d7709665218228421f38757226276f2f6573aa911c6d164c6\": rpc error: code = NotFound desc = could not find container \"f417f20f39e0696d7709665218228421f38757226276f2f6573aa911c6d164c6\": container with ID starting with f417f20f39e0696d7709665218228421f38757226276f2f6573aa911c6d164c6 not found: ID does not exist"
Jul 24 17:23:47.640592 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.640535    2575 scope.go:117] "RemoveContainer" containerID="ce629ffc7d2ec242bef12a076c13cddd18e1f6c39c2c7fa66e748f520acbc2fd"
Jul 24 17:23:47.640731 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.640716    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce629ffc7d2ec242bef12a076c13cddd18e1f6c39c2c7fa66e748f520acbc2fd"} err="failed to get container status \"ce629ffc7d2ec242bef12a076c13cddd18e1f6c39c2c7fa66e748f520acbc2fd\": rpc error: code = NotFound desc = could not find container \"ce629ffc7d2ec242bef12a076c13cddd18e1f6c39c2c7fa66e748f520acbc2fd\": container with ID starting with ce629ffc7d2ec242bef12a076c13cddd18e1f6c39c2c7fa66e748f520acbc2fd not found: ID does not exist"
Jul 24 17:23:47.640731 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.640731    2575 scope.go:117] "RemoveContainer" containerID="285088680ad9fb705a0d741a38a33293441c76cf4fac02919c6e1e3470485f6c"
Jul 24 17:23:47.640952 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.640916    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"285088680ad9fb705a0d741a38a33293441c76cf4fac02919c6e1e3470485f6c"} err="failed to get container status \"285088680ad9fb705a0d741a38a33293441c76cf4fac02919c6e1e3470485f6c\": rpc error: code = NotFound desc = could not find container \"285088680ad9fb705a0d741a38a33293441c76cf4fac02919c6e1e3470485f6c\": container with ID starting with 285088680ad9fb705a0d741a38a33293441c76cf4fac02919c6e1e3470485f6c not found: ID does not exist"
Jul 24 17:23:47.668865 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.668833    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/695ce553-fc1a-4987-8bd7-5ca80fb4336c-prometheus-trusted-ca-bundle\") pod \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") "
Jul 24 17:23:47.669037 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.668879    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/695ce553-fc1a-4987-8bd7-5ca80fb4336c-config\") pod \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") "
Jul 24 17:23:47.669037 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.668903    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/695ce553-fc1a-4987-8bd7-5ca80fb4336c-secret-prometheus-k8s-tls\") pod \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") "
Jul 24 17:23:47.669037 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.668930    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/695ce553-fc1a-4987-8bd7-5ca80fb4336c-configmap-serving-certs-ca-bundle\") pod \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") "
Jul 24 17:23:47.669037 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.668999    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7h6m\" (UniqueName: \"kubernetes.io/projected/695ce553-fc1a-4987-8bd7-5ca80fb4336c-kube-api-access-h7h6m\") pod \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") "
Jul 24 17:23:47.669037 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.669024    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/695ce553-fc1a-4987-8bd7-5ca80fb4336c-configmap-metrics-client-ca\") pod \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") "
Jul 24 17:23:47.669274 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.669045    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/695ce553-fc1a-4987-8bd7-5ca80fb4336c-thanos-prometheus-http-client-file\") pod \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") "
Jul 24 17:23:47.669274 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.669072    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/695ce553-fc1a-4987-8bd7-5ca80fb4336c-secret-kube-rbac-proxy\") pod \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") "
Jul 24 17:23:47.669274 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.669105    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/695ce553-fc1a-4987-8bd7-5ca80fb4336c-prometheus-k8s-db\") pod \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") "
Jul 24 17:23:47.669274 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.669131    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/695ce553-fc1a-4987-8bd7-5ca80fb4336c-web-config\") pod \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") "
Jul 24 17:23:47.669274 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.669154    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/695ce553-fc1a-4987-8bd7-5ca80fb4336c-configmap-kubelet-serving-ca-bundle\") pod \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") "
Jul 24 17:23:47.669274 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.669181    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/695ce553-fc1a-4987-8bd7-5ca80fb4336c-secret-grpc-tls\") pod \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") "
Jul 24 17:23:47.669274 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.669210    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/695ce553-fc1a-4987-8bd7-5ca80fb4336c-config-out\") pod \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") "
Jul 24 17:23:47.669274 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.669238    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/695ce553-fc1a-4987-8bd7-5ca80fb4336c-prometheus-k8s-rulefiles-0\") pod \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") "
Jul 24 17:23:47.669274 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.669263    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/695ce553-fc1a-4987-8bd7-5ca80fb4336c-prometheus-k8s-rulefiles-2\") pod \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") "
Jul 24 17:23:47.669708 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.669313    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/695ce553-fc1a-4987-8bd7-5ca80fb4336c-secret-metrics-client-certs\") pod \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") "
Jul 24 17:23:47.669708 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.669343    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/695ce553-fc1a-4987-8bd7-5ca80fb4336c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") "
Jul 24 17:23:47.669708 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.669367    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/695ce553-fc1a-4987-8bd7-5ca80fb4336c-prometheus-k8s-rulefiles-1\") pod \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") "
Jul 24 17:23:47.669708 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.669399    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/695ce553-fc1a-4987-8bd7-5ca80fb4336c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") "
Jul 24 17:23:47.669708 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.669428    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/695ce553-fc1a-4987-8bd7-5ca80fb4336c-tls-assets\") pod \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\" (UID: \"695ce553-fc1a-4987-8bd7-5ca80fb4336c\") "
Jul 24 17:23:47.669708 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.669457    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/695ce553-fc1a-4987-8bd7-5ca80fb4336c-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "695ce553-fc1a-4987-8bd7-5ca80fb4336c" (UID: "695ce553-fc1a-4987-8bd7-5ca80fb4336c"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:23:47.669708 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.669524    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/695ce553-fc1a-4987-8bd7-5ca80fb4336c-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "695ce553-fc1a-4987-8bd7-5ca80fb4336c" (UID: "695ce553-fc1a-4987-8bd7-5ca80fb4336c"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:23:47.670080 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.669799    2575 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/695ce553-fc1a-4987-8bd7-5ca80fb4336c-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 17:23:47.670080 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.669821    2575 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/695ce553-fc1a-4987-8bd7-5ca80fb4336c-configmap-metrics-client-ca\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 17:23:47.670305 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.670275    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/695ce553-fc1a-4987-8bd7-5ca80fb4336c-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "695ce553-fc1a-4987-8bd7-5ca80fb4336c" (UID: "695ce553-fc1a-4987-8bd7-5ca80fb4336c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:23:47.670592 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.670565    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/695ce553-fc1a-4987-8bd7-5ca80fb4336c-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "695ce553-fc1a-4987-8bd7-5ca80fb4336c" (UID: "695ce553-fc1a-4987-8bd7-5ca80fb4336c"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:23:47.671002 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.670975    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/695ce553-fc1a-4987-8bd7-5ca80fb4336c-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "695ce553-fc1a-4987-8bd7-5ca80fb4336c" (UID: "695ce553-fc1a-4987-8bd7-5ca80fb4336c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:23:47.671418 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.671392    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/695ce553-fc1a-4987-8bd7-5ca80fb4336c-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "695ce553-fc1a-4987-8bd7-5ca80fb4336c" (UID: "695ce553-fc1a-4987-8bd7-5ca80fb4336c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:23:47.671604 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.671581    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/695ce553-fc1a-4987-8bd7-5ca80fb4336c-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "695ce553-fc1a-4987-8bd7-5ca80fb4336c" (UID: "695ce553-fc1a-4987-8bd7-5ca80fb4336c"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:23:47.672079 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.672051    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/695ce553-fc1a-4987-8bd7-5ca80fb4336c-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "695ce553-fc1a-4987-8bd7-5ca80fb4336c" (UID: "695ce553-fc1a-4987-8bd7-5ca80fb4336c"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 17:23:47.672562 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.672409    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/695ce553-fc1a-4987-8bd7-5ca80fb4336c-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "695ce553-fc1a-4987-8bd7-5ca80fb4336c" (UID: "695ce553-fc1a-4987-8bd7-5ca80fb4336c"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:23:47.672562 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.672524    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/695ce553-fc1a-4987-8bd7-5ca80fb4336c-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "695ce553-fc1a-4987-8bd7-5ca80fb4336c" (UID: "695ce553-fc1a-4987-8bd7-5ca80fb4336c"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:23:47.672838 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.672581    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/695ce553-fc1a-4987-8bd7-5ca80fb4336c-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "695ce553-fc1a-4987-8bd7-5ca80fb4336c" (UID: "695ce553-fc1a-4987-8bd7-5ca80fb4336c"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:23:47.672838 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.672762    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/695ce553-fc1a-4987-8bd7-5ca80fb4336c-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "695ce553-fc1a-4987-8bd7-5ca80fb4336c" (UID: "695ce553-fc1a-4987-8bd7-5ca80fb4336c"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:23:47.672838 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.672817    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/695ce553-fc1a-4987-8bd7-5ca80fb4336c-kube-api-access-h7h6m" (OuterVolumeSpecName: "kube-api-access-h7h6m") pod "695ce553-fc1a-4987-8bd7-5ca80fb4336c" (UID: "695ce553-fc1a-4987-8bd7-5ca80fb4336c"). InnerVolumeSpecName "kube-api-access-h7h6m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:23:47.673168 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.673144    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/695ce553-fc1a-4987-8bd7-5ca80fb4336c-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "695ce553-fc1a-4987-8bd7-5ca80fb4336c" (UID: "695ce553-fc1a-4987-8bd7-5ca80fb4336c"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:23:47.673450 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.673419    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/695ce553-fc1a-4987-8bd7-5ca80fb4336c-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "695ce553-fc1a-4987-8bd7-5ca80fb4336c" (UID: "695ce553-fc1a-4987-8bd7-5ca80fb4336c"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:23:47.673925 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.673901    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/695ce553-fc1a-4987-8bd7-5ca80fb4336c-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "695ce553-fc1a-4987-8bd7-5ca80fb4336c" (UID: "695ce553-fc1a-4987-8bd7-5ca80fb4336c"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:23:47.674211 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.674186    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/695ce553-fc1a-4987-8bd7-5ca80fb4336c-config-out" (OuterVolumeSpecName: "config-out") pod "695ce553-fc1a-4987-8bd7-5ca80fb4336c" (UID: "695ce553-fc1a-4987-8bd7-5ca80fb4336c"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:23:47.674375 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.674354    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/695ce553-fc1a-4987-8bd7-5ca80fb4336c-config" (OuterVolumeSpecName: "config") pod "695ce553-fc1a-4987-8bd7-5ca80fb4336c" (UID: "695ce553-fc1a-4987-8bd7-5ca80fb4336c"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:23:47.674457 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.674442    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/695ce553-fc1a-4987-8bd7-5ca80fb4336c-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "695ce553-fc1a-4987-8bd7-5ca80fb4336c" (UID: "695ce553-fc1a-4987-8bd7-5ca80fb4336c"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:23:47.684410 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.684383    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/695ce553-fc1a-4987-8bd7-5ca80fb4336c-web-config" (OuterVolumeSpecName: "web-config") pod "695ce553-fc1a-4987-8bd7-5ca80fb4336c" (UID: "695ce553-fc1a-4987-8bd7-5ca80fb4336c"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:23:47.771011 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.770973    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/695ce553-fc1a-4987-8bd7-5ca80fb4336c-prometheus-k8s-db\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 17:23:47.771011 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.771006    2575 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/695ce553-fc1a-4987-8bd7-5ca80fb4336c-web-config\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 17:23:47.771289 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.771020    2575 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/695ce553-fc1a-4987-8bd7-5ca80fb4336c-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 17:23:47.771289 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.771032    2575 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/695ce553-fc1a-4987-8bd7-5ca80fb4336c-secret-grpc-tls\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 17:23:47.771289 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.771045    2575 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/695ce553-fc1a-4987-8bd7-5ca80fb4336c-config-out\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 17:23:47.771289 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.771056    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/695ce553-fc1a-4987-8bd7-5ca80fb4336c-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 17:23:47.771289 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.771066    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/695ce553-fc1a-4987-8bd7-5ca80fb4336c-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 17:23:47.771289 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.771078    2575 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/695ce553-fc1a-4987-8bd7-5ca80fb4336c-secret-metrics-client-certs\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 17:23:47.771289 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.771090    2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/695ce553-fc1a-4987-8bd7-5ca80fb4336c-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 17:23:47.771289 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.771102    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/695ce553-fc1a-4987-8bd7-5ca80fb4336c-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 17:23:47.771289 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.771113    2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/695ce553-fc1a-4987-8bd7-5ca80fb4336c-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 17:23:47.771289 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.771125    2575 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/695ce553-fc1a-4987-8bd7-5ca80fb4336c-tls-assets\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 17:23:47.771289 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.771137    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/695ce553-fc1a-4987-8bd7-5ca80fb4336c-prometheus-trusted-ca-bundle\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 17:23:47.771289 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.771149    2575 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/695ce553-fc1a-4987-8bd7-5ca80fb4336c-config\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 17:23:47.771289 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.771161    2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/695ce553-fc1a-4987-8bd7-5ca80fb4336c-secret-prometheus-k8s-tls\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 17:23:47.771289 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.771178    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7h6m\" (UniqueName: \"kubernetes.io/projected/695ce553-fc1a-4987-8bd7-5ca80fb4336c-kube-api-access-h7h6m\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 17:23:47.771289 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.771191    2575 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/695ce553-fc1a-4987-8bd7-5ca80fb4336c-thanos-prometheus-http-client-file\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 17:23:47.771289 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.771205    2575 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/695ce553-fc1a-4987-8bd7-5ca80fb4336c-secret-kube-rbac-proxy\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 17:23:47.898652 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.898618    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 17:23:47.903895 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:47.903872    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 17:23:49.200272 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:49.200237    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="695ce553-fc1a-4987-8bd7-5ca80fb4336c" path="/var/lib/kubelet/pods/695ce553-fc1a-4987-8bd7-5ca80fb4336c/volumes"
Jul 24 17:23:50.502074 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:50.502040    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:23:50.557546 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:50.557512    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:23:57.417892 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:57.417849    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:23:57.522991 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:57.522956    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:23:57.574335 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:23:57.574297    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:24:04.366955 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:24:04.366898    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:24:04.466766 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:24:04.466735    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:24:04.523658 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:24:04.523627    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:24:20.320474 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:24:20.320439    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:24:20.373956 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:24:20.373910    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:24:40.056339 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:24:40.056298    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:24:42.541022 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:24:42.540984    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:24:42.638565 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:24:42.638531    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:25:04.267570 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:04.267531    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:25:05.103752 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:05.103712    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:25:08.481421 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:08.481340    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:25:08.581597 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:08.581564    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:25:10.485262 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:10.485228    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:25:10.583554 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:10.583528    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:25:11.004366 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:11.004329    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:25:11.120492 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:11.120462    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:25:12.475264 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:12.475231    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:25:12.861450 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:12.861417    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:25:16.470384 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:16.470339    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:25:16.570598 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:16.570563    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:25:16.630393 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:16.630355    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:25:18.461841 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:18.461803    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:25:18.562816 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:18.562781    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:25:21.276017 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:21.275988    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:25:34.951214 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:34.951175    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:25:35.049077 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:35.049043    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:25:41.428135 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:41.428095    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:25:41.534410 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:41.534380    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:25:43.253087 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:43.253048    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:25:55.115350 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:55.115317    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:25:55.233547 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:55.233512    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:25:55.723263 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:55.723229    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:25:55.946522 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:55.946494    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:25:56.049882 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:56.049850    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:25:56.082044 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:56.082013    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8574785b6-qmn4c"]
Jul 24 17:25:56.082248 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:56.082236    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="695ce553-fc1a-4987-8bd7-5ca80fb4336c" containerName="init-config-reloader"
Jul 24 17:25:56.082292 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:56.082249    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="695ce553-fc1a-4987-8bd7-5ca80fb4336c" containerName="init-config-reloader"
Jul 24 17:25:56.082292 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:56.082261    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="695ce553-fc1a-4987-8bd7-5ca80fb4336c" containerName="thanos-sidecar"
Jul 24 17:25:56.082292 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:56.082266    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="695ce553-fc1a-4987-8bd7-5ca80fb4336c" containerName="thanos-sidecar"
Jul 24 17:25:56.082292 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:56.082274    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="695ce553-fc1a-4987-8bd7-5ca80fb4336c" containerName="kube-rbac-proxy"
Jul 24 17:25:56.082292 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:56.082278    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="695ce553-fc1a-4987-8bd7-5ca80fb4336c" containerName="kube-rbac-proxy"
Jul 24 17:25:56.082292 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:56.082285    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="695ce553-fc1a-4987-8bd7-5ca80fb4336c" containerName="kube-rbac-proxy-thanos"
Jul 24 17:25:56.082292 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:56.082289    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="695ce553-fc1a-4987-8bd7-5ca80fb4336c" containerName="kube-rbac-proxy-thanos"
Jul 24 17:25:56.082490 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:56.082297    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="695ce553-fc1a-4987-8bd7-5ca80fb4336c" containerName="config-reloader"
Jul 24 17:25:56.082490 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:56.082302    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="695ce553-fc1a-4987-8bd7-5ca80fb4336c" containerName="config-reloader"
Jul 24 17:25:56.082490 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:56.082307    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="695ce553-fc1a-4987-8bd7-5ca80fb4336c" containerName="prometheus"
Jul 24 17:25:56.082490 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:56.082311    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="695ce553-fc1a-4987-8bd7-5ca80fb4336c" containerName="prometheus"
Jul 24 17:25:56.082490 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:56.082340    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="695ce553-fc1a-4987-8bd7-5ca80fb4336c" containerName="kube-rbac-proxy-web"
Jul 24 17:25:56.082490 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:56.082345    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="695ce553-fc1a-4987-8bd7-5ca80fb4336c" containerName="kube-rbac-proxy-web"
Jul 24 17:25:56.082490 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:56.082385    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="695ce553-fc1a-4987-8bd7-5ca80fb4336c" containerName="kube-rbac-proxy-web"
Jul 24 17:25:56.082490 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:56.082392    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="695ce553-fc1a-4987-8bd7-5ca80fb4336c" containerName="kube-rbac-proxy"
Jul 24 17:25:56.082490 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:56.082398    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="695ce553-fc1a-4987-8bd7-5ca80fb4336c" containerName="config-reloader"
Jul 24 17:25:56.082490 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:56.082404    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="695ce553-fc1a-4987-8bd7-5ca80fb4336c" containerName="prometheus"
Jul 24 17:25:56.082490 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:56.082411    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="695ce553-fc1a-4987-8bd7-5ca80fb4336c" containerName="thanos-sidecar"
Jul 24 17:25:56.082490 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:56.082416    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="695ce553-fc1a-4987-8bd7-5ca80fb4336c" containerName="kube-rbac-proxy-thanos"
Jul 24 17:25:56.084541 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:56.084524    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8574785b6-qmn4c"
Jul 24 17:25:56.087351 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:56.087327    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 24 17:25:56.087580 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:56.087566    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 24 17:25:56.087580 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:56.087574    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 24 17:25:56.087669 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:56.087579    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-xxn55\""
Jul 24 17:25:56.089654 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:56.089636    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 24 17:25:56.098805 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:56.098783    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ceb37084-0553-4277-a11b-de466ba79a69-tmp\") pod \"opendatahub-operator-controller-manager-8574785b6-qmn4c\" (UID: \"ceb37084-0553-4277-a11b-de466ba79a69\") " pod="opendatahub/opendatahub-operator-controller-manager-8574785b6-qmn4c"
Jul 24 17:25:56.098889 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:56.098811    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ceb37084-0553-4277-a11b-de466ba79a69-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8574785b6-qmn4c\" (UID: \"ceb37084-0553-4277-a11b-de466ba79a69\") " pod="opendatahub/opendatahub-operator-controller-manager-8574785b6-qmn4c"
Jul 24 17:25:56.098889 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:56.098882    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ceb37084-0553-4277-a11b-de466ba79a69-webhook-cert\") pod \"opendatahub-operator-controller-manager-8574785b6-qmn4c\" (UID: \"ceb37084-0553-4277-a11b-de466ba79a69\") " pod="opendatahub/opendatahub-operator-controller-manager-8574785b6-qmn4c"
Jul 24 17:25:56.098981 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:56.098903    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ceb37084-0553-4277-a11b-de466ba79a69-manifests\") pod \"opendatahub-operator-controller-manager-8574785b6-qmn4c\" (UID: \"ceb37084-0553-4277-a11b-de466ba79a69\") " pod="opendatahub/opendatahub-operator-controller-manager-8574785b6-qmn4c"
Jul 24 17:25:56.098981 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:56.098948    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mb8tr\" (UniqueName: \"kubernetes.io/projected/ceb37084-0553-4277-a11b-de466ba79a69-kube-api-access-mb8tr\") pod \"opendatahub-operator-controller-manager-8574785b6-qmn4c\" (UID: \"ceb37084-0553-4277-a11b-de466ba79a69\") " pod="opendatahub/opendatahub-operator-controller-manager-8574785b6-qmn4c"
Jul 24 17:25:56.110806 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:56.110779    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8574785b6-qmn4c"]
Jul 24 17:25:56.199335 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:56.199303    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ceb37084-0553-4277-a11b-de466ba79a69-webhook-cert\") pod \"opendatahub-operator-controller-manager-8574785b6-qmn4c\" (UID: \"ceb37084-0553-4277-a11b-de466ba79a69\") " pod="opendatahub/opendatahub-operator-controller-manager-8574785b6-qmn4c"
Jul 24 17:25:56.199335 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:56.199333    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ceb37084-0553-4277-a11b-de466ba79a69-manifests\") pod \"opendatahub-operator-controller-manager-8574785b6-qmn4c\" (UID: \"ceb37084-0553-4277-a11b-de466ba79a69\") " pod="opendatahub/opendatahub-operator-controller-manager-8574785b6-qmn4c"
Jul 24 17:25:56.199808 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:56.199451    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mb8tr\" (UniqueName: \"kubernetes.io/projected/ceb37084-0553-4277-a11b-de466ba79a69-kube-api-access-mb8tr\") pod \"opendatahub-operator-controller-manager-8574785b6-qmn4c\" (UID: \"ceb37084-0553-4277-a11b-de466ba79a69\") " pod="opendatahub/opendatahub-operator-controller-manager-8574785b6-qmn4c"
Jul 24 17:25:56.199808 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:56.199503    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ceb37084-0553-4277-a11b-de466ba79a69-tmp\") pod \"opendatahub-operator-controller-manager-8574785b6-qmn4c\" (UID: \"ceb37084-0553-4277-a11b-de466ba79a69\") " pod="opendatahub/opendatahub-operator-controller-manager-8574785b6-qmn4c"
Jul 24 17:25:56.199808 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:56.199659    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ceb37084-0553-4277-a11b-de466ba79a69-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8574785b6-qmn4c\" (UID: \"ceb37084-0553-4277-a11b-de466ba79a69\") " pod="opendatahub/opendatahub-operator-controller-manager-8574785b6-qmn4c"
Jul 24 17:25:56.199914 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:56.199812    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ceb37084-0553-4277-a11b-de466ba79a69-manifests\") pod \"opendatahub-operator-controller-manager-8574785b6-qmn4c\" (UID: \"ceb37084-0553-4277-a11b-de466ba79a69\") " pod="opendatahub/opendatahub-operator-controller-manager-8574785b6-qmn4c"
Jul 24 17:25:56.201633 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:56.201602    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ceb37084-0553-4277-a11b-de466ba79a69-tmp\") pod \"opendatahub-operator-controller-manager-8574785b6-qmn4c\" (UID: \"ceb37084-0553-4277-a11b-de466ba79a69\") " pod="opendatahub/opendatahub-operator-controller-manager-8574785b6-qmn4c"
Jul 24 17:25:56.201760 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:56.201705    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ceb37084-0553-4277-a11b-de466ba79a69-webhook-cert\") pod \"opendatahub-operator-controller-manager-8574785b6-qmn4c\" (UID: \"ceb37084-0553-4277-a11b-de466ba79a69\") " pod="opendatahub/opendatahub-operator-controller-manager-8574785b6-qmn4c"
Jul 24 17:25:56.201820 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:56.201808    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ceb37084-0553-4277-a11b-de466ba79a69-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8574785b6-qmn4c\" (UID: \"ceb37084-0553-4277-a11b-de466ba79a69\") " pod="opendatahub/opendatahub-operator-controller-manager-8574785b6-qmn4c"
Jul 24 17:25:56.210689 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:56.210666    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mb8tr\" (UniqueName: \"kubernetes.io/projected/ceb37084-0553-4277-a11b-de466ba79a69-kube-api-access-mb8tr\") pod \"opendatahub-operator-controller-manager-8574785b6-qmn4c\" (UID: \"ceb37084-0553-4277-a11b-de466ba79a69\") " pod="opendatahub/opendatahub-operator-controller-manager-8574785b6-qmn4c"
Jul 24 17:25:56.335561 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:56.335471    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:25:56.394440 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:56.394395    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8574785b6-qmn4c"
Jul 24 17:25:56.435411 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:56.435378    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:25:56.528404 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:56.528380    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8574785b6-qmn4c"]
Jul 24 17:25:56.530158 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:25:56.530134    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podceb37084_0553_4277_a11b_de466ba79a69.slice/crio-3253b578e9ce31630c46634dd7bb4a089c24b884932f4cab1688f3bc6448028d WatchSource:0}: Error finding container 3253b578e9ce31630c46634dd7bb4a089c24b884932f4cab1688f3bc6448028d: Status 404 returned error can't find the container with id 3253b578e9ce31630c46634dd7bb4a089c24b884932f4cab1688f3bc6448028d
Jul 24 17:25:56.531898 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:56.531879    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 17:25:56.536762 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:56.536739    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:25:56.598243 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:56.598157    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:25:56.698374 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:56.698342    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:25:56.798736 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:56.798705    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:25:57.022995 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:57.022899    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8574785b6-qmn4c" event={"ID":"ceb37084-0553-4277-a11b-de466ba79a69","Type":"ContainerStarted","Data":"3253b578e9ce31630c46634dd7bb4a089c24b884932f4cab1688f3bc6448028d"}
Jul 24 17:25:57.068768 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:57.068732    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:25:57.165141 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:25:57.165090    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:26:00.038048 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:00.038010    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8574785b6-qmn4c" event={"ID":"ceb37084-0553-4277-a11b-de466ba79a69","Type":"ContainerStarted","Data":"ed5e59a7b3c61e128e23de933dbb34746a22ba0d584af87d424b7e239538bd14"}
Jul 24 17:26:01.043155 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:01.043125    2575 generic.go:356] "Generic (PLEG): container finished" podID="ceb37084-0553-4277-a11b-de466ba79a69" containerID="ed5e59a7b3c61e128e23de933dbb34746a22ba0d584af87d424b7e239538bd14" exitCode=0
Jul 24 17:26:01.043639 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:01.043177    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8574785b6-qmn4c" event={"ID":"ceb37084-0553-4277-a11b-de466ba79a69","Type":"ContainerDied","Data":"ed5e59a7b3c61e128e23de933dbb34746a22ba0d584af87d424b7e239538bd14"}
Jul 24 17:26:02.048825 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:02.048793    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8574785b6-qmn4c" event={"ID":"ceb37084-0553-4277-a11b-de466ba79a69","Type":"ContainerStarted","Data":"fc35157802508e526627b571f924821d843aab77ff5bb2a98f75d8f62c8a02ba"}
Jul 24 17:26:02.049225 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:02.048864    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-8574785b6-qmn4c"
Jul 24 17:26:02.071823 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:02.071770    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-8574785b6-qmn4c" podStartSLOduration=1.665355903 podStartE2EDuration="6.071755365s" totalImagesPullingTime="3.348625996s" totalInitContainerRuntime="1.057773466s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:25:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:26:02.070608492 +0000 UTC m=+497.551984112" watchObservedRunningTime="2026-07-24 17:26:02.071755365 +0000 UTC m=+497.553130984"
Jul 24 17:26:06.509768 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:06.509732    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:26:06.589527 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:06.589488    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:26:09.950364 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:09.950323    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:26:10.401923 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:10.401886    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:26:10.461749 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:10.461711    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:26:13.059161 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:13.059132    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-8574785b6-qmn4c"
Jul 24 17:26:15.495650 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:15.495609    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:26:15.648789 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:15.648752    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:26:16.172129 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:16.172094    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:26:16.194102 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:16.194073    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-956b69cf9-vgzmm"]
Jul 24 17:26:16.199998 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:16.199974    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-956b69cf9-vgzmm"
Jul 24 17:26:16.204034 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:16.204005    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 24 17:26:16.204152 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:16.204035    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 24 17:26:16.204152 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:16.204035    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 24 17:26:16.204547 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:16.204533    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 24 17:26:16.228248 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:16.228219    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-956b69cf9-vgzmm"]
Jul 24 17:26:16.255495 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:16.255466    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/910690a0-1e47-4441-b88b-869470a0d93a-tmp\") pod \"kube-auth-proxy-956b69cf9-vgzmm\" (UID: \"910690a0-1e47-4441-b88b-869470a0d93a\") " pod="openshift-ingress/kube-auth-proxy-956b69cf9-vgzmm"
Jul 24 17:26:16.255681 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:16.255508    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/910690a0-1e47-4441-b88b-869470a0d93a-tls-certs\") pod \"kube-auth-proxy-956b69cf9-vgzmm\" (UID: \"910690a0-1e47-4441-b88b-869470a0d93a\") " pod="openshift-ingress/kube-auth-proxy-956b69cf9-vgzmm"
Jul 24 17:26:16.255681 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:16.255528    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmc22\" (UniqueName: \"kubernetes.io/projected/910690a0-1e47-4441-b88b-869470a0d93a-kube-api-access-vmc22\") pod \"kube-auth-proxy-956b69cf9-vgzmm\" (UID: \"910690a0-1e47-4441-b88b-869470a0d93a\") " pod="openshift-ingress/kube-auth-proxy-956b69cf9-vgzmm"
Jul 24 17:26:16.356100 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:16.356073    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/910690a0-1e47-4441-b88b-869470a0d93a-tls-certs\") pod \"kube-auth-proxy-956b69cf9-vgzmm\" (UID: \"910690a0-1e47-4441-b88b-869470a0d93a\") " pod="openshift-ingress/kube-auth-proxy-956b69cf9-vgzmm"
Jul 24 17:26:16.356100 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:16.356104    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmc22\" (UniqueName: \"kubernetes.io/projected/910690a0-1e47-4441-b88b-869470a0d93a-kube-api-access-vmc22\") pod \"kube-auth-proxy-956b69cf9-vgzmm\" (UID: \"910690a0-1e47-4441-b88b-869470a0d93a\") " pod="openshift-ingress/kube-auth-proxy-956b69cf9-vgzmm"
Jul 24 17:26:16.356351 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:16.356176    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/910690a0-1e47-4441-b88b-869470a0d93a-tmp\") pod \"kube-auth-proxy-956b69cf9-vgzmm\" (UID: \"910690a0-1e47-4441-b88b-869470a0d93a\") " pod="openshift-ingress/kube-auth-proxy-956b69cf9-vgzmm"
Jul 24 17:26:16.356817 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:16.356790    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:26:16.358568 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:16.358537    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/910690a0-1e47-4441-b88b-869470a0d93a-tmp\") pod \"kube-auth-proxy-956b69cf9-vgzmm\" (UID: \"910690a0-1e47-4441-b88b-869470a0d93a\") " pod="openshift-ingress/kube-auth-proxy-956b69cf9-vgzmm"
Jul 24 17:26:16.358703 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:16.358686    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/910690a0-1e47-4441-b88b-869470a0d93a-tls-certs\") pod \"kube-auth-proxy-956b69cf9-vgzmm\" (UID: \"910690a0-1e47-4441-b88b-869470a0d93a\") " pod="openshift-ingress/kube-auth-proxy-956b69cf9-vgzmm"
Jul 24 17:26:16.376882 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:16.376853    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmc22\" (UniqueName: \"kubernetes.io/projected/910690a0-1e47-4441-b88b-869470a0d93a-kube-api-access-vmc22\") pod \"kube-auth-proxy-956b69cf9-vgzmm\" (UID: \"910690a0-1e47-4441-b88b-869470a0d93a\") " pod="openshift-ingress/kube-auth-proxy-956b69cf9-vgzmm"
Jul 24 17:26:16.396127 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:16.396097    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-j4wc7"]
Jul 24 17:26:16.398638 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:16.398621    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-j4wc7"
Jul 24 17:26:16.401608 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:16.401591    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-cnm7p\""
Jul 24 17:26:16.402095 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:16.402079    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 24 17:26:16.422009 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:16.421976    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-j4wc7"]
Jul 24 17:26:16.457418 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:16.457340    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/25c071d9-06e5-4528-824d-6341188947a8-cert\") pod \"odh-model-controller-7998c67dc4-j4wc7\" (UID: \"25c071d9-06e5-4528-824d-6341188947a8\") " pod="opendatahub/odh-model-controller-7998c67dc4-j4wc7"
Jul 24 17:26:16.457418 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:16.457408    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5f45z\" (UniqueName: \"kubernetes.io/projected/25c071d9-06e5-4528-824d-6341188947a8-kube-api-access-5f45z\") pod \"odh-model-controller-7998c67dc4-j4wc7\" (UID: \"25c071d9-06e5-4528-824d-6341188947a8\") " pod="opendatahub/odh-model-controller-7998c67dc4-j4wc7"
Jul 24 17:26:16.497768 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:16.497729    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:26:16.509332 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:16.509312    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-956b69cf9-vgzmm"
Jul 24 17:26:16.558653 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:16.558615    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5f45z\" (UniqueName: \"kubernetes.io/projected/25c071d9-06e5-4528-824d-6341188947a8-kube-api-access-5f45z\") pod \"odh-model-controller-7998c67dc4-j4wc7\" (UID: \"25c071d9-06e5-4528-824d-6341188947a8\") " pod="opendatahub/odh-model-controller-7998c67dc4-j4wc7"
Jul 24 17:26:16.558794 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:16.558734    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/25c071d9-06e5-4528-824d-6341188947a8-cert\") pod \"odh-model-controller-7998c67dc4-j4wc7\" (UID: \"25c071d9-06e5-4528-824d-6341188947a8\") " pod="opendatahub/odh-model-controller-7998c67dc4-j4wc7"
Jul 24 17:26:16.558898 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:26:16.558878    2575 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 24 17:26:16.559010 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:26:16.558995    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25c071d9-06e5-4528-824d-6341188947a8-cert podName:25c071d9-06e5-4528-824d-6341188947a8 nodeName:}" failed. No retries permitted until 2026-07-24 17:26:17.058972032 +0000 UTC m=+512.540347650 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/25c071d9-06e5-4528-824d-6341188947a8-cert") pod "odh-model-controller-7998c67dc4-j4wc7" (UID: "25c071d9-06e5-4528-824d-6341188947a8") : secret "odh-model-controller-webhook-cert" not found
Jul 24 17:26:16.589226 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:16.588810    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5f45z\" (UniqueName: \"kubernetes.io/projected/25c071d9-06e5-4528-824d-6341188947a8-kube-api-access-5f45z\") pod \"odh-model-controller-7998c67dc4-j4wc7\" (UID: \"25c071d9-06e5-4528-824d-6341188947a8\") " pod="opendatahub/odh-model-controller-7998c67dc4-j4wc7"
Jul 24 17:26:16.610634 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:16.610586    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:26:16.645593 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:16.645555    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-956b69cf9-vgzmm"]
Jul 24 17:26:16.650792 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:26:16.650767    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod910690a0_1e47_4441_b88b_869470a0d93a.slice/crio-7fe80418a70262c45ecc4c4008f5021807b6032f466a05fbfc91e8aab7ea2f3d WatchSource:0}: Error finding container 7fe80418a70262c45ecc4c4008f5021807b6032f466a05fbfc91e8aab7ea2f3d: Status 404 returned error can't find the container with id 7fe80418a70262c45ecc4c4008f5021807b6032f466a05fbfc91e8aab7ea2f3d
Jul 24 17:26:16.710278 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:16.710194    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:26:17.062049 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:17.062015    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/25c071d9-06e5-4528-824d-6341188947a8-cert\") pod \"odh-model-controller-7998c67dc4-j4wc7\" (UID: \"25c071d9-06e5-4528-824d-6341188947a8\") " pod="opendatahub/odh-model-controller-7998c67dc4-j4wc7"
Jul 24 17:26:17.064441 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:17.064417    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/25c071d9-06e5-4528-824d-6341188947a8-cert\") pod \"odh-model-controller-7998c67dc4-j4wc7\" (UID: \"25c071d9-06e5-4528-824d-6341188947a8\") " pod="opendatahub/odh-model-controller-7998c67dc4-j4wc7"
Jul 24 17:26:17.105675 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:17.105645    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-956b69cf9-vgzmm" event={"ID":"910690a0-1e47-4441-b88b-869470a0d93a","Type":"ContainerStarted","Data":"7fe80418a70262c45ecc4c4008f5021807b6032f466a05fbfc91e8aab7ea2f3d"}
Jul 24 17:26:17.308765 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:17.308718    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-j4wc7"
Jul 24 17:26:17.450156 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:17.450117    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:26:17.465889 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:17.465844    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-cd4ln"]
Jul 24 17:26:17.468791 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:17.468769    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-cd4ln"
Jul 24 17:26:17.506600 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:17.506567    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 24 17:26:17.553465 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:17.553433    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-cd4ln"]
Jul 24 17:26:17.567202 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:17.567167    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab850c2c-9f33-491a-a76a-3c509fa3e720-tls-certs\") pod \"model-serving-api-54d89bd5fc-cd4ln\" (UID: \"ab850c2c-9f33-491a-a76a-3c509fa3e720\") " pod="opendatahub/model-serving-api-54d89bd5fc-cd4ln"
Jul 24 17:26:17.567376 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:17.567306    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngxbk\" (UniqueName: \"kubernetes.io/projected/ab850c2c-9f33-491a-a76a-3c509fa3e720-kube-api-access-ngxbk\") pod \"model-serving-api-54d89bd5fc-cd4ln\" (UID: \"ab850c2c-9f33-491a-a76a-3c509fa3e720\") " pod="opendatahub/model-serving-api-54d89bd5fc-cd4ln"
Jul 24 17:26:17.616059 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:17.616035    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-j4wc7"]
Jul 24 17:26:17.618225 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:26:17.618189    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25c071d9_06e5_4528_824d_6341188947a8.slice/crio-d566f3b73e04a7198f25e92472d90aafc41650cd2d488978a59a3f75a352e177 WatchSource:0}: Error finding container d566f3b73e04a7198f25e92472d90aafc41650cd2d488978a59a3f75a352e177: Status 404 returned error can't find the container with id d566f3b73e04a7198f25e92472d90aafc41650cd2d488978a59a3f75a352e177
Jul 24 17:26:17.668181 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:17.668146    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab850c2c-9f33-491a-a76a-3c509fa3e720-tls-certs\") pod \"model-serving-api-54d89bd5fc-cd4ln\" (UID: \"ab850c2c-9f33-491a-a76a-3c509fa3e720\") " pod="opendatahub/model-serving-api-54d89bd5fc-cd4ln"
Jul 24 17:26:17.668371 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:17.668268    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngxbk\" (UniqueName: \"kubernetes.io/projected/ab850c2c-9f33-491a-a76a-3c509fa3e720-kube-api-access-ngxbk\") pod \"model-serving-api-54d89bd5fc-cd4ln\" (UID: \"ab850c2c-9f33-491a-a76a-3c509fa3e720\") " pod="opendatahub/model-serving-api-54d89bd5fc-cd4ln"
Jul 24 17:26:17.670872 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:17.670832    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab850c2c-9f33-491a-a76a-3c509fa3e720-tls-certs\") pod \"model-serving-api-54d89bd5fc-cd4ln\" (UID: \"ab850c2c-9f33-491a-a76a-3c509fa3e720\") " pod="opendatahub/model-serving-api-54d89bd5fc-cd4ln"
Jul 24 17:26:17.693119 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:17.693094    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngxbk\" (UniqueName: \"kubernetes.io/projected/ab850c2c-9f33-491a-a76a-3c509fa3e720-kube-api-access-ngxbk\") pod \"model-serving-api-54d89bd5fc-cd4ln\" (UID: \"ab850c2c-9f33-491a-a76a-3c509fa3e720\") " pod="opendatahub/model-serving-api-54d89bd5fc-cd4ln"
Jul 24 17:26:17.716426 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:17.716387    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:26:17.781547 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:17.781512    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-cd4ln"
Jul 24 17:26:17.933872 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:17.933841    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-cd4ln"]
Jul 24 17:26:17.937004 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:26:17.936974    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab850c2c_9f33_491a_a76a_3c509fa3e720.slice/crio-49ba0f721fd9c94727e3da902b578627a7251d36066b6c535e081c05f6aa9273 WatchSource:0}: Error finding container 49ba0f721fd9c94727e3da902b578627a7251d36066b6c535e081c05f6aa9273: Status 404 returned error can't find the container with id 49ba0f721fd9c94727e3da902b578627a7251d36066b6c535e081c05f6aa9273
Jul 24 17:26:18.084461 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:18.084430    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:26:18.111185 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:18.111147    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-j4wc7" event={"ID":"25c071d9-06e5-4528-824d-6341188947a8","Type":"ContainerStarted","Data":"d566f3b73e04a7198f25e92472d90aafc41650cd2d488978a59a3f75a352e177"}
Jul 24 17:26:18.112506 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:18.112472    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-cd4ln" event={"ID":"ab850c2c-9f33-491a-a76a-3c509fa3e720","Type":"ContainerStarted","Data":"49ba0f721fd9c94727e3da902b578627a7251d36066b6c535e081c05f6aa9273"}
Jul 24 17:26:18.315956 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:18.315910    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:26:19.107722 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:19.107665    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:26:21.127766 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:21.127731    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-j4wc7" event={"ID":"25c071d9-06e5-4528-824d-6341188947a8","Type":"ContainerStarted","Data":"12165c11b381958002e4a1042dfb270f44853d5583eb5b07a9ceed1f9693f955"}
Jul 24 17:26:21.128275 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:21.127880    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-j4wc7"
Jul 24 17:26:21.129221 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:21.129201    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-956b69cf9-vgzmm" event={"ID":"910690a0-1e47-4441-b88b-869470a0d93a","Type":"ContainerStarted","Data":"6d2f0b150fd98b1a3d5f2a021cd76d1baa8a7ab5ef52f59442094fb0f4ea94f6"}
Jul 24 17:26:21.130583 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:21.130560    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-cd4ln" event={"ID":"ab850c2c-9f33-491a-a76a-3c509fa3e720","Type":"ContainerStarted","Data":"644e772595c9356a86533bf20d8350851f80096a9938bfee148a32ae3022b2e9"}
Jul 24 17:26:21.130692 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:21.130612    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-cd4ln"
Jul 24 17:26:21.144603 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:21.144560    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-j4wc7" podStartSLOduration=2.135574047 podStartE2EDuration="5.144544087s" totalImagesPullingTime="3.00897004s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:26:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:26:21.143536871 +0000 UTC m=+516.624912492" watchObservedRunningTime="2026-07-24 17:26:21.144544087 +0000 UTC m=+516.625919708"
Jul 24 17:26:21.159743 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:21.159680    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-956b69cf9-vgzmm" podStartSLOduration=1.2081962 podStartE2EDuration="5.15965972s" totalImagesPullingTime="3.95146352s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:26:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:26:21.158520495 +0000 UTC m=+516.639896132" watchObservedRunningTime="2026-07-24 17:26:21.15965972 +0000 UTC m=+516.641035352"
Jul 24 17:26:21.173479 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:21.173426    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-cd4ln" podStartSLOduration=1.4812262170000001 podStartE2EDuration="4.173409343s" totalImagesPullingTime="2.692183126s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:26:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:26:21.172421874 +0000 UTC m=+516.653797495" watchObservedRunningTime="2026-07-24 17:26:21.173409343 +0000 UTC m=+516.654784964"
Jul 24 17:26:22.206307 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:22.206278    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:26:22.306194 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:22.306159    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:26:22.494960 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:22.494834    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cszjjv"]
Jul 24 17:26:22.497171 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:22.497152    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cszjjv"
Jul 24 17:26:22.499696 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:22.499677    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 24 17:26:22.499829 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:22.499738    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-n7mjp\""
Jul 24 17:26:22.510854 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:22.510816    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cszjjv"]
Jul 24 17:26:22.523754 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:22.523722    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:26:22.613211 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:22.613171    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6b553b3-f7fc-4795-b0fa-8cb7e0e1c4bd-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cszjjv\" (UID: \"b6b553b3-f7fc-4795-b0fa-8cb7e0e1c4bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cszjjv"
Jul 24 17:26:22.613421 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:22.613221    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6b553b3-f7fc-4795-b0fa-8cb7e0e1c4bd-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cszjjv\" (UID: \"b6b553b3-f7fc-4795-b0fa-8cb7e0e1c4bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cszjjv"
Jul 24 17:26:22.613421 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:22.613256    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6b553b3-f7fc-4795-b0fa-8cb7e0e1c4bd-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cszjjv\" (UID: \"b6b553b3-f7fc-4795-b0fa-8cb7e0e1c4bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cszjjv"
Jul 24 17:26:22.613421 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:22.613296    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6b553b3-f7fc-4795-b0fa-8cb7e0e1c4bd-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cszjjv\" (UID: \"b6b553b3-f7fc-4795-b0fa-8cb7e0e1c4bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cszjjv"
Jul 24 17:26:22.613421 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:22.613319    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6b553b3-f7fc-4795-b0fa-8cb7e0e1c4bd-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cszjjv\" (UID: \"b6b553b3-f7fc-4795-b0fa-8cb7e0e1c4bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cszjjv"
Jul 24 17:26:22.613421 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:22.613360    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6b553b3-f7fc-4795-b0fa-8cb7e0e1c4bd-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cszjjv\" (UID: \"b6b553b3-f7fc-4795-b0fa-8cb7e0e1c4bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cszjjv"
Jul 24 17:26:22.613421 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:22.613397    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbbmq\" (UniqueName: \"kubernetes.io/projected/b6b553b3-f7fc-4795-b0fa-8cb7e0e1c4bd-kube-api-access-kbbmq\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cszjjv\" (UID: \"b6b553b3-f7fc-4795-b0fa-8cb7e0e1c4bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cszjjv"
Jul 24 17:26:22.613646 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:22.613426    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6b553b3-f7fc-4795-b0fa-8cb7e0e1c4bd-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cszjjv\" (UID: \"b6b553b3-f7fc-4795-b0fa-8cb7e0e1c4bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cszjjv"
Jul 24 17:26:22.613646 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:22.613449    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6b553b3-f7fc-4795-b0fa-8cb7e0e1c4bd-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cszjjv\" (UID: \"b6b553b3-f7fc-4795-b0fa-8cb7e0e1c4bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cszjjv"
Jul 24 17:26:22.714574 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:22.714532    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6b553b3-f7fc-4795-b0fa-8cb7e0e1c4bd-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cszjjv\" (UID: \"b6b553b3-f7fc-4795-b0fa-8cb7e0e1c4bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cszjjv"
Jul 24 17:26:22.714574 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:22.714581    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6b553b3-f7fc-4795-b0fa-8cb7e0e1c4bd-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cszjjv\" (UID: \"b6b553b3-f7fc-4795-b0fa-8cb7e0e1c4bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cszjjv"
Jul 24 17:26:22.714819 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:22.714621    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6b553b3-f7fc-4795-b0fa-8cb7e0e1c4bd-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cszjjv\" (UID: \"b6b553b3-f7fc-4795-b0fa-8cb7e0e1c4bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cszjjv"
Jul 24 17:26:22.714819 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:22.714646    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6b553b3-f7fc-4795-b0fa-8cb7e0e1c4bd-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cszjjv\" (UID: \"b6b553b3-f7fc-4795-b0fa-8cb7e0e1c4bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cszjjv"
Jul 24 17:26:22.714819 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:22.714765    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6b553b3-f7fc-4795-b0fa-8cb7e0e1c4bd-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cszjjv\" (UID: \"b6b553b3-f7fc-4795-b0fa-8cb7e0e1c4bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cszjjv"
Jul 24 17:26:22.715016 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:22.714840    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbbmq\" (UniqueName: \"kubernetes.io/projected/b6b553b3-f7fc-4795-b0fa-8cb7e0e1c4bd-kube-api-access-kbbmq\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cszjjv\" (UID: \"b6b553b3-f7fc-4795-b0fa-8cb7e0e1c4bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cszjjv"
Jul 24 17:26:22.715016 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:22.714882    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6b553b3-f7fc-4795-b0fa-8cb7e0e1c4bd-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cszjjv\" (UID: \"b6b553b3-f7fc-4795-b0fa-8cb7e0e1c4bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cszjjv"
Jul 24 17:26:22.715016 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:22.714908    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6b553b3-f7fc-4795-b0fa-8cb7e0e1c4bd-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cszjjv\" (UID: \"b6b553b3-f7fc-4795-b0fa-8cb7e0e1c4bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cszjjv"
Jul 24 17:26:22.715016 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:22.714983    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6b553b3-f7fc-4795-b0fa-8cb7e0e1c4bd-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cszjjv\" (UID: \"b6b553b3-f7fc-4795-b0fa-8cb7e0e1c4bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cszjjv"
Jul 24 17:26:22.715207 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:22.715029    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6b553b3-f7fc-4795-b0fa-8cb7e0e1c4bd-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cszjjv\" (UID: \"b6b553b3-f7fc-4795-b0fa-8cb7e0e1c4bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cszjjv"
Jul 24 17:26:22.715207 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:22.715047    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6b553b3-f7fc-4795-b0fa-8cb7e0e1c4bd-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cszjjv\" (UID: \"b6b553b3-f7fc-4795-b0fa-8cb7e0e1c4bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cszjjv"
Jul 24 17:26:22.715207 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:22.715129    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6b553b3-f7fc-4795-b0fa-8cb7e0e1c4bd-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cszjjv\" (UID: \"b6b553b3-f7fc-4795-b0fa-8cb7e0e1c4bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cszjjv"
Jul 24 17:26:22.715352 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:22.715327    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6b553b3-f7fc-4795-b0fa-8cb7e0e1c4bd-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cszjjv\" (UID: \"b6b553b3-f7fc-4795-b0fa-8cb7e0e1c4bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cszjjv"
Jul 24 17:26:22.715597 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:22.715573    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6b553b3-f7fc-4795-b0fa-8cb7e0e1c4bd-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cszjjv\" (UID: \"b6b553b3-f7fc-4795-b0fa-8cb7e0e1c4bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cszjjv"
Jul 24 17:26:22.717018 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:22.716995    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6b553b3-f7fc-4795-b0fa-8cb7e0e1c4bd-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cszjjv\" (UID: \"b6b553b3-f7fc-4795-b0fa-8cb7e0e1c4bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cszjjv"
Jul 24 17:26:22.717280 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:22.717264    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6b553b3-f7fc-4795-b0fa-8cb7e0e1c4bd-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cszjjv\" (UID: \"b6b553b3-f7fc-4795-b0fa-8cb7e0e1c4bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cszjjv"
Jul 24 17:26:22.723140 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:22.723118    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbbmq\" (UniqueName: \"kubernetes.io/projected/b6b553b3-f7fc-4795-b0fa-8cb7e0e1c4bd-kube-api-access-kbbmq\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cszjjv\" (UID: \"b6b553b3-f7fc-4795-b0fa-8cb7e0e1c4bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cszjjv"
Jul 24 17:26:22.723235 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:22.723147    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6b553b3-f7fc-4795-b0fa-8cb7e0e1c4bd-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cszjjv\" (UID: \"b6b553b3-f7fc-4795-b0fa-8cb7e0e1c4bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cszjjv"
Jul 24 17:26:22.740079 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:22.740039    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:26:22.807155 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:22.807120    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cszjjv"
Jul 24 17:26:22.838824 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:22.838782    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:26:22.957517 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:22.957459    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cszjjv"]
Jul 24 17:26:22.959797 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:26:22.959767    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6b553b3_f7fc_4795_b0fa_8cb7e0e1c4bd.slice/crio-d12dd09ce434574552293402d35c07bb61ca7901099c989c816413e0baf3e566 WatchSource:0}: Error finding container d12dd09ce434574552293402d35c07bb61ca7901099c989c816413e0baf3e566: Status 404 returned error can't find the container with id d12dd09ce434574552293402d35c07bb61ca7901099c989c816413e0baf3e566
Jul 24 17:26:23.140238 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:23.140147    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cszjjv" event={"ID":"b6b553b3-f7fc-4795-b0fa-8cb7e0e1c4bd","Type":"ContainerStarted","Data":"d12dd09ce434574552293402d35c07bb61ca7901099c989c816413e0baf3e566"}
Jul 24 17:26:23.961965 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:23.961918    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-cc7897f66-c88hv"]
Jul 24 17:26:23.964255 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:23.964238    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-cc7897f66-c88hv"
Jul 24 17:26:23.966611 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:23.966566    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 24 17:26:23.967407 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:23.967378    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-mmrsm\""
Jul 24 17:26:23.967518 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:23.967406    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 24 17:26:23.967518 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:23.967408    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 24 17:26:23.967518 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:23.967405    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 24 17:26:23.967732 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:23.967383    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 24 17:26:23.975316 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:23.975285    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-cc7897f66-c88hv"]
Jul 24 17:26:24.029558 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:24.029525    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4f03e9fc-56bd-4107-b19e-c3abe00b3a37-metrics-cert\") pod \"lws-controller-manager-cc7897f66-c88hv\" (UID: \"4f03e9fc-56bd-4107-b19e-c3abe00b3a37\") " pod="openshift-lws-operator/lws-controller-manager-cc7897f66-c88hv"
Jul 24 17:26:24.029558 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:24.029567    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4f03e9fc-56bd-4107-b19e-c3abe00b3a37-cert\") pod \"lws-controller-manager-cc7897f66-c88hv\" (UID: \"4f03e9fc-56bd-4107-b19e-c3abe00b3a37\") " pod="openshift-lws-operator/lws-controller-manager-cc7897f66-c88hv"
Jul 24 17:26:24.029803 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:24.029609    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz5rq\" (UniqueName: \"kubernetes.io/projected/4f03e9fc-56bd-4107-b19e-c3abe00b3a37-kube-api-access-jz5rq\") pod \"lws-controller-manager-cc7897f66-c88hv\" (UID: \"4f03e9fc-56bd-4107-b19e-c3abe00b3a37\") " pod="openshift-lws-operator/lws-controller-manager-cc7897f66-c88hv"
Jul 24 17:26:24.029803 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:24.029696    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4f03e9fc-56bd-4107-b19e-c3abe00b3a37-manager-config\") pod \"lws-controller-manager-cc7897f66-c88hv\" (UID: \"4f03e9fc-56bd-4107-b19e-c3abe00b3a37\") " pod="openshift-lws-operator/lws-controller-manager-cc7897f66-c88hv"
Jul 24 17:26:24.130714 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:24.130669    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4f03e9fc-56bd-4107-b19e-c3abe00b3a37-metrics-cert\") pod \"lws-controller-manager-cc7897f66-c88hv\" (UID: \"4f03e9fc-56bd-4107-b19e-c3abe00b3a37\") " pod="openshift-lws-operator/lws-controller-manager-cc7897f66-c88hv"
Jul 24 17:26:24.130890 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:24.130731    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4f03e9fc-56bd-4107-b19e-c3abe00b3a37-cert\") pod \"lws-controller-manager-cc7897f66-c88hv\" (UID: \"4f03e9fc-56bd-4107-b19e-c3abe00b3a37\") " pod="openshift-lws-operator/lws-controller-manager-cc7897f66-c88hv"
Jul 24 17:26:24.130890 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:24.130782    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jz5rq\" (UniqueName: \"kubernetes.io/projected/4f03e9fc-56bd-4107-b19e-c3abe00b3a37-kube-api-access-jz5rq\") pod \"lws-controller-manager-cc7897f66-c88hv\" (UID: \"4f03e9fc-56bd-4107-b19e-c3abe00b3a37\") " pod="openshift-lws-operator/lws-controller-manager-cc7897f66-c88hv"
Jul 24 17:26:24.130890 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:24.130835    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4f03e9fc-56bd-4107-b19e-c3abe00b3a37-manager-config\") pod \"lws-controller-manager-cc7897f66-c88hv\" (UID: \"4f03e9fc-56bd-4107-b19e-c3abe00b3a37\") " pod="openshift-lws-operator/lws-controller-manager-cc7897f66-c88hv"
Jul 24 17:26:24.131720 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:24.131626    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4f03e9fc-56bd-4107-b19e-c3abe00b3a37-manager-config\") pod \"lws-controller-manager-cc7897f66-c88hv\" (UID: \"4f03e9fc-56bd-4107-b19e-c3abe00b3a37\") " pod="openshift-lws-operator/lws-controller-manager-cc7897f66-c88hv"
Jul 24 17:26:24.134053 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:24.134011    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4f03e9fc-56bd-4107-b19e-c3abe00b3a37-cert\") pod \"lws-controller-manager-cc7897f66-c88hv\" (UID: \"4f03e9fc-56bd-4107-b19e-c3abe00b3a37\") " pod="openshift-lws-operator/lws-controller-manager-cc7897f66-c88hv"
Jul 24 17:26:24.134174 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:24.134144    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4f03e9fc-56bd-4107-b19e-c3abe00b3a37-metrics-cert\") pod \"lws-controller-manager-cc7897f66-c88hv\" (UID: \"4f03e9fc-56bd-4107-b19e-c3abe00b3a37\") " pod="openshift-lws-operator/lws-controller-manager-cc7897f66-c88hv"
Jul 24 17:26:24.141092 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:24.141065    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz5rq\" (UniqueName: \"kubernetes.io/projected/4f03e9fc-56bd-4107-b19e-c3abe00b3a37-kube-api-access-jz5rq\") pod \"lws-controller-manager-cc7897f66-c88hv\" (UID: \"4f03e9fc-56bd-4107-b19e-c3abe00b3a37\") " pod="openshift-lws-operator/lws-controller-manager-cc7897f66-c88hv"
Jul 24 17:26:24.275462 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:24.275372    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-cc7897f66-c88hv"
Jul 24 17:26:24.432142 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:24.432106    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-cc7897f66-c88hv"]
Jul 24 17:26:24.435590 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:26:24.435561    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f03e9fc_56bd_4107_b19e_c3abe00b3a37.slice/crio-89e8cfa13d907809f9418e4149833cd886c8212f3d67cb5538bdccdfdcb7b522 WatchSource:0}: Error finding container 89e8cfa13d907809f9418e4149833cd886c8212f3d67cb5538bdccdfdcb7b522: Status 404 returned error can't find the container with id 89e8cfa13d907809f9418e4149833cd886c8212f3d67cb5538bdccdfdcb7b522
Jul 24 17:26:25.156810 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:25.156771    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-cc7897f66-c88hv" event={"ID":"4f03e9fc-56bd-4107-b19e-c3abe00b3a37","Type":"ContainerStarted","Data":"89e8cfa13d907809f9418e4149833cd886c8212f3d67cb5538bdccdfdcb7b522"}
Jul 24 17:26:27.450755 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:27.450719    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 17:26:27.451037 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:27.450796    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 17:26:27.451037 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:27.450824    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 17:26:27.598096 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:27.598060    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:26:27.691111 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:27.691059    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:26:27.941559 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:27.941517    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:26:28.067475 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:28.067438    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:26:28.169633 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:28.169595    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:26:28.172067 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:28.172042    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-cc7897f66-c88hv" event={"ID":"4f03e9fc-56bd-4107-b19e-c3abe00b3a37","Type":"ContainerStarted","Data":"1152b07ac3a29ff44b20e56b5c7adfd1f0bbb43725f50f76f47d91e3032b7d89"}
Jul 24 17:26:28.172264 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:28.172111    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-cc7897f66-c88hv"
Jul 24 17:26:28.173733 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:28.173705    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cszjjv" event={"ID":"b6b553b3-f7fc-4795-b0fa-8cb7e0e1c4bd","Type":"ContainerStarted","Data":"9c9925dede8b9962f639a3432a1ee78389069d5e8fcefded0a6667d431e334cb"}
Jul 24 17:26:28.209058 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:28.208919    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-cc7897f66-c88hv" podStartSLOduration=2.166811857 podStartE2EDuration="5.208899173s" totalImagesPullingTime="3.042087316s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:26:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:26:28.208850685 +0000 UTC m=+523.690226304" watchObservedRunningTime="2026-07-24 17:26:28.208899173 +0000 UTC m=+523.690274794"
Jul 24 17:26:28.242716 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:28.242666    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cszjjv" podStartSLOduration=1.7546896680000001 podStartE2EDuration="6.242649042s" totalImagesPullingTime="4.487959374s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:26:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:26:28.24071763 +0000 UTC m=+523.722093264" watchObservedRunningTime="2026-07-24 17:26:28.242649042 +0000 UTC m=+523.724024661"
Jul 24 17:26:28.265112 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:28.265070    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:26:28.807891 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:28.807855    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cszjjv"
Jul 24 17:26:28.812575 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:28.812550    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cszjjv"
Jul 24 17:26:29.178119 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:29.178036    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cszjjv"
Jul 24 17:26:29.179120 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:29.179101    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cszjjv"
Jul 24 17:26:29.287468 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:29.287422    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:26:29.389953 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:29.389901    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:26:32.136634 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:32.136600    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-j4wc7"
Jul 24 17:26:32.138666 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:32.138649    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-cd4ln"
Jul 24 17:26:35.390034 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:35.390001    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:26:39.179881 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:26:39.179850    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-cc7897f66-c88hv"
Jul 24 17:27:17.040583 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:27:17.040545    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:27:17.137996 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:27:17.137957    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:27:17.237530 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:27:17.237498    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:27:17.337899 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:27:17.337806    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:27:38.022136 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:27:38.022092    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:27:39.363547 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:27:39.363512    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:27:45.013485 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:27:45.013455    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82s5l_010c8b81-c5f5-43c3-b1bb-c812fcde2d6f/ovn-acl-logging/0.log"
Jul 24 17:27:45.013967 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:27:45.013598    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82s5l_010c8b81-c5f5-43c3-b1bb-c812fcde2d6f/ovn-acl-logging/0.log"
Jul 24 17:27:45.820128 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:27:45.820096    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:27:48.043351 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:27:48.043309    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:27:48.115127 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:27:48.115098    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:27:48.619426 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:27:48.619388    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:27:48.709682 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:27:48.709649    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:27:48.811295 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:27:48.811261    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:27:48.911139 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:27:48.911048    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:27:49.425305 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:27:49.425269    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:27:52.500021 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:27:52.499981    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:27:53.892791 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:27:53.892756    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:27:54.211417 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:27:54.211330    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:27:54.827256 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:27:54.827220    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:27:57.300945 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:27:57.300914    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:27:57.399187 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:27:57.399154    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:27:57.845249 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:27:57.845219    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:27:57.942953 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:27:57.942892    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:27:58.233572 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:27:58.233469    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:27:59.677262 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:27:59.677234    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:27:59.787511 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:27:59.787471    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:28:00.070266 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:00.070228    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:28:01.358907 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:01.358875    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:28:01.470713 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:01.470675    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:28:01.642232 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:01.642134    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:28:01.733251 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:01.733214    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:28:05.220478 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:05.220443    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:28:05.321486 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:05.321428    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:28:14.446301 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:14.446208    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:28:14.546185 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:14.546145    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:28:17.443625 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:17.443585    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:28:17.546268 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:17.546229    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:28:20.043503 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:20.043465    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:28:20.148853 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:20.148818    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:28:23.637556 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:23.637521    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:28:23.704910 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:23.704868    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:28:24.873425 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:24.873385    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:28:32.852265 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:32.852229    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:28:32.951001 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:32.950967    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:28:33.922298 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:33.922266    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:28:34.023083 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:34.023050    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:28:35.845112 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:35.845072    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:28:35.946031 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:35.945995    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:28:43.874156 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:43.874109    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:28:43.987750 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:43.987710    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:28:49.919900 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:49.919863    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:28:50.021051 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:50.021012    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:28:50.091240 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:50.091180    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:28:50.718857 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:50.718819    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-wg8wl"]
Jul 24 17:28:50.721086 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:50.721072    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-wg8wl"
Jul 24 17:28:50.723513 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:50.723462    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-4cwtj\""
Jul 24 17:28:50.723513 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:50.723480    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 24 17:28:50.723513 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:50.723483    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 24 17:28:50.729668 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:50.729650    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-wg8wl"]
Jul 24 17:28:50.760417 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:50.760388    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fc9rs\" (UniqueName: \"kubernetes.io/projected/263308c8-507f-4ba1-952c-d5b253d3b244-kube-api-access-fc9rs\") pod \"authorino-58cd955675-wg8wl\" (UID: \"263308c8-507f-4ba1-952c-d5b253d3b244\") " pod="kuadrant-system/authorino-58cd955675-wg8wl"
Jul 24 17:28:50.762400 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:50.762370    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:28:50.860836 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:50.860798    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fc9rs\" (UniqueName: \"kubernetes.io/projected/263308c8-507f-4ba1-952c-d5b253d3b244-kube-api-access-fc9rs\") pod \"authorino-58cd955675-wg8wl\" (UID: \"263308c8-507f-4ba1-952c-d5b253d3b244\") " pod="kuadrant-system/authorino-58cd955675-wg8wl"
Jul 24 17:28:50.863905 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:50.863872    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:28:50.868726 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:50.868699    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fc9rs\" (UniqueName: \"kubernetes.io/projected/263308c8-507f-4ba1-952c-d5b253d3b244-kube-api-access-fc9rs\") pod \"authorino-58cd955675-wg8wl\" (UID: \"263308c8-507f-4ba1-952c-d5b253d3b244\") " pod="kuadrant-system/authorino-58cd955675-wg8wl"
Jul 24 17:28:50.902786 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:50.902754    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-6ppsn"]
Jul 24 17:28:50.905102 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:50.905087    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-6ppsn"
Jul 24 17:28:50.912969 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:50.912928    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-6ppsn"]
Jul 24 17:28:50.961840 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:50.961797    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvghk\" (UniqueName: \"kubernetes.io/projected/9fa93122-e611-4658-bb0d-90870cd0816b-kube-api-access-mvghk\") pod \"authorino-75d556bd77-6ppsn\" (UID: \"9fa93122-e611-4658-bb0d-90870cd0816b\") " pod="kuadrant-system/authorino-75d556bd77-6ppsn"
Jul 24 17:28:51.030379 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:51.030297    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-wg8wl"
Jul 24 17:28:51.062795 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:51.062764    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvghk\" (UniqueName: \"kubernetes.io/projected/9fa93122-e611-4658-bb0d-90870cd0816b-kube-api-access-mvghk\") pod \"authorino-75d556bd77-6ppsn\" (UID: \"9fa93122-e611-4658-bb0d-90870cd0816b\") " pod="kuadrant-system/authorino-75d556bd77-6ppsn"
Jul 24 17:28:51.071374 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:51.071345    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvghk\" (UniqueName: \"kubernetes.io/projected/9fa93122-e611-4658-bb0d-90870cd0816b-kube-api-access-mvghk\") pod \"authorino-75d556bd77-6ppsn\" (UID: \"9fa93122-e611-4658-bb0d-90870cd0816b\") " pod="kuadrant-system/authorino-75d556bd77-6ppsn"
Jul 24 17:28:51.157079 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:51.157046    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-wg8wl"]
Jul 24 17:28:51.160080 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:28:51.160051    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod263308c8_507f_4ba1_952c_d5b253d3b244.slice/crio-2528fa54b56efd5f09eefc0bf86b6c85852d16b6f657104af0bbb3243921f317 WatchSource:0}: Error finding container 2528fa54b56efd5f09eefc0bf86b6c85852d16b6f657104af0bbb3243921f317: Status 404 returned error can't find the container with id 2528fa54b56efd5f09eefc0bf86b6c85852d16b6f657104af0bbb3243921f317
Jul 24 17:28:51.214658 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:51.214633    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-6ppsn"
Jul 24 17:28:51.337985 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:51.337958    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-6ppsn"]
Jul 24 17:28:51.340380 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:28:51.340355    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9fa93122_e611_4658_bb0d_90870cd0816b.slice/crio-77497e308a565d01f83d7e1b26b1f37982151348ecdb669749f6a1f009633b29 WatchSource:0}: Error finding container 77497e308a565d01f83d7e1b26b1f37982151348ecdb669749f6a1f009633b29: Status 404 returned error can't find the container with id 77497e308a565d01f83d7e1b26b1f37982151348ecdb669749f6a1f009633b29
Jul 24 17:28:51.761948 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:51.759967    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-6ppsn" event={"ID":"9fa93122-e611-4658-bb0d-90870cd0816b","Type":"ContainerStarted","Data":"77497e308a565d01f83d7e1b26b1f37982151348ecdb669749f6a1f009633b29"}
Jul 24 17:28:51.763261 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:51.763175    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-wg8wl" event={"ID":"263308c8-507f-4ba1-952c-d5b253d3b244","Type":"ContainerStarted","Data":"2528fa54b56efd5f09eefc0bf86b6c85852d16b6f657104af0bbb3243921f317"}
Jul 24 17:28:54.780434 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:54.780339    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-wg8wl" event={"ID":"263308c8-507f-4ba1-952c-d5b253d3b244","Type":"ContainerStarted","Data":"0bdf85bc7a71b85a15478bd7628ec1235a99522ab400f8d3309b40d984d16598"}
Jul 24 17:28:54.781739 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:54.781710    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-6ppsn" event={"ID":"9fa93122-e611-4658-bb0d-90870cd0816b","Type":"ContainerStarted","Data":"adafbb244618697af41b417d0f4bbebb536f6f43d5955a86555f4847f1a160c4"}
Jul 24 17:28:54.816828 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:54.816768    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-wg8wl" podStartSLOduration=1.6591921250000001 podStartE2EDuration="4.816746847s" totalImagesPullingTime="3.157554722s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:28:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:28:54.802490597 +0000 UTC m=+670.283866216" watchObservedRunningTime="2026-07-24 17:28:54.816746847 +0000 UTC m=+670.298122468"
Jul 24 17:28:54.817923 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:54.817880    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-6ppsn" podStartSLOduration=1.853159728 podStartE2EDuration="4.817863007s" totalImagesPullingTime="2.964703279s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:28:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:28:54.815969221 +0000 UTC m=+670.297344840" watchObservedRunningTime="2026-07-24 17:28:54.817863007 +0000 UTC m=+670.299238629"
Jul 24 17:28:54.842808 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:54.842779    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-wg8wl"]
Jul 24 17:28:56.789529 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:56.789486    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-wg8wl" podUID="263308c8-507f-4ba1-952c-d5b253d3b244" containerName="authorino" containerID="cri-o://0bdf85bc7a71b85a15478bd7628ec1235a99522ab400f8d3309b40d984d16598" gracePeriod=30
Jul 24 17:28:57.025116 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:57.025090    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-wg8wl"
Jul 24 17:28:57.117259 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:57.117166    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fc9rs\" (UniqueName: \"kubernetes.io/projected/263308c8-507f-4ba1-952c-d5b253d3b244-kube-api-access-fc9rs\") pod \"263308c8-507f-4ba1-952c-d5b253d3b244\" (UID: \"263308c8-507f-4ba1-952c-d5b253d3b244\") "
Jul 24 17:28:57.119307 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:57.119279    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/263308c8-507f-4ba1-952c-d5b253d3b244-kube-api-access-fc9rs" (OuterVolumeSpecName: "kube-api-access-fc9rs") pod "263308c8-507f-4ba1-952c-d5b253d3b244" (UID: "263308c8-507f-4ba1-952c-d5b253d3b244"). InnerVolumeSpecName "kube-api-access-fc9rs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:28:57.218665 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:57.218640    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fc9rs\" (UniqueName: \"kubernetes.io/projected/263308c8-507f-4ba1-952c-d5b253d3b244-kube-api-access-fc9rs\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 17:28:57.794723 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:57.794689    2575 generic.go:356] "Generic (PLEG): container finished" podID="263308c8-507f-4ba1-952c-d5b253d3b244" containerID="0bdf85bc7a71b85a15478bd7628ec1235a99522ab400f8d3309b40d984d16598" exitCode=0
Jul 24 17:28:57.795214 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:57.794733    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-wg8wl" event={"ID":"263308c8-507f-4ba1-952c-d5b253d3b244","Type":"ContainerDied","Data":"0bdf85bc7a71b85a15478bd7628ec1235a99522ab400f8d3309b40d984d16598"}
Jul 24 17:28:57.795214 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:57.794740    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-wg8wl"
Jul 24 17:28:57.795214 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:57.794759    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-wg8wl" event={"ID":"263308c8-507f-4ba1-952c-d5b253d3b244","Type":"ContainerDied","Data":"2528fa54b56efd5f09eefc0bf86b6c85852d16b6f657104af0bbb3243921f317"}
Jul 24 17:28:57.795214 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:57.794776    2575 scope.go:117] "RemoveContainer" containerID="0bdf85bc7a71b85a15478bd7628ec1235a99522ab400f8d3309b40d984d16598"
Jul 24 17:28:57.802846 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:57.802822    2575 scope.go:117] "RemoveContainer" containerID="0bdf85bc7a71b85a15478bd7628ec1235a99522ab400f8d3309b40d984d16598"
Jul 24 17:28:57.803138 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:28:57.803118    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0bdf85bc7a71b85a15478bd7628ec1235a99522ab400f8d3309b40d984d16598\": container with ID starting with 0bdf85bc7a71b85a15478bd7628ec1235a99522ab400f8d3309b40d984d16598 not found: ID does not exist" containerID="0bdf85bc7a71b85a15478bd7628ec1235a99522ab400f8d3309b40d984d16598"
Jul 24 17:28:57.803218 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:57.803151    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bdf85bc7a71b85a15478bd7628ec1235a99522ab400f8d3309b40d984d16598"} err="failed to get container status \"0bdf85bc7a71b85a15478bd7628ec1235a99522ab400f8d3309b40d984d16598\": rpc error: code = NotFound desc = could not find container \"0bdf85bc7a71b85a15478bd7628ec1235a99522ab400f8d3309b40d984d16598\": container with ID starting with 0bdf85bc7a71b85a15478bd7628ec1235a99522ab400f8d3309b40d984d16598 not found: ID does not exist"
Jul 24 17:28:57.809961 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:57.809925    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-wg8wl"]
Jul 24 17:28:57.813882 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:57.813858    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-wg8wl"]
Jul 24 17:28:59.201857 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:28:59.201829    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="263308c8-507f-4ba1-952c-d5b253d3b244" path="/var/lib/kubelet/pods/263308c8-507f-4ba1-952c-d5b253d3b244/volumes"
Jul 24 17:29:06.067295 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:06.067262    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:29:06.167569 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:06.167536    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:29:06.648423 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:06.648390    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:29:19.315372 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:19.315327    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:29:19.451070 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:19.451029    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:29:19.541049 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:19.541015    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-fmqlf"]
Jul 24 17:29:19.541332 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:19.541319    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="263308c8-507f-4ba1-952c-d5b253d3b244" containerName="authorino"
Jul 24 17:29:19.541380 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:19.541333    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="263308c8-507f-4ba1-952c-d5b253d3b244" containerName="authorino"
Jul 24 17:29:19.541418 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:19.541401    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="263308c8-507f-4ba1-952c-d5b253d3b244" containerName="authorino"
Jul 24 17:29:19.543684 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:19.543669    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-fmqlf"
Jul 24 17:29:19.553680 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:19.553657    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-fmqlf"]
Jul 24 17:29:19.606316 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:19.606215    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wwf4\" (UniqueName: \"kubernetes.io/projected/6669de30-35f4-4576-bff8-6936b2797cd4-kube-api-access-6wwf4\") pod \"authorino-5d4b67c446-fmqlf\" (UID: \"6669de30-35f4-4576-bff8-6936b2797cd4\") " pod="kuadrant-system/authorino-5d4b67c446-fmqlf"
Jul 24 17:29:19.707170 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:19.707134    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wwf4\" (UniqueName: \"kubernetes.io/projected/6669de30-35f4-4576-bff8-6936b2797cd4-kube-api-access-6wwf4\") pod \"authorino-5d4b67c446-fmqlf\" (UID: \"6669de30-35f4-4576-bff8-6936b2797cd4\") " pod="kuadrant-system/authorino-5d4b67c446-fmqlf"
Jul 24 17:29:19.715709 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:19.715673    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wwf4\" (UniqueName: \"kubernetes.io/projected/6669de30-35f4-4576-bff8-6936b2797cd4-kube-api-access-6wwf4\") pod \"authorino-5d4b67c446-fmqlf\" (UID: \"6669de30-35f4-4576-bff8-6936b2797cd4\") " pod="kuadrant-system/authorino-5d4b67c446-fmqlf"
Jul 24 17:29:19.797519 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:19.797476    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-fmqlf"]
Jul 24 17:29:19.797814 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:19.797797    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-fmqlf"
Jul 24 17:29:19.923888 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:19.923857    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-fmqlf"]
Jul 24 17:29:19.927041 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:29:19.927010    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6669de30_35f4_4576_bff8_6936b2797cd4.slice/crio-8ba1e455bad1aea09bfd2e7e3169da7a4b8347ad45420898e25b4e9559ebf332 WatchSource:0}: Error finding container 8ba1e455bad1aea09bfd2e7e3169da7a4b8347ad45420898e25b4e9559ebf332: Status 404 returned error can't find the container with id 8ba1e455bad1aea09bfd2e7e3169da7a4b8347ad45420898e25b4e9559ebf332
Jul 24 17:29:20.887945 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:20.887913    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-fmqlf" event={"ID":"6669de30-35f4-4576-bff8-6936b2797cd4","Type":"ContainerStarted","Data":"febda47ebc98cbdfd37e7bb55f34753c6abc9b7a7e5c0e2c4275c47d3e72b051"}
Jul 24 17:29:20.888427 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:20.887959    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-fmqlf" podUID="6669de30-35f4-4576-bff8-6936b2797cd4" containerName="authorino" containerID="cri-o://febda47ebc98cbdfd37e7bb55f34753c6abc9b7a7e5c0e2c4275c47d3e72b051" gracePeriod=30
Jul 24 17:29:20.888427 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:20.887970    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-fmqlf" event={"ID":"6669de30-35f4-4576-bff8-6936b2797cd4","Type":"ContainerStarted","Data":"8ba1e455bad1aea09bfd2e7e3169da7a4b8347ad45420898e25b4e9559ebf332"}
Jul 24 17:29:20.904038 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:20.903994    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-fmqlf" podStartSLOduration=1.56759027 podStartE2EDuration="1.90397854s" totalImagesPullingTime="336.38827ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:29:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:29:20.902151402 +0000 UTC m=+696.383527021" watchObservedRunningTime="2026-07-24 17:29:20.90397854 +0000 UTC m=+696.385354166"
Jul 24 17:29:21.123248 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:21.123225    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-fmqlf"
Jul 24 17:29:21.220592 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:21.220516    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6wwf4\" (UniqueName: \"kubernetes.io/projected/6669de30-35f4-4576-bff8-6936b2797cd4-kube-api-access-6wwf4\") pod \"6669de30-35f4-4576-bff8-6936b2797cd4\" (UID: \"6669de30-35f4-4576-bff8-6936b2797cd4\") "
Jul 24 17:29:21.222536 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:21.222513    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6669de30-35f4-4576-bff8-6936b2797cd4-kube-api-access-6wwf4" (OuterVolumeSpecName: "kube-api-access-6wwf4") pod "6669de30-35f4-4576-bff8-6936b2797cd4" (UID: "6669de30-35f4-4576-bff8-6936b2797cd4"). InnerVolumeSpecName "kube-api-access-6wwf4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:29:21.321786 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:21.321750    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wwf4\" (UniqueName: \"kubernetes.io/projected/6669de30-35f4-4576-bff8-6936b2797cd4-kube-api-access-6wwf4\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 17:29:21.892795 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:21.892762    2575 generic.go:356] "Generic (PLEG): container finished" podID="6669de30-35f4-4576-bff8-6936b2797cd4" containerID="febda47ebc98cbdfd37e7bb55f34753c6abc9b7a7e5c0e2c4275c47d3e72b051" exitCode=0
Jul 24 17:29:21.893315 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:21.892799    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-fmqlf"
Jul 24 17:29:21.893315 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:21.892839    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-fmqlf" event={"ID":"6669de30-35f4-4576-bff8-6936b2797cd4","Type":"ContainerDied","Data":"febda47ebc98cbdfd37e7bb55f34753c6abc9b7a7e5c0e2c4275c47d3e72b051"}
Jul 24 17:29:21.893315 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:21.892869    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-fmqlf" event={"ID":"6669de30-35f4-4576-bff8-6936b2797cd4","Type":"ContainerDied","Data":"8ba1e455bad1aea09bfd2e7e3169da7a4b8347ad45420898e25b4e9559ebf332"}
Jul 24 17:29:21.893315 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:21.892885    2575 scope.go:117] "RemoveContainer" containerID="febda47ebc98cbdfd37e7bb55f34753c6abc9b7a7e5c0e2c4275c47d3e72b051"
Jul 24 17:29:21.901228 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:21.901209    2575 scope.go:117] "RemoveContainer" containerID="febda47ebc98cbdfd37e7bb55f34753c6abc9b7a7e5c0e2c4275c47d3e72b051"
Jul 24 17:29:21.901511 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:29:21.901491    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"febda47ebc98cbdfd37e7bb55f34753c6abc9b7a7e5c0e2c4275c47d3e72b051\": container with ID starting with febda47ebc98cbdfd37e7bb55f34753c6abc9b7a7e5c0e2c4275c47d3e72b051 not found: ID does not exist" containerID="febda47ebc98cbdfd37e7bb55f34753c6abc9b7a7e5c0e2c4275c47d3e72b051"
Jul 24 17:29:21.901558 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:21.901520    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"febda47ebc98cbdfd37e7bb55f34753c6abc9b7a7e5c0e2c4275c47d3e72b051"} err="failed to get container status \"febda47ebc98cbdfd37e7bb55f34753c6abc9b7a7e5c0e2c4275c47d3e72b051\": rpc error: code = NotFound desc = could not find container \"febda47ebc98cbdfd37e7bb55f34753c6abc9b7a7e5c0e2c4275c47d3e72b051\": container with ID starting with febda47ebc98cbdfd37e7bb55f34753c6abc9b7a7e5c0e2c4275c47d3e72b051 not found: ID does not exist"
Jul 24 17:29:21.912369 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:21.912340    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-fmqlf"]
Jul 24 17:29:21.915159 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:21.915135    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-fmqlf"]
Jul 24 17:29:23.200955 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:23.200905    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6669de30-35f4-4576-bff8-6936b2797cd4" path="/var/lib/kubelet/pods/6669de30-35f4-4576-bff8-6936b2797cd4/volumes"
Jul 24 17:29:24.061094 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:24.061059    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-6ppsn"]
Jul 24 17:29:24.061264 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:24.061228    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-6ppsn" podUID="9fa93122-e611-4658-bb0d-90870cd0816b" containerName="authorino" containerID="cri-o://adafbb244618697af41b417d0f4bbebb536f6f43d5955a86555f4847f1a160c4" gracePeriod=30
Jul 24 17:29:24.308183 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:24.308160    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-6ppsn"
Jul 24 17:29:24.451697 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:24.451605    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mvghk\" (UniqueName: \"kubernetes.io/projected/9fa93122-e611-4658-bb0d-90870cd0816b-kube-api-access-mvghk\") pod \"9fa93122-e611-4658-bb0d-90870cd0816b\" (UID: \"9fa93122-e611-4658-bb0d-90870cd0816b\") "
Jul 24 17:29:24.453707 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:24.453684    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fa93122-e611-4658-bb0d-90870cd0816b-kube-api-access-mvghk" (OuterVolumeSpecName: "kube-api-access-mvghk") pod "9fa93122-e611-4658-bb0d-90870cd0816b" (UID: "9fa93122-e611-4658-bb0d-90870cd0816b"). InnerVolumeSpecName "kube-api-access-mvghk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:29:24.552962 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:24.552905    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mvghk\" (UniqueName: \"kubernetes.io/projected/9fa93122-e611-4658-bb0d-90870cd0816b-kube-api-access-mvghk\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 17:29:24.911770 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:24.911733    2575 generic.go:356] "Generic (PLEG): container finished" podID="9fa93122-e611-4658-bb0d-90870cd0816b" containerID="adafbb244618697af41b417d0f4bbebb536f6f43d5955a86555f4847f1a160c4" exitCode=0
Jul 24 17:29:24.911957 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:24.911781    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-6ppsn"
Jul 24 17:29:24.911957 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:24.911785    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-6ppsn" event={"ID":"9fa93122-e611-4658-bb0d-90870cd0816b","Type":"ContainerDied","Data":"adafbb244618697af41b417d0f4bbebb536f6f43d5955a86555f4847f1a160c4"}
Jul 24 17:29:24.911957 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:24.911823    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-6ppsn" event={"ID":"9fa93122-e611-4658-bb0d-90870cd0816b","Type":"ContainerDied","Data":"77497e308a565d01f83d7e1b26b1f37982151348ecdb669749f6a1f009633b29"}
Jul 24 17:29:24.911957 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:24.911840    2575 scope.go:117] "RemoveContainer" containerID="adafbb244618697af41b417d0f4bbebb536f6f43d5955a86555f4847f1a160c4"
Jul 24 17:29:24.920561 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:24.920542    2575 scope.go:117] "RemoveContainer" containerID="adafbb244618697af41b417d0f4bbebb536f6f43d5955a86555f4847f1a160c4"
Jul 24 17:29:24.920828 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:29:24.920808    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"adafbb244618697af41b417d0f4bbebb536f6f43d5955a86555f4847f1a160c4\": container with ID starting with adafbb244618697af41b417d0f4bbebb536f6f43d5955a86555f4847f1a160c4 not found: ID does not exist" containerID="adafbb244618697af41b417d0f4bbebb536f6f43d5955a86555f4847f1a160c4"
Jul 24 17:29:24.920879 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:24.920837    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"adafbb244618697af41b417d0f4bbebb536f6f43d5955a86555f4847f1a160c4"} err="failed to get container status \"adafbb244618697af41b417d0f4bbebb536f6f43d5955a86555f4847f1a160c4\": rpc error: code = NotFound desc = could not find container \"adafbb244618697af41b417d0f4bbebb536f6f43d5955a86555f4847f1a160c4\": container with ID starting with adafbb244618697af41b417d0f4bbebb536f6f43d5955a86555f4847f1a160c4 not found: ID does not exist"
Jul 24 17:29:24.931545 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:24.931520    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-6ppsn"]
Jul 24 17:29:24.935240 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:24.935217    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-6ppsn"]
Jul 24 17:29:25.201346 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:25.201273    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9fa93122-e611-4658-bb0d-90870cd0816b" path="/var/lib/kubelet/pods/9fa93122-e611-4658-bb0d-90870cd0816b/volumes"
Jul 24 17:29:28.847638 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:28.847606    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:29:28.942623 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:28.942585    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:29:29.022679 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:29.022636    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:29:29.026139 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:29.026117    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5ff575bb75-bbhnz"]
Jul 24 17:29:29.026427 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:29.026414    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6669de30-35f4-4576-bff8-6936b2797cd4" containerName="authorino"
Jul 24 17:29:29.026469 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:29.026429    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="6669de30-35f4-4576-bff8-6936b2797cd4" containerName="authorino"
Jul 24 17:29:29.026469 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:29.026444    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fa93122-e611-4658-bb0d-90870cd0816b" containerName="authorino"
Jul 24 17:29:29.026469 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:29.026449    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fa93122-e611-4658-bb0d-90870cd0816b" containerName="authorino"
Jul 24 17:29:29.026565 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:29.026498    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="6669de30-35f4-4576-bff8-6936b2797cd4" containerName="authorino"
Jul 24 17:29:29.026565 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:29.026508    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fa93122-e611-4658-bb0d-90870cd0816b" containerName="authorino"
Jul 24 17:29:29.030899 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:29.030880    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5ff575bb75-bbhnz"
Jul 24 17:29:29.034149 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:29.034130    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 24 17:29:29.034251 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:29.034158    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 24 17:29:29.034251 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:29.034160    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-46q8n\""
Jul 24 17:29:29.038625 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:29.038601    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5ff575bb75-bbhnz"]
Jul 24 17:29:29.192799 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:29.192721    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vr9zf\" (UniqueName: \"kubernetes.io/projected/eca82970-2408-4d1f-8c2f-7d48fbed4cd1-kube-api-access-vr9zf\") pod \"maas-controller-5ff575bb75-bbhnz\" (UID: \"eca82970-2408-4d1f-8c2f-7d48fbed4cd1\") " pod="opendatahub/maas-controller-5ff575bb75-bbhnz"
Jul 24 17:29:29.192799 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:29.192768    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eca82970-2408-4d1f-8c2f-7d48fbed4cd1-webhook-cert\") pod \"maas-controller-5ff575bb75-bbhnz\" (UID: \"eca82970-2408-4d1f-8c2f-7d48fbed4cd1\") " pod="opendatahub/maas-controller-5ff575bb75-bbhnz"
Jul 24 17:29:29.294001 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:29.293931    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eca82970-2408-4d1f-8c2f-7d48fbed4cd1-webhook-cert\") pod \"maas-controller-5ff575bb75-bbhnz\" (UID: \"eca82970-2408-4d1f-8c2f-7d48fbed4cd1\") " pod="opendatahub/maas-controller-5ff575bb75-bbhnz"
Jul 24 17:29:29.294199 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:29.294066    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr9zf\" (UniqueName: \"kubernetes.io/projected/eca82970-2408-4d1f-8c2f-7d48fbed4cd1-kube-api-access-vr9zf\") pod \"maas-controller-5ff575bb75-bbhnz\" (UID: \"eca82970-2408-4d1f-8c2f-7d48fbed4cd1\") " pod="opendatahub/maas-controller-5ff575bb75-bbhnz"
Jul 24 17:29:29.296426 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:29.296400    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eca82970-2408-4d1f-8c2f-7d48fbed4cd1-webhook-cert\") pod \"maas-controller-5ff575bb75-bbhnz\" (UID: \"eca82970-2408-4d1f-8c2f-7d48fbed4cd1\") " pod="opendatahub/maas-controller-5ff575bb75-bbhnz"
Jul 24 17:29:29.302703 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:29.302671    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vr9zf\" (UniqueName: \"kubernetes.io/projected/eca82970-2408-4d1f-8c2f-7d48fbed4cd1-kube-api-access-vr9zf\") pod \"maas-controller-5ff575bb75-bbhnz\" (UID: \"eca82970-2408-4d1f-8c2f-7d48fbed4cd1\") " pod="opendatahub/maas-controller-5ff575bb75-bbhnz"
Jul 24 17:29:29.342716 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:29.342673    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5ff575bb75-bbhnz"
Jul 24 17:29:29.470671 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:29.470646    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5ff575bb75-bbhnz"]
Jul 24 17:29:29.473482 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:29:29.473450    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeca82970_2408_4d1f_8c2f_7d48fbed4cd1.slice/crio-abda8eecd466e88475d8378d9f32bf184e3c505f87b0dbdd742e9017315b68d0 WatchSource:0}: Error finding container abda8eecd466e88475d8378d9f32bf184e3c505f87b0dbdd742e9017315b68d0: Status 404 returned error can't find the container with id abda8eecd466e88475d8378d9f32bf184e3c505f87b0dbdd742e9017315b68d0
Jul 24 17:29:29.934289 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:29.934254    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5ff575bb75-bbhnz" event={"ID":"eca82970-2408-4d1f-8c2f-7d48fbed4cd1","Type":"ContainerStarted","Data":"abda8eecd466e88475d8378d9f32bf184e3c505f87b0dbdd742e9017315b68d0"}
Jul 24 17:29:31.639343 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:31.639307    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:29:31.743498 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:31.743460    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:29:31.944663 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:31.944585    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5ff575bb75-bbhnz" event={"ID":"eca82970-2408-4d1f-8c2f-7d48fbed4cd1","Type":"ContainerStarted","Data":"3451d4982e097be5749f9bd1f2ac3a6ca4f333d3b6e43e536414d57a28978067"}
Jul 24 17:29:31.944808 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:31.944717    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5ff575bb75-bbhnz"
Jul 24 17:29:31.966071 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:31.966017    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5ff575bb75-bbhnz" podStartSLOduration=0.668128453 podStartE2EDuration="2.965999536s" totalImagesPullingTime="2.297871083s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:29:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:29:31.96368841 +0000 UTC m=+707.445064029" watchObservedRunningTime="2026-07-24 17:29:31.965999536 +0000 UTC m=+707.447375156"
Jul 24 17:29:42.951140 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:29:42.951070    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5ff575bb75-bbhnz"
Jul 24 17:30:03.649692 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:03.649657    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:30:03.744427 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:03.744389    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:30:04.246640 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:04.246597    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:30:04.343626 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:04.343599    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:30:04.921665 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:04.921619    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:30:04.999433 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:04.999396    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:30:15.987626 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:15.987588    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:30:16.151227 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:16.151195    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:30:22.203860 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:22.203828    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fnmd2"]
Jul 24 17:30:22.206011 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:22.205993    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fnmd2"
Jul 24 17:30:22.209109 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:22.209093    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 24 17:30:22.209225 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:22.209114    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-4mjtq\""
Jul 24 17:30:22.209225 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:22.209146    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 24 17:30:22.209346 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:22.209241    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 24 17:30:22.215501 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:22.215478    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fnmd2"]
Jul 24 17:30:22.226561 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:22.226528    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:30:22.340232 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:22.340189    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08d61c7d-7ffe-4fce-9fbc-97c893f9faaf-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fnmd2\" (UID: \"08d61c7d-7ffe-4fce-9fbc-97c893f9faaf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fnmd2"
Jul 24 17:30:22.340232 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:22.340221    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2s7l9\" (UniqueName: \"kubernetes.io/projected/08d61c7d-7ffe-4fce-9fbc-97c893f9faaf-kube-api-access-2s7l9\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fnmd2\" (UID: \"08d61c7d-7ffe-4fce-9fbc-97c893f9faaf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fnmd2"
Jul 24 17:30:22.340516 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:22.340317    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08d61c7d-7ffe-4fce-9fbc-97c893f9faaf-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fnmd2\" (UID: \"08d61c7d-7ffe-4fce-9fbc-97c893f9faaf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fnmd2"
Jul 24 17:30:22.340516 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:22.340361    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08d61c7d-7ffe-4fce-9fbc-97c893f9faaf-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fnmd2\" (UID: \"08d61c7d-7ffe-4fce-9fbc-97c893f9faaf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fnmd2"
Jul 24 17:30:22.340516 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:22.340401    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08d61c7d-7ffe-4fce-9fbc-97c893f9faaf-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fnmd2\" (UID: \"08d61c7d-7ffe-4fce-9fbc-97c893f9faaf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fnmd2"
Jul 24 17:30:22.340516 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:22.340449    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08d61c7d-7ffe-4fce-9fbc-97c893f9faaf-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fnmd2\" (UID: \"08d61c7d-7ffe-4fce-9fbc-97c893f9faaf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fnmd2"
Jul 24 17:30:22.441865 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:22.441827    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08d61c7d-7ffe-4fce-9fbc-97c893f9faaf-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fnmd2\" (UID: \"08d61c7d-7ffe-4fce-9fbc-97c893f9faaf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fnmd2"
Jul 24 17:30:22.442085 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:22.441877    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08d61c7d-7ffe-4fce-9fbc-97c893f9faaf-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fnmd2\" (UID: \"08d61c7d-7ffe-4fce-9fbc-97c893f9faaf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fnmd2"
Jul 24 17:30:22.442085 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:22.441980    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08d61c7d-7ffe-4fce-9fbc-97c893f9faaf-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fnmd2\" (UID: \"08d61c7d-7ffe-4fce-9fbc-97c893f9faaf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fnmd2"
Jul 24 17:30:22.442085 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:22.442003    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2s7l9\" (UniqueName: \"kubernetes.io/projected/08d61c7d-7ffe-4fce-9fbc-97c893f9faaf-kube-api-access-2s7l9\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fnmd2\" (UID: \"08d61c7d-7ffe-4fce-9fbc-97c893f9faaf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fnmd2"
Jul 24 17:30:22.442085 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:22.442044    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08d61c7d-7ffe-4fce-9fbc-97c893f9faaf-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fnmd2\" (UID: \"08d61c7d-7ffe-4fce-9fbc-97c893f9faaf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fnmd2"
Jul 24 17:30:22.442085 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:22.442070    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08d61c7d-7ffe-4fce-9fbc-97c893f9faaf-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fnmd2\" (UID: \"08d61c7d-7ffe-4fce-9fbc-97c893f9faaf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fnmd2"
Jul 24 17:30:22.442360 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:22.442231    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08d61c7d-7ffe-4fce-9fbc-97c893f9faaf-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fnmd2\" (UID: \"08d61c7d-7ffe-4fce-9fbc-97c893f9faaf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fnmd2"
Jul 24 17:30:22.442360 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:22.442299    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08d61c7d-7ffe-4fce-9fbc-97c893f9faaf-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fnmd2\" (UID: \"08d61c7d-7ffe-4fce-9fbc-97c893f9faaf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fnmd2"
Jul 24 17:30:22.442360 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:22.442333    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08d61c7d-7ffe-4fce-9fbc-97c893f9faaf-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fnmd2\" (UID: \"08d61c7d-7ffe-4fce-9fbc-97c893f9faaf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fnmd2"
Jul 24 17:30:22.444361 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:22.444324    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08d61c7d-7ffe-4fce-9fbc-97c893f9faaf-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fnmd2\" (UID: \"08d61c7d-7ffe-4fce-9fbc-97c893f9faaf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fnmd2"
Jul 24 17:30:22.444523 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:22.444503    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08d61c7d-7ffe-4fce-9fbc-97c893f9faaf-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fnmd2\" (UID: \"08d61c7d-7ffe-4fce-9fbc-97c893f9faaf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fnmd2"
Jul 24 17:30:22.449650 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:22.449631    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2s7l9\" (UniqueName: \"kubernetes.io/projected/08d61c7d-7ffe-4fce-9fbc-97c893f9faaf-kube-api-access-2s7l9\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fnmd2\" (UID: \"08d61c7d-7ffe-4fce-9fbc-97c893f9faaf\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fnmd2"
Jul 24 17:30:22.516790 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:22.516695    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fnmd2"
Jul 24 17:30:22.649384 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:22.649352    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fnmd2"]
Jul 24 17:30:22.652667 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:30:22.652634    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08d61c7d_7ffe_4fce_9fbc_97c893f9faaf.slice/crio-b155f5a2ecaed26fe3ea7f818fc09a70c9494be3c8d1094b2459ce1d0fe849c0 WatchSource:0}: Error finding container b155f5a2ecaed26fe3ea7f818fc09a70c9494be3c8d1094b2459ce1d0fe849c0: Status 404 returned error can't find the container with id b155f5a2ecaed26fe3ea7f818fc09a70c9494be3c8d1094b2459ce1d0fe849c0
Jul 24 17:30:23.165493 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:23.165459    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fnmd2" event={"ID":"08d61c7d-7ffe-4fce-9fbc-97c893f9faaf","Type":"ContainerStarted","Data":"b155f5a2ecaed26fe3ea7f818fc09a70c9494be3c8d1094b2459ce1d0fe849c0"}
Jul 24 17:30:24.171193 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:24.171156    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fnmd2" event={"ID":"08d61c7d-7ffe-4fce-9fbc-97c893f9faaf","Type":"ContainerStarted","Data":"54532b8f3da1e780a7c2330488602f23f0da2bb7111a6b0e67b9c598778f6c30"}
Jul 24 17:30:24.189648 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:24.189597    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fnmd2" podStartSLOduration=1.253852856 podStartE2EDuration="2.189580547s" totalImagesPullingTime="935.727691ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:30:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:30:24.187582059 +0000 UTC m=+759.668957679" watchObservedRunningTime="2026-07-24 17:30:24.189580547 +0000 UTC m=+759.670956167"
Jul 24 17:30:32.517080 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:32.517040    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fnmd2"
Jul 24 17:30:32.517489 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:32.517108    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fnmd2"
Jul 24 17:30:32.529745 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:32.529716    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fnmd2"
Jul 24 17:30:32.924676 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:32.924646    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:30:33.220625 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:33.220542    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fnmd2"
Jul 24 17:30:34.377236 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:34.377203    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:30:35.485085 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:35.485046    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:30:41.409850 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:41.409818    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdmvhf"]
Jul 24 17:30:41.412043 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:41.412022    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdmvhf"
Jul 24 17:30:41.427276 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:41.427255    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 24 17:30:41.449856 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:41.449826    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdmvhf"]
Jul 24 17:30:41.490873 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:41.490809    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:30:41.499966 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:41.499917    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7812213-30c5-4fbd-8f08-e993a602cea8-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdmvhf\" (UID: \"f7812213-30c5-4fbd-8f08-e993a602cea8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdmvhf"
Jul 24 17:30:41.500117 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:41.499974    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f7812213-30c5-4fbd-8f08-e993a602cea8-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdmvhf\" (UID: \"f7812213-30c5-4fbd-8f08-e993a602cea8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdmvhf"
Jul 24 17:30:41.500117 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:41.500049    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f7812213-30c5-4fbd-8f08-e993a602cea8-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdmvhf\" (UID: \"f7812213-30c5-4fbd-8f08-e993a602cea8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdmvhf"
Jul 24 17:30:41.500117 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:41.500099    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f7812213-30c5-4fbd-8f08-e993a602cea8-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdmvhf\" (UID: \"f7812213-30c5-4fbd-8f08-e993a602cea8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdmvhf"
Jul 24 17:30:41.500269 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:41.500118    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7812213-30c5-4fbd-8f08-e993a602cea8-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdmvhf\" (UID: \"f7812213-30c5-4fbd-8f08-e993a602cea8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdmvhf"
Jul 24 17:30:41.500269 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:41.500213    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxmm7\" (UniqueName: \"kubernetes.io/projected/f7812213-30c5-4fbd-8f08-e993a602cea8-kube-api-access-vxmm7\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdmvhf\" (UID: \"f7812213-30c5-4fbd-8f08-e993a602cea8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdmvhf"
Jul 24 17:30:41.601212 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:41.601178    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxmm7\" (UniqueName: \"kubernetes.io/projected/f7812213-30c5-4fbd-8f08-e993a602cea8-kube-api-access-vxmm7\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdmvhf\" (UID: \"f7812213-30c5-4fbd-8f08-e993a602cea8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdmvhf"
Jul 24 17:30:41.601406 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:41.601235    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7812213-30c5-4fbd-8f08-e993a602cea8-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdmvhf\" (UID: \"f7812213-30c5-4fbd-8f08-e993a602cea8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdmvhf"
Jul 24 17:30:41.601406 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:41.601256    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f7812213-30c5-4fbd-8f08-e993a602cea8-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdmvhf\" (UID: \"f7812213-30c5-4fbd-8f08-e993a602cea8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdmvhf"
Jul 24 17:30:41.601406 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:41.601282    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f7812213-30c5-4fbd-8f08-e993a602cea8-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdmvhf\" (UID: \"f7812213-30c5-4fbd-8f08-e993a602cea8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdmvhf"
Jul 24 17:30:41.601406 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:41.601309    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f7812213-30c5-4fbd-8f08-e993a602cea8-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdmvhf\" (UID: \"f7812213-30c5-4fbd-8f08-e993a602cea8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdmvhf"
Jul 24 17:30:41.601406 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:41.601326    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7812213-30c5-4fbd-8f08-e993a602cea8-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdmvhf\" (UID: \"f7812213-30c5-4fbd-8f08-e993a602cea8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdmvhf"
Jul 24 17:30:41.601725 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:41.601692    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7812213-30c5-4fbd-8f08-e993a602cea8-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdmvhf\" (UID: \"f7812213-30c5-4fbd-8f08-e993a602cea8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdmvhf"
Jul 24 17:30:41.601805 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:41.601725    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f7812213-30c5-4fbd-8f08-e993a602cea8-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdmvhf\" (UID: \"f7812213-30c5-4fbd-8f08-e993a602cea8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdmvhf"
Jul 24 17:30:41.601805 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:41.601771    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f7812213-30c5-4fbd-8f08-e993a602cea8-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdmvhf\" (UID: \"f7812213-30c5-4fbd-8f08-e993a602cea8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdmvhf"
Jul 24 17:30:41.603579 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:41.603559    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f7812213-30c5-4fbd-8f08-e993a602cea8-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdmvhf\" (UID: \"f7812213-30c5-4fbd-8f08-e993a602cea8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdmvhf"
Jul 24 17:30:41.603857 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:41.603838    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7812213-30c5-4fbd-8f08-e993a602cea8-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdmvhf\" (UID: \"f7812213-30c5-4fbd-8f08-e993a602cea8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdmvhf"
Jul 24 17:30:41.610561 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:41.610537    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxmm7\" (UniqueName: \"kubernetes.io/projected/f7812213-30c5-4fbd-8f08-e993a602cea8-kube-api-access-vxmm7\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdmvhf\" (UID: \"f7812213-30c5-4fbd-8f08-e993a602cea8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdmvhf"
Jul 24 17:30:41.721397 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:41.721303    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdmvhf"
Jul 24 17:30:41.850396 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:41.850353    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdmvhf"]
Jul 24 17:30:41.853109 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:30:41.853079    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7812213_30c5_4fbd_8f08_e993a602cea8.slice/crio-2797f300ca9744927f183856f1f7412940289c466510725e5033ed492671df5b WatchSource:0}: Error finding container 2797f300ca9744927f183856f1f7412940289c466510725e5033ed492671df5b: Status 404 returned error can't find the container with id 2797f300ca9744927f183856f1f7412940289c466510725e5033ed492671df5b
Jul 24 17:30:42.248658 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:42.248626    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdmvhf" event={"ID":"f7812213-30c5-4fbd-8f08-e993a602cea8","Type":"ContainerStarted","Data":"130c5d54a7da29661928b0ba78b0a04b3cf1c9d34674bd33fc3a1a940452d706"}
Jul 24 17:30:42.248851 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:42.248677    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdmvhf" event={"ID":"f7812213-30c5-4fbd-8f08-e993a602cea8","Type":"ContainerStarted","Data":"2797f300ca9744927f183856f1f7412940289c466510725e5033ed492671df5b"}
Jul 24 17:30:42.266136 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:42.266057    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdmvhf" podStartSLOduration=1.081140705 podStartE2EDuration="1.266037725s" totalImagesPullingTime="184.89702ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:30:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:30:42.264534745 +0000 UTC m=+777.745910365" watchObservedRunningTime="2026-07-24 17:30:42.266037725 +0000 UTC m=+777.747413344"
Jul 24 17:30:51.722020 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:51.721969    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdmvhf"
Jul 24 17:30:51.722418 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:51.722054    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdmvhf"
Jul 24 17:30:51.734379 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:51.734356    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdmvhf"
Jul 24 17:30:52.299652 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:52.299623    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdmvhf"
Jul 24 17:30:59.614765 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:30:59.614723    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:31:05.785123 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:31:05.785041    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-wwfsz"]
Jul 24 17:31:05.787731 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:31:05.787712    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wwfsz"
Jul 24 17:31:05.790254 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:31:05.790236    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 24 17:31:05.796736 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:31:05.796713    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-wwfsz"]
Jul 24 17:31:05.809462 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:31:05.809427    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:31:05.913896 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:31:05.913859    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37be2ab5-4911-4af6-9640-6127bda8fedf-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-wwfsz\" (UID: \"37be2ab5-4911-4af6-9640-6127bda8fedf\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wwfsz"
Jul 24 17:31:05.913896 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:31:05.913900    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37be2ab5-4911-4af6-9640-6127bda8fedf-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-wwfsz\" (UID: \"37be2ab5-4911-4af6-9640-6127bda8fedf\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wwfsz"
Jul 24 17:31:05.914137 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:31:05.913923    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48ns6\" (UniqueName: \"kubernetes.io/projected/37be2ab5-4911-4af6-9640-6127bda8fedf-kube-api-access-48ns6\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-wwfsz\" (UID: \"37be2ab5-4911-4af6-9640-6127bda8fedf\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wwfsz"
Jul 24 17:31:05.914137 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:31:05.914004    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37be2ab5-4911-4af6-9640-6127bda8fedf-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-wwfsz\" (UID: \"37be2ab5-4911-4af6-9640-6127bda8fedf\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wwfsz"
Jul 24 17:31:05.914137 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:31:05.914040    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37be2ab5-4911-4af6-9640-6127bda8fedf-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-wwfsz\" (UID: \"37be2ab5-4911-4af6-9640-6127bda8fedf\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wwfsz"
Jul 24 17:31:05.914137 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:31:05.914126    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37be2ab5-4911-4af6-9640-6127bda8fedf-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-wwfsz\" (UID: \"37be2ab5-4911-4af6-9640-6127bda8fedf\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wwfsz"
Jul 24 17:31:06.015119 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:31:06.015080    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37be2ab5-4911-4af6-9640-6127bda8fedf-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-wwfsz\" (UID: \"37be2ab5-4911-4af6-9640-6127bda8fedf\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wwfsz"
Jul 24 17:31:06.015301 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:31:06.015142    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37be2ab5-4911-4af6-9640-6127bda8fedf-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-wwfsz\" (UID: \"37be2ab5-4911-4af6-9640-6127bda8fedf\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wwfsz"
Jul 24 17:31:06.015301 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:31:06.015168    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37be2ab5-4911-4af6-9640-6127bda8fedf-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-wwfsz\" (UID: \"37be2ab5-4911-4af6-9640-6127bda8fedf\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wwfsz"
Jul 24 17:31:06.015301 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:31:06.015188    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48ns6\" (UniqueName: \"kubernetes.io/projected/37be2ab5-4911-4af6-9640-6127bda8fedf-kube-api-access-48ns6\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-wwfsz\" (UID: \"37be2ab5-4911-4af6-9640-6127bda8fedf\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wwfsz"
Jul 24 17:31:06.015301 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:31:06.015211    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37be2ab5-4911-4af6-9640-6127bda8fedf-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-wwfsz\" (UID: \"37be2ab5-4911-4af6-9640-6127bda8fedf\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wwfsz"
Jul 24 17:31:06.015301 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:31:06.015243    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37be2ab5-4911-4af6-9640-6127bda8fedf-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-wwfsz\" (UID: \"37be2ab5-4911-4af6-9640-6127bda8fedf\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wwfsz"
Jul 24 17:31:06.015638 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:31:06.015613    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37be2ab5-4911-4af6-9640-6127bda8fedf-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-wwfsz\" (UID: \"37be2ab5-4911-4af6-9640-6127bda8fedf\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wwfsz"
Jul 24 17:31:06.015709 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:31:06.015619    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37be2ab5-4911-4af6-9640-6127bda8fedf-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-wwfsz\" (UID: \"37be2ab5-4911-4af6-9640-6127bda8fedf\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wwfsz"
Jul 24 17:31:06.015709 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:31:06.015678    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37be2ab5-4911-4af6-9640-6127bda8fedf-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-wwfsz\" (UID: \"37be2ab5-4911-4af6-9640-6127bda8fedf\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wwfsz"
Jul 24 17:31:06.017338 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:31:06.017313    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37be2ab5-4911-4af6-9640-6127bda8fedf-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-wwfsz\" (UID: \"37be2ab5-4911-4af6-9640-6127bda8fedf\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wwfsz"
Jul 24 17:31:06.017726 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:31:06.017703    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37be2ab5-4911-4af6-9640-6127bda8fedf-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-wwfsz\" (UID: \"37be2ab5-4911-4af6-9640-6127bda8fedf\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wwfsz"
Jul 24 17:31:06.023326 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:31:06.023298    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48ns6\" (UniqueName: \"kubernetes.io/projected/37be2ab5-4911-4af6-9640-6127bda8fedf-kube-api-access-48ns6\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-wwfsz\" (UID: \"37be2ab5-4911-4af6-9640-6127bda8fedf\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wwfsz"
Jul 24 17:31:06.097009 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:31:06.096909    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wwfsz"
Jul 24 17:31:06.230386 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:31:06.230157    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-wwfsz"]
Jul 24 17:31:06.232595 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:31:06.232563    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod37be2ab5_4911_4af6_9640_6127bda8fedf.slice/crio-2eadfc1f9f720aa96d169d3251beb70974e51c983d023033065e876376ddbf03 WatchSource:0}: Error finding container 2eadfc1f9f720aa96d169d3251beb70974e51c983d023033065e876376ddbf03: Status 404 returned error can't find the container with id 2eadfc1f9f720aa96d169d3251beb70974e51c983d023033065e876376ddbf03
Jul 24 17:31:06.234407 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:31:06.234386    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 17:31:06.348133 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:31:06.348049    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wwfsz" event={"ID":"37be2ab5-4911-4af6-9640-6127bda8fedf","Type":"ContainerStarted","Data":"2eadfc1f9f720aa96d169d3251beb70974e51c983d023033065e876376ddbf03"}
Jul 24 17:31:07.353683 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:31:07.353647    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wwfsz" event={"ID":"37be2ab5-4911-4af6-9640-6127bda8fedf","Type":"ContainerStarted","Data":"faff63b2964ac7a382761c778f390119f84af04b4f04a8cacbfc8d616e43392a"}
Jul 24 17:31:07.373218 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:31:07.373167    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wwfsz" podStartSLOduration=2.205973329 podStartE2EDuration="2.373150696s" totalImagesPullingTime="167.177367ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:31:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:31:07.372575092 +0000 UTC m=+802.853950734" watchObservedRunningTime="2026-07-24 17:31:07.373150696 +0000 UTC m=+802.854526315"
Jul 24 17:31:16.098102 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:31:16.098067    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wwfsz"
Jul 24 17:31:16.098565 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:31:16.098120    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wwfsz"
Jul 24 17:31:16.110580 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:31:16.110550    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wwfsz"
Jul 24 17:31:16.403206 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:31:16.403129    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wwfsz"
Jul 24 17:31:18.654066 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:31:18.654025    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:32:10.524159 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:32:10.524123    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-946dcd694-n6wsz"]
Jul 24 17:32:10.527018 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:32:10.526999    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-946dcd694-n6wsz"
Jul 24 17:32:10.534210 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:32:10.534185    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-4cwtj\""
Jul 24 17:32:10.534329 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:32:10.534277    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 24 17:32:10.534329 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:32:10.534294    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 24 17:32:10.534424 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:32:10.534362    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 24 17:32:10.544877 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:32:10.544843    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-946dcd694-n6wsz"]
Jul 24 17:32:10.666864 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:32:10.666820    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqmtr\" (UniqueName: \"kubernetes.io/projected/e1fb313c-b700-45db-bb6e-2dd310ba3b09-kube-api-access-mqmtr\") pod \"authorino-946dcd694-n6wsz\" (UID: \"e1fb313c-b700-45db-bb6e-2dd310ba3b09\") " pod="kuadrant-system/authorino-946dcd694-n6wsz"
Jul 24 17:32:10.667072 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:32:10.666903    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e1fb313c-b700-45db-bb6e-2dd310ba3b09-tls-cert\") pod \"authorino-946dcd694-n6wsz\" (UID: \"e1fb313c-b700-45db-bb6e-2dd310ba3b09\") " pod="kuadrant-system/authorino-946dcd694-n6wsz"
Jul 24 17:32:10.767908 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:32:10.767870    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e1fb313c-b700-45db-bb6e-2dd310ba3b09-tls-cert\") pod \"authorino-946dcd694-n6wsz\" (UID: \"e1fb313c-b700-45db-bb6e-2dd310ba3b09\") " pod="kuadrant-system/authorino-946dcd694-n6wsz"
Jul 24 17:32:10.768134 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:32:10.768035    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqmtr\" (UniqueName: \"kubernetes.io/projected/e1fb313c-b700-45db-bb6e-2dd310ba3b09-kube-api-access-mqmtr\") pod \"authorino-946dcd694-n6wsz\" (UID: \"e1fb313c-b700-45db-bb6e-2dd310ba3b09\") " pod="kuadrant-system/authorino-946dcd694-n6wsz"
Jul 24 17:32:10.770352 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:32:10.770331    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e1fb313c-b700-45db-bb6e-2dd310ba3b09-tls-cert\") pod \"authorino-946dcd694-n6wsz\" (UID: \"e1fb313c-b700-45db-bb6e-2dd310ba3b09\") " pod="kuadrant-system/authorino-946dcd694-n6wsz"
Jul 24 17:32:10.789769 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:32:10.789743    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqmtr\" (UniqueName: \"kubernetes.io/projected/e1fb313c-b700-45db-bb6e-2dd310ba3b09-kube-api-access-mqmtr\") pod \"authorino-946dcd694-n6wsz\" (UID: \"e1fb313c-b700-45db-bb6e-2dd310ba3b09\") " pod="kuadrant-system/authorino-946dcd694-n6wsz"
Jul 24 17:32:10.818116 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:32:10.818085    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:32:10.835654 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:32:10.835624    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-946dcd694-n6wsz"
Jul 24 17:32:11.013666 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:32:11.013624    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-946dcd694-n6wsz"]
Jul 24 17:32:11.016657 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:32:11.016629    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode1fb313c_b700_45db_bb6e_2dd310ba3b09.slice/crio-0a5b626187e9d945c0f917aa3bbaef010da6d32bcb2ad0b1a72e5c40dc945d7b WatchSource:0}: Error finding container 0a5b626187e9d945c0f917aa3bbaef010da6d32bcb2ad0b1a72e5c40dc945d7b: Status 404 returned error can't find the container with id 0a5b626187e9d945c0f917aa3bbaef010da6d32bcb2ad0b1a72e5c40dc945d7b
Jul 24 17:32:11.022929 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:32:11.022895    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:32:11.631145 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:32:11.631059    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-946dcd694-n6wsz" event={"ID":"e1fb313c-b700-45db-bb6e-2dd310ba3b09","Type":"ContainerStarted","Data":"231077cd011c5b213cfbcda0ed1fa1036f7e71b5d8c3fa742b26392bea1d6235"}
Jul 24 17:32:11.631145 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:32:11.631107    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-946dcd694-n6wsz" event={"ID":"e1fb313c-b700-45db-bb6e-2dd310ba3b09","Type":"ContainerStarted","Data":"0a5b626187e9d945c0f917aa3bbaef010da6d32bcb2ad0b1a72e5c40dc945d7b"}
Jul 24 17:32:11.697679 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:32:11.697622    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-946dcd694-n6wsz" podStartSLOduration=1.34907394 podStartE2EDuration="1.697601737s" totalImagesPullingTime="348.527797ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:32:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:32:11.693873947 +0000 UTC m=+867.175249567" watchObservedRunningTime="2026-07-24 17:32:11.697601737 +0000 UTC m=+867.178977356"
Jul 24 17:32:12.179985 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:32:12.179949    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:32:12.354669 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:32:12.354617    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:32:45.037888 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:32:45.037858    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82s5l_010c8b81-c5f5-43c3-b1bb-c812fcde2d6f/ovn-acl-logging/0.log"
Jul 24 17:32:45.038822 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:32:45.038803    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82s5l_010c8b81-c5f5-43c3-b1bb-c812fcde2d6f/ovn-acl-logging/0.log"
Jul 24 17:32:46.744699 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:32:46.744660    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:32:48.156249 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:32:48.156133    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:33:01.800798 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:33:01.800760    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5ff575bb75-bbhnz"]
Jul 24 17:33:01.801254 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:33:01.800960    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5ff575bb75-bbhnz" podUID="eca82970-2408-4d1f-8c2f-7d48fbed4cd1" containerName="manager" containerID="cri-o://3451d4982e097be5749f9bd1f2ac3a6ca4f333d3b6e43e536414d57a28978067" gracePeriod=30
Jul 24 17:33:02.045559 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:33:02.045530    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5ff575bb75-bbhnz"
Jul 24 17:33:02.126138 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:33:02.126053    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vr9zf\" (UniqueName: \"kubernetes.io/projected/eca82970-2408-4d1f-8c2f-7d48fbed4cd1-kube-api-access-vr9zf\") pod \"eca82970-2408-4d1f-8c2f-7d48fbed4cd1\" (UID: \"eca82970-2408-4d1f-8c2f-7d48fbed4cd1\") "
Jul 24 17:33:02.126138 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:33:02.126088    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eca82970-2408-4d1f-8c2f-7d48fbed4cd1-webhook-cert\") pod \"eca82970-2408-4d1f-8c2f-7d48fbed4cd1\" (UID: \"eca82970-2408-4d1f-8c2f-7d48fbed4cd1\") "
Jul 24 17:33:02.128300 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:33:02.128272    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eca82970-2408-4d1f-8c2f-7d48fbed4cd1-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "eca82970-2408-4d1f-8c2f-7d48fbed4cd1" (UID: "eca82970-2408-4d1f-8c2f-7d48fbed4cd1"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:33:02.128418 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:33:02.128305    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eca82970-2408-4d1f-8c2f-7d48fbed4cd1-kube-api-access-vr9zf" (OuterVolumeSpecName: "kube-api-access-vr9zf") pod "eca82970-2408-4d1f-8c2f-7d48fbed4cd1" (UID: "eca82970-2408-4d1f-8c2f-7d48fbed4cd1"). InnerVolumeSpecName "kube-api-access-vr9zf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:33:02.227785 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:33:02.227745    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vr9zf\" (UniqueName: \"kubernetes.io/projected/eca82970-2408-4d1f-8c2f-7d48fbed4cd1-kube-api-access-vr9zf\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 17:33:02.227785 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:33:02.227776    2575 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eca82970-2408-4d1f-8c2f-7d48fbed4cd1-webhook-cert\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 17:33:02.866704 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:33:02.866674    2575 generic.go:356] "Generic (PLEG): container finished" podID="eca82970-2408-4d1f-8c2f-7d48fbed4cd1" containerID="3451d4982e097be5749f9bd1f2ac3a6ca4f333d3b6e43e536414d57a28978067" exitCode=0
Jul 24 17:33:02.867188 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:33:02.866717    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5ff575bb75-bbhnz"
Jul 24 17:33:02.867188 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:33:02.866743    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5ff575bb75-bbhnz" event={"ID":"eca82970-2408-4d1f-8c2f-7d48fbed4cd1","Type":"ContainerDied","Data":"3451d4982e097be5749f9bd1f2ac3a6ca4f333d3b6e43e536414d57a28978067"}
Jul 24 17:33:02.867188 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:33:02.866783    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5ff575bb75-bbhnz" event={"ID":"eca82970-2408-4d1f-8c2f-7d48fbed4cd1","Type":"ContainerDied","Data":"abda8eecd466e88475d8378d9f32bf184e3c505f87b0dbdd742e9017315b68d0"}
Jul 24 17:33:02.867188 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:33:02.866805    2575 scope.go:117] "RemoveContainer" containerID="3451d4982e097be5749f9bd1f2ac3a6ca4f333d3b6e43e536414d57a28978067"
Jul 24 17:33:02.875318 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:33:02.875301    2575 scope.go:117] "RemoveContainer" containerID="3451d4982e097be5749f9bd1f2ac3a6ca4f333d3b6e43e536414d57a28978067"
Jul 24 17:33:02.875557 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:33:02.875540    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3451d4982e097be5749f9bd1f2ac3a6ca4f333d3b6e43e536414d57a28978067\": container with ID starting with 3451d4982e097be5749f9bd1f2ac3a6ca4f333d3b6e43e536414d57a28978067 not found: ID does not exist" containerID="3451d4982e097be5749f9bd1f2ac3a6ca4f333d3b6e43e536414d57a28978067"
Jul 24 17:33:02.875605 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:33:02.875563    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3451d4982e097be5749f9bd1f2ac3a6ca4f333d3b6e43e536414d57a28978067"} err="failed to get container status \"3451d4982e097be5749f9bd1f2ac3a6ca4f333d3b6e43e536414d57a28978067\": rpc error: code = NotFound desc = could not find container \"3451d4982e097be5749f9bd1f2ac3a6ca4f333d3b6e43e536414d57a28978067\": container with ID starting with 3451d4982e097be5749f9bd1f2ac3a6ca4f333d3b6e43e536414d57a28978067 not found: ID does not exist"
Jul 24 17:33:02.893586 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:33:02.893553    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5ff575bb75-bbhnz"]
Jul 24 17:33:02.897709 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:33:02.897683    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5ff575bb75-bbhnz"]
Jul 24 17:33:03.202820 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:33:03.202727    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eca82970-2408-4d1f-8c2f-7d48fbed4cd1" path="/var/lib/kubelet/pods/eca82970-2408-4d1f-8c2f-7d48fbed4cd1/volumes"
Jul 24 17:33:36.858832 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:33:36.858790    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:34:20.632856 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:34:20.632771    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:34:21.868158 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:34:21.868123    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:34:48.375952 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:34:48.375897    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:35:04.939153 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:35:04.939111    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:35:05.035210 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:35:05.035176    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:35:05.146330 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:35:05.146291    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:35:11.103252 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:35:11.103214    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:35:11.173204 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:35:11.173168    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:35:11.276908 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:35:11.276869    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:35:11.502405 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:35:11.502315    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:35:17.428655 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:35:17.428615    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:35:17.529351 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:35:17.529317    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:35:26.122537 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:35:26.122495    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:35:26.190167 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:35:26.190131    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:36:26.577556 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:36:26.577511    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:37:31.531844 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:37:31.531807    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:37:45.061259 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:37:45.061234    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82s5l_010c8b81-c5f5-43c3-b1bb-c812fcde2d6f/ovn-acl-logging/0.log"
Jul 24 17:37:45.063584 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:37:45.063552    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82s5l_010c8b81-c5f5-43c3-b1bb-c812fcde2d6f/ovn-acl-logging/0.log"
Jul 24 17:38:11.908971 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:38:11.908920    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:40:52.980561 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:40:52.980525    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:40:53.071092 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:40:53.071059    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:42:12.183598 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:42:12.183491    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:42:45.086445 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:42:45.086411    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82s5l_010c8b81-c5f5-43c3-b1bb-c812fcde2d6f/ovn-acl-logging/0.log"
Jul 24 17:42:45.088736 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:42:45.088713    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82s5l_010c8b81-c5f5-43c3-b1bb-c812fcde2d6f/ovn-acl-logging/0.log"
Jul 24 17:42:55.497584 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:42:55.497544    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:43:04.004918 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:04.004883    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-edf3838a-kserve-fb59c599f-hzkll"]
Jul 24 17:43:04.005316 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:04.005202    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eca82970-2408-4d1f-8c2f-7d48fbed4cd1" containerName="manager"
Jul 24 17:43:04.005316 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:04.005212    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="eca82970-2408-4d1f-8c2f-7d48fbed4cd1" containerName="manager"
Jul 24 17:43:04.005316 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:04.005267    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="eca82970-2408-4d1f-8c2f-7d48fbed4cd1" containerName="manager"
Jul 24 17:43:04.008219 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:04.008203    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-edf3838a-kserve-fb59c599f-hzkll"
Jul 24 17:43:04.010404 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:04.010385    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-edf3838a-kserve-self-signed-certs\""
Jul 24 17:43:04.029336 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:04.029308    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-edf3838a-kserve-fb59c599f-hzkll"]
Jul 24 17:43:04.123924 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:04.123886    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rj646\" (UniqueName: \"kubernetes.io/projected/bdd05e5e-e2fb-41c2-829a-91b190bcc7ca-kube-api-access-rj646\") pod \"e2e-same-id-a-edf3838a-kserve-fb59c599f-hzkll\" (UID: \"bdd05e5e-e2fb-41c2-829a-91b190bcc7ca\") " pod="llm/e2e-same-id-a-edf3838a-kserve-fb59c599f-hzkll"
Jul 24 17:43:04.124115 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:04.123954    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bdd05e5e-e2fb-41c2-829a-91b190bcc7ca-tmp-dir\") pod \"e2e-same-id-a-edf3838a-kserve-fb59c599f-hzkll\" (UID: \"bdd05e5e-e2fb-41c2-829a-91b190bcc7ca\") " pod="llm/e2e-same-id-a-edf3838a-kserve-fb59c599f-hzkll"
Jul 24 17:43:04.124115 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:04.124071    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bdd05e5e-e2fb-41c2-829a-91b190bcc7ca-tls-certs\") pod \"e2e-same-id-a-edf3838a-kserve-fb59c599f-hzkll\" (UID: \"bdd05e5e-e2fb-41c2-829a-91b190bcc7ca\") " pod="llm/e2e-same-id-a-edf3838a-kserve-fb59c599f-hzkll"
Jul 24 17:43:04.124115 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:04.124111    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bdd05e5e-e2fb-41c2-829a-91b190bcc7ca-dshm\") pod \"e2e-same-id-a-edf3838a-kserve-fb59c599f-hzkll\" (UID: \"bdd05e5e-e2fb-41c2-829a-91b190bcc7ca\") " pod="llm/e2e-same-id-a-edf3838a-kserve-fb59c599f-hzkll"
Jul 24 17:43:04.124293 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:04.124150    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bdd05e5e-e2fb-41c2-829a-91b190bcc7ca-home\") pod \"e2e-same-id-a-edf3838a-kserve-fb59c599f-hzkll\" (UID: \"bdd05e5e-e2fb-41c2-829a-91b190bcc7ca\") " pod="llm/e2e-same-id-a-edf3838a-kserve-fb59c599f-hzkll"
Jul 24 17:43:04.124293 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:04.124210    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bdd05e5e-e2fb-41c2-829a-91b190bcc7ca-model-cache\") pod \"e2e-same-id-a-edf3838a-kserve-fb59c599f-hzkll\" (UID: \"bdd05e5e-e2fb-41c2-829a-91b190bcc7ca\") " pod="llm/e2e-same-id-a-edf3838a-kserve-fb59c599f-hzkll"
Jul 24 17:43:04.193344 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:04.193314    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:43:04.225672 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:04.225641    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rj646\" (UniqueName: \"kubernetes.io/projected/bdd05e5e-e2fb-41c2-829a-91b190bcc7ca-kube-api-access-rj646\") pod \"e2e-same-id-a-edf3838a-kserve-fb59c599f-hzkll\" (UID: \"bdd05e5e-e2fb-41c2-829a-91b190bcc7ca\") " pod="llm/e2e-same-id-a-edf3838a-kserve-fb59c599f-hzkll"
Jul 24 17:43:04.225830 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:04.225680    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bdd05e5e-e2fb-41c2-829a-91b190bcc7ca-tmp-dir\") pod \"e2e-same-id-a-edf3838a-kserve-fb59c599f-hzkll\" (UID: \"bdd05e5e-e2fb-41c2-829a-91b190bcc7ca\") " pod="llm/e2e-same-id-a-edf3838a-kserve-fb59c599f-hzkll"
Jul 24 17:43:04.225830 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:04.225725    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bdd05e5e-e2fb-41c2-829a-91b190bcc7ca-tls-certs\") pod \"e2e-same-id-a-edf3838a-kserve-fb59c599f-hzkll\" (UID: \"bdd05e5e-e2fb-41c2-829a-91b190bcc7ca\") " pod="llm/e2e-same-id-a-edf3838a-kserve-fb59c599f-hzkll"
Jul 24 17:43:04.225830 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:04.225744    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bdd05e5e-e2fb-41c2-829a-91b190bcc7ca-dshm\") pod \"e2e-same-id-a-edf3838a-kserve-fb59c599f-hzkll\" (UID: \"bdd05e5e-e2fb-41c2-829a-91b190bcc7ca\") " pod="llm/e2e-same-id-a-edf3838a-kserve-fb59c599f-hzkll"
Jul 24 17:43:04.225830 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:04.225760    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bdd05e5e-e2fb-41c2-829a-91b190bcc7ca-home\") pod \"e2e-same-id-a-edf3838a-kserve-fb59c599f-hzkll\" (UID: \"bdd05e5e-e2fb-41c2-829a-91b190bcc7ca\") " pod="llm/e2e-same-id-a-edf3838a-kserve-fb59c599f-hzkll"
Jul 24 17:43:04.225830 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:04.225787    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bdd05e5e-e2fb-41c2-829a-91b190bcc7ca-model-cache\") pod \"e2e-same-id-a-edf3838a-kserve-fb59c599f-hzkll\" (UID: \"bdd05e5e-e2fb-41c2-829a-91b190bcc7ca\") " pod="llm/e2e-same-id-a-edf3838a-kserve-fb59c599f-hzkll"
Jul 24 17:43:04.226258 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:04.226235    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bdd05e5e-e2fb-41c2-829a-91b190bcc7ca-home\") pod \"e2e-same-id-a-edf3838a-kserve-fb59c599f-hzkll\" (UID: \"bdd05e5e-e2fb-41c2-829a-91b190bcc7ca\") " pod="llm/e2e-same-id-a-edf3838a-kserve-fb59c599f-hzkll"
Jul 24 17:43:04.226258 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:04.226251    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bdd05e5e-e2fb-41c2-829a-91b190bcc7ca-model-cache\") pod \"e2e-same-id-a-edf3838a-kserve-fb59c599f-hzkll\" (UID: \"bdd05e5e-e2fb-41c2-829a-91b190bcc7ca\") " pod="llm/e2e-same-id-a-edf3838a-kserve-fb59c599f-hzkll"
Jul 24 17:43:04.226361 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:04.226298    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bdd05e5e-e2fb-41c2-829a-91b190bcc7ca-tmp-dir\") pod \"e2e-same-id-a-edf3838a-kserve-fb59c599f-hzkll\" (UID: \"bdd05e5e-e2fb-41c2-829a-91b190bcc7ca\") " pod="llm/e2e-same-id-a-edf3838a-kserve-fb59c599f-hzkll"
Jul 24 17:43:04.228120 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:04.228105    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bdd05e5e-e2fb-41c2-829a-91b190bcc7ca-dshm\") pod \"e2e-same-id-a-edf3838a-kserve-fb59c599f-hzkll\" (UID: \"bdd05e5e-e2fb-41c2-829a-91b190bcc7ca\") " pod="llm/e2e-same-id-a-edf3838a-kserve-fb59c599f-hzkll"
Jul 24 17:43:04.228389 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:04.228374    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bdd05e5e-e2fb-41c2-829a-91b190bcc7ca-tls-certs\") pod \"e2e-same-id-a-edf3838a-kserve-fb59c599f-hzkll\" (UID: \"bdd05e5e-e2fb-41c2-829a-91b190bcc7ca\") " pod="llm/e2e-same-id-a-edf3838a-kserve-fb59c599f-hzkll"
Jul 24 17:43:04.236163 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:04.236140    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rj646\" (UniqueName: \"kubernetes.io/projected/bdd05e5e-e2fb-41c2-829a-91b190bcc7ca-kube-api-access-rj646\") pod \"e2e-same-id-a-edf3838a-kserve-fb59c599f-hzkll\" (UID: \"bdd05e5e-e2fb-41c2-829a-91b190bcc7ca\") " pod="llm/e2e-same-id-a-edf3838a-kserve-fb59c599f-hzkll"
Jul 24 17:43:04.317527 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:04.317498    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-edf3838a-kserve-fb59c599f-hzkll"
Jul 24 17:43:04.448833 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:04.448804    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-edf3838a-kserve-fb59c599f-hzkll"]
Jul 24 17:43:04.451219 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:43:04.451195    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbdd05e5e_e2fb_41c2_829a_91b190bcc7ca.slice/crio-2c057cad429e6ca2cce681003fc60ab58852a73af718e91eee15d7f45bc6da69 WatchSource:0}: Error finding container 2c057cad429e6ca2cce681003fc60ab58852a73af718e91eee15d7f45bc6da69: Status 404 returned error can't find the container with id 2c057cad429e6ca2cce681003fc60ab58852a73af718e91eee15d7f45bc6da69
Jul 24 17:43:05.436761 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:05.436727    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-edf3838a-kserve-fb59c599f-hzkll" event={"ID":"bdd05e5e-e2fb-41c2-829a-91b190bcc7ca","Type":"ContainerStarted","Data":"46cd2cbfe026514e09637841f3ca27bdbc89a8b4f7d6401138e96f948a5f56bb"}
Jul 24 17:43:05.436761 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:05.436770    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-edf3838a-kserve-fb59c599f-hzkll" event={"ID":"bdd05e5e-e2fb-41c2-829a-91b190bcc7ca","Type":"ContainerStarted","Data":"2c057cad429e6ca2cce681003fc60ab58852a73af718e91eee15d7f45bc6da69"}
Jul 24 17:43:05.454147 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:05.454097    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-edf3838a-kserve-fb59c599f-hzkll" podStartSLOduration=2.454079932 podStartE2EDuration="2.454079932s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:43:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:43:05.453044224 +0000 UTC m=+1520.934419854" watchObservedRunningTime="2026-07-24 17:43:05.454079932 +0000 UTC m=+1520.935455551"
Jul 24 17:43:14.318408 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:14.318372    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-edf3838a-kserve-fb59c599f-hzkll"
Jul 24 17:43:14.318876 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:14.318422    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-edf3838a-kserve-fb59c599f-hzkll"
Jul 24 17:43:14.331022 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:14.330998    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-edf3838a-kserve-fb59c599f-hzkll"
Jul 24 17:43:14.494241 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:14.494213    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-edf3838a-kserve-fb59c599f-hzkll"
Jul 24 17:43:15.596952 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:15.596914    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-edf3838a-kserve-78b69bcb99-8lknz"]
Jul 24 17:43:15.599966 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:15.599924    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-edf3838a-kserve-78b69bcb99-8lknz"
Jul 24 17:43:15.602322 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:15.602301    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-edf3838a-kserve-self-signed-certs\""
Jul 24 17:43:15.610270 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:15.610247    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-edf3838a-kserve-78b69bcb99-8lknz"]
Jul 24 17:43:15.621108 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:15.621072    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:43:15.732220 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:15.732185    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf-dshm\") pod \"e2e-same-id-b-edf3838a-kserve-78b69bcb99-8lknz\" (UID: \"8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf\") " pod="llm/e2e-same-id-b-edf3838a-kserve-78b69bcb99-8lknz"
Jul 24 17:43:15.732388 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:15.732240    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf-tmp-dir\") pod \"e2e-same-id-b-edf3838a-kserve-78b69bcb99-8lknz\" (UID: \"8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf\") " pod="llm/e2e-same-id-b-edf3838a-kserve-78b69bcb99-8lknz"
Jul 24 17:43:15.732388 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:15.732332    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf-home\") pod \"e2e-same-id-b-edf3838a-kserve-78b69bcb99-8lknz\" (UID: \"8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf\") " pod="llm/e2e-same-id-b-edf3838a-kserve-78b69bcb99-8lknz"
Jul 24 17:43:15.732388 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:15.732365    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf-model-cache\") pod \"e2e-same-id-b-edf3838a-kserve-78b69bcb99-8lknz\" (UID: \"8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf\") " pod="llm/e2e-same-id-b-edf3838a-kserve-78b69bcb99-8lknz"
Jul 24 17:43:15.732494 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:15.732387    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf-tls-certs\") pod \"e2e-same-id-b-edf3838a-kserve-78b69bcb99-8lknz\" (UID: \"8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf\") " pod="llm/e2e-same-id-b-edf3838a-kserve-78b69bcb99-8lknz"
Jul 24 17:43:15.732494 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:15.732412    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m66b8\" (UniqueName: \"kubernetes.io/projected/8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf-kube-api-access-m66b8\") pod \"e2e-same-id-b-edf3838a-kserve-78b69bcb99-8lknz\" (UID: \"8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf\") " pod="llm/e2e-same-id-b-edf3838a-kserve-78b69bcb99-8lknz"
Jul 24 17:43:15.833298 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:15.833260    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf-dshm\") pod \"e2e-same-id-b-edf3838a-kserve-78b69bcb99-8lknz\" (UID: \"8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf\") " pod="llm/e2e-same-id-b-edf3838a-kserve-78b69bcb99-8lknz"
Jul 24 17:43:15.833558 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:15.833326    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf-tmp-dir\") pod \"e2e-same-id-b-edf3838a-kserve-78b69bcb99-8lknz\" (UID: \"8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf\") " pod="llm/e2e-same-id-b-edf3838a-kserve-78b69bcb99-8lknz"
Jul 24 17:43:15.833558 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:15.833373    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf-home\") pod \"e2e-same-id-b-edf3838a-kserve-78b69bcb99-8lknz\" (UID: \"8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf\") " pod="llm/e2e-same-id-b-edf3838a-kserve-78b69bcb99-8lknz"
Jul 24 17:43:15.833558 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:15.833403    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf-model-cache\") pod \"e2e-same-id-b-edf3838a-kserve-78b69bcb99-8lknz\" (UID: \"8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf\") " pod="llm/e2e-same-id-b-edf3838a-kserve-78b69bcb99-8lknz"
Jul 24 17:43:15.833558 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:15.833425    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf-tls-certs\") pod \"e2e-same-id-b-edf3838a-kserve-78b69bcb99-8lknz\" (UID: \"8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf\") " pod="llm/e2e-same-id-b-edf3838a-kserve-78b69bcb99-8lknz"
Jul 24 17:43:15.833558 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:15.833445    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m66b8\" (UniqueName: \"kubernetes.io/projected/8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf-kube-api-access-m66b8\") pod \"e2e-same-id-b-edf3838a-kserve-78b69bcb99-8lknz\" (UID: \"8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf\") " pod="llm/e2e-same-id-b-edf3838a-kserve-78b69bcb99-8lknz"
Jul 24 17:43:15.833828 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:15.833675    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf-tmp-dir\") pod \"e2e-same-id-b-edf3838a-kserve-78b69bcb99-8lknz\" (UID: \"8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf\") " pod="llm/e2e-same-id-b-edf3838a-kserve-78b69bcb99-8lknz"
Jul 24 17:43:15.833828 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:15.833735    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf-home\") pod \"e2e-same-id-b-edf3838a-kserve-78b69bcb99-8lknz\" (UID: \"8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf\") " pod="llm/e2e-same-id-b-edf3838a-kserve-78b69bcb99-8lknz"
Jul 24 17:43:15.833961 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:15.833878    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf-model-cache\") pod \"e2e-same-id-b-edf3838a-kserve-78b69bcb99-8lknz\" (UID: \"8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf\") " pod="llm/e2e-same-id-b-edf3838a-kserve-78b69bcb99-8lknz"
Jul 24 17:43:15.835593 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:15.835572    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf-dshm\") pod \"e2e-same-id-b-edf3838a-kserve-78b69bcb99-8lknz\" (UID: \"8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf\") " pod="llm/e2e-same-id-b-edf3838a-kserve-78b69bcb99-8lknz"
Jul 24 17:43:15.835970 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:15.835950    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf-tls-certs\") pod \"e2e-same-id-b-edf3838a-kserve-78b69bcb99-8lknz\" (UID: \"8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf\") " pod="llm/e2e-same-id-b-edf3838a-kserve-78b69bcb99-8lknz"
Jul 24 17:43:15.843807 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:15.843778    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m66b8\" (UniqueName: \"kubernetes.io/projected/8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf-kube-api-access-m66b8\") pod \"e2e-same-id-b-edf3838a-kserve-78b69bcb99-8lknz\" (UID: \"8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf\") " pod="llm/e2e-same-id-b-edf3838a-kserve-78b69bcb99-8lknz"
Jul 24 17:43:15.910074 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:15.909984    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-edf3838a-kserve-78b69bcb99-8lknz"
Jul 24 17:43:16.040089 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:16.040064    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-edf3838a-kserve-78b69bcb99-8lknz"]
Jul 24 17:43:16.041952 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:43:16.041916    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8d711dfe_7ed3_4d35_85e4_3b1d8a59d9cf.slice/crio-11615c1828a34d2ca28efee8dbc77c0833561ae4550865a3ff989fd7e75f0a80 WatchSource:0}: Error finding container 11615c1828a34d2ca28efee8dbc77c0833561ae4550865a3ff989fd7e75f0a80: Status 404 returned error can't find the container with id 11615c1828a34d2ca28efee8dbc77c0833561ae4550865a3ff989fd7e75f0a80
Jul 24 17:43:16.493071 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:16.493040    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-edf3838a-kserve-78b69bcb99-8lknz" event={"ID":"8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf","Type":"ContainerStarted","Data":"ce08a27959f18d12fdc830ca17bbe20c94aadcedc66f91704f9f2748c4187a2f"}
Jul 24 17:43:16.493071 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:16.493079    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-edf3838a-kserve-78b69bcb99-8lknz" event={"ID":"8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf","Type":"ContainerStarted","Data":"11615c1828a34d2ca28efee8dbc77c0833561ae4550865a3ff989fd7e75f0a80"}
Jul 24 17:43:16.510757 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:16.510708    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-edf3838a-kserve-78b69bcb99-8lknz" podStartSLOduration=1.5106903630000001 podStartE2EDuration="1.510690363s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:43:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:43:16.509169796 +0000 UTC m=+1531.990545416" watchObservedRunningTime="2026-07-24 17:43:16.510690363 +0000 UTC m=+1531.992065982"
Jul 24 17:43:25.910964 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:25.910897    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-edf3838a-kserve-78b69bcb99-8lknz"
Jul 24 17:43:25.911440 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:25.911100    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-edf3838a-kserve-78b69bcb99-8lknz"
Jul 24 17:43:25.923670 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:25.923641    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-edf3838a-kserve-78b69bcb99-8lknz"
Jul 24 17:43:26.553404 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:26.553377    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-edf3838a-kserve-78b69bcb99-8lknz"
Jul 24 17:43:40.775821 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:40.775787    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-edf3838a-kserve-fb59c599f-hzkll"]
Jul 24 17:43:40.799082 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:40.799056    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:43:41.875470 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:41.875441    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-edf3838a-kserve-78b69bcb99-8lknz"]
Jul 24 17:43:41.893531 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:41.893503    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:43:55.795608 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:55.795559    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-edf3838a-kserve-fb59c599f-hzkll" podUID="bdd05e5e-e2fb-41c2-829a-91b190bcc7ca" containerName="main" containerID="cri-o://46cd2cbfe026514e09637841f3ca27bdbc89a8b4f7d6401138e96f948a5f56bb" gracePeriod=45
Jul 24 17:43:56.043085 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:56.043060    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-edf3838a-kserve-fb59c599f-hzkll"
Jul 24 17:43:56.113554 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:56.113461    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bdd05e5e-e2fb-41c2-829a-91b190bcc7ca-home\") pod \"bdd05e5e-e2fb-41c2-829a-91b190bcc7ca\" (UID: \"bdd05e5e-e2fb-41c2-829a-91b190bcc7ca\") "
Jul 24 17:43:56.113554 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:56.113526    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bdd05e5e-e2fb-41c2-829a-91b190bcc7ca-tmp-dir\") pod \"bdd05e5e-e2fb-41c2-829a-91b190bcc7ca\" (UID: \"bdd05e5e-e2fb-41c2-829a-91b190bcc7ca\") "
Jul 24 17:43:56.113788 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:56.113559    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bdd05e5e-e2fb-41c2-829a-91b190bcc7ca-dshm\") pod \"bdd05e5e-e2fb-41c2-829a-91b190bcc7ca\" (UID: \"bdd05e5e-e2fb-41c2-829a-91b190bcc7ca\") "
Jul 24 17:43:56.113788 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:56.113604    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bdd05e5e-e2fb-41c2-829a-91b190bcc7ca-tls-certs\") pod \"bdd05e5e-e2fb-41c2-829a-91b190bcc7ca\" (UID: \"bdd05e5e-e2fb-41c2-829a-91b190bcc7ca\") "
Jul 24 17:43:56.113788 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:56.113650    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rj646\" (UniqueName: \"kubernetes.io/projected/bdd05e5e-e2fb-41c2-829a-91b190bcc7ca-kube-api-access-rj646\") pod \"bdd05e5e-e2fb-41c2-829a-91b190bcc7ca\" (UID: \"bdd05e5e-e2fb-41c2-829a-91b190bcc7ca\") "
Jul 24 17:43:56.113788 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:56.113689    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bdd05e5e-e2fb-41c2-829a-91b190bcc7ca-model-cache\") pod \"bdd05e5e-e2fb-41c2-829a-91b190bcc7ca\" (UID: \"bdd05e5e-e2fb-41c2-829a-91b190bcc7ca\") "
Jul 24 17:43:56.113788 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:56.113739    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdd05e5e-e2fb-41c2-829a-91b190bcc7ca-home" (OuterVolumeSpecName: "home") pod "bdd05e5e-e2fb-41c2-829a-91b190bcc7ca" (UID: "bdd05e5e-e2fb-41c2-829a-91b190bcc7ca"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:43:56.114044 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:56.113800    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdd05e5e-e2fb-41c2-829a-91b190bcc7ca-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bdd05e5e-e2fb-41c2-829a-91b190bcc7ca" (UID: "bdd05e5e-e2fb-41c2-829a-91b190bcc7ca"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:43:56.114044 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:56.113980    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdd05e5e-e2fb-41c2-829a-91b190bcc7ca-model-cache" (OuterVolumeSpecName: "model-cache") pod "bdd05e5e-e2fb-41c2-829a-91b190bcc7ca" (UID: "bdd05e5e-e2fb-41c2-829a-91b190bcc7ca"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:43:56.114044 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:56.113991    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bdd05e5e-e2fb-41c2-829a-91b190bcc7ca-home\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 17:43:56.114139 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:56.114043    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bdd05e5e-e2fb-41c2-829a-91b190bcc7ca-tmp-dir\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 17:43:56.115823 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:56.115788    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdd05e5e-e2fb-41c2-829a-91b190bcc7ca-dshm" (OuterVolumeSpecName: "dshm") pod "bdd05e5e-e2fb-41c2-829a-91b190bcc7ca" (UID: "bdd05e5e-e2fb-41c2-829a-91b190bcc7ca"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:43:56.115927 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:56.115861    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bdd05e5e-e2fb-41c2-829a-91b190bcc7ca-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bdd05e5e-e2fb-41c2-829a-91b190bcc7ca" (UID: "bdd05e5e-e2fb-41c2-829a-91b190bcc7ca"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:43:56.115927 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:56.115861    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdd05e5e-e2fb-41c2-829a-91b190bcc7ca-kube-api-access-rj646" (OuterVolumeSpecName: "kube-api-access-rj646") pod "bdd05e5e-e2fb-41c2-829a-91b190bcc7ca" (UID: "bdd05e5e-e2fb-41c2-829a-91b190bcc7ca"). InnerVolumeSpecName "kube-api-access-rj646". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:43:56.215272 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:56.215236    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bdd05e5e-e2fb-41c2-829a-91b190bcc7ca-model-cache\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 17:43:56.215272 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:56.215266    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bdd05e5e-e2fb-41c2-829a-91b190bcc7ca-dshm\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 17:43:56.215272 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:56.215275    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bdd05e5e-e2fb-41c2-829a-91b190bcc7ca-tls-certs\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 17:43:56.215272 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:56.215283    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rj646\" (UniqueName: \"kubernetes.io/projected/bdd05e5e-e2fb-41c2-829a-91b190bcc7ca-kube-api-access-rj646\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 17:43:56.676014 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:56.675977    2575 generic.go:356] "Generic (PLEG): container finished" podID="bdd05e5e-e2fb-41c2-829a-91b190bcc7ca" containerID="46cd2cbfe026514e09637841f3ca27bdbc89a8b4f7d6401138e96f948a5f56bb" exitCode=0
Jul 24 17:43:56.676198 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:56.676019    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-edf3838a-kserve-fb59c599f-hzkll"
Jul 24 17:43:56.676198 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:56.676067    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-edf3838a-kserve-fb59c599f-hzkll" event={"ID":"bdd05e5e-e2fb-41c2-829a-91b190bcc7ca","Type":"ContainerDied","Data":"46cd2cbfe026514e09637841f3ca27bdbc89a8b4f7d6401138e96f948a5f56bb"}
Jul 24 17:43:56.676198 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:56.676112    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-edf3838a-kserve-fb59c599f-hzkll" event={"ID":"bdd05e5e-e2fb-41c2-829a-91b190bcc7ca","Type":"ContainerDied","Data":"2c057cad429e6ca2cce681003fc60ab58852a73af718e91eee15d7f45bc6da69"}
Jul 24 17:43:56.676198 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:56.676130    2575 scope.go:117] "RemoveContainer" containerID="46cd2cbfe026514e09637841f3ca27bdbc89a8b4f7d6401138e96f948a5f56bb"
Jul 24 17:43:56.684922 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:56.684906    2575 scope.go:117] "RemoveContainer" containerID="46cd2cbfe026514e09637841f3ca27bdbc89a8b4f7d6401138e96f948a5f56bb"
Jul 24 17:43:56.685205 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:43:56.685188    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46cd2cbfe026514e09637841f3ca27bdbc89a8b4f7d6401138e96f948a5f56bb\": container with ID starting with 46cd2cbfe026514e09637841f3ca27bdbc89a8b4f7d6401138e96f948a5f56bb not found: ID does not exist" containerID="46cd2cbfe026514e09637841f3ca27bdbc89a8b4f7d6401138e96f948a5f56bb"
Jul 24 17:43:56.685260 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:56.685213    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46cd2cbfe026514e09637841f3ca27bdbc89a8b4f7d6401138e96f948a5f56bb"} err="failed to get container status \"46cd2cbfe026514e09637841f3ca27bdbc89a8b4f7d6401138e96f948a5f56bb\": rpc error: code = NotFound desc = could not find container \"46cd2cbfe026514e09637841f3ca27bdbc89a8b4f7d6401138e96f948a5f56bb\": container with ID starting with 46cd2cbfe026514e09637841f3ca27bdbc89a8b4f7d6401138e96f948a5f56bb not found: ID does not exist"
Jul 24 17:43:56.696865 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:56.696843    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-edf3838a-kserve-fb59c599f-hzkll"]
Jul 24 17:43:56.700595 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:56.700574    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-edf3838a-kserve-fb59c599f-hzkll"]
Jul 24 17:43:56.894640 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:56.894576    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-edf3838a-kserve-78b69bcb99-8lknz" podUID="8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf" containerName="main" containerID="cri-o://ce08a27959f18d12fdc830ca17bbe20c94aadcedc66f91704f9f2748c4187a2f" gracePeriod=45
Jul 24 17:43:57.143343 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:57.143318    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-edf3838a-kserve-78b69bcb99-8lknz"
Jul 24 17:43:57.202057 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:57.201998    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bdd05e5e-e2fb-41c2-829a-91b190bcc7ca" path="/var/lib/kubelet/pods/bdd05e5e-e2fb-41c2-829a-91b190bcc7ca/volumes"
Jul 24 17:43:57.223124 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:57.223091    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf-model-cache\") pod \"8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf\" (UID: \"8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf\") "
Jul 24 17:43:57.223257 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:57.223141    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf-home\") pod \"8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf\" (UID: \"8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf\") "
Jul 24 17:43:57.223257 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:57.223164    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf-tmp-dir\") pod \"8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf\" (UID: \"8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf\") "
Jul 24 17:43:57.223257 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:57.223207    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m66b8\" (UniqueName: \"kubernetes.io/projected/8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf-kube-api-access-m66b8\") pod \"8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf\" (UID: \"8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf\") "
Jul 24 17:43:57.223257 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:57.223224    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf-dshm\") pod \"8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf\" (UID: \"8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf\") "
Jul 24 17:43:57.223468 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:57.223266    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf-tls-certs\") pod \"8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf\" (UID: \"8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf\") "
Jul 24 17:43:57.223468 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:57.223389    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf-home" (OuterVolumeSpecName: "home") pod "8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf" (UID: "8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:43:57.223468 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:57.223399    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf-model-cache" (OuterVolumeSpecName: "model-cache") pod "8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf" (UID: "8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:43:57.223609 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:57.223486    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf" (UID: "8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:43:57.223609 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:57.223545    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf-model-cache\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 17:43:57.223609 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:57.223567    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf-home\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 17:43:57.225379 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:57.225356    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf-dshm" (OuterVolumeSpecName: "dshm") pod "8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf" (UID: "8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:43:57.225487 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:57.225374    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf" (UID: "8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:43:57.225487 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:57.225445    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf-kube-api-access-m66b8" (OuterVolumeSpecName: "kube-api-access-m66b8") pod "8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf" (UID: "8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf"). InnerVolumeSpecName "kube-api-access-m66b8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:43:57.324888 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:57.324855    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf-tls-certs\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 17:43:57.324888 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:57.324882    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf-tmp-dir\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 17:43:57.324888 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:57.324893    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m66b8\" (UniqueName: \"kubernetes.io/projected/8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf-kube-api-access-m66b8\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 17:43:57.325136 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:57.324902    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf-dshm\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 17:43:57.688140 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:57.688052    2575 generic.go:356] "Generic (PLEG): container finished" podID="8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf" containerID="ce08a27959f18d12fdc830ca17bbe20c94aadcedc66f91704f9f2748c4187a2f" exitCode=0
Jul 24 17:43:57.688140 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:57.688093    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-edf3838a-kserve-78b69bcb99-8lknz" event={"ID":"8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf","Type":"ContainerDied","Data":"ce08a27959f18d12fdc830ca17bbe20c94aadcedc66f91704f9f2748c4187a2f"}
Jul 24 17:43:57.688140 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:57.688097    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-edf3838a-kserve-78b69bcb99-8lknz"
Jul 24 17:43:57.688140 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:57.688118    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-edf3838a-kserve-78b69bcb99-8lknz" event={"ID":"8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf","Type":"ContainerDied","Data":"11615c1828a34d2ca28efee8dbc77c0833561ae4550865a3ff989fd7e75f0a80"}
Jul 24 17:43:57.688140 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:57.688134    2575 scope.go:117] "RemoveContainer" containerID="ce08a27959f18d12fdc830ca17bbe20c94aadcedc66f91704f9f2748c4187a2f"
Jul 24 17:43:57.696820 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:57.696800    2575 scope.go:117] "RemoveContainer" containerID="ce08a27959f18d12fdc830ca17bbe20c94aadcedc66f91704f9f2748c4187a2f"
Jul 24 17:43:57.697121 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:43:57.697095    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce08a27959f18d12fdc830ca17bbe20c94aadcedc66f91704f9f2748c4187a2f\": container with ID starting with ce08a27959f18d12fdc830ca17bbe20c94aadcedc66f91704f9f2748c4187a2f not found: ID does not exist" containerID="ce08a27959f18d12fdc830ca17bbe20c94aadcedc66f91704f9f2748c4187a2f"
Jul 24 17:43:57.697209 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:57.697125    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce08a27959f18d12fdc830ca17bbe20c94aadcedc66f91704f9f2748c4187a2f"} err="failed to get container status \"ce08a27959f18d12fdc830ca17bbe20c94aadcedc66f91704f9f2748c4187a2f\": rpc error: code = NotFound desc = could not find container \"ce08a27959f18d12fdc830ca17bbe20c94aadcedc66f91704f9f2748c4187a2f\": container with ID starting with ce08a27959f18d12fdc830ca17bbe20c94aadcedc66f91704f9f2748c4187a2f not found: ID does not exist"
Jul 24 17:43:57.709111 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:57.709082    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-edf3838a-kserve-78b69bcb99-8lknz"]
Jul 24 17:43:57.712424 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:57.712399    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-edf3838a-kserve-78b69bcb99-8lknz"]
Jul 24 17:43:59.202151 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:43:59.202110    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf" path="/var/lib/kubelet/pods/8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf/volumes"
Jul 24 17:46:49.236322 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:46:49.236284    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:47:10.938079 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:47:10.938030    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:47:14.245720 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:47:14.245687    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:47:14.343377 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:47:14.343321    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:47:14.737863 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:47:14.737817    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:47:20.750550 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:47:20.750510    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:47:20.816991 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:47:20.816957    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:47:20.986788 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:47:20.986748    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:47:21.335199 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:47:21.335157    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:47:21.754496 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:47:21.754397    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:47:23.527039 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:47:23.527002    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:47:23.622059 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:47:23.622023    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:47:23.697867 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:47:23.697833    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:47:23.840557 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:47:23.840522    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:47:24.237080 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:47:24.236972    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:47:24.336752 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:47:24.336703    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:47:45.113220 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:47:45.113185    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82s5l_010c8b81-c5f5-43c3-b1bb-c812fcde2d6f/ovn-acl-logging/0.log"
Jul 24 17:47:45.118558 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:47:45.118532    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82s5l_010c8b81-c5f5-43c3-b1bb-c812fcde2d6f/ovn-acl-logging/0.log"
Jul 24 17:47:59.583202 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:47:59.583166    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:47:59.650223 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:47:59.650190    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:47:59.756796 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:47:59.756762    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:48:02.477916 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:48:02.477878    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:48:04.175788 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:48:04.175743    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:48:04.361057 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:48:04.361018    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:48:04.591712 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:48:04.591672    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:48:04.925541 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:48:04.925441    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:48:05.013841 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:48:05.013807    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:48:05.112774 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:48:05.112740    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:48:05.479586 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:48:05.479536    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:48:05.827536 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:48:05.827499    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:48:07.784187 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:48:07.784140    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:48:07.945590 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:48:07.945552    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:48:08.039514 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:48:08.039426    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:48:08.489176 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:48:08.489074    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:48:08.586464 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:48:08.586413    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:48:43.559437 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:48:43.559355    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:48:44.659484 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:48:44.659448    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:48:48.005240 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:48:48.005187    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:48:48.211172 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:48:48.211132    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:48:48.503932 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:48:48.503894    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:48:48.782325 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:48:48.782293    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:48:49.143667 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:48:49.143565    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:48:49.537337 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:48:49.537305    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:48:52.055066 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:48:52.055023    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:48:52.235288 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:48:52.235255    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:48:52.370627 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:48:52.370536    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:48:52.495266 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:48:52.495229    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:48:53.060293 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:48:53.060263    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:48:53.188611 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:48:53.188578    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:49:28.522773 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:49:28.522735    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:49:28.611057 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:49:28.611017    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:49:28.685046 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:49:28.685010    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:49:32.951976 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:49:32.951919    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:49:34.317617 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:49:34.317575    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:49:34.526242 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:49:34.526206    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:49:34.779109 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:49:34.779022    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:49:35.117314 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:49:35.117281    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:49:35.438586 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:49:35.438506    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:49:37.213134 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:49:37.213090    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:49:37.307319 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:49:37.307281    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:49:37.397535 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:49:37.397499    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:49:37.925169 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:49:37.925135    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:49:38.059345 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:49:38.059314    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:49:38.249003 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:49:38.248889    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:50:12.937046 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:50:12.937011    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:50:13.057706 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:50:13.057677    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:50:13.175836 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:50:13.175802    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:50:17.235125 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:50:17.235089    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:50:17.426057 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:50:17.426016    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:50:17.704922 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:50:17.704880    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:50:18.202648 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:50:18.202617    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:50:18.317869 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:50:18.317834    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:50:18.415583 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:50:18.415552    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:50:20.039658 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:50:20.039628    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:50:27.476589 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:50:27.476548    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:50:27.579786 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:50:27.579745    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:50:27.685685 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:50:27.685647    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:50:27.786592 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:50:27.786556    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:50:28.238452 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:50:28.238362    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:50:54.284190 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:50:54.284105    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:51:01.374169 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:51:01.374129    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:51:01.501849 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:51:01.501811    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:51:01.609303 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:51:01.609261    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:51:17.565417 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:51:17.565368    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:51:23.631816 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:51:23.631777    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:51:23.737282 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:51:23.737221    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:51:23.834619 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:51:23.834581    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:51:34.447611 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:51:34.447559    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:51:35.281549 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:51:35.281512    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:51:40.005422 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:51:40.005388    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:51:42.847863 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:51:42.847826    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:51:42.928450 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:51:42.928416    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:51:43.032201 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:51:43.032169    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:51:43.128386 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:51:43.128296    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:51:44.006778 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:51:44.006745    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:51:44.107728 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:51:44.107697    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:51:44.213423 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:51:44.213383    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:51:46.003595 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:51:46.003562    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:51:52.479948 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:51:52.479899    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:51:55.558754 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:51:55.558713    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:51:55.712562 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:51:55.712521    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:51:56.328806 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:51:56.328773    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:52:04.032237 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:52:04.032201    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:52:04.133127 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:52:04.133089    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:52:04.313361 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:52:04.313268    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:52:04.693613 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:52:04.693521    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:52:04.785949 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:52:04.785916    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:52:07.971499 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:52:07.971417    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:52:08.157783 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:52:08.157728    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:52:08.305321 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:52:08.305287    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:52:08.511501 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:52:08.511468    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:52:09.265308 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:52:09.265272    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:52:09.462780 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:52:09.462745    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:52:12.456692 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:52:12.456654    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:52:13.174599 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:52:13.174553    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:52:13.295632 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:52:13.295599    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:52:13.654711 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:52:13.654675    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:52:20.646066 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:52:20.646020    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:52:20.756159 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:52:20.756128    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:52:31.724402 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:52:31.724364    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:52:31.821291 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:52:31.821252    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:52:31.893340 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:52:31.893308    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:52:36.200833 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:52:36.200795    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:52:36.688982 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:52:36.688925    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:52:42.608629 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:52:42.608593    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:52:42.723479 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:52:42.723430    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:52:42.921374 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:52:42.921247    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:52:43.204484 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:52:43.204382    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:52:43.305230 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:52:43.305198    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:52:43.417169 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:52:43.417140    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:52:43.566596 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:52:43.566556    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:52:45.139588 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:52:45.139563    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82s5l_010c8b81-c5f5-43c3-b1bb-c812fcde2d6f/ovn-acl-logging/0.log"
Jul 24 17:52:45.144429 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:52:45.144404    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82s5l_010c8b81-c5f5-43c3-b1bb-c812fcde2d6f/ovn-acl-logging/0.log"
Jul 24 17:52:50.100562 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:52:50.100525    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:52:50.220596 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:52:50.220560    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:52:50.344093 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:52:50.344052    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:52:50.489576 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:52:50.489464    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:52:56.795659 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:52:56.795611    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:52:56.893609 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:52:56.893489    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:53:03.825233 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:53:03.825191    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:53:04.228190 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:53:04.228088    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:53:04.471074 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:53:04.471028    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:53:07.154637 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:53:07.154607    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:53:07.252069 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:53:07.252036    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:53:07.468325 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:53:07.468235    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:53:07.571676 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:53:07.571639    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:53:08.192647 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:53:08.192614    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:53:08.306549 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:53:08.306514    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:53:11.701837 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:53:11.701800    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:53:27.617516 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:53:27.617470    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-9ae4eef5/e2e-lifecycle-model-9ae4eef5-kserve-7b7776644c-x6b6w"]
Jul 24 17:53:27.617981 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:53:27.617901    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdd05e5e-e2fb-41c2-829a-91b190bcc7ca" containerName="main"
Jul 24 17:53:27.617981 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:53:27.617916    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdd05e5e-e2fb-41c2-829a-91b190bcc7ca" containerName="main"
Jul 24 17:53:27.617981 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:53:27.617923    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf" containerName="main"
Jul 24 17:53:27.617981 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:53:27.617929    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf" containerName="main"
Jul 24 17:53:27.618119 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:53:27.618020    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="bdd05e5e-e2fb-41c2-829a-91b190bcc7ca" containerName="main"
Jul 24 17:53:27.618119 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:53:27.618029    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d711dfe-7ed3-4d35-85e4-3b1d8a59d9cf" containerName="main"
Jul 24 17:53:27.620891 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:53:27.620876    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-9ae4eef5/e2e-lifecycle-model-9ae4eef5-kserve-7b7776644c-x6b6w"
Jul 24 17:53:27.624447 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:53:27.624420    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-9ae4eef5\"/\"e2e-lifecycle-model-9ae4eef5-kserve-self-signed-certs\""
Jul 24 17:53:27.625317 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:53:27.625299    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-9ae4eef5\"/\"kube-root-ca.crt\""
Jul 24 17:53:27.625391 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:53:27.625316    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-9ae4eef5\"/\"default-dockercfg-wsrlp\""
Jul 24 17:53:27.625391 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:53:27.625380    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-9ae4eef5\"/\"openshift-service-ca.crt\""
Jul 24 17:53:27.636548 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:53:27.636517    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-9ae4eef5/e2e-lifecycle-model-9ae4eef5-kserve-7b7776644c-x6b6w"]
Jul 24 17:53:27.676098 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:53:27.676066    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:53:27.710996 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:53:27.710965    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd1d2534-b6e6-4e39-b96e-e5fb6d5de263-tls-certs\") pod \"e2e-lifecycle-model-9ae4eef5-kserve-7b7776644c-x6b6w\" (UID: \"fd1d2534-b6e6-4e39-b96e-e5fb6d5de263\") " pod="ai-tenant-e2e-mt-9ae4eef5/e2e-lifecycle-model-9ae4eef5-kserve-7b7776644c-x6b6w"
Jul 24 17:53:27.710996 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:53:27.711002    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd1d2534-b6e6-4e39-b96e-e5fb6d5de263-tmp-dir\") pod \"e2e-lifecycle-model-9ae4eef5-kserve-7b7776644c-x6b6w\" (UID: \"fd1d2534-b6e6-4e39-b96e-e5fb6d5de263\") " pod="ai-tenant-e2e-mt-9ae4eef5/e2e-lifecycle-model-9ae4eef5-kserve-7b7776644c-x6b6w"
Jul 24 17:53:27.711248 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:53:27.711064    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd1d2534-b6e6-4e39-b96e-e5fb6d5de263-dshm\") pod \"e2e-lifecycle-model-9ae4eef5-kserve-7b7776644c-x6b6w\" (UID: \"fd1d2534-b6e6-4e39-b96e-e5fb6d5de263\") " pod="ai-tenant-e2e-mt-9ae4eef5/e2e-lifecycle-model-9ae4eef5-kserve-7b7776644c-x6b6w"
Jul 24 17:53:27.711248 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:53:27.711104    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd1d2534-b6e6-4e39-b96e-e5fb6d5de263-model-cache\") pod \"e2e-lifecycle-model-9ae4eef5-kserve-7b7776644c-x6b6w\" (UID: \"fd1d2534-b6e6-4e39-b96e-e5fb6d5de263\") " pod="ai-tenant-e2e-mt-9ae4eef5/e2e-lifecycle-model-9ae4eef5-kserve-7b7776644c-x6b6w"
Jul 24 17:53:27.711248 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:53:27.711134    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd1d2534-b6e6-4e39-b96e-e5fb6d5de263-home\") pod \"e2e-lifecycle-model-9ae4eef5-kserve-7b7776644c-x6b6w\" (UID: \"fd1d2534-b6e6-4e39-b96e-e5fb6d5de263\") " pod="ai-tenant-e2e-mt-9ae4eef5/e2e-lifecycle-model-9ae4eef5-kserve-7b7776644c-x6b6w"
Jul 24 17:53:27.711248 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:53:27.711162    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4q6w\" (UniqueName: \"kubernetes.io/projected/fd1d2534-b6e6-4e39-b96e-e5fb6d5de263-kube-api-access-q4q6w\") pod \"e2e-lifecycle-model-9ae4eef5-kserve-7b7776644c-x6b6w\" (UID: \"fd1d2534-b6e6-4e39-b96e-e5fb6d5de263\") " pod="ai-tenant-e2e-mt-9ae4eef5/e2e-lifecycle-model-9ae4eef5-kserve-7b7776644c-x6b6w"
Jul 24 17:53:27.812160 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:53:27.812124    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd1d2534-b6e6-4e39-b96e-e5fb6d5de263-tmp-dir\") pod \"e2e-lifecycle-model-9ae4eef5-kserve-7b7776644c-x6b6w\" (UID: \"fd1d2534-b6e6-4e39-b96e-e5fb6d5de263\") " pod="ai-tenant-e2e-mt-9ae4eef5/e2e-lifecycle-model-9ae4eef5-kserve-7b7776644c-x6b6w"
Jul 24 17:53:27.812160 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:53:27.812163    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd1d2534-b6e6-4e39-b96e-e5fb6d5de263-dshm\") pod \"e2e-lifecycle-model-9ae4eef5-kserve-7b7776644c-x6b6w\" (UID: \"fd1d2534-b6e6-4e39-b96e-e5fb6d5de263\") " pod="ai-tenant-e2e-mt-9ae4eef5/e2e-lifecycle-model-9ae4eef5-kserve-7b7776644c-x6b6w"
Jul 24 17:53:27.812411 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:53:27.812183    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd1d2534-b6e6-4e39-b96e-e5fb6d5de263-model-cache\") pod \"e2e-lifecycle-model-9ae4eef5-kserve-7b7776644c-x6b6w\" (UID: \"fd1d2534-b6e6-4e39-b96e-e5fb6d5de263\") " pod="ai-tenant-e2e-mt-9ae4eef5/e2e-lifecycle-model-9ae4eef5-kserve-7b7776644c-x6b6w"
Jul 24 17:53:27.812411 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:53:27.812203    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd1d2534-b6e6-4e39-b96e-e5fb6d5de263-home\") pod \"e2e-lifecycle-model-9ae4eef5-kserve-7b7776644c-x6b6w\" (UID: \"fd1d2534-b6e6-4e39-b96e-e5fb6d5de263\") " pod="ai-tenant-e2e-mt-9ae4eef5/e2e-lifecycle-model-9ae4eef5-kserve-7b7776644c-x6b6w"
Jul 24 17:53:27.812411 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:53:27.812224    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4q6w\" (UniqueName: \"kubernetes.io/projected/fd1d2534-b6e6-4e39-b96e-e5fb6d5de263-kube-api-access-q4q6w\") pod \"e2e-lifecycle-model-9ae4eef5-kserve-7b7776644c-x6b6w\" (UID: \"fd1d2534-b6e6-4e39-b96e-e5fb6d5de263\") " pod="ai-tenant-e2e-mt-9ae4eef5/e2e-lifecycle-model-9ae4eef5-kserve-7b7776644c-x6b6w"
Jul 24 17:53:27.812411 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:53:27.812309    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd1d2534-b6e6-4e39-b96e-e5fb6d5de263-tls-certs\") pod \"e2e-lifecycle-model-9ae4eef5-kserve-7b7776644c-x6b6w\" (UID: \"fd1d2534-b6e6-4e39-b96e-e5fb6d5de263\") " pod="ai-tenant-e2e-mt-9ae4eef5/e2e-lifecycle-model-9ae4eef5-kserve-7b7776644c-x6b6w"
Jul 24 17:53:27.812694 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:53:27.812667    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd1d2534-b6e6-4e39-b96e-e5fb6d5de263-tmp-dir\") pod \"e2e-lifecycle-model-9ae4eef5-kserve-7b7776644c-x6b6w\" (UID: \"fd1d2534-b6e6-4e39-b96e-e5fb6d5de263\") " pod="ai-tenant-e2e-mt-9ae4eef5/e2e-lifecycle-model-9ae4eef5-kserve-7b7776644c-x6b6w"
Jul 24 17:53:27.812766 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:53:27.812700    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd1d2534-b6e6-4e39-b96e-e5fb6d5de263-home\") pod \"e2e-lifecycle-model-9ae4eef5-kserve-7b7776644c-x6b6w\" (UID: \"fd1d2534-b6e6-4e39-b96e-e5fb6d5de263\") " pod="ai-tenant-e2e-mt-9ae4eef5/e2e-lifecycle-model-9ae4eef5-kserve-7b7776644c-x6b6w"
Jul 24 17:53:27.812853 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:53:27.812836    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd1d2534-b6e6-4e39-b96e-e5fb6d5de263-model-cache\") pod \"e2e-lifecycle-model-9ae4eef5-kserve-7b7776644c-x6b6w\" (UID: \"fd1d2534-b6e6-4e39-b96e-e5fb6d5de263\") " pod="ai-tenant-e2e-mt-9ae4eef5/e2e-lifecycle-model-9ae4eef5-kserve-7b7776644c-x6b6w"
Jul 24 17:53:27.814437 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:53:27.814410    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd1d2534-b6e6-4e39-b96e-e5fb6d5de263-dshm\") pod \"e2e-lifecycle-model-9ae4eef5-kserve-7b7776644c-x6b6w\" (UID: \"fd1d2534-b6e6-4e39-b96e-e5fb6d5de263\") " pod="ai-tenant-e2e-mt-9ae4eef5/e2e-lifecycle-model-9ae4eef5-kserve-7b7776644c-x6b6w"
Jul 24 17:53:27.814729 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:53:27.814712    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd1d2534-b6e6-4e39-b96e-e5fb6d5de263-tls-certs\") pod \"e2e-lifecycle-model-9ae4eef5-kserve-7b7776644c-x6b6w\" (UID: \"fd1d2534-b6e6-4e39-b96e-e5fb6d5de263\") " pod="ai-tenant-e2e-mt-9ae4eef5/e2e-lifecycle-model-9ae4eef5-kserve-7b7776644c-x6b6w"
Jul 24 17:53:27.820922 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:53:27.820899    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4q6w\" (UniqueName: \"kubernetes.io/projected/fd1d2534-b6e6-4e39-b96e-e5fb6d5de263-kube-api-access-q4q6w\") pod \"e2e-lifecycle-model-9ae4eef5-kserve-7b7776644c-x6b6w\" (UID: \"fd1d2534-b6e6-4e39-b96e-e5fb6d5de263\") " pod="ai-tenant-e2e-mt-9ae4eef5/e2e-lifecycle-model-9ae4eef5-kserve-7b7776644c-x6b6w"
Jul 24 17:53:27.930185 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:53:27.930099    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-9ae4eef5/e2e-lifecycle-model-9ae4eef5-kserve-7b7776644c-x6b6w"
Jul 24 17:53:28.076764 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:53:28.076728    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-9ae4eef5/e2e-lifecycle-model-9ae4eef5-kserve-7b7776644c-x6b6w"]
Jul 24 17:53:28.079680 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:53:28.079650    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfd1d2534_b6e6_4e39_b96e_e5fb6d5de263.slice/crio-3d4227bd0ed8aacf5399024b172f42b8e3afe24f80a863de260e7e210e29117c WatchSource:0}: Error finding container 3d4227bd0ed8aacf5399024b172f42b8e3afe24f80a863de260e7e210e29117c: Status 404 returned error can't find the container with id 3d4227bd0ed8aacf5399024b172f42b8e3afe24f80a863de260e7e210e29117c
Jul 24 17:53:28.118566 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:53:28.118533    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-9ae4eef5/e2e-lifecycle-model-9ae4eef5-kserve-7b7776644c-x6b6w" event={"ID":"fd1d2534-b6e6-4e39-b96e-e5fb6d5de263","Type":"ContainerStarted","Data":"3d4227bd0ed8aacf5399024b172f42b8e3afe24f80a863de260e7e210e29117c"}
Jul 24 17:53:29.124926 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:53:29.124890    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-9ae4eef5/e2e-lifecycle-model-9ae4eef5-kserve-7b7776644c-x6b6w" event={"ID":"fd1d2534-b6e6-4e39-b96e-e5fb6d5de263","Type":"ContainerStarted","Data":"9bcfc4c11a97835eccdc459802710911231b71d2216c63eedf432d2b8634935c"}
Jul 24 17:53:29.165576 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:53:29.165521    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-9ae4eef5/e2e-lifecycle-model-9ae4eef5-kserve-7b7776644c-x6b6w" podStartSLOduration=2.165504222 podStartE2EDuration="2.165504222s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:53:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:53:29.164283969 +0000 UTC m=+2144.645659589" watchObservedRunningTime="2026-07-24 17:53:29.165504222 +0000 UTC m=+2144.646879867"
Jul 24 17:53:37.930777 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:53:37.930681    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-9ae4eef5/e2e-lifecycle-model-9ae4eef5-kserve-7b7776644c-x6b6w"
Jul 24 17:53:37.930777 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:53:37.930734    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-9ae4eef5/e2e-lifecycle-model-9ae4eef5-kserve-7b7776644c-x6b6w"
Jul 24 17:53:37.943319 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:53:37.943290    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-9ae4eef5/e2e-lifecycle-model-9ae4eef5-kserve-7b7776644c-x6b6w"
Jul 24 17:53:38.173060 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:53:38.173025    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-9ae4eef5/e2e-lifecycle-model-9ae4eef5-kserve-7b7776644c-x6b6w"
Jul 24 17:54:12.542545 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:54:12.542507    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:54:14.079219 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:54:14.079176    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:54:16.857533 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:54:16.857483    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:54:20.333568 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:54:20.333530    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:54:25.305979 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:54:25.305924    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-9ae4eef5/e2e-lifecycle-model-9ae4eef5-kserve-7b7776644c-x6b6w"]
Jul 24 17:54:25.402352 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:54:25.402306    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:54:40.324915 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:54:40.324877    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-9ae4eef5/e2e-lifecycle-model-9ae4eef5-kserve-7b7776644c-x6b6w" podUID="fd1d2534-b6e6-4e39-b96e-e5fb6d5de263" containerName="main" containerID="cri-o://9bcfc4c11a97835eccdc459802710911231b71d2216c63eedf432d2b8634935c" gracePeriod=45
Jul 24 17:54:40.572076 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:54:40.572048    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-9ae4eef5/e2e-lifecycle-model-9ae4eef5-kserve-7b7776644c-x6b6w"
Jul 24 17:54:40.671650 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:54:40.671555    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd1d2534-b6e6-4e39-b96e-e5fb6d5de263-tls-certs\") pod \"fd1d2534-b6e6-4e39-b96e-e5fb6d5de263\" (UID: \"fd1d2534-b6e6-4e39-b96e-e5fb6d5de263\") "
Jul 24 17:54:40.671650 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:54:40.671593    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd1d2534-b6e6-4e39-b96e-e5fb6d5de263-home\") pod \"fd1d2534-b6e6-4e39-b96e-e5fb6d5de263\" (UID: \"fd1d2534-b6e6-4e39-b96e-e5fb6d5de263\") "
Jul 24 17:54:40.671865 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:54:40.671653    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd1d2534-b6e6-4e39-b96e-e5fb6d5de263-tmp-dir\") pod \"fd1d2534-b6e6-4e39-b96e-e5fb6d5de263\" (UID: \"fd1d2534-b6e6-4e39-b96e-e5fb6d5de263\") "
Jul 24 17:54:40.671865 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:54:40.671670    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q4q6w\" (UniqueName: \"kubernetes.io/projected/fd1d2534-b6e6-4e39-b96e-e5fb6d5de263-kube-api-access-q4q6w\") pod \"fd1d2534-b6e6-4e39-b96e-e5fb6d5de263\" (UID: \"fd1d2534-b6e6-4e39-b96e-e5fb6d5de263\") "
Jul 24 17:54:40.671865 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:54:40.671689    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd1d2534-b6e6-4e39-b96e-e5fb6d5de263-model-cache\") pod \"fd1d2534-b6e6-4e39-b96e-e5fb6d5de263\" (UID: \"fd1d2534-b6e6-4e39-b96e-e5fb6d5de263\") "
Jul 24 17:54:40.671865 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:54:40.671790    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd1d2534-b6e6-4e39-b96e-e5fb6d5de263-dshm\") pod \"fd1d2534-b6e6-4e39-b96e-e5fb6d5de263\" (UID: \"fd1d2534-b6e6-4e39-b96e-e5fb6d5de263\") "
Jul 24 17:54:40.672108 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:54:40.671971    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd1d2534-b6e6-4e39-b96e-e5fb6d5de263-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fd1d2534-b6e6-4e39-b96e-e5fb6d5de263" (UID: "fd1d2534-b6e6-4e39-b96e-e5fb6d5de263"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:54:40.672108 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:54:40.671996    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd1d2534-b6e6-4e39-b96e-e5fb6d5de263-home" (OuterVolumeSpecName: "home") pod "fd1d2534-b6e6-4e39-b96e-e5fb6d5de263" (UID: "fd1d2534-b6e6-4e39-b96e-e5fb6d5de263"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:54:40.672198 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:54:40.672116    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd1d2534-b6e6-4e39-b96e-e5fb6d5de263-home\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 17:54:40.672198 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:54:40.672132    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd1d2534-b6e6-4e39-b96e-e5fb6d5de263-tmp-dir\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 17:54:40.672198 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:54:40.672107    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd1d2534-b6e6-4e39-b96e-e5fb6d5de263-model-cache" (OuterVolumeSpecName: "model-cache") pod "fd1d2534-b6e6-4e39-b96e-e5fb6d5de263" (UID: "fd1d2534-b6e6-4e39-b96e-e5fb6d5de263"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:54:40.674015 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:54:40.673989    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd1d2534-b6e6-4e39-b96e-e5fb6d5de263-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fd1d2534-b6e6-4e39-b96e-e5fb6d5de263" (UID: "fd1d2534-b6e6-4e39-b96e-e5fb6d5de263"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:54:40.674015 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:54:40.673997    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd1d2534-b6e6-4e39-b96e-e5fb6d5de263-dshm" (OuterVolumeSpecName: "dshm") pod "fd1d2534-b6e6-4e39-b96e-e5fb6d5de263" (UID: "fd1d2534-b6e6-4e39-b96e-e5fb6d5de263"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:54:40.674015 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:54:40.674013    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd1d2534-b6e6-4e39-b96e-e5fb6d5de263-kube-api-access-q4q6w" (OuterVolumeSpecName: "kube-api-access-q4q6w") pod "fd1d2534-b6e6-4e39-b96e-e5fb6d5de263" (UID: "fd1d2534-b6e6-4e39-b96e-e5fb6d5de263"). InnerVolumeSpecName "kube-api-access-q4q6w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:54:40.773499 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:54:40.773461    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q4q6w\" (UniqueName: \"kubernetes.io/projected/fd1d2534-b6e6-4e39-b96e-e5fb6d5de263-kube-api-access-q4q6w\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 17:54:40.773499 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:54:40.773493    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd1d2534-b6e6-4e39-b96e-e5fb6d5de263-model-cache\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 17:54:40.773499 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:54:40.773506    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd1d2534-b6e6-4e39-b96e-e5fb6d5de263-dshm\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 17:54:40.773742 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:54:40.773517    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd1d2534-b6e6-4e39-b96e-e5fb6d5de263-tls-certs\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 17:54:41.430286 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:54:41.430231    2575 generic.go:356] "Generic (PLEG): container finished" podID="fd1d2534-b6e6-4e39-b96e-e5fb6d5de263" containerID="9bcfc4c11a97835eccdc459802710911231b71d2216c63eedf432d2b8634935c" exitCode=0
Jul 24 17:54:41.430694 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:54:41.430308    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-9ae4eef5/e2e-lifecycle-model-9ae4eef5-kserve-7b7776644c-x6b6w"
Jul 24 17:54:41.430694 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:54:41.430312    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-9ae4eef5/e2e-lifecycle-model-9ae4eef5-kserve-7b7776644c-x6b6w" event={"ID":"fd1d2534-b6e6-4e39-b96e-e5fb6d5de263","Type":"ContainerDied","Data":"9bcfc4c11a97835eccdc459802710911231b71d2216c63eedf432d2b8634935c"}
Jul 24 17:54:41.430694 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:54:41.430364    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-9ae4eef5/e2e-lifecycle-model-9ae4eef5-kserve-7b7776644c-x6b6w" event={"ID":"fd1d2534-b6e6-4e39-b96e-e5fb6d5de263","Type":"ContainerDied","Data":"3d4227bd0ed8aacf5399024b172f42b8e3afe24f80a863de260e7e210e29117c"}
Jul 24 17:54:41.430694 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:54:41.430387    2575 scope.go:117] "RemoveContainer" containerID="9bcfc4c11a97835eccdc459802710911231b71d2216c63eedf432d2b8634935c"
Jul 24 17:54:41.438917 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:54:41.438900    2575 scope.go:117] "RemoveContainer" containerID="9bcfc4c11a97835eccdc459802710911231b71d2216c63eedf432d2b8634935c"
Jul 24 17:54:41.439200 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:54:41.439178    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9bcfc4c11a97835eccdc459802710911231b71d2216c63eedf432d2b8634935c\": container with ID starting with 9bcfc4c11a97835eccdc459802710911231b71d2216c63eedf432d2b8634935c not found: ID does not exist" containerID="9bcfc4c11a97835eccdc459802710911231b71d2216c63eedf432d2b8634935c"
Jul 24 17:54:41.439248 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:54:41.439214    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bcfc4c11a97835eccdc459802710911231b71d2216c63eedf432d2b8634935c"} err="failed to get container status \"9bcfc4c11a97835eccdc459802710911231b71d2216c63eedf432d2b8634935c\": rpc error: code = NotFound desc = could not find container \"9bcfc4c11a97835eccdc459802710911231b71d2216c63eedf432d2b8634935c\": container with ID starting with 9bcfc4c11a97835eccdc459802710911231b71d2216c63eedf432d2b8634935c not found: ID does not exist"
Jul 24 17:54:41.451834 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:54:41.451804    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-9ae4eef5/e2e-lifecycle-model-9ae4eef5-kserve-7b7776644c-x6b6w"]
Jul 24 17:54:41.454163 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:54:41.454139    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-9ae4eef5/e2e-lifecycle-model-9ae4eef5-kserve-7b7776644c-x6b6w"]
Jul 24 17:54:43.201274 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:54:43.201242    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd1d2534-b6e6-4e39-b96e-e5fb6d5de263" path="/var/lib/kubelet/pods/fd1d2534-b6e6-4e39-b96e-e5fb6d5de263/volumes"
Jul 24 17:54:55.668047 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:54:55.668009    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:54:55.731860 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:54:55.731830    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:55:02.321187 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:55:02.321154    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:55:02.931615 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:55:02.931572    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:55:08.918657 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:55:08.918571    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:55:27.559069 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:55:27.559029    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:55:27.639785 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:55:27.639755    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:55:27.927301 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:55:27.927211    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:55:28.164003 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:55:28.163968    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:55:29.267800 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:55:29.267764    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:55:29.359106 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:55:29.359067    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:55:29.468190 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:55:29.468155    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:55:30.276412 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:55:30.276382    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:55:30.377092 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:55:30.377058    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:55:30.473021 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:55:30.472987    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:55:31.978086 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:55:31.978047    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:55:38.089877 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:55:38.089835    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:55:38.233753 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:55:38.233723    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:55:38.886612 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:55:38.886572    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:55:45.106486 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:55:45.106444    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:55:45.214849 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:55:45.214805    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:55:45.309379 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:55:45.309342    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:55:55.934465 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:55:55.934427    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:55:56.301848 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:55:56.301790    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:56:17.343195 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:56:17.343142    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:56:24.236140 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:56:24.236101    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:56:24.340755 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:56:24.340719    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:56:24.617205 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:56:24.617170    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:56:25.003301 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:56:25.003211    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:56:25.235839 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:56:25.235810    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:56:28.428132 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:56:28.428091    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:56:28.537081 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:56:28.537038    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:56:28.630029 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:56:28.629984    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:56:28.994560 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:56:28.994526    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:56:29.186553 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:56:29.186518    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:56:29.285401 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:56:29.285369    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:56:32.916434 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:56:32.916397    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:56:33.318774 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:56:33.318742    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:56:33.654715 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:56:33.654630    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:56:33.955446 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:56:33.955365    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:56:36.510298 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:56:36.510214    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:56:36.715387 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:56:36.715349    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:56:36.861743 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:56:36.861710    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:56:37.310151 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:56:37.310118    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:56:37.457597 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:56:37.457552    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:56:37.571127 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:56:37.571039    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:56:41.019283 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:56:41.019248    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:56:53.595252 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:56:53.595215    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-cdf40f/test-model-cdf40f-kserve-7d5f5f4c55-rwfd7"]
Jul 24 17:56:53.595691 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:56:53.595528    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd1d2534-b6e6-4e39-b96e-e5fb6d5de263" containerName="main"
Jul 24 17:56:53.595691 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:56:53.595538    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd1d2534-b6e6-4e39-b96e-e5fb6d5de263" containerName="main"
Jul 24 17:56:53.595691 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:56:53.595589    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd1d2534-b6e6-4e39-b96e-e5fb6d5de263" containerName="main"
Jul 24 17:56:53.598244 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:56:53.598227    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-cdf40f/test-model-cdf40f-kserve-7d5f5f4c55-rwfd7"
Jul 24 17:56:53.600842 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:56:53.600819    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-cdf40f\"/\"kube-root-ca.crt\""
Jul 24 17:56:53.601385 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:56:53.601364    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-cdf40f\"/\"openshift-service-ca.crt\""
Jul 24 17:56:53.601451 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:56:53.601406    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-cdf40f\"/\"default-dockercfg-wqklf\""
Jul 24 17:56:53.607445 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:56:53.602117    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-cdf40f\"/\"test-model-cdf40f-kserve-self-signed-certs\""
Jul 24 17:56:53.610507 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:56:53.610475    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-cdf40f/test-model-cdf40f-kserve-7d5f5f4c55-rwfd7"]
Jul 24 17:56:53.631152 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:56:53.631114    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:56:53.729820 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:56:53.729778    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/874ab5f9-4cd0-4b3f-a22e-bce52331c172-home\") pod \"test-model-cdf40f-kserve-7d5f5f4c55-rwfd7\" (UID: \"874ab5f9-4cd0-4b3f-a22e-bce52331c172\") " pod="ai-tenant-e2e-inf-a-cdf40f/test-model-cdf40f-kserve-7d5f5f4c55-rwfd7"
Jul 24 17:56:53.730050 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:56:53.729827    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/874ab5f9-4cd0-4b3f-a22e-bce52331c172-model-cache\") pod \"test-model-cdf40f-kserve-7d5f5f4c55-rwfd7\" (UID: \"874ab5f9-4cd0-4b3f-a22e-bce52331c172\") " pod="ai-tenant-e2e-inf-a-cdf40f/test-model-cdf40f-kserve-7d5f5f4c55-rwfd7"
Jul 24 17:56:53.730050 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:56:53.729877    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/874ab5f9-4cd0-4b3f-a22e-bce52331c172-tls-certs\") pod \"test-model-cdf40f-kserve-7d5f5f4c55-rwfd7\" (UID: \"874ab5f9-4cd0-4b3f-a22e-bce52331c172\") " pod="ai-tenant-e2e-inf-a-cdf40f/test-model-cdf40f-kserve-7d5f5f4c55-rwfd7"
Jul 24 17:56:53.730050 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:56:53.729919    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/874ab5f9-4cd0-4b3f-a22e-bce52331c172-dshm\") pod \"test-model-cdf40f-kserve-7d5f5f4c55-rwfd7\" (UID: \"874ab5f9-4cd0-4b3f-a22e-bce52331c172\") " pod="ai-tenant-e2e-inf-a-cdf40f/test-model-cdf40f-kserve-7d5f5f4c55-rwfd7"
Jul 24 17:56:53.730050 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:56:53.730012    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/874ab5f9-4cd0-4b3f-a22e-bce52331c172-tmp-dir\") pod \"test-model-cdf40f-kserve-7d5f5f4c55-rwfd7\" (UID: \"874ab5f9-4cd0-4b3f-a22e-bce52331c172\") " pod="ai-tenant-e2e-inf-a-cdf40f/test-model-cdf40f-kserve-7d5f5f4c55-rwfd7"
Jul 24 17:56:53.730050 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:56:53.730040    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vtrf\" (UniqueName: \"kubernetes.io/projected/874ab5f9-4cd0-4b3f-a22e-bce52331c172-kube-api-access-4vtrf\") pod \"test-model-cdf40f-kserve-7d5f5f4c55-rwfd7\" (UID: \"874ab5f9-4cd0-4b3f-a22e-bce52331c172\") " pod="ai-tenant-e2e-inf-a-cdf40f/test-model-cdf40f-kserve-7d5f5f4c55-rwfd7"
Jul 24 17:56:53.831274 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:56:53.831224    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/874ab5f9-4cd0-4b3f-a22e-bce52331c172-tls-certs\") pod \"test-model-cdf40f-kserve-7d5f5f4c55-rwfd7\" (UID: \"874ab5f9-4cd0-4b3f-a22e-bce52331c172\") " pod="ai-tenant-e2e-inf-a-cdf40f/test-model-cdf40f-kserve-7d5f5f4c55-rwfd7"
Jul 24 17:56:53.831274 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:56:53.831275    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/874ab5f9-4cd0-4b3f-a22e-bce52331c172-dshm\") pod \"test-model-cdf40f-kserve-7d5f5f4c55-rwfd7\" (UID: \"874ab5f9-4cd0-4b3f-a22e-bce52331c172\") " pod="ai-tenant-e2e-inf-a-cdf40f/test-model-cdf40f-kserve-7d5f5f4c55-rwfd7"
Jul 24 17:56:53.831468 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:56:53.831301    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/874ab5f9-4cd0-4b3f-a22e-bce52331c172-tmp-dir\") pod \"test-model-cdf40f-kserve-7d5f5f4c55-rwfd7\" (UID: \"874ab5f9-4cd0-4b3f-a22e-bce52331c172\") " pod="ai-tenant-e2e-inf-a-cdf40f/test-model-cdf40f-kserve-7d5f5f4c55-rwfd7"
Jul 24 17:56:53.831468 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:56:53.831319    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vtrf\" (UniqueName: \"kubernetes.io/projected/874ab5f9-4cd0-4b3f-a22e-bce52331c172-kube-api-access-4vtrf\") pod \"test-model-cdf40f-kserve-7d5f5f4c55-rwfd7\" (UID: \"874ab5f9-4cd0-4b3f-a22e-bce52331c172\") " pod="ai-tenant-e2e-inf-a-cdf40f/test-model-cdf40f-kserve-7d5f5f4c55-rwfd7"
Jul 24 17:56:53.831468 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:56:53.831388    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/874ab5f9-4cd0-4b3f-a22e-bce52331c172-home\") pod \"test-model-cdf40f-kserve-7d5f5f4c55-rwfd7\" (UID: \"874ab5f9-4cd0-4b3f-a22e-bce52331c172\") " pod="ai-tenant-e2e-inf-a-cdf40f/test-model-cdf40f-kserve-7d5f5f4c55-rwfd7"
Jul 24 17:56:53.831468 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:56:53.831423    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/874ab5f9-4cd0-4b3f-a22e-bce52331c172-model-cache\") pod \"test-model-cdf40f-kserve-7d5f5f4c55-rwfd7\" (UID: \"874ab5f9-4cd0-4b3f-a22e-bce52331c172\") " pod="ai-tenant-e2e-inf-a-cdf40f/test-model-cdf40f-kserve-7d5f5f4c55-rwfd7"
Jul 24 17:56:53.831837 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:56:53.831815    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/874ab5f9-4cd0-4b3f-a22e-bce52331c172-tmp-dir\") pod \"test-model-cdf40f-kserve-7d5f5f4c55-rwfd7\" (UID: \"874ab5f9-4cd0-4b3f-a22e-bce52331c172\") " pod="ai-tenant-e2e-inf-a-cdf40f/test-model-cdf40f-kserve-7d5f5f4c55-rwfd7"
Jul 24 17:56:53.831928 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:56:53.831875    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/874ab5f9-4cd0-4b3f-a22e-bce52331c172-model-cache\") pod \"test-model-cdf40f-kserve-7d5f5f4c55-rwfd7\" (UID: \"874ab5f9-4cd0-4b3f-a22e-bce52331c172\") " pod="ai-tenant-e2e-inf-a-cdf40f/test-model-cdf40f-kserve-7d5f5f4c55-rwfd7"
Jul 24 17:56:53.831928 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:56:53.831903    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/874ab5f9-4cd0-4b3f-a22e-bce52331c172-home\") pod \"test-model-cdf40f-kserve-7d5f5f4c55-rwfd7\" (UID: \"874ab5f9-4cd0-4b3f-a22e-bce52331c172\") " pod="ai-tenant-e2e-inf-a-cdf40f/test-model-cdf40f-kserve-7d5f5f4c55-rwfd7"
Jul 24 17:56:53.833511 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:56:53.833492    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/874ab5f9-4cd0-4b3f-a22e-bce52331c172-dshm\") pod \"test-model-cdf40f-kserve-7d5f5f4c55-rwfd7\" (UID: \"874ab5f9-4cd0-4b3f-a22e-bce52331c172\") " pod="ai-tenant-e2e-inf-a-cdf40f/test-model-cdf40f-kserve-7d5f5f4c55-rwfd7"
Jul 24 17:56:53.833787 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:56:53.833768    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/874ab5f9-4cd0-4b3f-a22e-bce52331c172-tls-certs\") pod \"test-model-cdf40f-kserve-7d5f5f4c55-rwfd7\" (UID: \"874ab5f9-4cd0-4b3f-a22e-bce52331c172\") " pod="ai-tenant-e2e-inf-a-cdf40f/test-model-cdf40f-kserve-7d5f5f4c55-rwfd7"
Jul 24 17:56:53.842353 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:56:53.842326    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vtrf\" (UniqueName: \"kubernetes.io/projected/874ab5f9-4cd0-4b3f-a22e-bce52331c172-kube-api-access-4vtrf\") pod \"test-model-cdf40f-kserve-7d5f5f4c55-rwfd7\" (UID: \"874ab5f9-4cd0-4b3f-a22e-bce52331c172\") " pod="ai-tenant-e2e-inf-a-cdf40f/test-model-cdf40f-kserve-7d5f5f4c55-rwfd7"
Jul 24 17:56:53.915255 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:56:53.915156    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-cdf40f/test-model-cdf40f-kserve-7d5f5f4c55-rwfd7"
Jul 24 17:56:54.045536 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:56:54.045508    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-cdf40f/test-model-cdf40f-kserve-7d5f5f4c55-rwfd7"]
Jul 24 17:56:54.048206 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:56:54.048182    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod874ab5f9_4cd0_4b3f_a22e_bce52331c172.slice/crio-ede7c5cefa5ca79d4aa201503cb308c8422444a84da67adfd94704dff25ba70e WatchSource:0}: Error finding container ede7c5cefa5ca79d4aa201503cb308c8422444a84da67adfd94704dff25ba70e: Status 404 returned error can't find the container with id ede7c5cefa5ca79d4aa201503cb308c8422444a84da67adfd94704dff25ba70e
Jul 24 17:56:54.997021 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:56:54.996979    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-cdf40f/test-model-cdf40f-kserve-7d5f5f4c55-rwfd7" event={"ID":"874ab5f9-4cd0-4b3f-a22e-bce52331c172","Type":"ContainerStarted","Data":"641268ab118454356a12e6dabb59a40e05141d6eb3358eb20e0f9eb235ee2786"}
Jul 24 17:56:54.997021 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:56:54.997025    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-cdf40f/test-model-cdf40f-kserve-7d5f5f4c55-rwfd7" event={"ID":"874ab5f9-4cd0-4b3f-a22e-bce52331c172","Type":"ContainerStarted","Data":"ede7c5cefa5ca79d4aa201503cb308c8422444a84da67adfd94704dff25ba70e"}
Jul 24 17:56:55.015171 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:56:55.015118    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-cdf40f/test-model-cdf40f-kserve-7d5f5f4c55-rwfd7" podStartSLOduration=2.015098712 podStartE2EDuration="2.015098712s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:56:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:56:55.014001948 +0000 UTC m=+2350.495377568" watchObservedRunningTime="2026-07-24 17:56:55.015098712 +0000 UTC m=+2350.496474331"
Jul 24 17:57:03.915530 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:57:03.915485    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-cdf40f/test-model-cdf40f-kserve-7d5f5f4c55-rwfd7"
Jul 24 17:57:03.915530 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:57:03.915534    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-cdf40f/test-model-cdf40f-kserve-7d5f5f4c55-rwfd7"
Jul 24 17:57:03.928335 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:57:03.928311    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-cdf40f/test-model-cdf40f-kserve-7d5f5f4c55-rwfd7"
Jul 24 17:57:04.049206 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:57:04.049176    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-cdf40f/test-model-cdf40f-kserve-7d5f5f4c55-rwfd7"
Jul 24 17:57:20.512118 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:57:20.512086    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-3922c3/test-model-3922c3-kserve-6f569b6857-qqxdx"]
Jul 24 17:57:20.516432 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:57:20.516406    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-3922c3/test-model-3922c3-kserve-6f569b6857-qqxdx"
Jul 24 17:57:20.520095 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:57:20.520065    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-3922c3\"/\"kube-root-ca.crt\""
Jul 24 17:57:20.520244 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:57:20.520107    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-3922c3\"/\"openshift-service-ca.crt\""
Jul 24 17:57:20.520244 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:57:20.520107    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-3922c3\"/\"default-dockercfg-7tkgn\""
Jul 24 17:57:20.520244 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:57:20.520108    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-3922c3\"/\"test-model-3922c3-kserve-self-signed-certs\""
Jul 24 17:57:20.526837 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:57:20.526815    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-3922c3/test-model-3922c3-kserve-6f569b6857-qqxdx"]
Jul 24 17:57:20.567051 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:57:20.567000    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:57:20.586275 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:57:20.586242    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb2561c9-7a30-4f71-aac8-fbc7c7bbef35-dshm\") pod \"test-model-3922c3-kserve-6f569b6857-qqxdx\" (UID: \"bb2561c9-7a30-4f71-aac8-fbc7c7bbef35\") " pod="ai-tenant-e2e-inf-b-3922c3/test-model-3922c3-kserve-6f569b6857-qqxdx"
Jul 24 17:57:20.586275 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:57:20.586277    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4qdx\" (UniqueName: \"kubernetes.io/projected/bb2561c9-7a30-4f71-aac8-fbc7c7bbef35-kube-api-access-j4qdx\") pod \"test-model-3922c3-kserve-6f569b6857-qqxdx\" (UID: \"bb2561c9-7a30-4f71-aac8-fbc7c7bbef35\") " pod="ai-tenant-e2e-inf-b-3922c3/test-model-3922c3-kserve-6f569b6857-qqxdx"
Jul 24 17:57:20.586492 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:57:20.586376    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb2561c9-7a30-4f71-aac8-fbc7c7bbef35-tmp-dir\") pod \"test-model-3922c3-kserve-6f569b6857-qqxdx\" (UID: \"bb2561c9-7a30-4f71-aac8-fbc7c7bbef35\") " pod="ai-tenant-e2e-inf-b-3922c3/test-model-3922c3-kserve-6f569b6857-qqxdx"
Jul 24 17:57:20.586492 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:57:20.586393    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb2561c9-7a30-4f71-aac8-fbc7c7bbef35-home\") pod \"test-model-3922c3-kserve-6f569b6857-qqxdx\" (UID: \"bb2561c9-7a30-4f71-aac8-fbc7c7bbef35\") " pod="ai-tenant-e2e-inf-b-3922c3/test-model-3922c3-kserve-6f569b6857-qqxdx"
Jul 24 17:57:20.586492 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:57:20.586407    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb2561c9-7a30-4f71-aac8-fbc7c7bbef35-model-cache\") pod \"test-model-3922c3-kserve-6f569b6857-qqxdx\" (UID: \"bb2561c9-7a30-4f71-aac8-fbc7c7bbef35\") " pod="ai-tenant-e2e-inf-b-3922c3/test-model-3922c3-kserve-6f569b6857-qqxdx"
Jul 24 17:57:20.586492 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:57:20.586488    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb2561c9-7a30-4f71-aac8-fbc7c7bbef35-tls-certs\") pod \"test-model-3922c3-kserve-6f569b6857-qqxdx\" (UID: \"bb2561c9-7a30-4f71-aac8-fbc7c7bbef35\") " pod="ai-tenant-e2e-inf-b-3922c3/test-model-3922c3-kserve-6f569b6857-qqxdx"
Jul 24 17:57:20.687815 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:57:20.687777    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb2561c9-7a30-4f71-aac8-fbc7c7bbef35-tmp-dir\") pod \"test-model-3922c3-kserve-6f569b6857-qqxdx\" (UID: \"bb2561c9-7a30-4f71-aac8-fbc7c7bbef35\") " pod="ai-tenant-e2e-inf-b-3922c3/test-model-3922c3-kserve-6f569b6857-qqxdx"
Jul 24 17:57:20.687815 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:57:20.687817    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb2561c9-7a30-4f71-aac8-fbc7c7bbef35-home\") pod \"test-model-3922c3-kserve-6f569b6857-qqxdx\" (UID: \"bb2561c9-7a30-4f71-aac8-fbc7c7bbef35\") " pod="ai-tenant-e2e-inf-b-3922c3/test-model-3922c3-kserve-6f569b6857-qqxdx"
Jul 24 17:57:20.688065 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:57:20.687840    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb2561c9-7a30-4f71-aac8-fbc7c7bbef35-model-cache\") pod \"test-model-3922c3-kserve-6f569b6857-qqxdx\" (UID: \"bb2561c9-7a30-4f71-aac8-fbc7c7bbef35\") " pod="ai-tenant-e2e-inf-b-3922c3/test-model-3922c3-kserve-6f569b6857-qqxdx"
Jul 24 17:57:20.688065 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:57:20.687879    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb2561c9-7a30-4f71-aac8-fbc7c7bbef35-tls-certs\") pod \"test-model-3922c3-kserve-6f569b6857-qqxdx\" (UID: \"bb2561c9-7a30-4f71-aac8-fbc7c7bbef35\") " pod="ai-tenant-e2e-inf-b-3922c3/test-model-3922c3-kserve-6f569b6857-qqxdx"
Jul 24 17:57:20.688065 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:57:20.687931    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb2561c9-7a30-4f71-aac8-fbc7c7bbef35-dshm\") pod \"test-model-3922c3-kserve-6f569b6857-qqxdx\" (UID: \"bb2561c9-7a30-4f71-aac8-fbc7c7bbef35\") " pod="ai-tenant-e2e-inf-b-3922c3/test-model-3922c3-kserve-6f569b6857-qqxdx"
Jul 24 17:57:20.688065 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:57:20.687981    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4qdx\" (UniqueName: \"kubernetes.io/projected/bb2561c9-7a30-4f71-aac8-fbc7c7bbef35-kube-api-access-j4qdx\") pod \"test-model-3922c3-kserve-6f569b6857-qqxdx\" (UID: \"bb2561c9-7a30-4f71-aac8-fbc7c7bbef35\") " pod="ai-tenant-e2e-inf-b-3922c3/test-model-3922c3-kserve-6f569b6857-qqxdx"
Jul 24 17:57:20.688297 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:57:20.688274    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb2561c9-7a30-4f71-aac8-fbc7c7bbef35-tmp-dir\") pod \"test-model-3922c3-kserve-6f569b6857-qqxdx\" (UID: \"bb2561c9-7a30-4f71-aac8-fbc7c7bbef35\") " pod="ai-tenant-e2e-inf-b-3922c3/test-model-3922c3-kserve-6f569b6857-qqxdx"
Jul 24 17:57:20.688371 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:57:20.688301    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb2561c9-7a30-4f71-aac8-fbc7c7bbef35-model-cache\") pod \"test-model-3922c3-kserve-6f569b6857-qqxdx\" (UID: \"bb2561c9-7a30-4f71-aac8-fbc7c7bbef35\") " pod="ai-tenant-e2e-inf-b-3922c3/test-model-3922c3-kserve-6f569b6857-qqxdx"
Jul 24 17:57:20.688425 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:57:20.688376    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb2561c9-7a30-4f71-aac8-fbc7c7bbef35-home\") pod \"test-model-3922c3-kserve-6f569b6857-qqxdx\" (UID: \"bb2561c9-7a30-4f71-aac8-fbc7c7bbef35\") " pod="ai-tenant-e2e-inf-b-3922c3/test-model-3922c3-kserve-6f569b6857-qqxdx"
Jul 24 17:57:20.690628 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:57:20.690596    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb2561c9-7a30-4f71-aac8-fbc7c7bbef35-tls-certs\") pod \"test-model-3922c3-kserve-6f569b6857-qqxdx\" (UID: \"bb2561c9-7a30-4f71-aac8-fbc7c7bbef35\") " pod="ai-tenant-e2e-inf-b-3922c3/test-model-3922c3-kserve-6f569b6857-qqxdx"
Jul 24 17:57:20.690628 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:57:20.690616    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb2561c9-7a30-4f71-aac8-fbc7c7bbef35-dshm\") pod \"test-model-3922c3-kserve-6f569b6857-qqxdx\" (UID: \"bb2561c9-7a30-4f71-aac8-fbc7c7bbef35\") " pod="ai-tenant-e2e-inf-b-3922c3/test-model-3922c3-kserve-6f569b6857-qqxdx"
Jul 24 17:57:20.696119 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:57:20.696094    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4qdx\" (UniqueName: \"kubernetes.io/projected/bb2561c9-7a30-4f71-aac8-fbc7c7bbef35-kube-api-access-j4qdx\") pod \"test-model-3922c3-kserve-6f569b6857-qqxdx\" (UID: \"bb2561c9-7a30-4f71-aac8-fbc7c7bbef35\") " pod="ai-tenant-e2e-inf-b-3922c3/test-model-3922c3-kserve-6f569b6857-qqxdx"
Jul 24 17:57:20.829532 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:57:20.829503    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-3922c3/test-model-3922c3-kserve-6f569b6857-qqxdx"
Jul 24 17:57:20.963907 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:57:20.963883    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-3922c3/test-model-3922c3-kserve-6f569b6857-qqxdx"]
Jul 24 17:57:20.966856 ip-10-0-139-113 kubenswrapper[2575]: W0724 17:57:20.966829    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbb2561c9_7a30_4f71_aac8_fbc7c7bbef35.slice/crio-acb2b6c94a8e0b66be5948c8809f75c3d07cba5b4e1668483385bfcf980edfdd WatchSource:0}: Error finding container acb2b6c94a8e0b66be5948c8809f75c3d07cba5b4e1668483385bfcf980edfdd: Status 404 returned error can't find the container with id acb2b6c94a8e0b66be5948c8809f75c3d07cba5b4e1668483385bfcf980edfdd
Jul 24 17:57:21.113911 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:57:21.113808    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-3922c3/test-model-3922c3-kserve-6f569b6857-qqxdx" event={"ID":"bb2561c9-7a30-4f71-aac8-fbc7c7bbef35","Type":"ContainerStarted","Data":"9cb3a28414a3a60498fcf6dd07301ea437da5e2d572d1f5d39bb305318b1850b"}
Jul 24 17:57:21.113911 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:57:21.113858    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-3922c3/test-model-3922c3-kserve-6f569b6857-qqxdx" event={"ID":"bb2561c9-7a30-4f71-aac8-fbc7c7bbef35","Type":"ContainerStarted","Data":"acb2b6c94a8e0b66be5948c8809f75c3d07cba5b4e1668483385bfcf980edfdd"}
Jul 24 17:57:21.132591 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:57:21.132539    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-3922c3/test-model-3922c3-kserve-6f569b6857-qqxdx" podStartSLOduration=1.132523915 podStartE2EDuration="1.132523915s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:57:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:57:21.130622933 +0000 UTC m=+2376.611998553" watchObservedRunningTime="2026-07-24 17:57:21.132523915 +0000 UTC m=+2376.613899535"
Jul 24 17:57:30.830106 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:57:30.830065    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-3922c3/test-model-3922c3-kserve-6f569b6857-qqxdx"
Jul 24 17:57:30.830106 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:57:30.830114    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-3922c3/test-model-3922c3-kserve-6f569b6857-qqxdx"
Jul 24 17:57:30.844642 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:57:30.844611    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-3922c3/test-model-3922c3-kserve-6f569b6857-qqxdx"
Jul 24 17:57:31.169301 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:57:31.169193    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-3922c3/test-model-3922c3-kserve-6f569b6857-qqxdx"
Jul 24 17:57:45.169986 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:57:45.169956    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82s5l_010c8b81-c5f5-43c3-b1bb-c812fcde2d6f/ovn-acl-logging/0.log"
Jul 24 17:57:45.172855 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:57:45.172834    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82s5l_010c8b81-c5f5-43c3-b1bb-c812fcde2d6f/ovn-acl-logging/0.log"
Jul 24 17:57:54.688654 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:57:54.688621    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:58:06.286331 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:06.286252    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-cdf40f/test-model-cdf40f-kserve-7d5f5f4c55-rwfd7"]
Jul 24 17:58:06.294873 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:58:06.294833    2575 secret.go:189] Couldn't get secret ai-tenant-e2e-inf-a-cdf40f/test-model-cdf40f-kserve-self-signed-certs: secret "test-model-cdf40f-kserve-self-signed-certs" not found
Jul 24 17:58:06.295058 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:58:06.294917    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/874ab5f9-4cd0-4b3f-a22e-bce52331c172-tls-certs podName:874ab5f9-4cd0-4b3f-a22e-bce52331c172 nodeName:}" failed. No retries permitted until 2026-07-24 17:58:06.794894109 +0000 UTC m=+2422.276269730 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/874ab5f9-4cd0-4b3f-a22e-bce52331c172-tls-certs") pod "test-model-cdf40f-kserve-7d5f5f4c55-rwfd7" (UID: "874ab5f9-4cd0-4b3f-a22e-bce52331c172") : secret "test-model-cdf40f-kserve-self-signed-certs" not found
Jul 24 17:58:06.307422 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:06.307393    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:58:06.798538 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:58:06.798490    2575 secret.go:189] Couldn't get secret ai-tenant-e2e-inf-a-cdf40f/test-model-cdf40f-kserve-self-signed-certs: secret "test-model-cdf40f-kserve-self-signed-certs" not found
Jul 24 17:58:06.798731 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:58:06.798588    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/874ab5f9-4cd0-4b3f-a22e-bce52331c172-tls-certs podName:874ab5f9-4cd0-4b3f-a22e-bce52331c172 nodeName:}" failed. No retries permitted until 2026-07-24 17:58:07.79857081 +0000 UTC m=+2423.279946412 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/874ab5f9-4cd0-4b3f-a22e-bce52331c172-tls-certs") pod "test-model-cdf40f-kserve-7d5f5f4c55-rwfd7" (UID: "874ab5f9-4cd0-4b3f-a22e-bce52331c172") : secret "test-model-cdf40f-kserve-self-signed-certs" not found
Jul 24 17:58:07.191987 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:07.191895    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-3922c3/test-model-3922c3-kserve-6f569b6857-qqxdx"]
Jul 24 17:58:07.216255 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:07.216220    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:58:07.807416 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:58:07.807379    2575 secret.go:189] Couldn't get secret ai-tenant-e2e-inf-a-cdf40f/test-model-cdf40f-kserve-self-signed-certs: secret "test-model-cdf40f-kserve-self-signed-certs" not found
Jul 24 17:58:07.807900 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:58:07.807456    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/874ab5f9-4cd0-4b3f-a22e-bce52331c172-tls-certs podName:874ab5f9-4cd0-4b3f-a22e-bce52331c172 nodeName:}" failed. No retries permitted until 2026-07-24 17:58:09.807438278 +0000 UTC m=+2425.288813876 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/874ab5f9-4cd0-4b3f-a22e-bce52331c172-tls-certs") pod "test-model-cdf40f-kserve-7d5f5f4c55-rwfd7" (UID: "874ab5f9-4cd0-4b3f-a22e-bce52331c172") : secret "test-model-cdf40f-kserve-self-signed-certs" not found
Jul 24 17:58:09.824371 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:58:09.824332    2575 secret.go:189] Couldn't get secret ai-tenant-e2e-inf-a-cdf40f/test-model-cdf40f-kserve-self-signed-certs: secret "test-model-cdf40f-kserve-self-signed-certs" not found
Jul 24 17:58:09.824795 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:58:09.824417    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/874ab5f9-4cd0-4b3f-a22e-bce52331c172-tls-certs podName:874ab5f9-4cd0-4b3f-a22e-bce52331c172 nodeName:}" failed. No retries permitted until 2026-07-24 17:58:13.824399772 +0000 UTC m=+2429.305775372 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/874ab5f9-4cd0-4b3f-a22e-bce52331c172-tls-certs") pod "test-model-cdf40f-kserve-7d5f5f4c55-rwfd7" (UID: "874ab5f9-4cd0-4b3f-a22e-bce52331c172") : secret "test-model-cdf40f-kserve-self-signed-certs" not found
Jul 24 17:58:13.856579 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:58:13.856539    2575 secret.go:189] Couldn't get secret ai-tenant-e2e-inf-a-cdf40f/test-model-cdf40f-kserve-self-signed-certs: secret "test-model-cdf40f-kserve-self-signed-certs" not found
Jul 24 17:58:13.857102 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:58:13.856631    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/874ab5f9-4cd0-4b3f-a22e-bce52331c172-tls-certs podName:874ab5f9-4cd0-4b3f-a22e-bce52331c172 nodeName:}" failed. No retries permitted until 2026-07-24 17:58:21.856611853 +0000 UTC m=+2437.337987462 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/874ab5f9-4cd0-4b3f-a22e-bce52331c172-tls-certs") pod "test-model-cdf40f-kserve-7d5f5f4c55-rwfd7" (UID: "874ab5f9-4cd0-4b3f-a22e-bce52331c172") : secret "test-model-cdf40f-kserve-self-signed-certs" not found
Jul 24 17:58:18.107198 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:18.107135    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:58:18.222087 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:18.222041    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:58:18.329464 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:18.329426    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:58:21.333160 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:21.333106    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-cdf40f/test-model-cdf40f-kserve-7d5f5f4c55-rwfd7" podUID="874ab5f9-4cd0-4b3f-a22e-bce52331c172" containerName="main" containerID="cri-o://641268ab118454356a12e6dabb59a40e05141d6eb3358eb20e0f9eb235ee2786" gracePeriod=45
Jul 24 17:58:21.576506 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:21.576477    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-cdf40f/test-model-cdf40f-kserve-7d5f5f4c55-rwfd7"
Jul 24 17:58:21.631703 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:21.631614    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/874ab5f9-4cd0-4b3f-a22e-bce52331c172-model-cache\") pod \"874ab5f9-4cd0-4b3f-a22e-bce52331c172\" (UID: \"874ab5f9-4cd0-4b3f-a22e-bce52331c172\") "
Jul 24 17:58:21.631703 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:21.631691    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/874ab5f9-4cd0-4b3f-a22e-bce52331c172-home\") pod \"874ab5f9-4cd0-4b3f-a22e-bce52331c172\" (UID: \"874ab5f9-4cd0-4b3f-a22e-bce52331c172\") "
Jul 24 17:58:21.631963 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:21.631757    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4vtrf\" (UniqueName: \"kubernetes.io/projected/874ab5f9-4cd0-4b3f-a22e-bce52331c172-kube-api-access-4vtrf\") pod \"874ab5f9-4cd0-4b3f-a22e-bce52331c172\" (UID: \"874ab5f9-4cd0-4b3f-a22e-bce52331c172\") "
Jul 24 17:58:21.631963 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:21.631794    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/874ab5f9-4cd0-4b3f-a22e-bce52331c172-dshm\") pod \"874ab5f9-4cd0-4b3f-a22e-bce52331c172\" (UID: \"874ab5f9-4cd0-4b3f-a22e-bce52331c172\") "
Jul 24 17:58:21.631963 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:21.631847    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/874ab5f9-4cd0-4b3f-a22e-bce52331c172-tls-certs\") pod \"874ab5f9-4cd0-4b3f-a22e-bce52331c172\" (UID: \"874ab5f9-4cd0-4b3f-a22e-bce52331c172\") "
Jul 24 17:58:21.631963 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:21.631867    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/874ab5f9-4cd0-4b3f-a22e-bce52331c172-tmp-dir\") pod \"874ab5f9-4cd0-4b3f-a22e-bce52331c172\" (UID: \"874ab5f9-4cd0-4b3f-a22e-bce52331c172\") "
Jul 24 17:58:21.631963 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:21.631904    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/874ab5f9-4cd0-4b3f-a22e-bce52331c172-model-cache" (OuterVolumeSpecName: "model-cache") pod "874ab5f9-4cd0-4b3f-a22e-bce52331c172" (UID: "874ab5f9-4cd0-4b3f-a22e-bce52331c172"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:58:21.632236 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:21.631974    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/874ab5f9-4cd0-4b3f-a22e-bce52331c172-home" (OuterVolumeSpecName: "home") pod "874ab5f9-4cd0-4b3f-a22e-bce52331c172" (UID: "874ab5f9-4cd0-4b3f-a22e-bce52331c172"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:58:21.632236 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:21.632204    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/874ab5f9-4cd0-4b3f-a22e-bce52331c172-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "874ab5f9-4cd0-4b3f-a22e-bce52331c172" (UID: "874ab5f9-4cd0-4b3f-a22e-bce52331c172"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:58:21.632310 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:21.632233    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/874ab5f9-4cd0-4b3f-a22e-bce52331c172-model-cache\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 17:58:21.632310 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:21.632259    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/874ab5f9-4cd0-4b3f-a22e-bce52331c172-home\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 17:58:21.633968 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:21.633926    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/874ab5f9-4cd0-4b3f-a22e-bce52331c172-kube-api-access-4vtrf" (OuterVolumeSpecName: "kube-api-access-4vtrf") pod "874ab5f9-4cd0-4b3f-a22e-bce52331c172" (UID: "874ab5f9-4cd0-4b3f-a22e-bce52331c172"). InnerVolumeSpecName "kube-api-access-4vtrf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:58:21.634100 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:21.634008    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/874ab5f9-4cd0-4b3f-a22e-bce52331c172-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "874ab5f9-4cd0-4b3f-a22e-bce52331c172" (UID: "874ab5f9-4cd0-4b3f-a22e-bce52331c172"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:58:21.634100 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:21.634018    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/874ab5f9-4cd0-4b3f-a22e-bce52331c172-dshm" (OuterVolumeSpecName: "dshm") pod "874ab5f9-4cd0-4b3f-a22e-bce52331c172" (UID: "874ab5f9-4cd0-4b3f-a22e-bce52331c172"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:58:21.733186 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:21.733157    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4vtrf\" (UniqueName: \"kubernetes.io/projected/874ab5f9-4cd0-4b3f-a22e-bce52331c172-kube-api-access-4vtrf\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 17:58:21.733186 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:21.733182    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/874ab5f9-4cd0-4b3f-a22e-bce52331c172-dshm\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 17:58:21.733186 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:21.733193    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/874ab5f9-4cd0-4b3f-a22e-bce52331c172-tls-certs\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 17:58:21.733422 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:21.733201    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/874ab5f9-4cd0-4b3f-a22e-bce52331c172-tmp-dir\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 17:58:22.210932 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:22.210859    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-3922c3/test-model-3922c3-kserve-6f569b6857-qqxdx" podUID="bb2561c9-7a30-4f71-aac8-fbc7c7bbef35" containerName="main" containerID="cri-o://9cb3a28414a3a60498fcf6dd07301ea437da5e2d572d1f5d39bb305318b1850b" gracePeriod=45
Jul 24 17:58:22.383616 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:22.383443    2575 generic.go:356] "Generic (PLEG): container finished" podID="bb2561c9-7a30-4f71-aac8-fbc7c7bbef35" containerID="9cb3a28414a3a60498fcf6dd07301ea437da5e2d572d1f5d39bb305318b1850b" exitCode=0
Jul 24 17:58:22.383616 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:22.383560    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-3922c3/test-model-3922c3-kserve-6f569b6857-qqxdx" event={"ID":"bb2561c9-7a30-4f71-aac8-fbc7c7bbef35","Type":"ContainerDied","Data":"9cb3a28414a3a60498fcf6dd07301ea437da5e2d572d1f5d39bb305318b1850b"}
Jul 24 17:58:22.384926 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:22.384902    2575 generic.go:356] "Generic (PLEG): container finished" podID="874ab5f9-4cd0-4b3f-a22e-bce52331c172" containerID="641268ab118454356a12e6dabb59a40e05141d6eb3358eb20e0f9eb235ee2786" exitCode=0
Jul 24 17:58:22.385065 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:22.384954    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-cdf40f/test-model-cdf40f-kserve-7d5f5f4c55-rwfd7"
Jul 24 17:58:22.385065 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:22.384977    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-cdf40f/test-model-cdf40f-kserve-7d5f5f4c55-rwfd7" event={"ID":"874ab5f9-4cd0-4b3f-a22e-bce52331c172","Type":"ContainerDied","Data":"641268ab118454356a12e6dabb59a40e05141d6eb3358eb20e0f9eb235ee2786"}
Jul 24 17:58:22.385065 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:22.385017    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-cdf40f/test-model-cdf40f-kserve-7d5f5f4c55-rwfd7" event={"ID":"874ab5f9-4cd0-4b3f-a22e-bce52331c172","Type":"ContainerDied","Data":"ede7c5cefa5ca79d4aa201503cb308c8422444a84da67adfd94704dff25ba70e"}
Jul 24 17:58:22.385065 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:22.385038    2575 scope.go:117] "RemoveContainer" containerID="641268ab118454356a12e6dabb59a40e05141d6eb3358eb20e0f9eb235ee2786"
Jul 24 17:58:22.394931 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:22.394866    2575 scope.go:117] "RemoveContainer" containerID="641268ab118454356a12e6dabb59a40e05141d6eb3358eb20e0f9eb235ee2786"
Jul 24 17:58:22.395188 ip-10-0-139-113 kubenswrapper[2575]: E0724 17:58:22.395169    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"641268ab118454356a12e6dabb59a40e05141d6eb3358eb20e0f9eb235ee2786\": container with ID starting with 641268ab118454356a12e6dabb59a40e05141d6eb3358eb20e0f9eb235ee2786 not found: ID does not exist" containerID="641268ab118454356a12e6dabb59a40e05141d6eb3358eb20e0f9eb235ee2786"
Jul 24 17:58:22.395268 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:22.395197    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"641268ab118454356a12e6dabb59a40e05141d6eb3358eb20e0f9eb235ee2786"} err="failed to get container status \"641268ab118454356a12e6dabb59a40e05141d6eb3358eb20e0f9eb235ee2786\": rpc error: code = NotFound desc = could not find container \"641268ab118454356a12e6dabb59a40e05141d6eb3358eb20e0f9eb235ee2786\": container with ID starting with 641268ab118454356a12e6dabb59a40e05141d6eb3358eb20e0f9eb235ee2786 not found: ID does not exist"
Jul 24 17:58:22.411062 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:22.411033    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-cdf40f/test-model-cdf40f-kserve-7d5f5f4c55-rwfd7"]
Jul 24 17:58:22.417793 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:22.417768    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-cdf40f/test-model-cdf40f-kserve-7d5f5f4c55-rwfd7"]
Jul 24 17:58:22.454323 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:22.454291    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:58:22.461686 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:22.461626    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-3922c3/test-model-3922c3-kserve-6f569b6857-qqxdx"
Jul 24 17:58:22.539797 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:22.539762    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb2561c9-7a30-4f71-aac8-fbc7c7bbef35-home\") pod \"bb2561c9-7a30-4f71-aac8-fbc7c7bbef35\" (UID: \"bb2561c9-7a30-4f71-aac8-fbc7c7bbef35\") "
Jul 24 17:58:22.540029 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:22.539829    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb2561c9-7a30-4f71-aac8-fbc7c7bbef35-dshm\") pod \"bb2561c9-7a30-4f71-aac8-fbc7c7bbef35\" (UID: \"bb2561c9-7a30-4f71-aac8-fbc7c7bbef35\") "
Jul 24 17:58:22.540029 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:22.539877    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb2561c9-7a30-4f71-aac8-fbc7c7bbef35-tmp-dir\") pod \"bb2561c9-7a30-4f71-aac8-fbc7c7bbef35\" (UID: \"bb2561c9-7a30-4f71-aac8-fbc7c7bbef35\") "
Jul 24 17:58:22.540029 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:22.539912    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb2561c9-7a30-4f71-aac8-fbc7c7bbef35-tls-certs\") pod \"bb2561c9-7a30-4f71-aac8-fbc7c7bbef35\" (UID: \"bb2561c9-7a30-4f71-aac8-fbc7c7bbef35\") "
Jul 24 17:58:22.540029 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:22.539977    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j4qdx\" (UniqueName: \"kubernetes.io/projected/bb2561c9-7a30-4f71-aac8-fbc7c7bbef35-kube-api-access-j4qdx\") pod \"bb2561c9-7a30-4f71-aac8-fbc7c7bbef35\" (UID: \"bb2561c9-7a30-4f71-aac8-fbc7c7bbef35\") "
Jul 24 17:58:22.540029 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:22.540003    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb2561c9-7a30-4f71-aac8-fbc7c7bbef35-model-cache\") pod \"bb2561c9-7a30-4f71-aac8-fbc7c7bbef35\" (UID: \"bb2561c9-7a30-4f71-aac8-fbc7c7bbef35\") "
Jul 24 17:58:22.540308 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:22.540094    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb2561c9-7a30-4f71-aac8-fbc7c7bbef35-home" (OuterVolumeSpecName: "home") pod "bb2561c9-7a30-4f71-aac8-fbc7c7bbef35" (UID: "bb2561c9-7a30-4f71-aac8-fbc7c7bbef35"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:58:22.540308 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:22.540185    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb2561c9-7a30-4f71-aac8-fbc7c7bbef35-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bb2561c9-7a30-4f71-aac8-fbc7c7bbef35" (UID: "bb2561c9-7a30-4f71-aac8-fbc7c7bbef35"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:58:22.540308 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:22.540298    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb2561c9-7a30-4f71-aac8-fbc7c7bbef35-model-cache" (OuterVolumeSpecName: "model-cache") pod "bb2561c9-7a30-4f71-aac8-fbc7c7bbef35" (UID: "bb2561c9-7a30-4f71-aac8-fbc7c7bbef35"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:58:22.540448 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:22.540369    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb2561c9-7a30-4f71-aac8-fbc7c7bbef35-tmp-dir\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 17:58:22.540448 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:22.540385    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb2561c9-7a30-4f71-aac8-fbc7c7bbef35-home\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 17:58:22.542220 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:22.542196    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb2561c9-7a30-4f71-aac8-fbc7c7bbef35-kube-api-access-j4qdx" (OuterVolumeSpecName: "kube-api-access-j4qdx") pod "bb2561c9-7a30-4f71-aac8-fbc7c7bbef35" (UID: "bb2561c9-7a30-4f71-aac8-fbc7c7bbef35"). InnerVolumeSpecName "kube-api-access-j4qdx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 17:58:22.542309 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:22.542200    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb2561c9-7a30-4f71-aac8-fbc7c7bbef35-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bb2561c9-7a30-4f71-aac8-fbc7c7bbef35" (UID: "bb2561c9-7a30-4f71-aac8-fbc7c7bbef35"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 17:58:22.542309 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:22.542198    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb2561c9-7a30-4f71-aac8-fbc7c7bbef35-dshm" (OuterVolumeSpecName: "dshm") pod "bb2561c9-7a30-4f71-aac8-fbc7c7bbef35" (UID: "bb2561c9-7a30-4f71-aac8-fbc7c7bbef35"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 17:58:22.641666 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:22.641627    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb2561c9-7a30-4f71-aac8-fbc7c7bbef35-tls-certs\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 17:58:22.641666 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:22.641660    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j4qdx\" (UniqueName: \"kubernetes.io/projected/bb2561c9-7a30-4f71-aac8-fbc7c7bbef35-kube-api-access-j4qdx\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 17:58:22.641666 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:22.641669    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb2561c9-7a30-4f71-aac8-fbc7c7bbef35-model-cache\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 17:58:22.641913 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:22.641680    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb2561c9-7a30-4f71-aac8-fbc7c7bbef35-dshm\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 17:58:22.885205 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:22.885171    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:58:23.201670 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:23.201590    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="874ab5f9-4cd0-4b3f-a22e-bce52331c172" path="/var/lib/kubelet/pods/874ab5f9-4cd0-4b3f-a22e-bce52331c172/volumes"
Jul 24 17:58:23.390791 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:23.390758    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-3922c3/test-model-3922c3-kserve-6f569b6857-qqxdx"
Jul 24 17:58:23.391248 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:23.390800    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-3922c3/test-model-3922c3-kserve-6f569b6857-qqxdx" event={"ID":"bb2561c9-7a30-4f71-aac8-fbc7c7bbef35","Type":"ContainerDied","Data":"acb2b6c94a8e0b66be5948c8809f75c3d07cba5b4e1668483385bfcf980edfdd"}
Jul 24 17:58:23.391248 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:23.390871    2575 scope.go:117] "RemoveContainer" containerID="9cb3a28414a3a60498fcf6dd07301ea437da5e2d572d1f5d39bb305318b1850b"
Jul 24 17:58:23.407115 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:23.407089    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-3922c3/test-model-3922c3-kserve-6f569b6857-qqxdx"]
Jul 24 17:58:23.411568 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:23.411545    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-3922c3/test-model-3922c3-kserve-6f569b6857-qqxdx"]
Jul 24 17:58:25.202464 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:25.202433    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb2561c9-7a30-4f71-aac8-fbc7c7bbef35" path="/var/lib/kubelet/pods/bb2561c9-7a30-4f71-aac8-fbc7c7bbef35/volumes"
Jul 24 17:58:29.558621 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:29.558587    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:58:29.703216 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:29.703180    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:58:29.977411 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:29.977315    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:58:30.202265 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:30.202228    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:58:40.775846 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:40.775807    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:58:40.851213 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:40.851179    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:58:40.913009 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:40.912968    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:58:45.388625 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:45.388549    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:58:45.821010 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:45.820962    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:58:52.974827 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:52.974767    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:58:53.115478 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:53.115444    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:58:53.395978 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:53.395923    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:58:53.596532 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:53.596499    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:58:53.998147 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:53.998096    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:58:54.654866 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:54.654820    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:58:54.784143 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:54.784101    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:58:57.423880 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:57.423835    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:58:57.540337 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:57.540300    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:58:57.652549 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:57.652516    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:58:57.992903 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:57.992876    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:58:58.534226 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:58.534190    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:58:58.677709 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:58:58.677673    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:59:01.854608 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:59:01.854569    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:59:02.390016 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:59:02.389970    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:59:03.035272 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:59:03.035240    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:59:03.201505 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:59:03.201468    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:59:06.488550 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:59:06.488519    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:59:06.590402 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:59:06.590364    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:59:06.741100 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:59:06.741008    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:59:06.975496 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:59:06.975463    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:59:07.683288 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:59:07.683251    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:59:07.850829 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:59:07.850789    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:59:10.895240 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:59:10.895197    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:59:34.502725 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:59:34.502690    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:59:35.737146 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:59:35.737067    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:59:39.231278 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:59:39.231237    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:59:39.656377 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:59:39.656345    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:59:45.996818 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:59:45.996778    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:59:46.090764 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:59:46.090732    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:59:46.293423 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:59:46.293392    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 17:59:46.508616 ip-10-0-139-113 kubenswrapper[2575]: I0724 17:59:46.508581    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:00:02.957901 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:02.957869    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:00:03.049691 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:03.049655    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:00:03.276777 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:03.276685    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:00:06.746306 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:06.746259    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:00:07.156950 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:07.156908    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:00:12.995022 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:12.994987    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:00:13.094634 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:13.094596    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:00:13.279465 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:13.279387    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:00:13.530768 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:13.530669    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:00:13.878051 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:13.878012    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:00:14.282806 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:14.282771    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:00:14.391869 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:14.391834    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:00:16.804830 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:16.804795    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:00:16.900829 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:16.900794    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:00:16.981608 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:16.981576    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:00:17.584735 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:17.584700    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:00:17.756673 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:17.756631    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:00:17.858498 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:17.858408    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:00:19.310244 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:19.310203    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:00:19.410166 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:19.410107    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:00:21.326343 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:21.326304    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:00:21.665541 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:21.665450    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:00:21.990754 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:21.990648    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:00:22.247636 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:22.247535    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:00:24.846701 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:24.846640    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:00:25.027088 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:25.027053    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:00:25.132526 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:25.132438    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:00:25.682745 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:25.682712    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:00:25.782194 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:25.782158    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:00:25.881838 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:25.881807    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:00:29.354042 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:29.354008    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:00:34.307418 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:34.307370    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:00:52.007323 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:52.007285    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-257940/auth-test-model-257940-kserve-cfc9fff75-htx6h"]
Jul 24 18:00:52.007798 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:52.007605    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb2561c9-7a30-4f71-aac8-fbc7c7bbef35" containerName="main"
Jul 24 18:00:52.007798 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:52.007616    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb2561c9-7a30-4f71-aac8-fbc7c7bbef35" containerName="main"
Jul 24 18:00:52.007798 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:52.007627    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="874ab5f9-4cd0-4b3f-a22e-bce52331c172" containerName="main"
Jul 24 18:00:52.007798 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:52.007632    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="874ab5f9-4cd0-4b3f-a22e-bce52331c172" containerName="main"
Jul 24 18:00:52.007798 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:52.007685    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="874ab5f9-4cd0-4b3f-a22e-bce52331c172" containerName="main"
Jul 24 18:00:52.007798 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:52.007692    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb2561c9-7a30-4f71-aac8-fbc7c7bbef35" containerName="main"
Jul 24 18:00:52.010516 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:52.010499    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-257940/auth-test-model-257940-kserve-cfc9fff75-htx6h"
Jul 24 18:00:52.012815 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:52.012788    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-257940\"/\"openshift-service-ca.crt\""
Jul 24 18:00:52.013627 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:52.013604    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-257940\"/\"auth-test-model-257940-kserve-self-signed-certs\""
Jul 24 18:00:52.013747 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:52.013666    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-257940\"/\"kube-root-ca.crt\""
Jul 24 18:00:52.013747 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:52.013703    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-257940\"/\"default-dockercfg-b7kbg\""
Jul 24 18:00:52.020281 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:52.020255    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-257940/auth-test-model-257940-kserve-cfc9fff75-htx6h"]
Jul 24 18:00:52.035924 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:52.035895    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:00:52.118864 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:52.118832    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8-tmp-dir\") pod \"auth-test-model-257940-kserve-cfc9fff75-htx6h\" (UID: \"f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8\") " pod="ai-tenant-e2e-shared-a-257940/auth-test-model-257940-kserve-cfc9fff75-htx6h"
Jul 24 18:00:52.119058 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:52.118869    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8-dshm\") pod \"auth-test-model-257940-kserve-cfc9fff75-htx6h\" (UID: \"f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8\") " pod="ai-tenant-e2e-shared-a-257940/auth-test-model-257940-kserve-cfc9fff75-htx6h"
Jul 24 18:00:52.119058 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:52.118902    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8-tls-certs\") pod \"auth-test-model-257940-kserve-cfc9fff75-htx6h\" (UID: \"f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8\") " pod="ai-tenant-e2e-shared-a-257940/auth-test-model-257940-kserve-cfc9fff75-htx6h"
Jul 24 18:00:52.119058 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:52.118969    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8-model-cache\") pod \"auth-test-model-257940-kserve-cfc9fff75-htx6h\" (UID: \"f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8\") " pod="ai-tenant-e2e-shared-a-257940/auth-test-model-257940-kserve-cfc9fff75-htx6h"
Jul 24 18:00:52.119058 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:52.118992    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlrwg\" (UniqueName: \"kubernetes.io/projected/f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8-kube-api-access-vlrwg\") pod \"auth-test-model-257940-kserve-cfc9fff75-htx6h\" (UID: \"f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8\") " pod="ai-tenant-e2e-shared-a-257940/auth-test-model-257940-kserve-cfc9fff75-htx6h"
Jul 24 18:00:52.119200 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:52.119067    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8-home\") pod \"auth-test-model-257940-kserve-cfc9fff75-htx6h\" (UID: \"f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8\") " pod="ai-tenant-e2e-shared-a-257940/auth-test-model-257940-kserve-cfc9fff75-htx6h"
Jul 24 18:00:52.220147 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:52.220108    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8-dshm\") pod \"auth-test-model-257940-kserve-cfc9fff75-htx6h\" (UID: \"f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8\") " pod="ai-tenant-e2e-shared-a-257940/auth-test-model-257940-kserve-cfc9fff75-htx6h"
Jul 24 18:00:52.220322 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:52.220159    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8-tls-certs\") pod \"auth-test-model-257940-kserve-cfc9fff75-htx6h\" (UID: \"f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8\") " pod="ai-tenant-e2e-shared-a-257940/auth-test-model-257940-kserve-cfc9fff75-htx6h"
Jul 24 18:00:52.220322 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:52.220279    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8-model-cache\") pod \"auth-test-model-257940-kserve-cfc9fff75-htx6h\" (UID: \"f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8\") " pod="ai-tenant-e2e-shared-a-257940/auth-test-model-257940-kserve-cfc9fff75-htx6h"
Jul 24 18:00:52.220413 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:52.220321    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlrwg\" (UniqueName: \"kubernetes.io/projected/f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8-kube-api-access-vlrwg\") pod \"auth-test-model-257940-kserve-cfc9fff75-htx6h\" (UID: \"f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8\") " pod="ai-tenant-e2e-shared-a-257940/auth-test-model-257940-kserve-cfc9fff75-htx6h"
Jul 24 18:00:52.220413 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:52.220381    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8-home\") pod \"auth-test-model-257940-kserve-cfc9fff75-htx6h\" (UID: \"f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8\") " pod="ai-tenant-e2e-shared-a-257940/auth-test-model-257940-kserve-cfc9fff75-htx6h"
Jul 24 18:00:52.220513 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:52.220428    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8-tmp-dir\") pod \"auth-test-model-257940-kserve-cfc9fff75-htx6h\" (UID: \"f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8\") " pod="ai-tenant-e2e-shared-a-257940/auth-test-model-257940-kserve-cfc9fff75-htx6h"
Jul 24 18:00:52.220642 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:52.220622    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8-model-cache\") pod \"auth-test-model-257940-kserve-cfc9fff75-htx6h\" (UID: \"f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8\") " pod="ai-tenant-e2e-shared-a-257940/auth-test-model-257940-kserve-cfc9fff75-htx6h"
Jul 24 18:00:52.220727 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:52.220707    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8-home\") pod \"auth-test-model-257940-kserve-cfc9fff75-htx6h\" (UID: \"f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8\") " pod="ai-tenant-e2e-shared-a-257940/auth-test-model-257940-kserve-cfc9fff75-htx6h"
Jul 24 18:00:52.220794 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:52.220774    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8-tmp-dir\") pod \"auth-test-model-257940-kserve-cfc9fff75-htx6h\" (UID: \"f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8\") " pod="ai-tenant-e2e-shared-a-257940/auth-test-model-257940-kserve-cfc9fff75-htx6h"
Jul 24 18:00:52.222990 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:52.222970    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8-dshm\") pod \"auth-test-model-257940-kserve-cfc9fff75-htx6h\" (UID: \"f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8\") " pod="ai-tenant-e2e-shared-a-257940/auth-test-model-257940-kserve-cfc9fff75-htx6h"
Jul 24 18:00:52.223358 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:52.223338    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8-tls-certs\") pod \"auth-test-model-257940-kserve-cfc9fff75-htx6h\" (UID: \"f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8\") " pod="ai-tenant-e2e-shared-a-257940/auth-test-model-257940-kserve-cfc9fff75-htx6h"
Jul 24 18:00:52.229404 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:52.229381    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlrwg\" (UniqueName: \"kubernetes.io/projected/f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8-kube-api-access-vlrwg\") pod \"auth-test-model-257940-kserve-cfc9fff75-htx6h\" (UID: \"f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8\") " pod="ai-tenant-e2e-shared-a-257940/auth-test-model-257940-kserve-cfc9fff75-htx6h"
Jul 24 18:00:52.320296 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:52.320260    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-257940/auth-test-model-257940-kserve-cfc9fff75-htx6h"
Jul 24 18:00:52.458885 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:52.458773    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-257940/auth-test-model-257940-kserve-cfc9fff75-htx6h"]
Jul 24 18:00:52.461765 ip-10-0-139-113 kubenswrapper[2575]: W0724 18:00:52.461738    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf9f1a13c_13f8_4b8f_8820_de8a73f1d6d8.slice/crio-aac33b57915817eefccc01460195fd4455b8c8763ee1856db628110b21a48c0e WatchSource:0}: Error finding container aac33b57915817eefccc01460195fd4455b8c8763ee1856db628110b21a48c0e: Status 404 returned error can't find the container with id aac33b57915817eefccc01460195fd4455b8c8763ee1856db628110b21a48c0e
Jul 24 18:00:53.030117 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:53.030080    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-257940/auth-test-model-257940-kserve-cfc9fff75-htx6h" event={"ID":"f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8","Type":"ContainerStarted","Data":"6d4bd54af5ece575ae7c104a1edd46b6e9a8d426873b71b10181778f49456434"}
Jul 24 18:00:53.030500 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:53.030129    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-257940/auth-test-model-257940-kserve-cfc9fff75-htx6h" event={"ID":"f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8","Type":"ContainerStarted","Data":"aac33b57915817eefccc01460195fd4455b8c8763ee1856db628110b21a48c0e"}
Jul 24 18:00:53.048198 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:00:53.048127    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-257940/auth-test-model-257940-kserve-cfc9fff75-htx6h" podStartSLOduration=2.048106928 podStartE2EDuration="2.048106928s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:00:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:00:53.047573083 +0000 UTC m=+2588.528948703" watchObservedRunningTime="2026-07-24 18:00:53.048106928 +0000 UTC m=+2588.529482551"
Jul 24 18:01:02.320413 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:01:02.320372    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-257940/auth-test-model-257940-kserve-cfc9fff75-htx6h"
Jul 24 18:01:02.320413 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:01:02.320423    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-257940/auth-test-model-257940-kserve-cfc9fff75-htx6h"
Jul 24 18:01:02.332757 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:01:02.332728    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-257940/auth-test-model-257940-kserve-cfc9fff75-htx6h"
Jul 24 18:01:03.081301 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:01:03.081269    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-257940/auth-test-model-257940-kserve-cfc9fff75-htx6h"
Jul 24 18:01:09.193041 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:01:09.192957    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-06ffdb/auth-test-model-06ffdb-kserve-6477d5bb4c-5hshw"]
Jul 24 18:01:09.196420 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:01:09.196396    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-06ffdb/auth-test-model-06ffdb-kserve-6477d5bb4c-5hshw"
Jul 24 18:01:09.199481 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:01:09.199456    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-06ffdb\"/\"auth-test-model-06ffdb-kserve-self-signed-certs\""
Jul 24 18:01:09.199616 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:01:09.199496    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-06ffdb\"/\"kube-root-ca.crt\""
Jul 24 18:01:09.199616 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:01:09.199579    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-06ffdb\"/\"openshift-service-ca.crt\""
Jul 24 18:01:09.199740 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:01:09.199707    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-06ffdb\"/\"default-dockercfg-7clj4\""
Jul 24 18:01:09.206310 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:01:09.206288    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-06ffdb/auth-test-model-06ffdb-kserve-6477d5bb4c-5hshw"]
Jul 24 18:01:09.226167 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:01:09.226134    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:01:09.268313 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:01:09.268278    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f0136cf-45ee-4eef-91ff-1598a4103f91-dshm\") pod \"auth-test-model-06ffdb-kserve-6477d5bb4c-5hshw\" (UID: \"1f0136cf-45ee-4eef-91ff-1598a4103f91\") " pod="ai-tenant-e2e-shared-b-06ffdb/auth-test-model-06ffdb-kserve-6477d5bb4c-5hshw"
Jul 24 18:01:09.268495 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:01:09.268319    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f0136cf-45ee-4eef-91ff-1598a4103f91-tls-certs\") pod \"auth-test-model-06ffdb-kserve-6477d5bb4c-5hshw\" (UID: \"1f0136cf-45ee-4eef-91ff-1598a4103f91\") " pod="ai-tenant-e2e-shared-b-06ffdb/auth-test-model-06ffdb-kserve-6477d5bb4c-5hshw"
Jul 24 18:01:09.268495 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:01:09.268340    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrw68\" (UniqueName: \"kubernetes.io/projected/1f0136cf-45ee-4eef-91ff-1598a4103f91-kube-api-access-xrw68\") pod \"auth-test-model-06ffdb-kserve-6477d5bb4c-5hshw\" (UID: \"1f0136cf-45ee-4eef-91ff-1598a4103f91\") " pod="ai-tenant-e2e-shared-b-06ffdb/auth-test-model-06ffdb-kserve-6477d5bb4c-5hshw"
Jul 24 18:01:09.268495 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:01:09.268407    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f0136cf-45ee-4eef-91ff-1598a4103f91-model-cache\") pod \"auth-test-model-06ffdb-kserve-6477d5bb4c-5hshw\" (UID: \"1f0136cf-45ee-4eef-91ff-1598a4103f91\") " pod="ai-tenant-e2e-shared-b-06ffdb/auth-test-model-06ffdb-kserve-6477d5bb4c-5hshw"
Jul 24 18:01:09.268495 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:01:09.268471    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f0136cf-45ee-4eef-91ff-1598a4103f91-home\") pod \"auth-test-model-06ffdb-kserve-6477d5bb4c-5hshw\" (UID: \"1f0136cf-45ee-4eef-91ff-1598a4103f91\") " pod="ai-tenant-e2e-shared-b-06ffdb/auth-test-model-06ffdb-kserve-6477d5bb4c-5hshw"
Jul 24 18:01:09.268495 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:01:09.268490    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f0136cf-45ee-4eef-91ff-1598a4103f91-tmp-dir\") pod \"auth-test-model-06ffdb-kserve-6477d5bb4c-5hshw\" (UID: \"1f0136cf-45ee-4eef-91ff-1598a4103f91\") " pod="ai-tenant-e2e-shared-b-06ffdb/auth-test-model-06ffdb-kserve-6477d5bb4c-5hshw"
Jul 24 18:01:09.369379 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:01:09.369330    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f0136cf-45ee-4eef-91ff-1598a4103f91-dshm\") pod \"auth-test-model-06ffdb-kserve-6477d5bb4c-5hshw\" (UID: \"1f0136cf-45ee-4eef-91ff-1598a4103f91\") " pod="ai-tenant-e2e-shared-b-06ffdb/auth-test-model-06ffdb-kserve-6477d5bb4c-5hshw"
Jul 24 18:01:09.369379 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:01:09.369375    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f0136cf-45ee-4eef-91ff-1598a4103f91-tls-certs\") pod \"auth-test-model-06ffdb-kserve-6477d5bb4c-5hshw\" (UID: \"1f0136cf-45ee-4eef-91ff-1598a4103f91\") " pod="ai-tenant-e2e-shared-b-06ffdb/auth-test-model-06ffdb-kserve-6477d5bb4c-5hshw"
Jul 24 18:01:09.369642 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:01:09.369394    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrw68\" (UniqueName: \"kubernetes.io/projected/1f0136cf-45ee-4eef-91ff-1598a4103f91-kube-api-access-xrw68\") pod \"auth-test-model-06ffdb-kserve-6477d5bb4c-5hshw\" (UID: \"1f0136cf-45ee-4eef-91ff-1598a4103f91\") " pod="ai-tenant-e2e-shared-b-06ffdb/auth-test-model-06ffdb-kserve-6477d5bb4c-5hshw"
Jul 24 18:01:09.369642 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:01:09.369433    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f0136cf-45ee-4eef-91ff-1598a4103f91-model-cache\") pod \"auth-test-model-06ffdb-kserve-6477d5bb4c-5hshw\" (UID: \"1f0136cf-45ee-4eef-91ff-1598a4103f91\") " pod="ai-tenant-e2e-shared-b-06ffdb/auth-test-model-06ffdb-kserve-6477d5bb4c-5hshw"
Jul 24 18:01:09.369642 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:01:09.369500    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f0136cf-45ee-4eef-91ff-1598a4103f91-home\") pod \"auth-test-model-06ffdb-kserve-6477d5bb4c-5hshw\" (UID: \"1f0136cf-45ee-4eef-91ff-1598a4103f91\") " pod="ai-tenant-e2e-shared-b-06ffdb/auth-test-model-06ffdb-kserve-6477d5bb4c-5hshw"
Jul 24 18:01:09.369642 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:01:09.369622    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f0136cf-45ee-4eef-91ff-1598a4103f91-tmp-dir\") pod \"auth-test-model-06ffdb-kserve-6477d5bb4c-5hshw\" (UID: \"1f0136cf-45ee-4eef-91ff-1598a4103f91\") " pod="ai-tenant-e2e-shared-b-06ffdb/auth-test-model-06ffdb-kserve-6477d5bb4c-5hshw"
Jul 24 18:01:09.369956 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:01:09.369919    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f0136cf-45ee-4eef-91ff-1598a4103f91-model-cache\") pod \"auth-test-model-06ffdb-kserve-6477d5bb4c-5hshw\" (UID: \"1f0136cf-45ee-4eef-91ff-1598a4103f91\") " pod="ai-tenant-e2e-shared-b-06ffdb/auth-test-model-06ffdb-kserve-6477d5bb4c-5hshw"
Jul 24 18:01:09.370032 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:01:09.369925    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f0136cf-45ee-4eef-91ff-1598a4103f91-home\") pod \"auth-test-model-06ffdb-kserve-6477d5bb4c-5hshw\" (UID: \"1f0136cf-45ee-4eef-91ff-1598a4103f91\") " pod="ai-tenant-e2e-shared-b-06ffdb/auth-test-model-06ffdb-kserve-6477d5bb4c-5hshw"
Jul 24 18:01:09.370090 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:01:09.370046    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f0136cf-45ee-4eef-91ff-1598a4103f91-tmp-dir\") pod \"auth-test-model-06ffdb-kserve-6477d5bb4c-5hshw\" (UID: \"1f0136cf-45ee-4eef-91ff-1598a4103f91\") " pod="ai-tenant-e2e-shared-b-06ffdb/auth-test-model-06ffdb-kserve-6477d5bb4c-5hshw"
Jul 24 18:01:09.371631 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:01:09.371601    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f0136cf-45ee-4eef-91ff-1598a4103f91-dshm\") pod \"auth-test-model-06ffdb-kserve-6477d5bb4c-5hshw\" (UID: \"1f0136cf-45ee-4eef-91ff-1598a4103f91\") " pod="ai-tenant-e2e-shared-b-06ffdb/auth-test-model-06ffdb-kserve-6477d5bb4c-5hshw"
Jul 24 18:01:09.371862 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:01:09.371844    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f0136cf-45ee-4eef-91ff-1598a4103f91-tls-certs\") pod \"auth-test-model-06ffdb-kserve-6477d5bb4c-5hshw\" (UID: \"1f0136cf-45ee-4eef-91ff-1598a4103f91\") " pod="ai-tenant-e2e-shared-b-06ffdb/auth-test-model-06ffdb-kserve-6477d5bb4c-5hshw"
Jul 24 18:01:09.377971 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:01:09.377930    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrw68\" (UniqueName: \"kubernetes.io/projected/1f0136cf-45ee-4eef-91ff-1598a4103f91-kube-api-access-xrw68\") pod \"auth-test-model-06ffdb-kserve-6477d5bb4c-5hshw\" (UID: \"1f0136cf-45ee-4eef-91ff-1598a4103f91\") " pod="ai-tenant-e2e-shared-b-06ffdb/auth-test-model-06ffdb-kserve-6477d5bb4c-5hshw"
Jul 24 18:01:09.507428 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:01:09.507329    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-06ffdb/auth-test-model-06ffdb-kserve-6477d5bb4c-5hshw"
Jul 24 18:01:09.640365 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:01:09.640323    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-06ffdb/auth-test-model-06ffdb-kserve-6477d5bb4c-5hshw"]
Jul 24 18:01:09.643242 ip-10-0-139-113 kubenswrapper[2575]: W0724 18:01:09.643216    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1f0136cf_45ee_4eef_91ff_1598a4103f91.slice/crio-783a63ac10c0d1084264a39fdc4a9189521c808e727a979cc4a8871e99fd904b WatchSource:0}: Error finding container 783a63ac10c0d1084264a39fdc4a9189521c808e727a979cc4a8871e99fd904b: Status 404 returned error can't find the container with id 783a63ac10c0d1084264a39fdc4a9189521c808e727a979cc4a8871e99fd904b
Jul 24 18:01:10.102226 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:01:10.102180    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-06ffdb/auth-test-model-06ffdb-kserve-6477d5bb4c-5hshw" event={"ID":"1f0136cf-45ee-4eef-91ff-1598a4103f91","Type":"ContainerStarted","Data":"9b94e8bfe208a445456c7fef7d9c0105eda2570239e3034b7ce60fdce2595e09"}
Jul 24 18:01:10.102226 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:01:10.102229    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-06ffdb/auth-test-model-06ffdb-kserve-6477d5bb4c-5hshw" event={"ID":"1f0136cf-45ee-4eef-91ff-1598a4103f91","Type":"ContainerStarted","Data":"783a63ac10c0d1084264a39fdc4a9189521c808e727a979cc4a8871e99fd904b"}
Jul 24 18:01:10.120567 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:01:10.120517    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-06ffdb/auth-test-model-06ffdb-kserve-6477d5bb4c-5hshw" podStartSLOduration=1.120499455 podStartE2EDuration="1.120499455s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:01:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:01:10.118883838 +0000 UTC m=+2605.600259458" watchObservedRunningTime="2026-07-24 18:01:10.120499455 +0000 UTC m=+2605.601875075"
Jul 24 18:01:16.666849 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:01:16.666804    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:01:16.767923 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:01:16.767883    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:01:19.508198 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:01:19.508153    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-06ffdb/auth-test-model-06ffdb-kserve-6477d5bb4c-5hshw"
Jul 24 18:01:19.508704 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:01:19.508235    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-06ffdb/auth-test-model-06ffdb-kserve-6477d5bb4c-5hshw"
Jul 24 18:01:19.520705 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:01:19.520680    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-06ffdb/auth-test-model-06ffdb-kserve-6477d5bb4c-5hshw"
Jul 24 18:01:20.156032 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:01:20.156002    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-06ffdb/auth-test-model-06ffdb-kserve-6477d5bb4c-5hshw"
Jul 24 18:01:43.887464 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:01:43.887425    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:02:45.195251 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:02:45.195171    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82s5l_010c8b81-c5f5-43c3-b1bb-c812fcde2d6f/ovn-acl-logging/0.log"
Jul 24 18:02:45.199800 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:02:45.199774    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82s5l_010c8b81-c5f5-43c3-b1bb-c812fcde2d6f/ovn-acl-logging/0.log"
Jul 24 18:03:14.002435 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:14.002397    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-257940/auth-test-model-257940-kserve-cfc9fff75-htx6h"]
Jul 24 18:03:14.071746 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:14.071705    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:03:14.893299 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:14.893259    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-06ffdb/auth-test-model-06ffdb-kserve-6477d5bb4c-5hshw"]
Jul 24 18:03:14.903103 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:14.903071    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:03:18.699992 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:18.699954    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:03:18.799159 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:18.799124    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:03:24.987634 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:24.987600    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-257940/sub-test-model-257940-kserve-6bc96896b9-jlhq2"]
Jul 24 18:03:24.990637 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:24.990620    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-257940/sub-test-model-257940-kserve-6bc96896b9-jlhq2"
Jul 24 18:03:24.993287 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:24.993264    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-257940\"/\"sub-test-model-257940-kserve-self-signed-certs\""
Jul 24 18:03:25.009373 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:25.009341    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-257940/sub-test-model-257940-kserve-6bc96896b9-jlhq2"]
Jul 24 18:03:25.032599 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:25.032563    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:03:25.086297 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:25.086255    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dbea92ff-5708-4594-9c8d-1b7c6399cd80-dshm\") pod \"sub-test-model-257940-kserve-6bc96896b9-jlhq2\" (UID: \"dbea92ff-5708-4594-9c8d-1b7c6399cd80\") " pod="ai-tenant-e2e-shared-a-257940/sub-test-model-257940-kserve-6bc96896b9-jlhq2"
Jul 24 18:03:25.086494 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:25.086307    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dbea92ff-5708-4594-9c8d-1b7c6399cd80-home\") pod \"sub-test-model-257940-kserve-6bc96896b9-jlhq2\" (UID: \"dbea92ff-5708-4594-9c8d-1b7c6399cd80\") " pod="ai-tenant-e2e-shared-a-257940/sub-test-model-257940-kserve-6bc96896b9-jlhq2"
Jul 24 18:03:25.086494 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:25.086397    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dbea92ff-5708-4594-9c8d-1b7c6399cd80-model-cache\") pod \"sub-test-model-257940-kserve-6bc96896b9-jlhq2\" (UID: \"dbea92ff-5708-4594-9c8d-1b7c6399cd80\") " pod="ai-tenant-e2e-shared-a-257940/sub-test-model-257940-kserve-6bc96896b9-jlhq2"
Jul 24 18:03:25.086494 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:25.086428    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbea92ff-5708-4594-9c8d-1b7c6399cd80-tls-certs\") pod \"sub-test-model-257940-kserve-6bc96896b9-jlhq2\" (UID: \"dbea92ff-5708-4594-9c8d-1b7c6399cd80\") " pod="ai-tenant-e2e-shared-a-257940/sub-test-model-257940-kserve-6bc96896b9-jlhq2"
Jul 24 18:03:25.086494 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:25.086451    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4n9n8\" (UniqueName: \"kubernetes.io/projected/dbea92ff-5708-4594-9c8d-1b7c6399cd80-kube-api-access-4n9n8\") pod \"sub-test-model-257940-kserve-6bc96896b9-jlhq2\" (UID: \"dbea92ff-5708-4594-9c8d-1b7c6399cd80\") " pod="ai-tenant-e2e-shared-a-257940/sub-test-model-257940-kserve-6bc96896b9-jlhq2"
Jul 24 18:03:25.086637 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:25.086565    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dbea92ff-5708-4594-9c8d-1b7c6399cd80-tmp-dir\") pod \"sub-test-model-257940-kserve-6bc96896b9-jlhq2\" (UID: \"dbea92ff-5708-4594-9c8d-1b7c6399cd80\") " pod="ai-tenant-e2e-shared-a-257940/sub-test-model-257940-kserve-6bc96896b9-jlhq2"
Jul 24 18:03:25.187071 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:25.187024    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dbea92ff-5708-4594-9c8d-1b7c6399cd80-dshm\") pod \"sub-test-model-257940-kserve-6bc96896b9-jlhq2\" (UID: \"dbea92ff-5708-4594-9c8d-1b7c6399cd80\") " pod="ai-tenant-e2e-shared-a-257940/sub-test-model-257940-kserve-6bc96896b9-jlhq2"
Jul 24 18:03:25.187071 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:25.187071    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dbea92ff-5708-4594-9c8d-1b7c6399cd80-home\") pod \"sub-test-model-257940-kserve-6bc96896b9-jlhq2\" (UID: \"dbea92ff-5708-4594-9c8d-1b7c6399cd80\") " pod="ai-tenant-e2e-shared-a-257940/sub-test-model-257940-kserve-6bc96896b9-jlhq2"
Jul 24 18:03:25.187340 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:25.187104    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dbea92ff-5708-4594-9c8d-1b7c6399cd80-model-cache\") pod \"sub-test-model-257940-kserve-6bc96896b9-jlhq2\" (UID: \"dbea92ff-5708-4594-9c8d-1b7c6399cd80\") " pod="ai-tenant-e2e-shared-a-257940/sub-test-model-257940-kserve-6bc96896b9-jlhq2"
Jul 24 18:03:25.187340 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:25.187119    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbea92ff-5708-4594-9c8d-1b7c6399cd80-tls-certs\") pod \"sub-test-model-257940-kserve-6bc96896b9-jlhq2\" (UID: \"dbea92ff-5708-4594-9c8d-1b7c6399cd80\") " pod="ai-tenant-e2e-shared-a-257940/sub-test-model-257940-kserve-6bc96896b9-jlhq2"
Jul 24 18:03:25.187340 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:25.187137    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4n9n8\" (UniqueName: \"kubernetes.io/projected/dbea92ff-5708-4594-9c8d-1b7c6399cd80-kube-api-access-4n9n8\") pod \"sub-test-model-257940-kserve-6bc96896b9-jlhq2\" (UID: \"dbea92ff-5708-4594-9c8d-1b7c6399cd80\") " pod="ai-tenant-e2e-shared-a-257940/sub-test-model-257940-kserve-6bc96896b9-jlhq2"
Jul 24 18:03:25.187340 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:25.187190    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dbea92ff-5708-4594-9c8d-1b7c6399cd80-tmp-dir\") pod \"sub-test-model-257940-kserve-6bc96896b9-jlhq2\" (UID: \"dbea92ff-5708-4594-9c8d-1b7c6399cd80\") " pod="ai-tenant-e2e-shared-a-257940/sub-test-model-257940-kserve-6bc96896b9-jlhq2"
Jul 24 18:03:25.187559 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:25.187540    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dbea92ff-5708-4594-9c8d-1b7c6399cd80-home\") pod \"sub-test-model-257940-kserve-6bc96896b9-jlhq2\" (UID: \"dbea92ff-5708-4594-9c8d-1b7c6399cd80\") " pod="ai-tenant-e2e-shared-a-257940/sub-test-model-257940-kserve-6bc96896b9-jlhq2"
Jul 24 18:03:25.187609 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:25.187585    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dbea92ff-5708-4594-9c8d-1b7c6399cd80-model-cache\") pod \"sub-test-model-257940-kserve-6bc96896b9-jlhq2\" (UID: \"dbea92ff-5708-4594-9c8d-1b7c6399cd80\") " pod="ai-tenant-e2e-shared-a-257940/sub-test-model-257940-kserve-6bc96896b9-jlhq2"
Jul 24 18:03:25.187646 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:25.187628    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dbea92ff-5708-4594-9c8d-1b7c6399cd80-tmp-dir\") pod \"sub-test-model-257940-kserve-6bc96896b9-jlhq2\" (UID: \"dbea92ff-5708-4594-9c8d-1b7c6399cd80\") " pod="ai-tenant-e2e-shared-a-257940/sub-test-model-257940-kserve-6bc96896b9-jlhq2"
Jul 24 18:03:25.189282 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:25.189257    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dbea92ff-5708-4594-9c8d-1b7c6399cd80-dshm\") pod \"sub-test-model-257940-kserve-6bc96896b9-jlhq2\" (UID: \"dbea92ff-5708-4594-9c8d-1b7c6399cd80\") " pod="ai-tenant-e2e-shared-a-257940/sub-test-model-257940-kserve-6bc96896b9-jlhq2"
Jul 24 18:03:25.189651 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:25.189629    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbea92ff-5708-4594-9c8d-1b7c6399cd80-tls-certs\") pod \"sub-test-model-257940-kserve-6bc96896b9-jlhq2\" (UID: \"dbea92ff-5708-4594-9c8d-1b7c6399cd80\") " pod="ai-tenant-e2e-shared-a-257940/sub-test-model-257940-kserve-6bc96896b9-jlhq2"
Jul 24 18:03:25.196063 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:25.196042    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4n9n8\" (UniqueName: \"kubernetes.io/projected/dbea92ff-5708-4594-9c8d-1b7c6399cd80-kube-api-access-4n9n8\") pod \"sub-test-model-257940-kserve-6bc96896b9-jlhq2\" (UID: \"dbea92ff-5708-4594-9c8d-1b7c6399cd80\") " pod="ai-tenant-e2e-shared-a-257940/sub-test-model-257940-kserve-6bc96896b9-jlhq2"
Jul 24 18:03:25.300063 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:25.300031    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-257940/sub-test-model-257940-kserve-6bc96896b9-jlhq2"
Jul 24 18:03:25.435561 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:25.435527    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-257940/sub-test-model-257940-kserve-6bc96896b9-jlhq2"]
Jul 24 18:03:25.437357 ip-10-0-139-113 kubenswrapper[2575]: W0724 18:03:25.437323    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddbea92ff_5708_4594_9c8d_1b7c6399cd80.slice/crio-a3b6549edac56c46dc01a287b4b24b082f758df6cf8e1b7cc5bb71538b25c27a WatchSource:0}: Error finding container a3b6549edac56c46dc01a287b4b24b082f758df6cf8e1b7cc5bb71538b25c27a: Status 404 returned error can't find the container with id a3b6549edac56c46dc01a287b4b24b082f758df6cf8e1b7cc5bb71538b25c27a
Jul 24 18:03:25.694327 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:25.694240    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-257940/sub-test-model-257940-kserve-6bc96896b9-jlhq2" event={"ID":"dbea92ff-5708-4594-9c8d-1b7c6399cd80","Type":"ContainerStarted","Data":"0f7b9832aac25722ef0e82c88e6a3153014785d0ad404212775ec51c17c0e11d"}
Jul 24 18:03:25.694327 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:25.694279    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-257940/sub-test-model-257940-kserve-6bc96896b9-jlhq2" event={"ID":"dbea92ff-5708-4594-9c8d-1b7c6399cd80","Type":"ContainerStarted","Data":"a3b6549edac56c46dc01a287b4b24b082f758df6cf8e1b7cc5bb71538b25c27a"}
Jul 24 18:03:29.021662 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:29.021617    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-257940/auth-test-model-257940-kserve-cfc9fff75-htx6h" podUID="f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8" containerName="main" containerID="cri-o://6d4bd54af5ece575ae7c104a1edd46b6e9a8d426873b71b10181778f49456434" gracePeriod=45
Jul 24 18:03:29.270308 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:29.270276    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-257940/auth-test-model-257940-kserve-cfc9fff75-htx6h"
Jul 24 18:03:29.291380 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:29.291322    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-257940/sub-test-model-257940-kserve-6bc96896b9-jlhq2" podStartSLOduration=5.291304093 podStartE2EDuration="5.291304093s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:03:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:03:25.722520405 +0000 UTC m=+2741.203896024" watchObservedRunningTime="2026-07-24 18:03:29.291304093 +0000 UTC m=+2744.772679712"
Jul 24 18:03:29.317574 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:29.317536    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8-tmp-dir\") pod \"f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8\" (UID: \"f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8\") "
Jul 24 18:03:29.317768 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:29.317584    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vlrwg\" (UniqueName: \"kubernetes.io/projected/f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8-kube-api-access-vlrwg\") pod \"f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8\" (UID: \"f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8\") "
Jul 24 18:03:29.317768 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:29.317603    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8-tls-certs\") pod \"f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8\" (UID: \"f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8\") "
Jul 24 18:03:29.317768 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:29.317624    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8-dshm\") pod \"f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8\" (UID: \"f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8\") "
Jul 24 18:03:29.317768 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:29.317639    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8-model-cache\") pod \"f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8\" (UID: \"f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8\") "
Jul 24 18:03:29.317768 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:29.317692    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8-home\") pod \"f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8\" (UID: \"f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8\") "
Jul 24 18:03:29.318065 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:29.317796    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8" (UID: "f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 18:03:29.318065 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:29.317918    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8-model-cache" (OuterVolumeSpecName: "model-cache") pod "f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8" (UID: "f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 18:03:29.318065 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:29.317982    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8-home" (OuterVolumeSpecName: "home") pod "f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8" (UID: "f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 18:03:29.318065 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:29.318004    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8-tmp-dir\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 18:03:29.318065 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:29.318025    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8-model-cache\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 18:03:29.319968 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:29.319931    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8-kube-api-access-vlrwg" (OuterVolumeSpecName: "kube-api-access-vlrwg") pod "f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8" (UID: "f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8"). InnerVolumeSpecName "kube-api-access-vlrwg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:03:29.320108 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:29.319947    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8" (UID: "f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 18:03:29.320108 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:29.319990    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8-dshm" (OuterVolumeSpecName: "dshm") pod "f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8" (UID: "f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 18:03:29.418706 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:29.418667    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8-home\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 18:03:29.418706 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:29.418701    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vlrwg\" (UniqueName: \"kubernetes.io/projected/f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8-kube-api-access-vlrwg\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 18:03:29.418706 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:29.418711    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8-tls-certs\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 18:03:29.418984 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:29.418721    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8-dshm\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 18:03:29.713515 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:29.713424    2575 generic.go:356] "Generic (PLEG): container finished" podID="f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8" containerID="6d4bd54af5ece575ae7c104a1edd46b6e9a8d426873b71b10181778f49456434" exitCode=0
Jul 24 18:03:29.713515 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:29.713469    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-257940/auth-test-model-257940-kserve-cfc9fff75-htx6h"
Jul 24 18:03:29.713699 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:29.713519    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-257940/auth-test-model-257940-kserve-cfc9fff75-htx6h" event={"ID":"f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8","Type":"ContainerDied","Data":"6d4bd54af5ece575ae7c104a1edd46b6e9a8d426873b71b10181778f49456434"}
Jul 24 18:03:29.713699 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:29.713555    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-257940/auth-test-model-257940-kserve-cfc9fff75-htx6h" event={"ID":"f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8","Type":"ContainerDied","Data":"aac33b57915817eefccc01460195fd4455b8c8763ee1856db628110b21a48c0e"}
Jul 24 18:03:29.713699 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:29.713573    2575 scope.go:117] "RemoveContainer" containerID="6d4bd54af5ece575ae7c104a1edd46b6e9a8d426873b71b10181778f49456434"
Jul 24 18:03:29.722309 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:29.722291    2575 scope.go:117] "RemoveContainer" containerID="6d4bd54af5ece575ae7c104a1edd46b6e9a8d426873b71b10181778f49456434"
Jul 24 18:03:29.722621 ip-10-0-139-113 kubenswrapper[2575]: E0724 18:03:29.722600    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d4bd54af5ece575ae7c104a1edd46b6e9a8d426873b71b10181778f49456434\": container with ID starting with 6d4bd54af5ece575ae7c104a1edd46b6e9a8d426873b71b10181778f49456434 not found: ID does not exist" containerID="6d4bd54af5ece575ae7c104a1edd46b6e9a8d426873b71b10181778f49456434"
Jul 24 18:03:29.722668 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:29.722631    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d4bd54af5ece575ae7c104a1edd46b6e9a8d426873b71b10181778f49456434"} err="failed to get container status \"6d4bd54af5ece575ae7c104a1edd46b6e9a8d426873b71b10181778f49456434\": rpc error: code = NotFound desc = could not find container \"6d4bd54af5ece575ae7c104a1edd46b6e9a8d426873b71b10181778f49456434\": container with ID starting with 6d4bd54af5ece575ae7c104a1edd46b6e9a8d426873b71b10181778f49456434 not found: ID does not exist"
Jul 24 18:03:29.740007 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:29.739975    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-257940/auth-test-model-257940-kserve-cfc9fff75-htx6h"]
Jul 24 18:03:29.749175 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:29.749147    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-257940/auth-test-model-257940-kserve-cfc9fff75-htx6h"]
Jul 24 18:03:29.912175 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:29.912135    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-06ffdb/auth-test-model-06ffdb-kserve-6477d5bb4c-5hshw" podUID="1f0136cf-45ee-4eef-91ff-1598a4103f91" containerName="main" containerID="cri-o://9b94e8bfe208a445456c7fef7d9c0105eda2570239e3034b7ce60fdce2595e09" gracePeriod=45
Jul 24 18:03:30.167842 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:30.167816    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-06ffdb/auth-test-model-06ffdb-kserve-6477d5bb4c-5hshw"
Jul 24 18:03:30.224164 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:30.224131    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xrw68\" (UniqueName: \"kubernetes.io/projected/1f0136cf-45ee-4eef-91ff-1598a4103f91-kube-api-access-xrw68\") pod \"1f0136cf-45ee-4eef-91ff-1598a4103f91\" (UID: \"1f0136cf-45ee-4eef-91ff-1598a4103f91\") "
Jul 24 18:03:30.224358 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:30.224176    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f0136cf-45ee-4eef-91ff-1598a4103f91-tmp-dir\") pod \"1f0136cf-45ee-4eef-91ff-1598a4103f91\" (UID: \"1f0136cf-45ee-4eef-91ff-1598a4103f91\") "
Jul 24 18:03:30.224358 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:30.224229    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f0136cf-45ee-4eef-91ff-1598a4103f91-dshm\") pod \"1f0136cf-45ee-4eef-91ff-1598a4103f91\" (UID: \"1f0136cf-45ee-4eef-91ff-1598a4103f91\") "
Jul 24 18:03:30.224358 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:30.224244    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f0136cf-45ee-4eef-91ff-1598a4103f91-tls-certs\") pod \"1f0136cf-45ee-4eef-91ff-1598a4103f91\" (UID: \"1f0136cf-45ee-4eef-91ff-1598a4103f91\") "
Jul 24 18:03:30.224358 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:30.224273    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f0136cf-45ee-4eef-91ff-1598a4103f91-model-cache\") pod \"1f0136cf-45ee-4eef-91ff-1598a4103f91\" (UID: \"1f0136cf-45ee-4eef-91ff-1598a4103f91\") "
Jul 24 18:03:30.224358 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:30.224309    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f0136cf-45ee-4eef-91ff-1598a4103f91-home\") pod \"1f0136cf-45ee-4eef-91ff-1598a4103f91\" (UID: \"1f0136cf-45ee-4eef-91ff-1598a4103f91\") "
Jul 24 18:03:30.224617 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:30.224529    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f0136cf-45ee-4eef-91ff-1598a4103f91-model-cache" (OuterVolumeSpecName: "model-cache") pod "1f0136cf-45ee-4eef-91ff-1598a4103f91" (UID: "1f0136cf-45ee-4eef-91ff-1598a4103f91"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 18:03:30.224617 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:30.224560    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f0136cf-45ee-4eef-91ff-1598a4103f91-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1f0136cf-45ee-4eef-91ff-1598a4103f91" (UID: "1f0136cf-45ee-4eef-91ff-1598a4103f91"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 18:03:30.224690 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:30.224617    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f0136cf-45ee-4eef-91ff-1598a4103f91-home" (OuterVolumeSpecName: "home") pod "1f0136cf-45ee-4eef-91ff-1598a4103f91" (UID: "1f0136cf-45ee-4eef-91ff-1598a4103f91"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 18:03:30.226536 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:30.226512    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f0136cf-45ee-4eef-91ff-1598a4103f91-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1f0136cf-45ee-4eef-91ff-1598a4103f91" (UID: "1f0136cf-45ee-4eef-91ff-1598a4103f91"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 18:03:30.226654 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:30.226561    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f0136cf-45ee-4eef-91ff-1598a4103f91-dshm" (OuterVolumeSpecName: "dshm") pod "1f0136cf-45ee-4eef-91ff-1598a4103f91" (UID: "1f0136cf-45ee-4eef-91ff-1598a4103f91"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 18:03:30.226654 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:30.226617    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f0136cf-45ee-4eef-91ff-1598a4103f91-kube-api-access-xrw68" (OuterVolumeSpecName: "kube-api-access-xrw68") pod "1f0136cf-45ee-4eef-91ff-1598a4103f91" (UID: "1f0136cf-45ee-4eef-91ff-1598a4103f91"). InnerVolumeSpecName "kube-api-access-xrw68". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:03:30.325188 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:30.325146    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f0136cf-45ee-4eef-91ff-1598a4103f91-dshm\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 18:03:30.325188 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:30.325178    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f0136cf-45ee-4eef-91ff-1598a4103f91-tls-certs\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 18:03:30.325188 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:30.325191    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f0136cf-45ee-4eef-91ff-1598a4103f91-model-cache\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 18:03:30.325188 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:30.325202    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f0136cf-45ee-4eef-91ff-1598a4103f91-home\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 18:03:30.325484 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:30.325213    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xrw68\" (UniqueName: \"kubernetes.io/projected/1f0136cf-45ee-4eef-91ff-1598a4103f91-kube-api-access-xrw68\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 18:03:30.325484 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:30.325226    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f0136cf-45ee-4eef-91ff-1598a4103f91-tmp-dir\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 18:03:30.718750 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:30.718653    2575 generic.go:356] "Generic (PLEG): container finished" podID="1f0136cf-45ee-4eef-91ff-1598a4103f91" containerID="9b94e8bfe208a445456c7fef7d9c0105eda2570239e3034b7ce60fdce2595e09" exitCode=0
Jul 24 18:03:30.718750 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:30.718701    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-06ffdb/auth-test-model-06ffdb-kserve-6477d5bb4c-5hshw"
Jul 24 18:03:30.718750 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:30.718738    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-06ffdb/auth-test-model-06ffdb-kserve-6477d5bb4c-5hshw" event={"ID":"1f0136cf-45ee-4eef-91ff-1598a4103f91","Type":"ContainerDied","Data":"9b94e8bfe208a445456c7fef7d9c0105eda2570239e3034b7ce60fdce2595e09"}
Jul 24 18:03:30.719088 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:30.718788    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-06ffdb/auth-test-model-06ffdb-kserve-6477d5bb4c-5hshw" event={"ID":"1f0136cf-45ee-4eef-91ff-1598a4103f91","Type":"ContainerDied","Data":"783a63ac10c0d1084264a39fdc4a9189521c808e727a979cc4a8871e99fd904b"}
Jul 24 18:03:30.719088 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:30.718807    2575 scope.go:117] "RemoveContainer" containerID="9b94e8bfe208a445456c7fef7d9c0105eda2570239e3034b7ce60fdce2595e09"
Jul 24 18:03:30.727910 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:30.727888    2575 scope.go:117] "RemoveContainer" containerID="9b94e8bfe208a445456c7fef7d9c0105eda2570239e3034b7ce60fdce2595e09"
Jul 24 18:03:30.728218 ip-10-0-139-113 kubenswrapper[2575]: E0724 18:03:30.728199    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b94e8bfe208a445456c7fef7d9c0105eda2570239e3034b7ce60fdce2595e09\": container with ID starting with 9b94e8bfe208a445456c7fef7d9c0105eda2570239e3034b7ce60fdce2595e09 not found: ID does not exist" containerID="9b94e8bfe208a445456c7fef7d9c0105eda2570239e3034b7ce60fdce2595e09"
Jul 24 18:03:30.728261 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:30.728227    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b94e8bfe208a445456c7fef7d9c0105eda2570239e3034b7ce60fdce2595e09"} err="failed to get container status \"9b94e8bfe208a445456c7fef7d9c0105eda2570239e3034b7ce60fdce2595e09\": rpc error: code = NotFound desc = could not find container \"9b94e8bfe208a445456c7fef7d9c0105eda2570239e3034b7ce60fdce2595e09\": container with ID starting with 9b94e8bfe208a445456c7fef7d9c0105eda2570239e3034b7ce60fdce2595e09 not found: ID does not exist"
Jul 24 18:03:30.744575 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:30.742434    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-06ffdb/auth-test-model-06ffdb-kserve-6477d5bb4c-5hshw"]
Jul 24 18:03:30.745611 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:30.745576    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-06ffdb/auth-test-model-06ffdb-kserve-6477d5bb4c-5hshw"]
Jul 24 18:03:31.201270 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:31.201224    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f0136cf-45ee-4eef-91ff-1598a4103f91" path="/var/lib/kubelet/pods/1f0136cf-45ee-4eef-91ff-1598a4103f91/volumes"
Jul 24 18:03:31.201825 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:31.201803    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8" path="/var/lib/kubelet/pods/f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8/volumes"
Jul 24 18:03:35.145512 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:35.145463    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-shared-b-06ffdb/auth-test-model-06ffdb-kserve-6477d5bb4c-5hshw" podUID="1f0136cf-45ee-4eef-91ff-1598a4103f91" containerName="main" probeResult="failure" output="Get \"https://10.134.0.36:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Jul 24 18:03:35.300588 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:35.300550    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-257940/sub-test-model-257940-kserve-6bc96896b9-jlhq2"
Jul 24 18:03:35.300588 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:35.300589    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-257940/sub-test-model-257940-kserve-6bc96896b9-jlhq2"
Jul 24 18:03:35.313161 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:35.313129    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-257940/sub-test-model-257940-kserve-6bc96896b9-jlhq2"
Jul 24 18:03:35.755379 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:03:35.755348    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-257940/sub-test-model-257940-kserve-6bc96896b9-jlhq2"
Jul 24 18:04:24.492098 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:04:24.492065    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-06ffdb/sub-test-model-06ffdb-kserve-689fb5db55-4xxx6"]
Jul 24 18:04:24.492501 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:04:24.492364    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8" containerName="main"
Jul 24 18:04:24.492501 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:04:24.492374    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8" containerName="main"
Jul 24 18:04:24.492501 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:04:24.492385    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f0136cf-45ee-4eef-91ff-1598a4103f91" containerName="main"
Jul 24 18:04:24.492501 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:04:24.492393    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f0136cf-45ee-4eef-91ff-1598a4103f91" containerName="main"
Jul 24 18:04:24.492501 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:04:24.492466    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9f1a13c-13f8-4b8f-8820-de8a73f1d6d8" containerName="main"
Jul 24 18:04:24.492501 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:04:24.492477    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f0136cf-45ee-4eef-91ff-1598a4103f91" containerName="main"
Jul 24 18:04:24.495196 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:04:24.495179    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-06ffdb/sub-test-model-06ffdb-kserve-689fb5db55-4xxx6"
Jul 24 18:04:24.500167 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:04:24.500140    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-06ffdb\"/\"default-dockercfg-7clj4\""
Jul 24 18:04:24.500167 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:04:24.500161    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-06ffdb\"/\"kube-root-ca.crt\""
Jul 24 18:04:24.500391 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:04:24.500183    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-06ffdb\"/\"openshift-service-ca.crt\""
Jul 24 18:04:24.500391 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:04:24.500145    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-06ffdb\"/\"sub-test-model-06ffdb-kserve-self-signed-certs\""
Jul 24 18:04:24.519165 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:04:24.519135    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-06ffdb/sub-test-model-06ffdb-kserve-689fb5db55-4xxx6"]
Jul 24 18:04:24.558695 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:04:24.558645    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:04:24.598981 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:04:24.598928    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f-tmp-dir\") pod \"sub-test-model-06ffdb-kserve-689fb5db55-4xxx6\" (UID: \"ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f\") " pod="ai-tenant-e2e-shared-b-06ffdb/sub-test-model-06ffdb-kserve-689fb5db55-4xxx6"
Jul 24 18:04:24.599132 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:04:24.598992    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f-tls-certs\") pod \"sub-test-model-06ffdb-kserve-689fb5db55-4xxx6\" (UID: \"ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f\") " pod="ai-tenant-e2e-shared-b-06ffdb/sub-test-model-06ffdb-kserve-689fb5db55-4xxx6"
Jul 24 18:04:24.599132 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:04:24.599116    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4zq8\" (UniqueName: \"kubernetes.io/projected/ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f-kube-api-access-f4zq8\") pod \"sub-test-model-06ffdb-kserve-689fb5db55-4xxx6\" (UID: \"ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f\") " pod="ai-tenant-e2e-shared-b-06ffdb/sub-test-model-06ffdb-kserve-689fb5db55-4xxx6"
Jul 24 18:04:24.599222 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:04:24.599169    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f-model-cache\") pod \"sub-test-model-06ffdb-kserve-689fb5db55-4xxx6\" (UID: \"ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f\") " pod="ai-tenant-e2e-shared-b-06ffdb/sub-test-model-06ffdb-kserve-689fb5db55-4xxx6"
Jul 24 18:04:24.599222 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:04:24.599207    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f-home\") pod \"sub-test-model-06ffdb-kserve-689fb5db55-4xxx6\" (UID: \"ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f\") " pod="ai-tenant-e2e-shared-b-06ffdb/sub-test-model-06ffdb-kserve-689fb5db55-4xxx6"
Jul 24 18:04:24.599296 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:04:24.599230    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f-dshm\") pod \"sub-test-model-06ffdb-kserve-689fb5db55-4xxx6\" (UID: \"ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f\") " pod="ai-tenant-e2e-shared-b-06ffdb/sub-test-model-06ffdb-kserve-689fb5db55-4xxx6"
Jul 24 18:04:24.700711 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:04:24.700676    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4zq8\" (UniqueName: \"kubernetes.io/projected/ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f-kube-api-access-f4zq8\") pod \"sub-test-model-06ffdb-kserve-689fb5db55-4xxx6\" (UID: \"ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f\") " pod="ai-tenant-e2e-shared-b-06ffdb/sub-test-model-06ffdb-kserve-689fb5db55-4xxx6"
Jul 24 18:04:24.700868 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:04:24.700724    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f-model-cache\") pod \"sub-test-model-06ffdb-kserve-689fb5db55-4xxx6\" (UID: \"ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f\") " pod="ai-tenant-e2e-shared-b-06ffdb/sub-test-model-06ffdb-kserve-689fb5db55-4xxx6"
Jul 24 18:04:24.700920 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:04:24.700903    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f-home\") pod \"sub-test-model-06ffdb-kserve-689fb5db55-4xxx6\" (UID: \"ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f\") " pod="ai-tenant-e2e-shared-b-06ffdb/sub-test-model-06ffdb-kserve-689fb5db55-4xxx6"
Jul 24 18:04:24.700982 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:04:24.700964    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f-dshm\") pod \"sub-test-model-06ffdb-kserve-689fb5db55-4xxx6\" (UID: \"ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f\") " pod="ai-tenant-e2e-shared-b-06ffdb/sub-test-model-06ffdb-kserve-689fb5db55-4xxx6"
Jul 24 18:04:24.701036 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:04:24.701002    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f-tmp-dir\") pod \"sub-test-model-06ffdb-kserve-689fb5db55-4xxx6\" (UID: \"ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f\") " pod="ai-tenant-e2e-shared-b-06ffdb/sub-test-model-06ffdb-kserve-689fb5db55-4xxx6"
Jul 24 18:04:24.701086 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:04:24.701048    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f-tls-certs\") pod \"sub-test-model-06ffdb-kserve-689fb5db55-4xxx6\" (UID: \"ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f\") " pod="ai-tenant-e2e-shared-b-06ffdb/sub-test-model-06ffdb-kserve-689fb5db55-4xxx6"
Jul 24 18:04:24.701224 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:04:24.701198    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f-model-cache\") pod \"sub-test-model-06ffdb-kserve-689fb5db55-4xxx6\" (UID: \"ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f\") " pod="ai-tenant-e2e-shared-b-06ffdb/sub-test-model-06ffdb-kserve-689fb5db55-4xxx6"
Jul 24 18:04:24.701412 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:04:24.701348    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f-home\") pod \"sub-test-model-06ffdb-kserve-689fb5db55-4xxx6\" (UID: \"ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f\") " pod="ai-tenant-e2e-shared-b-06ffdb/sub-test-model-06ffdb-kserve-689fb5db55-4xxx6"
Jul 24 18:04:24.701466 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:04:24.701423    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f-tmp-dir\") pod \"sub-test-model-06ffdb-kserve-689fb5db55-4xxx6\" (UID: \"ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f\") " pod="ai-tenant-e2e-shared-b-06ffdb/sub-test-model-06ffdb-kserve-689fb5db55-4xxx6"
Jul 24 18:04:24.703334 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:04:24.703316    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f-dshm\") pod \"sub-test-model-06ffdb-kserve-689fb5db55-4xxx6\" (UID: \"ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f\") " pod="ai-tenant-e2e-shared-b-06ffdb/sub-test-model-06ffdb-kserve-689fb5db55-4xxx6"
Jul 24 18:04:24.703615 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:04:24.703595    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f-tls-certs\") pod \"sub-test-model-06ffdb-kserve-689fb5db55-4xxx6\" (UID: \"ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f\") " pod="ai-tenant-e2e-shared-b-06ffdb/sub-test-model-06ffdb-kserve-689fb5db55-4xxx6"
Jul 24 18:04:24.710327 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:04:24.710306    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4zq8\" (UniqueName: \"kubernetes.io/projected/ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f-kube-api-access-f4zq8\") pod \"sub-test-model-06ffdb-kserve-689fb5db55-4xxx6\" (UID: \"ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f\") " pod="ai-tenant-e2e-shared-b-06ffdb/sub-test-model-06ffdb-kserve-689fb5db55-4xxx6"
Jul 24 18:04:24.804791 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:04:24.804757    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-06ffdb/sub-test-model-06ffdb-kserve-689fb5db55-4xxx6"
Jul 24 18:04:24.943058 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:04:24.943027    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-06ffdb/sub-test-model-06ffdb-kserve-689fb5db55-4xxx6"]
Jul 24 18:04:24.945338 ip-10-0-139-113 kubenswrapper[2575]: W0724 18:04:24.945305    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podff3215c8_b5b0_4dcc_96d4_c3e58ada5b3f.slice/crio-0893261c2955a4c248ba3e1bd9c2806bf45f3907c9e6396a01f472a70b6130c4 WatchSource:0}: Error finding container 0893261c2955a4c248ba3e1bd9c2806bf45f3907c9e6396a01f472a70b6130c4: Status 404 returned error can't find the container with id 0893261c2955a4c248ba3e1bd9c2806bf45f3907c9e6396a01f472a70b6130c4
Jul 24 18:04:24.964689 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:04:24.964661    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-06ffdb/sub-test-model-06ffdb-kserve-689fb5db55-4xxx6" event={"ID":"ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f","Type":"ContainerStarted","Data":"0893261c2955a4c248ba3e1bd9c2806bf45f3907c9e6396a01f472a70b6130c4"}
Jul 24 18:04:25.971721 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:04:25.971681    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-06ffdb/sub-test-model-06ffdb-kserve-689fb5db55-4xxx6" event={"ID":"ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f","Type":"ContainerStarted","Data":"514d4753a529d2ac9d1fb1b28a05ba1694afd9159a09f66d89667131f63cf6ee"}
Jul 24 18:04:26.009168 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:04:26.009112    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-06ffdb/sub-test-model-06ffdb-kserve-689fb5db55-4xxx6" podStartSLOduration=2.00909349 podStartE2EDuration="2.00909349s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:04:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:04:26.006656617 +0000 UTC m=+2801.488032236" watchObservedRunningTime="2026-07-24 18:04:26.00909349 +0000 UTC m=+2801.490469109"
Jul 24 18:04:34.805835 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:04:34.805792    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-06ffdb/sub-test-model-06ffdb-kserve-689fb5db55-4xxx6"
Jul 24 18:04:34.806565 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:04:34.805855    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-06ffdb/sub-test-model-06ffdb-kserve-689fb5db55-4xxx6"
Jul 24 18:04:34.818407 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:04:34.818370    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-06ffdb/sub-test-model-06ffdb-kserve-689fb5db55-4xxx6"
Jul 24 18:04:35.024728 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:04:35.024699    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-06ffdb/sub-test-model-06ffdb-kserve-689fb5db55-4xxx6"
Jul 24 18:04:42.838077 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:04:42.838042    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:05:05.495519 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:05.495486    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-257940/sub-test-model-257940-kserve-6bc96896b9-jlhq2"]
Jul 24 18:05:05.525823 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:05.525796    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:05:06.415683 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:06.415646    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-06ffdb/sub-test-model-06ffdb-kserve-689fb5db55-4xxx6"]
Jul 24 18:05:06.446835 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:06.446803    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:05:19.785100 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:19.785065    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-257940/rate-test-model-257940-kserve-55758f76bc-cllnf"]
Jul 24 18:05:19.788378 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:19.788361    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-257940/rate-test-model-257940-kserve-55758f76bc-cllnf"
Jul 24 18:05:19.791004 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:19.790975    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-257940\"/\"rate-test-model-257940-kserve-self-signed-certs\""
Jul 24 18:05:19.801642 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:19.801612    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-257940/rate-test-model-257940-kserve-55758f76bc-cllnf"]
Jul 24 18:05:19.816827 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:19.816794    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:05:19.907978 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:19.907923    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b89dc320-993c-4f6b-9c96-d31310a9512e-dshm\") pod \"rate-test-model-257940-kserve-55758f76bc-cllnf\" (UID: \"b89dc320-993c-4f6b-9c96-d31310a9512e\") " pod="ai-tenant-e2e-shared-a-257940/rate-test-model-257940-kserve-55758f76bc-cllnf"
Jul 24 18:05:19.908167 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:19.907997    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b89dc320-993c-4f6b-9c96-d31310a9512e-tmp-dir\") pod \"rate-test-model-257940-kserve-55758f76bc-cllnf\" (UID: \"b89dc320-993c-4f6b-9c96-d31310a9512e\") " pod="ai-tenant-e2e-shared-a-257940/rate-test-model-257940-kserve-55758f76bc-cllnf"
Jul 24 18:05:19.908167 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:19.908022    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8k2v\" (UniqueName: \"kubernetes.io/projected/b89dc320-993c-4f6b-9c96-d31310a9512e-kube-api-access-g8k2v\") pod \"rate-test-model-257940-kserve-55758f76bc-cllnf\" (UID: \"b89dc320-993c-4f6b-9c96-d31310a9512e\") " pod="ai-tenant-e2e-shared-a-257940/rate-test-model-257940-kserve-55758f76bc-cllnf"
Jul 24 18:05:19.908167 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:19.908063    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b89dc320-993c-4f6b-9c96-d31310a9512e-home\") pod \"rate-test-model-257940-kserve-55758f76bc-cllnf\" (UID: \"b89dc320-993c-4f6b-9c96-d31310a9512e\") " pod="ai-tenant-e2e-shared-a-257940/rate-test-model-257940-kserve-55758f76bc-cllnf"
Jul 24 18:05:19.908167 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:19.908130    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b89dc320-993c-4f6b-9c96-d31310a9512e-model-cache\") pod \"rate-test-model-257940-kserve-55758f76bc-cllnf\" (UID: \"b89dc320-993c-4f6b-9c96-d31310a9512e\") " pod="ai-tenant-e2e-shared-a-257940/rate-test-model-257940-kserve-55758f76bc-cllnf"
Jul 24 18:05:19.908167 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:19.908162    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b89dc320-993c-4f6b-9c96-d31310a9512e-tls-certs\") pod \"rate-test-model-257940-kserve-55758f76bc-cllnf\" (UID: \"b89dc320-993c-4f6b-9c96-d31310a9512e\") " pod="ai-tenant-e2e-shared-a-257940/rate-test-model-257940-kserve-55758f76bc-cllnf"
Jul 24 18:05:20.009242 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:20.009203    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b89dc320-993c-4f6b-9c96-d31310a9512e-dshm\") pod \"rate-test-model-257940-kserve-55758f76bc-cllnf\" (UID: \"b89dc320-993c-4f6b-9c96-d31310a9512e\") " pod="ai-tenant-e2e-shared-a-257940/rate-test-model-257940-kserve-55758f76bc-cllnf"
Jul 24 18:05:20.009438 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:20.009267    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b89dc320-993c-4f6b-9c96-d31310a9512e-tmp-dir\") pod \"rate-test-model-257940-kserve-55758f76bc-cllnf\" (UID: \"b89dc320-993c-4f6b-9c96-d31310a9512e\") " pod="ai-tenant-e2e-shared-a-257940/rate-test-model-257940-kserve-55758f76bc-cllnf"
Jul 24 18:05:20.009886 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:20.009301    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8k2v\" (UniqueName: \"kubernetes.io/projected/b89dc320-993c-4f6b-9c96-d31310a9512e-kube-api-access-g8k2v\") pod \"rate-test-model-257940-kserve-55758f76bc-cllnf\" (UID: \"b89dc320-993c-4f6b-9c96-d31310a9512e\") " pod="ai-tenant-e2e-shared-a-257940/rate-test-model-257940-kserve-55758f76bc-cllnf"
Jul 24 18:05:20.013962 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:20.010109    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b89dc320-993c-4f6b-9c96-d31310a9512e-tmp-dir\") pod \"rate-test-model-257940-kserve-55758f76bc-cllnf\" (UID: \"b89dc320-993c-4f6b-9c96-d31310a9512e\") " pod="ai-tenant-e2e-shared-a-257940/rate-test-model-257940-kserve-55758f76bc-cllnf"
Jul 24 18:05:20.013962 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:20.010156    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b89dc320-993c-4f6b-9c96-d31310a9512e-home\") pod \"rate-test-model-257940-kserve-55758f76bc-cllnf\" (UID: \"b89dc320-993c-4f6b-9c96-d31310a9512e\") " pod="ai-tenant-e2e-shared-a-257940/rate-test-model-257940-kserve-55758f76bc-cllnf"
Jul 24 18:05:20.013962 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:20.010231    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b89dc320-993c-4f6b-9c96-d31310a9512e-model-cache\") pod \"rate-test-model-257940-kserve-55758f76bc-cllnf\" (UID: \"b89dc320-993c-4f6b-9c96-d31310a9512e\") " pod="ai-tenant-e2e-shared-a-257940/rate-test-model-257940-kserve-55758f76bc-cllnf"
Jul 24 18:05:20.013962 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:20.010269    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b89dc320-993c-4f6b-9c96-d31310a9512e-tls-certs\") pod \"rate-test-model-257940-kserve-55758f76bc-cllnf\" (UID: \"b89dc320-993c-4f6b-9c96-d31310a9512e\") " pod="ai-tenant-e2e-shared-a-257940/rate-test-model-257940-kserve-55758f76bc-cllnf"
Jul 24 18:05:20.013962 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:20.010381    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b89dc320-993c-4f6b-9c96-d31310a9512e-home\") pod \"rate-test-model-257940-kserve-55758f76bc-cllnf\" (UID: \"b89dc320-993c-4f6b-9c96-d31310a9512e\") " pod="ai-tenant-e2e-shared-a-257940/rate-test-model-257940-kserve-55758f76bc-cllnf"
Jul 24 18:05:20.013962 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:20.010640    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b89dc320-993c-4f6b-9c96-d31310a9512e-model-cache\") pod \"rate-test-model-257940-kserve-55758f76bc-cllnf\" (UID: \"b89dc320-993c-4f6b-9c96-d31310a9512e\") " pod="ai-tenant-e2e-shared-a-257940/rate-test-model-257940-kserve-55758f76bc-cllnf"
Jul 24 18:05:20.013962 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:20.012298    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b89dc320-993c-4f6b-9c96-d31310a9512e-dshm\") pod \"rate-test-model-257940-kserve-55758f76bc-cllnf\" (UID: \"b89dc320-993c-4f6b-9c96-d31310a9512e\") " pod="ai-tenant-e2e-shared-a-257940/rate-test-model-257940-kserve-55758f76bc-cllnf"
Jul 24 18:05:20.013962 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:20.013263    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b89dc320-993c-4f6b-9c96-d31310a9512e-tls-certs\") pod \"rate-test-model-257940-kserve-55758f76bc-cllnf\" (UID: \"b89dc320-993c-4f6b-9c96-d31310a9512e\") " pod="ai-tenant-e2e-shared-a-257940/rate-test-model-257940-kserve-55758f76bc-cllnf"
Jul 24 18:05:20.019834 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:20.019804    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8k2v\" (UniqueName: \"kubernetes.io/projected/b89dc320-993c-4f6b-9c96-d31310a9512e-kube-api-access-g8k2v\") pod \"rate-test-model-257940-kserve-55758f76bc-cllnf\" (UID: \"b89dc320-993c-4f6b-9c96-d31310a9512e\") " pod="ai-tenant-e2e-shared-a-257940/rate-test-model-257940-kserve-55758f76bc-cllnf"
Jul 24 18:05:20.097913 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:20.097811    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-257940/rate-test-model-257940-kserve-55758f76bc-cllnf"
Jul 24 18:05:20.236997 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:20.236970    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-257940/rate-test-model-257940-kserve-55758f76bc-cllnf"]
Jul 24 18:05:20.238982 ip-10-0-139-113 kubenswrapper[2575]: W0724 18:05:20.238956    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb89dc320_993c_4f6b_9c96_d31310a9512e.slice/crio-5734d40aae241f8953910c5bc470f595e06f1c9266dddc6f3d77cf8b288d36cf WatchSource:0}: Error finding container 5734d40aae241f8953910c5bc470f595e06f1c9266dddc6f3d77cf8b288d36cf: Status 404 returned error can't find the container with id 5734d40aae241f8953910c5bc470f595e06f1c9266dddc6f3d77cf8b288d36cf
Jul 24 18:05:20.514229 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:20.514140    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-257940/sub-test-model-257940-kserve-6bc96896b9-jlhq2" podUID="dbea92ff-5708-4594-9c8d-1b7c6399cd80" containerName="main" containerID="cri-o://0f7b9832aac25722ef0e82c88e6a3153014785d0ad404212775ec51c17c0e11d" gracePeriod=45
Jul 24 18:05:20.759860 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:20.759831    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-257940/sub-test-model-257940-kserve-6bc96896b9-jlhq2"
Jul 24 18:05:20.819063 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:20.819025    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dbea92ff-5708-4594-9c8d-1b7c6399cd80-tmp-dir\") pod \"dbea92ff-5708-4594-9c8d-1b7c6399cd80\" (UID: \"dbea92ff-5708-4594-9c8d-1b7c6399cd80\") "
Jul 24 18:05:20.819063 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:20.819073    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dbea92ff-5708-4594-9c8d-1b7c6399cd80-dshm\") pod \"dbea92ff-5708-4594-9c8d-1b7c6399cd80\" (UID: \"dbea92ff-5708-4594-9c8d-1b7c6399cd80\") "
Jul 24 18:05:20.819603 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:20.819107    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbea92ff-5708-4594-9c8d-1b7c6399cd80-tls-certs\") pod \"dbea92ff-5708-4594-9c8d-1b7c6399cd80\" (UID: \"dbea92ff-5708-4594-9c8d-1b7c6399cd80\") "
Jul 24 18:05:20.819603 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:20.819167    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dbea92ff-5708-4594-9c8d-1b7c6399cd80-model-cache\") pod \"dbea92ff-5708-4594-9c8d-1b7c6399cd80\" (UID: \"dbea92ff-5708-4594-9c8d-1b7c6399cd80\") "
Jul 24 18:05:20.819603 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:20.819186    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dbea92ff-5708-4594-9c8d-1b7c6399cd80-home\") pod \"dbea92ff-5708-4594-9c8d-1b7c6399cd80\" (UID: \"dbea92ff-5708-4594-9c8d-1b7c6399cd80\") "
Jul 24 18:05:20.819603 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:20.819220    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4n9n8\" (UniqueName: \"kubernetes.io/projected/dbea92ff-5708-4594-9c8d-1b7c6399cd80-kube-api-access-4n9n8\") pod \"dbea92ff-5708-4594-9c8d-1b7c6399cd80\" (UID: \"dbea92ff-5708-4594-9c8d-1b7c6399cd80\") "
Jul 24 18:05:20.819603 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:20.819310    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbea92ff-5708-4594-9c8d-1b7c6399cd80-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "dbea92ff-5708-4594-9c8d-1b7c6399cd80" (UID: "dbea92ff-5708-4594-9c8d-1b7c6399cd80"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 18:05:20.819603 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:20.819459    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbea92ff-5708-4594-9c8d-1b7c6399cd80-model-cache" (OuterVolumeSpecName: "model-cache") pod "dbea92ff-5708-4594-9c8d-1b7c6399cd80" (UID: "dbea92ff-5708-4594-9c8d-1b7c6399cd80"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 18:05:20.819603 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:20.819475    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbea92ff-5708-4594-9c8d-1b7c6399cd80-home" (OuterVolumeSpecName: "home") pod "dbea92ff-5708-4594-9c8d-1b7c6399cd80" (UID: "dbea92ff-5708-4594-9c8d-1b7c6399cd80"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 18:05:20.819603 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:20.819517    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dbea92ff-5708-4594-9c8d-1b7c6399cd80-tmp-dir\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 18:05:20.821342 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:20.821321    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbea92ff-5708-4594-9c8d-1b7c6399cd80-dshm" (OuterVolumeSpecName: "dshm") pod "dbea92ff-5708-4594-9c8d-1b7c6399cd80" (UID: "dbea92ff-5708-4594-9c8d-1b7c6399cd80"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 18:05:20.821427 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:20.821354    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbea92ff-5708-4594-9c8d-1b7c6399cd80-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "dbea92ff-5708-4594-9c8d-1b7c6399cd80" (UID: "dbea92ff-5708-4594-9c8d-1b7c6399cd80"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 18:05:20.821427 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:20.821365    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbea92ff-5708-4594-9c8d-1b7c6399cd80-kube-api-access-4n9n8" (OuterVolumeSpecName: "kube-api-access-4n9n8") pod "dbea92ff-5708-4594-9c8d-1b7c6399cd80" (UID: "dbea92ff-5708-4594-9c8d-1b7c6399cd80"). InnerVolumeSpecName "kube-api-access-4n9n8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:05:20.920834 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:20.920799    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbea92ff-5708-4594-9c8d-1b7c6399cd80-tls-certs\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 18:05:20.920834 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:20.920826    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dbea92ff-5708-4594-9c8d-1b7c6399cd80-model-cache\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 18:05:20.920834 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:20.920835    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dbea92ff-5708-4594-9c8d-1b7c6399cd80-home\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 18:05:20.920834 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:20.920843    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4n9n8\" (UniqueName: \"kubernetes.io/projected/dbea92ff-5708-4594-9c8d-1b7c6399cd80-kube-api-access-4n9n8\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 18:05:20.921118 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:20.920851    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dbea92ff-5708-4594-9c8d-1b7c6399cd80-dshm\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 18:05:21.215008 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:21.214969    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-257940/rate-test-model-257940-kserve-55758f76bc-cllnf" event={"ID":"b89dc320-993c-4f6b-9c96-d31310a9512e","Type":"ContainerStarted","Data":"a3b50fbb8053cca2386e53791dea195b7d15b5527c76eeae9f91b7e28ae04838"}
Jul 24 18:05:21.215181 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:21.215022    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-257940/rate-test-model-257940-kserve-55758f76bc-cllnf" event={"ID":"b89dc320-993c-4f6b-9c96-d31310a9512e","Type":"ContainerStarted","Data":"5734d40aae241f8953910c5bc470f595e06f1c9266dddc6f3d77cf8b288d36cf"}
Jul 24 18:05:21.216271 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:21.216249    2575 generic.go:356] "Generic (PLEG): container finished" podID="dbea92ff-5708-4594-9c8d-1b7c6399cd80" containerID="0f7b9832aac25722ef0e82c88e6a3153014785d0ad404212775ec51c17c0e11d" exitCode=0
Jul 24 18:05:21.216361 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:21.216289    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-257940/sub-test-model-257940-kserve-6bc96896b9-jlhq2"
Jul 24 18:05:21.216414 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:21.216290    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-257940/sub-test-model-257940-kserve-6bc96896b9-jlhq2" event={"ID":"dbea92ff-5708-4594-9c8d-1b7c6399cd80","Type":"ContainerDied","Data":"0f7b9832aac25722ef0e82c88e6a3153014785d0ad404212775ec51c17c0e11d"}
Jul 24 18:05:21.216451 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:21.216420    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-257940/sub-test-model-257940-kserve-6bc96896b9-jlhq2" event={"ID":"dbea92ff-5708-4594-9c8d-1b7c6399cd80","Type":"ContainerDied","Data":"a3b6549edac56c46dc01a287b4b24b082f758df6cf8e1b7cc5bb71538b25c27a"}
Jul 24 18:05:21.216488 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:21.216449    2575 scope.go:117] "RemoveContainer" containerID="0f7b9832aac25722ef0e82c88e6a3153014785d0ad404212775ec51c17c0e11d"
Jul 24 18:05:21.224664 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:21.224641    2575 scope.go:117] "RemoveContainer" containerID="0f7b9832aac25722ef0e82c88e6a3153014785d0ad404212775ec51c17c0e11d"
Jul 24 18:05:21.224917 ip-10-0-139-113 kubenswrapper[2575]: E0724 18:05:21.224898    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f7b9832aac25722ef0e82c88e6a3153014785d0ad404212775ec51c17c0e11d\": container with ID starting with 0f7b9832aac25722ef0e82c88e6a3153014785d0ad404212775ec51c17c0e11d not found: ID does not exist" containerID="0f7b9832aac25722ef0e82c88e6a3153014785d0ad404212775ec51c17c0e11d"
Jul 24 18:05:21.225056 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:21.224929    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f7b9832aac25722ef0e82c88e6a3153014785d0ad404212775ec51c17c0e11d"} err="failed to get container status \"0f7b9832aac25722ef0e82c88e6a3153014785d0ad404212775ec51c17c0e11d\": rpc error: code = NotFound desc = could not find container \"0f7b9832aac25722ef0e82c88e6a3153014785d0ad404212775ec51c17c0e11d\": container with ID starting with 0f7b9832aac25722ef0e82c88e6a3153014785d0ad404212775ec51c17c0e11d not found: ID does not exist"
Jul 24 18:05:21.234589 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:21.234546    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-257940/rate-test-model-257940-kserve-55758f76bc-cllnf" podStartSLOduration=2.234530456 podStartE2EDuration="2.234530456s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:05:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:05:21.23298171 +0000 UTC m=+2856.714357327" watchObservedRunningTime="2026-07-24 18:05:21.234530456 +0000 UTC m=+2856.715906075"
Jul 24 18:05:21.247030 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:21.246998    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-257940/sub-test-model-257940-kserve-6bc96896b9-jlhq2"]
Jul 24 18:05:21.251740 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:21.251719    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-257940/sub-test-model-257940-kserve-6bc96896b9-jlhq2"]
Jul 24 18:05:21.434172 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:21.434135    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-06ffdb/sub-test-model-06ffdb-kserve-689fb5db55-4xxx6" podUID="ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f" containerName="main" containerID="cri-o://514d4753a529d2ac9d1fb1b28a05ba1694afd9159a09f66d89667131f63cf6ee" gracePeriod=45
Jul 24 18:05:21.680734 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:21.680704    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-06ffdb/sub-test-model-06ffdb-kserve-689fb5db55-4xxx6"
Jul 24 18:05:21.728048 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:21.728001    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f-tmp-dir\") pod \"ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f\" (UID: \"ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f\") "
Jul 24 18:05:21.728048 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:21.728060    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f4zq8\" (UniqueName: \"kubernetes.io/projected/ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f-kube-api-access-f4zq8\") pod \"ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f\" (UID: \"ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f\") "
Jul 24 18:05:21.728336 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:21.728102    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f-home\") pod \"ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f\" (UID: \"ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f\") "
Jul 24 18:05:21.728336 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:21.728124    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f-dshm\") pod \"ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f\" (UID: \"ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f\") "
Jul 24 18:05:21.728336 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:21.728179    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f-model-cache\") pod \"ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f\" (UID: \"ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f\") "
Jul 24 18:05:21.728336 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:21.728227    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f-tls-certs\") pod \"ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f\" (UID: \"ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f\") "
Jul 24 18:05:21.728336 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:21.728288    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f" (UID: "ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 18:05:21.728608 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:21.728414    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f-home" (OuterVolumeSpecName: "home") pod "ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f" (UID: "ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 18:05:21.728608 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:21.728424    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f-model-cache" (OuterVolumeSpecName: "model-cache") pod "ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f" (UID: "ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 18:05:21.728608 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:21.728510    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f-tmp-dir\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 18:05:21.728608 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:21.728527    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f-home\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 18:05:21.728608 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:21.728536    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f-model-cache\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 18:05:21.730317 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:21.730289    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f-kube-api-access-f4zq8" (OuterVolumeSpecName: "kube-api-access-f4zq8") pod "ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f" (UID: "ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f"). InnerVolumeSpecName "kube-api-access-f4zq8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:05:21.730428 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:21.730319    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f" (UID: "ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 18:05:21.730483 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:21.730457    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f-dshm" (OuterVolumeSpecName: "dshm") pod "ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f" (UID: "ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 18:05:21.829823 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:21.829731    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f-tls-certs\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 18:05:21.829823 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:21.829763    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f4zq8\" (UniqueName: \"kubernetes.io/projected/ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f-kube-api-access-f4zq8\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 18:05:21.829823 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:21.829774    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f-dshm\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 18:05:22.222400 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:22.222315    2575 generic.go:356] "Generic (PLEG): container finished" podID="ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f" containerID="514d4753a529d2ac9d1fb1b28a05ba1694afd9159a09f66d89667131f63cf6ee" exitCode=0
Jul 24 18:05:22.222400 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:22.222352    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-06ffdb/sub-test-model-06ffdb-kserve-689fb5db55-4xxx6"
Jul 24 18:05:22.222636 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:22.222403    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-06ffdb/sub-test-model-06ffdb-kserve-689fb5db55-4xxx6" event={"ID":"ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f","Type":"ContainerDied","Data":"514d4753a529d2ac9d1fb1b28a05ba1694afd9159a09f66d89667131f63cf6ee"}
Jul 24 18:05:22.222636 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:22.222450    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-06ffdb/sub-test-model-06ffdb-kserve-689fb5db55-4xxx6" event={"ID":"ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f","Type":"ContainerDied","Data":"0893261c2955a4c248ba3e1bd9c2806bf45f3907c9e6396a01f472a70b6130c4"}
Jul 24 18:05:22.222636 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:22.222472    2575 scope.go:117] "RemoveContainer" containerID="514d4753a529d2ac9d1fb1b28a05ba1694afd9159a09f66d89667131f63cf6ee"
Jul 24 18:05:22.231139 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:22.231121    2575 scope.go:117] "RemoveContainer" containerID="514d4753a529d2ac9d1fb1b28a05ba1694afd9159a09f66d89667131f63cf6ee"
Jul 24 18:05:22.231419 ip-10-0-139-113 kubenswrapper[2575]: E0724 18:05:22.231402    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"514d4753a529d2ac9d1fb1b28a05ba1694afd9159a09f66d89667131f63cf6ee\": container with ID starting with 514d4753a529d2ac9d1fb1b28a05ba1694afd9159a09f66d89667131f63cf6ee not found: ID does not exist" containerID="514d4753a529d2ac9d1fb1b28a05ba1694afd9159a09f66d89667131f63cf6ee"
Jul 24 18:05:22.231464 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:22.231427    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"514d4753a529d2ac9d1fb1b28a05ba1694afd9159a09f66d89667131f63cf6ee"} err="failed to get container status \"514d4753a529d2ac9d1fb1b28a05ba1694afd9159a09f66d89667131f63cf6ee\": rpc error: code = NotFound desc = could not find container \"514d4753a529d2ac9d1fb1b28a05ba1694afd9159a09f66d89667131f63cf6ee\": container with ID starting with 514d4753a529d2ac9d1fb1b28a05ba1694afd9159a09f66d89667131f63cf6ee not found: ID does not exist"
Jul 24 18:05:22.245224 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:22.245193    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-06ffdb/sub-test-model-06ffdb-kserve-689fb5db55-4xxx6"]
Jul 24 18:05:22.249313 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:22.249285    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-06ffdb/sub-test-model-06ffdb-kserve-689fb5db55-4xxx6"]
Jul 24 18:05:23.201736 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:23.201702    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbea92ff-5708-4594-9c8d-1b7c6399cd80" path="/var/lib/kubelet/pods/dbea92ff-5708-4594-9c8d-1b7c6399cd80/volumes"
Jul 24 18:05:23.202128 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:23.202118    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f" path="/var/lib/kubelet/pods/ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f/volumes"
Jul 24 18:05:30.098035 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:30.097998    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-257940/rate-test-model-257940-kserve-55758f76bc-cllnf"
Jul 24 18:05:30.098533 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:30.098055    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-257940/rate-test-model-257940-kserve-55758f76bc-cllnf"
Jul 24 18:05:30.116270 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:30.116234    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-257940/rate-test-model-257940-kserve-55758f76bc-cllnf"
Jul 24 18:05:30.267877 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:30.267845    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-257940/rate-test-model-257940-kserve-55758f76bc-cllnf"
Jul 24 18:05:44.905274 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:44.905187    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-06ffdb/rate-test-model-06ffdb-kserve-6565997b47-wvml6"]
Jul 24 18:05:44.905739 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:44.905517    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f" containerName="main"
Jul 24 18:05:44.905739 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:44.905529    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f" containerName="main"
Jul 24 18:05:44.905739 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:44.905544    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbea92ff-5708-4594-9c8d-1b7c6399cd80" containerName="main"
Jul 24 18:05:44.905739 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:44.905549    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbea92ff-5708-4594-9c8d-1b7c6399cd80" containerName="main"
Jul 24 18:05:44.905739 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:44.905616    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff3215c8-b5b0-4dcc-96d4-c3e58ada5b3f" containerName="main"
Jul 24 18:05:44.905739 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:44.905625    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbea92ff-5708-4594-9c8d-1b7c6399cd80" containerName="main"
Jul 24 18:05:44.908853 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:44.908831    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-06ffdb/rate-test-model-06ffdb-kserve-6565997b47-wvml6"
Jul 24 18:05:44.913137 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:44.912984    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-06ffdb\"/\"default-dockercfg-7clj4\""
Jul 24 18:05:44.913137 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:44.912999    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-06ffdb\"/\"rate-test-model-06ffdb-kserve-self-signed-certs\""
Jul 24 18:05:44.913137 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:44.913016    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-06ffdb\"/\"openshift-service-ca.crt\""
Jul 24 18:05:44.913137 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:44.913033    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-06ffdb\"/\"kube-root-ca.crt\""
Jul 24 18:05:44.920979 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:44.920954    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-06ffdb/rate-test-model-06ffdb-kserve-6565997b47-wvml6"]
Jul 24 18:05:44.949758 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:44.949725    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:05:45.036977 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:45.036913    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db9a7d80-71f6-4b24-bb12-8f1276944da3-home\") pod \"rate-test-model-06ffdb-kserve-6565997b47-wvml6\" (UID: \"db9a7d80-71f6-4b24-bb12-8f1276944da3\") " pod="ai-tenant-e2e-shared-b-06ffdb/rate-test-model-06ffdb-kserve-6565997b47-wvml6"
Jul 24 18:05:45.037167 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:45.037034    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db9a7d80-71f6-4b24-bb12-8f1276944da3-dshm\") pod \"rate-test-model-06ffdb-kserve-6565997b47-wvml6\" (UID: \"db9a7d80-71f6-4b24-bb12-8f1276944da3\") " pod="ai-tenant-e2e-shared-b-06ffdb/rate-test-model-06ffdb-kserve-6565997b47-wvml6"
Jul 24 18:05:45.037167 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:45.037069    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db9a7d80-71f6-4b24-bb12-8f1276944da3-model-cache\") pod \"rate-test-model-06ffdb-kserve-6565997b47-wvml6\" (UID: \"db9a7d80-71f6-4b24-bb12-8f1276944da3\") " pod="ai-tenant-e2e-shared-b-06ffdb/rate-test-model-06ffdb-kserve-6565997b47-wvml6"
Jul 24 18:05:45.037167 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:45.037108    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db9a7d80-71f6-4b24-bb12-8f1276944da3-tmp-dir\") pod \"rate-test-model-06ffdb-kserve-6565997b47-wvml6\" (UID: \"db9a7d80-71f6-4b24-bb12-8f1276944da3\") " pod="ai-tenant-e2e-shared-b-06ffdb/rate-test-model-06ffdb-kserve-6565997b47-wvml6"
Jul 24 18:05:45.037167 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:45.037132    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4n997\" (UniqueName: \"kubernetes.io/projected/db9a7d80-71f6-4b24-bb12-8f1276944da3-kube-api-access-4n997\") pod \"rate-test-model-06ffdb-kserve-6565997b47-wvml6\" (UID: \"db9a7d80-71f6-4b24-bb12-8f1276944da3\") " pod="ai-tenant-e2e-shared-b-06ffdb/rate-test-model-06ffdb-kserve-6565997b47-wvml6"
Jul 24 18:05:45.037307 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:45.037196    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db9a7d80-71f6-4b24-bb12-8f1276944da3-tls-certs\") pod \"rate-test-model-06ffdb-kserve-6565997b47-wvml6\" (UID: \"db9a7d80-71f6-4b24-bb12-8f1276944da3\") " pod="ai-tenant-e2e-shared-b-06ffdb/rate-test-model-06ffdb-kserve-6565997b47-wvml6"
Jul 24 18:05:45.138251 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:45.138204    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db9a7d80-71f6-4b24-bb12-8f1276944da3-dshm\") pod \"rate-test-model-06ffdb-kserve-6565997b47-wvml6\" (UID: \"db9a7d80-71f6-4b24-bb12-8f1276944da3\") " pod="ai-tenant-e2e-shared-b-06ffdb/rate-test-model-06ffdb-kserve-6565997b47-wvml6"
Jul 24 18:05:45.138251 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:45.138258    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db9a7d80-71f6-4b24-bb12-8f1276944da3-model-cache\") pod \"rate-test-model-06ffdb-kserve-6565997b47-wvml6\" (UID: \"db9a7d80-71f6-4b24-bb12-8f1276944da3\") " pod="ai-tenant-e2e-shared-b-06ffdb/rate-test-model-06ffdb-kserve-6565997b47-wvml6"
Jul 24 18:05:45.138496 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:45.138292    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db9a7d80-71f6-4b24-bb12-8f1276944da3-tmp-dir\") pod \"rate-test-model-06ffdb-kserve-6565997b47-wvml6\" (UID: \"db9a7d80-71f6-4b24-bb12-8f1276944da3\") " pod="ai-tenant-e2e-shared-b-06ffdb/rate-test-model-06ffdb-kserve-6565997b47-wvml6"
Jul 24 18:05:45.138496 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:45.138315    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4n997\" (UniqueName: \"kubernetes.io/projected/db9a7d80-71f6-4b24-bb12-8f1276944da3-kube-api-access-4n997\") pod \"rate-test-model-06ffdb-kserve-6565997b47-wvml6\" (UID: \"db9a7d80-71f6-4b24-bb12-8f1276944da3\") " pod="ai-tenant-e2e-shared-b-06ffdb/rate-test-model-06ffdb-kserve-6565997b47-wvml6"
Jul 24 18:05:45.138496 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:45.138345    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db9a7d80-71f6-4b24-bb12-8f1276944da3-tls-certs\") pod \"rate-test-model-06ffdb-kserve-6565997b47-wvml6\" (UID: \"db9a7d80-71f6-4b24-bb12-8f1276944da3\") " pod="ai-tenant-e2e-shared-b-06ffdb/rate-test-model-06ffdb-kserve-6565997b47-wvml6"
Jul 24 18:05:45.138649 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:45.138628    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db9a7d80-71f6-4b24-bb12-8f1276944da3-home\") pod \"rate-test-model-06ffdb-kserve-6565997b47-wvml6\" (UID: \"db9a7d80-71f6-4b24-bb12-8f1276944da3\") " pod="ai-tenant-e2e-shared-b-06ffdb/rate-test-model-06ffdb-kserve-6565997b47-wvml6"
Jul 24 18:05:45.138743 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:45.138718    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db9a7d80-71f6-4b24-bb12-8f1276944da3-tmp-dir\") pod \"rate-test-model-06ffdb-kserve-6565997b47-wvml6\" (UID: \"db9a7d80-71f6-4b24-bb12-8f1276944da3\") " pod="ai-tenant-e2e-shared-b-06ffdb/rate-test-model-06ffdb-kserve-6565997b47-wvml6"
Jul 24 18:05:45.138812 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:45.138732    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db9a7d80-71f6-4b24-bb12-8f1276944da3-model-cache\") pod \"rate-test-model-06ffdb-kserve-6565997b47-wvml6\" (UID: \"db9a7d80-71f6-4b24-bb12-8f1276944da3\") " pod="ai-tenant-e2e-shared-b-06ffdb/rate-test-model-06ffdb-kserve-6565997b47-wvml6"
Jul 24 18:05:45.138999 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:45.138964    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db9a7d80-71f6-4b24-bb12-8f1276944da3-home\") pod \"rate-test-model-06ffdb-kserve-6565997b47-wvml6\" (UID: \"db9a7d80-71f6-4b24-bb12-8f1276944da3\") " pod="ai-tenant-e2e-shared-b-06ffdb/rate-test-model-06ffdb-kserve-6565997b47-wvml6"
Jul 24 18:05:45.140699 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:45.140681    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db9a7d80-71f6-4b24-bb12-8f1276944da3-dshm\") pod \"rate-test-model-06ffdb-kserve-6565997b47-wvml6\" (UID: \"db9a7d80-71f6-4b24-bb12-8f1276944da3\") " pod="ai-tenant-e2e-shared-b-06ffdb/rate-test-model-06ffdb-kserve-6565997b47-wvml6"
Jul 24 18:05:45.141880 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:45.141861    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-06ffdb\"/\"rate-test-model-06ffdb-kserve-self-signed-certs\""
Jul 24 18:05:45.147754 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:45.147736    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-06ffdb\"/\"kube-root-ca.crt\""
Jul 24 18:05:45.150805 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:45.150786    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db9a7d80-71f6-4b24-bb12-8f1276944da3-tls-certs\") pod \"rate-test-model-06ffdb-kserve-6565997b47-wvml6\" (UID: \"db9a7d80-71f6-4b24-bb12-8f1276944da3\") " pod="ai-tenant-e2e-shared-b-06ffdb/rate-test-model-06ffdb-kserve-6565997b47-wvml6"
Jul 24 18:05:45.159191 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:45.159141    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-06ffdb\"/\"openshift-service-ca.crt\""
Jul 24 18:05:45.169657 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:45.169631    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4n997\" (UniqueName: \"kubernetes.io/projected/db9a7d80-71f6-4b24-bb12-8f1276944da3-kube-api-access-4n997\") pod \"rate-test-model-06ffdb-kserve-6565997b47-wvml6\" (UID: \"db9a7d80-71f6-4b24-bb12-8f1276944da3\") " pod="ai-tenant-e2e-shared-b-06ffdb/rate-test-model-06ffdb-kserve-6565997b47-wvml6"
Jul 24 18:05:45.221485 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:45.221454    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-06ffdb\"/\"default-dockercfg-7clj4\""
Jul 24 18:05:45.229644 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:45.229620    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-06ffdb/rate-test-model-06ffdb-kserve-6565997b47-wvml6"
Jul 24 18:05:45.371109 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:45.371081    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-06ffdb/rate-test-model-06ffdb-kserve-6565997b47-wvml6"]
Jul 24 18:05:45.373539 ip-10-0-139-113 kubenswrapper[2575]: W0724 18:05:45.373513    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddb9a7d80_71f6_4b24_bb12_8f1276944da3.slice/crio-4b53d5e0ff06e17f877cb3df085fed03d5f48bcaef3709951bb5fc27999eba66 WatchSource:0}: Error finding container 4b53d5e0ff06e17f877cb3df085fed03d5f48bcaef3709951bb5fc27999eba66: Status 404 returned error can't find the container with id 4b53d5e0ff06e17f877cb3df085fed03d5f48bcaef3709951bb5fc27999eba66
Jul 24 18:05:46.327313 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:46.327282    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-06ffdb/rate-test-model-06ffdb-kserve-6565997b47-wvml6" event={"ID":"db9a7d80-71f6-4b24-bb12-8f1276944da3","Type":"ContainerStarted","Data":"4e13485070c0d18764387bc7eeab7158652a7253409d455f87a4966cf3daa7fa"}
Jul 24 18:05:46.327313 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:46.327319    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-06ffdb/rate-test-model-06ffdb-kserve-6565997b47-wvml6" event={"ID":"db9a7d80-71f6-4b24-bb12-8f1276944da3","Type":"ContainerStarted","Data":"4b53d5e0ff06e17f877cb3df085fed03d5f48bcaef3709951bb5fc27999eba66"}
Jul 24 18:05:46.352305 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:46.352251    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-06ffdb/rate-test-model-06ffdb-kserve-6565997b47-wvml6" podStartSLOduration=2.352232346 podStartE2EDuration="2.352232346s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:05:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:05:46.352112276 +0000 UTC m=+2881.833487896" watchObservedRunningTime="2026-07-24 18:05:46.352232346 +0000 UTC m=+2881.833608004"
Jul 24 18:05:55.230130 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:55.230080    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-06ffdb/rate-test-model-06ffdb-kserve-6565997b47-wvml6"
Jul 24 18:05:55.230130 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:55.230140    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-06ffdb/rate-test-model-06ffdb-kserve-6565997b47-wvml6"
Jul 24 18:05:55.242794 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:55.242754    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-06ffdb/rate-test-model-06ffdb-kserve-6565997b47-wvml6"
Jul 24 18:05:55.377063 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:05:55.377034    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-06ffdb/rate-test-model-06ffdb-kserve-6565997b47-wvml6"
Jul 24 18:06:22.239626 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:22.239585    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:06:25.990758 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:25.990724    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-257940/rate-test-model-257940-kserve-55758f76bc-cllnf"]
Jul 24 18:06:26.023154 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:26.023123    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:06:26.827388 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:26.827349    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-06ffdb/rate-test-model-06ffdb-kserve-6565997b47-wvml6"]
Jul 24 18:06:26.855207 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:26.855172    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:06:41.009287 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:41.009241    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-257940/rate-test-model-257940-kserve-55758f76bc-cllnf" podUID="b89dc320-993c-4f6b-9c96-d31310a9512e" containerName="main" containerID="cri-o://a3b50fbb8053cca2386e53791dea195b7d15b5527c76eeae9f91b7e28ae04838" gracePeriod=45
Jul 24 18:06:41.253580 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:41.253553    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-257940/rate-test-model-257940-kserve-55758f76bc-cllnf"
Jul 24 18:06:41.254509 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:41.254487    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b89dc320-993c-4f6b-9c96-d31310a9512e-dshm\") pod \"b89dc320-993c-4f6b-9c96-d31310a9512e\" (UID: \"b89dc320-993c-4f6b-9c96-d31310a9512e\") "
Jul 24 18:06:41.254633 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:41.254522    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b89dc320-993c-4f6b-9c96-d31310a9512e-model-cache\") pod \"b89dc320-993c-4f6b-9c96-d31310a9512e\" (UID: \"b89dc320-993c-4f6b-9c96-d31310a9512e\") "
Jul 24 18:06:41.254633 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:41.254560    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b89dc320-993c-4f6b-9c96-d31310a9512e-tmp-dir\") pod \"b89dc320-993c-4f6b-9c96-d31310a9512e\" (UID: \"b89dc320-993c-4f6b-9c96-d31310a9512e\") "
Jul 24 18:06:41.254633 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:41.254602    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g8k2v\" (UniqueName: \"kubernetes.io/projected/b89dc320-993c-4f6b-9c96-d31310a9512e-kube-api-access-g8k2v\") pod \"b89dc320-993c-4f6b-9c96-d31310a9512e\" (UID: \"b89dc320-993c-4f6b-9c96-d31310a9512e\") "
Jul 24 18:06:41.254633 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:41.254627    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b89dc320-993c-4f6b-9c96-d31310a9512e-home\") pod \"b89dc320-993c-4f6b-9c96-d31310a9512e\" (UID: \"b89dc320-993c-4f6b-9c96-d31310a9512e\") "
Jul 24 18:06:41.254857 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:41.254655    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b89dc320-993c-4f6b-9c96-d31310a9512e-tls-certs\") pod \"b89dc320-993c-4f6b-9c96-d31310a9512e\" (UID: \"b89dc320-993c-4f6b-9c96-d31310a9512e\") "
Jul 24 18:06:41.254917 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:41.254844    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b89dc320-993c-4f6b-9c96-d31310a9512e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b89dc320-993c-4f6b-9c96-d31310a9512e" (UID: "b89dc320-993c-4f6b-9c96-d31310a9512e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 18:06:41.254917 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:41.254859    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b89dc320-993c-4f6b-9c96-d31310a9512e-model-cache" (OuterVolumeSpecName: "model-cache") pod "b89dc320-993c-4f6b-9c96-d31310a9512e" (UID: "b89dc320-993c-4f6b-9c96-d31310a9512e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 18:06:41.255048 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:41.254982    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b89dc320-993c-4f6b-9c96-d31310a9512e-home" (OuterVolumeSpecName: "home") pod "b89dc320-993c-4f6b-9c96-d31310a9512e" (UID: "b89dc320-993c-4f6b-9c96-d31310a9512e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 18:06:41.255048 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:41.255009    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b89dc320-993c-4f6b-9c96-d31310a9512e-tmp-dir\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 18:06:41.255048 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:41.255031    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b89dc320-993c-4f6b-9c96-d31310a9512e-model-cache\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 18:06:41.256698 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:41.256675    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b89dc320-993c-4f6b-9c96-d31310a9512e-dshm" (OuterVolumeSpecName: "dshm") pod "b89dc320-993c-4f6b-9c96-d31310a9512e" (UID: "b89dc320-993c-4f6b-9c96-d31310a9512e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 18:06:41.256794 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:41.256673    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b89dc320-993c-4f6b-9c96-d31310a9512e-kube-api-access-g8k2v" (OuterVolumeSpecName: "kube-api-access-g8k2v") pod "b89dc320-993c-4f6b-9c96-d31310a9512e" (UID: "b89dc320-993c-4f6b-9c96-d31310a9512e"). InnerVolumeSpecName "kube-api-access-g8k2v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:06:41.256840 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:41.256797    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b89dc320-993c-4f6b-9c96-d31310a9512e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b89dc320-993c-4f6b-9c96-d31310a9512e" (UID: "b89dc320-993c-4f6b-9c96-d31310a9512e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 18:06:41.356142 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:41.356100    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g8k2v\" (UniqueName: \"kubernetes.io/projected/b89dc320-993c-4f6b-9c96-d31310a9512e-kube-api-access-g8k2v\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 18:06:41.356142 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:41.356131    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b89dc320-993c-4f6b-9c96-d31310a9512e-home\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 18:06:41.356142 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:41.356142    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b89dc320-993c-4f6b-9c96-d31310a9512e-tls-certs\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 18:06:41.356142 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:41.356150    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b89dc320-993c-4f6b-9c96-d31310a9512e-dshm\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 18:06:41.573262 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:41.573230    2575 generic.go:356] "Generic (PLEG): container finished" podID="b89dc320-993c-4f6b-9c96-d31310a9512e" containerID="a3b50fbb8053cca2386e53791dea195b7d15b5527c76eeae9f91b7e28ae04838" exitCode=0
Jul 24 18:06:41.573468 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:41.573280    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-257940/rate-test-model-257940-kserve-55758f76bc-cllnf"
Jul 24 18:06:41.573468 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:41.573323    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-257940/rate-test-model-257940-kserve-55758f76bc-cllnf" event={"ID":"b89dc320-993c-4f6b-9c96-d31310a9512e","Type":"ContainerDied","Data":"a3b50fbb8053cca2386e53791dea195b7d15b5527c76eeae9f91b7e28ae04838"}
Jul 24 18:06:41.573468 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:41.573369    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-257940/rate-test-model-257940-kserve-55758f76bc-cllnf" event={"ID":"b89dc320-993c-4f6b-9c96-d31310a9512e","Type":"ContainerDied","Data":"5734d40aae241f8953910c5bc470f595e06f1c9266dddc6f3d77cf8b288d36cf"}
Jul 24 18:06:41.573468 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:41.573386    2575 scope.go:117] "RemoveContainer" containerID="a3b50fbb8053cca2386e53791dea195b7d15b5527c76eeae9f91b7e28ae04838"
Jul 24 18:06:41.582535 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:41.582518    2575 scope.go:117] "RemoveContainer" containerID="a3b50fbb8053cca2386e53791dea195b7d15b5527c76eeae9f91b7e28ae04838"
Jul 24 18:06:41.582821 ip-10-0-139-113 kubenswrapper[2575]: E0724 18:06:41.582802    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3b50fbb8053cca2386e53791dea195b7d15b5527c76eeae9f91b7e28ae04838\": container with ID starting with a3b50fbb8053cca2386e53791dea195b7d15b5527c76eeae9f91b7e28ae04838 not found: ID does not exist" containerID="a3b50fbb8053cca2386e53791dea195b7d15b5527c76eeae9f91b7e28ae04838"
Jul 24 18:06:41.582885 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:41.582828    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3b50fbb8053cca2386e53791dea195b7d15b5527c76eeae9f91b7e28ae04838"} err="failed to get container status \"a3b50fbb8053cca2386e53791dea195b7d15b5527c76eeae9f91b7e28ae04838\": rpc error: code = NotFound desc = could not find container \"a3b50fbb8053cca2386e53791dea195b7d15b5527c76eeae9f91b7e28ae04838\": container with ID starting with a3b50fbb8053cca2386e53791dea195b7d15b5527c76eeae9f91b7e28ae04838 not found: ID does not exist"
Jul 24 18:06:41.612252 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:41.612217    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-257940/rate-test-model-257940-kserve-55758f76bc-cllnf"]
Jul 24 18:06:41.616900 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:41.616877    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-257940/rate-test-model-257940-kserve-55758f76bc-cllnf"]
Jul 24 18:06:41.846021 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:41.845910    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-06ffdb/rate-test-model-06ffdb-kserve-6565997b47-wvml6" podUID="db9a7d80-71f6-4b24-bb12-8f1276944da3" containerName="main" containerID="cri-o://4e13485070c0d18764387bc7eeab7158652a7253409d455f87a4966cf3daa7fa" gracePeriod=45
Jul 24 18:06:42.097203 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:42.097137    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-06ffdb/rate-test-model-06ffdb-kserve-6565997b47-wvml6"
Jul 24 18:06:42.163036 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:42.163004    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db9a7d80-71f6-4b24-bb12-8f1276944da3-model-cache\") pod \"db9a7d80-71f6-4b24-bb12-8f1276944da3\" (UID: \"db9a7d80-71f6-4b24-bb12-8f1276944da3\") "
Jul 24 18:06:42.163225 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:42.163058    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db9a7d80-71f6-4b24-bb12-8f1276944da3-tls-certs\") pod \"db9a7d80-71f6-4b24-bb12-8f1276944da3\" (UID: \"db9a7d80-71f6-4b24-bb12-8f1276944da3\") "
Jul 24 18:06:42.163225 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:42.163080    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db9a7d80-71f6-4b24-bb12-8f1276944da3-dshm\") pod \"db9a7d80-71f6-4b24-bb12-8f1276944da3\" (UID: \"db9a7d80-71f6-4b24-bb12-8f1276944da3\") "
Jul 24 18:06:42.163225 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:42.163106    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4n997\" (UniqueName: \"kubernetes.io/projected/db9a7d80-71f6-4b24-bb12-8f1276944da3-kube-api-access-4n997\") pod \"db9a7d80-71f6-4b24-bb12-8f1276944da3\" (UID: \"db9a7d80-71f6-4b24-bb12-8f1276944da3\") "
Jul 24 18:06:42.163225 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:42.163132    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db9a7d80-71f6-4b24-bb12-8f1276944da3-tmp-dir\") pod \"db9a7d80-71f6-4b24-bb12-8f1276944da3\" (UID: \"db9a7d80-71f6-4b24-bb12-8f1276944da3\") "
Jul 24 18:06:42.163225 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:42.163148    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db9a7d80-71f6-4b24-bb12-8f1276944da3-home\") pod \"db9a7d80-71f6-4b24-bb12-8f1276944da3\" (UID: \"db9a7d80-71f6-4b24-bb12-8f1276944da3\") "
Jul 24 18:06:42.163509 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:42.163318    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db9a7d80-71f6-4b24-bb12-8f1276944da3-model-cache" (OuterVolumeSpecName: "model-cache") pod "db9a7d80-71f6-4b24-bb12-8f1276944da3" (UID: "db9a7d80-71f6-4b24-bb12-8f1276944da3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 18:06:42.163509 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:42.163457    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db9a7d80-71f6-4b24-bb12-8f1276944da3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "db9a7d80-71f6-4b24-bb12-8f1276944da3" (UID: "db9a7d80-71f6-4b24-bb12-8f1276944da3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 18:06:42.163509 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:42.163491    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db9a7d80-71f6-4b24-bb12-8f1276944da3-home" (OuterVolumeSpecName: "home") pod "db9a7d80-71f6-4b24-bb12-8f1276944da3" (UID: "db9a7d80-71f6-4b24-bb12-8f1276944da3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 18:06:42.165343 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:42.165319    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db9a7d80-71f6-4b24-bb12-8f1276944da3-dshm" (OuterVolumeSpecName: "dshm") pod "db9a7d80-71f6-4b24-bb12-8f1276944da3" (UID: "db9a7d80-71f6-4b24-bb12-8f1276944da3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 18:06:42.165343 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:42.165333    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db9a7d80-71f6-4b24-bb12-8f1276944da3-kube-api-access-4n997" (OuterVolumeSpecName: "kube-api-access-4n997") pod "db9a7d80-71f6-4b24-bb12-8f1276944da3" (UID: "db9a7d80-71f6-4b24-bb12-8f1276944da3"). InnerVolumeSpecName "kube-api-access-4n997". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:06:42.165528 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:42.165345    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db9a7d80-71f6-4b24-bb12-8f1276944da3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "db9a7d80-71f6-4b24-bb12-8f1276944da3" (UID: "db9a7d80-71f6-4b24-bb12-8f1276944da3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 18:06:42.264828 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:42.264720    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db9a7d80-71f6-4b24-bb12-8f1276944da3-tls-certs\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 18:06:42.264828 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:42.264752    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db9a7d80-71f6-4b24-bb12-8f1276944da3-dshm\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 18:06:42.264828 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:42.264764    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4n997\" (UniqueName: \"kubernetes.io/projected/db9a7d80-71f6-4b24-bb12-8f1276944da3-kube-api-access-4n997\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 18:06:42.264828 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:42.264778    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db9a7d80-71f6-4b24-bb12-8f1276944da3-tmp-dir\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 18:06:42.264828 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:42.264792    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db9a7d80-71f6-4b24-bb12-8f1276944da3-home\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 18:06:42.264828 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:42.264803    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db9a7d80-71f6-4b24-bb12-8f1276944da3-model-cache\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 18:06:42.579228 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:42.579191    2575 generic.go:356] "Generic (PLEG): container finished" podID="db9a7d80-71f6-4b24-bb12-8f1276944da3" containerID="4e13485070c0d18764387bc7eeab7158652a7253409d455f87a4966cf3daa7fa" exitCode=0
Jul 24 18:06:42.579399 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:42.579236    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-06ffdb/rate-test-model-06ffdb-kserve-6565997b47-wvml6"
Jul 24 18:06:42.579399 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:42.579282    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-06ffdb/rate-test-model-06ffdb-kserve-6565997b47-wvml6" event={"ID":"db9a7d80-71f6-4b24-bb12-8f1276944da3","Type":"ContainerDied","Data":"4e13485070c0d18764387bc7eeab7158652a7253409d455f87a4966cf3daa7fa"}
Jul 24 18:06:42.579399 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:42.579329    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-06ffdb/rate-test-model-06ffdb-kserve-6565997b47-wvml6" event={"ID":"db9a7d80-71f6-4b24-bb12-8f1276944da3","Type":"ContainerDied","Data":"4b53d5e0ff06e17f877cb3df085fed03d5f48bcaef3709951bb5fc27999eba66"}
Jul 24 18:06:42.579399 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:42.579349    2575 scope.go:117] "RemoveContainer" containerID="4e13485070c0d18764387bc7eeab7158652a7253409d455f87a4966cf3daa7fa"
Jul 24 18:06:42.590466 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:42.590445    2575 scope.go:117] "RemoveContainer" containerID="4e13485070c0d18764387bc7eeab7158652a7253409d455f87a4966cf3daa7fa"
Jul 24 18:06:42.590829 ip-10-0-139-113 kubenswrapper[2575]: E0724 18:06:42.590808    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e13485070c0d18764387bc7eeab7158652a7253409d455f87a4966cf3daa7fa\": container with ID starting with 4e13485070c0d18764387bc7eeab7158652a7253409d455f87a4966cf3daa7fa not found: ID does not exist" containerID="4e13485070c0d18764387bc7eeab7158652a7253409d455f87a4966cf3daa7fa"
Jul 24 18:06:42.590883 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:42.590838    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e13485070c0d18764387bc7eeab7158652a7253409d455f87a4966cf3daa7fa"} err="failed to get container status \"4e13485070c0d18764387bc7eeab7158652a7253409d455f87a4966cf3daa7fa\": rpc error: code = NotFound desc = could not find container \"4e13485070c0d18764387bc7eeab7158652a7253409d455f87a4966cf3daa7fa\": container with ID starting with 4e13485070c0d18764387bc7eeab7158652a7253409d455f87a4966cf3daa7fa not found: ID does not exist"
Jul 24 18:06:42.601307 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:42.601281    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-06ffdb/rate-test-model-06ffdb-kserve-6565997b47-wvml6"]
Jul 24 18:06:42.608423 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:42.608397    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-06ffdb/rate-test-model-06ffdb-kserve-6565997b47-wvml6"]
Jul 24 18:06:43.201074 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:43.201044    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b89dc320-993c-4f6b-9c96-d31310a9512e" path="/var/lib/kubelet/pods/b89dc320-993c-4f6b-9c96-d31310a9512e/volumes"
Jul 24 18:06:43.201458 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:43.201439    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db9a7d80-71f6-4b24-bb12-8f1276944da3" path="/var/lib/kubelet/pods/db9a7d80-71f6-4b24-bb12-8f1276944da3/volumes"
Jul 24 18:06:46.977462 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:46.977422    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:06:47.370894 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:47.370846    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:06:47.910106 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:47.910074    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:06:50.328589 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:50.328547    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:06:50.488030 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:50.487981    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:06:50.582801 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:50.582696    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:06:51.138257 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:51.138216    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:06:51.303356 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:51.303302    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:06:51.396452 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:51.396331    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:06:54.822952 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:06:54.822901    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:07:05.820386 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:05.820278    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:07:06.173851 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:06.173743    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:07:06.421950 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:06.421913    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:07:09.473458 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:09.473425    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:07:09.596856 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:09.596827    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:07:09.772027 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:09.771871    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:07:10.109366 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:10.109314    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:07:10.329858 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:10.329791    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:07:10.431844 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:10.431752    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:07:10.474207 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:10.474178    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-53e30e-7ffb4fcfc4-gf7fm"]
Jul 24 18:07:10.474613 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:10.474489    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db9a7d80-71f6-4b24-bb12-8f1276944da3" containerName="main"
Jul 24 18:07:10.474613 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:10.474499    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="db9a7d80-71f6-4b24-bb12-8f1276944da3" containerName="main"
Jul 24 18:07:10.474613 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:10.474509    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b89dc320-993c-4f6b-9c96-d31310a9512e" containerName="main"
Jul 24 18:07:10.474613 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:10.474514    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b89dc320-993c-4f6b-9c96-d31310a9512e" containerName="main"
Jul 24 18:07:10.474613 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:10.474558    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b89dc320-993c-4f6b-9c96-d31310a9512e" containerName="main"
Jul 24 18:07:10.474613 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:10.474570    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="db9a7d80-71f6-4b24-bb12-8f1276944da3" containerName="main"
Jul 24 18:07:10.477453 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:10.477429    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-53e30e-7ffb4fcfc4-gf7fm"
Jul 24 18:07:10.479854 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:10.479835    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-53e30e-dockercfg-pwmlm\""
Jul 24 18:07:10.479984 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:10.479834    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-53e30e\""
Jul 24 18:07:10.492705 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:10.492678    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-53e30e-7ffb4fcfc4-gf7fm"]
Jul 24 18:07:10.617814 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:10.617767    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-827tp\" (UniqueName: \"kubernetes.io/projected/42072e38-1855-4e6c-91f0-6357ee97c10d-kube-api-access-827tp\") pod \"payload-processing-e2e-ipp-b-53e30e-7ffb4fcfc4-gf7fm\" (UID: \"42072e38-1855-4e6c-91f0-6357ee97c10d\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-53e30e-7ffb4fcfc4-gf7fm"
Jul 24 18:07:10.618017 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:10.617829    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42072e38-1855-4e6c-91f0-6357ee97c10d-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-53e30e-7ffb4fcfc4-gf7fm\" (UID: \"42072e38-1855-4e6c-91f0-6357ee97c10d\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-53e30e-7ffb4fcfc4-gf7fm"
Jul 24 18:07:10.719222 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:10.719121    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-827tp\" (UniqueName: \"kubernetes.io/projected/42072e38-1855-4e6c-91f0-6357ee97c10d-kube-api-access-827tp\") pod \"payload-processing-e2e-ipp-b-53e30e-7ffb4fcfc4-gf7fm\" (UID: \"42072e38-1855-4e6c-91f0-6357ee97c10d\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-53e30e-7ffb4fcfc4-gf7fm"
Jul 24 18:07:10.719222 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:10.719182    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42072e38-1855-4e6c-91f0-6357ee97c10d-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-53e30e-7ffb4fcfc4-gf7fm\" (UID: \"42072e38-1855-4e6c-91f0-6357ee97c10d\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-53e30e-7ffb4fcfc4-gf7fm"
Jul 24 18:07:10.719978 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:10.719959    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42072e38-1855-4e6c-91f0-6357ee97c10d-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-53e30e-7ffb4fcfc4-gf7fm\" (UID: \"42072e38-1855-4e6c-91f0-6357ee97c10d\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-53e30e-7ffb4fcfc4-gf7fm"
Jul 24 18:07:10.727451 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:10.727423    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-827tp\" (UniqueName: \"kubernetes.io/projected/42072e38-1855-4e6c-91f0-6357ee97c10d-kube-api-access-827tp\") pod \"payload-processing-e2e-ipp-b-53e30e-7ffb4fcfc4-gf7fm\" (UID: \"42072e38-1855-4e6c-91f0-6357ee97c10d\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-53e30e-7ffb4fcfc4-gf7fm"
Jul 24 18:07:10.787350 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:10.787313    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-53e30e-7ffb4fcfc4-gf7fm"
Jul 24 18:07:10.919783 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:10.919757    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-53e30e-7ffb4fcfc4-gf7fm"]
Jul 24 18:07:10.921724 ip-10-0-139-113 kubenswrapper[2575]: W0724 18:07:10.921695    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42072e38_1855_4e6c_91f0_6357ee97c10d.slice/crio-db04ee871353a7365631da682acc194594459ae7f241388427f82f47db062a42 WatchSource:0}: Error finding container db04ee871353a7365631da682acc194594459ae7f241388427f82f47db062a42: Status 404 returned error can't find the container with id db04ee871353a7365631da682acc194594459ae7f241388427f82f47db062a42
Jul 24 18:07:10.923912 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:10.923894    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 18:07:11.704106 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:11.704062    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-53e30e-7ffb4fcfc4-gf7fm" event={"ID":"42072e38-1855-4e6c-91f0-6357ee97c10d","Type":"ContainerStarted","Data":"db04ee871353a7365631da682acc194594459ae7f241388427f82f47db062a42"}
Jul 24 18:07:13.716213 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:13.716179    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-53e30e-7ffb4fcfc4-gf7fm" event={"ID":"42072e38-1855-4e6c-91f0-6357ee97c10d","Type":"ContainerStarted","Data":"baff720d9256a9845512d10ae834225c3f35f616cddb87578ae93ee58de254cb"}
Jul 24 18:07:13.716628 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:13.716317    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-53e30e-7ffb4fcfc4-gf7fm"
Jul 24 18:07:13.736787 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:13.736733    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-53e30e-7ffb4fcfc4-gf7fm" podStartSLOduration=1.531676879 podStartE2EDuration="3.736717349s" totalImagesPullingTime="2.20504047s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:07:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:07:13.735092552 +0000 UTC m=+2969.216468175" watchObservedRunningTime="2026-07-24 18:07:13.736717349 +0000 UTC m=+2969.218092968"
Jul 24 18:07:13.981655 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:13.981565    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:07:24.723131 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:24.723096    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-53e30e-7ffb4fcfc4-gf7fm"
Jul 24 18:07:36.694368 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:36.694338    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-53e30e-7ffb4fcfc4-gf7fm_42072e38-1855-4e6c-91f0-6357ee97c10d/payload-processing/0.log"
Jul 24 18:07:45.220688 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:45.220659    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82s5l_010c8b81-c5f5-43c3-b1bb-c812fcde2d6f/ovn-acl-logging/0.log"
Jul 24 18:07:45.228578 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:45.228551    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82s5l_010c8b81-c5f5-43c3-b1bb-c812fcde2d6f/ovn-acl-logging/0.log"
Jul 24 18:07:46.282047 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:46.282011    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-737ef6/ipp-route-737ef6-kserve-798dc55b55-wqgc9"]
Jul 24 18:07:46.287863 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:46.287841    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-737ef6/ipp-route-737ef6-kserve-798dc55b55-wqgc9"
Jul 24 18:07:46.291540 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:46.291512    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-737ef6\"/\"default-dockercfg-7b66f\""
Jul 24 18:07:46.291986 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:46.291581    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-737ef6\"/\"openshift-service-ca.crt\""
Jul 24 18:07:46.291986 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:46.291524    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-737ef6\"/\"ipp-route-737ef6-kserve-self-signed-certs\""
Jul 24 18:07:46.291986 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:46.291512    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-737ef6\"/\"kube-root-ca.crt\""
Jul 24 18:07:46.305553 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:46.305516    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-737ef6/ipp-route-737ef6-kserve-798dc55b55-wqgc9"]
Jul 24 18:07:46.321108 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:46.321062    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:07:46.332850 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:46.332824    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dacc5d09-5e79-4f2c-8e69-173c2012b81d-home\") pod \"ipp-route-737ef6-kserve-798dc55b55-wqgc9\" (UID: \"dacc5d09-5e79-4f2c-8e69-173c2012b81d\") " pod="ai-tenant-e2e-ipp-a-737ef6/ipp-route-737ef6-kserve-798dc55b55-wqgc9"
Jul 24 18:07:46.332970 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:46.332879    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dacc5d09-5e79-4f2c-8e69-173c2012b81d-dshm\") pod \"ipp-route-737ef6-kserve-798dc55b55-wqgc9\" (UID: \"dacc5d09-5e79-4f2c-8e69-173c2012b81d\") " pod="ai-tenant-e2e-ipp-a-737ef6/ipp-route-737ef6-kserve-798dc55b55-wqgc9"
Jul 24 18:07:46.332970 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:46.332897    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dacc5d09-5e79-4f2c-8e69-173c2012b81d-tmp-dir\") pod \"ipp-route-737ef6-kserve-798dc55b55-wqgc9\" (UID: \"dacc5d09-5e79-4f2c-8e69-173c2012b81d\") " pod="ai-tenant-e2e-ipp-a-737ef6/ipp-route-737ef6-kserve-798dc55b55-wqgc9"
Jul 24 18:07:46.332970 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:46.332915    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8f2bh\" (UniqueName: \"kubernetes.io/projected/dacc5d09-5e79-4f2c-8e69-173c2012b81d-kube-api-access-8f2bh\") pod \"ipp-route-737ef6-kserve-798dc55b55-wqgc9\" (UID: \"dacc5d09-5e79-4f2c-8e69-173c2012b81d\") " pod="ai-tenant-e2e-ipp-a-737ef6/ipp-route-737ef6-kserve-798dc55b55-wqgc9"
Jul 24 18:07:46.333078 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:46.332980    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dacc5d09-5e79-4f2c-8e69-173c2012b81d-model-cache\") pod \"ipp-route-737ef6-kserve-798dc55b55-wqgc9\" (UID: \"dacc5d09-5e79-4f2c-8e69-173c2012b81d\") " pod="ai-tenant-e2e-ipp-a-737ef6/ipp-route-737ef6-kserve-798dc55b55-wqgc9"
Jul 24 18:07:46.333078 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:46.333001    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dacc5d09-5e79-4f2c-8e69-173c2012b81d-tls-certs\") pod \"ipp-route-737ef6-kserve-798dc55b55-wqgc9\" (UID: \"dacc5d09-5e79-4f2c-8e69-173c2012b81d\") " pod="ai-tenant-e2e-ipp-a-737ef6/ipp-route-737ef6-kserve-798dc55b55-wqgc9"
Jul 24 18:07:46.433719 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:46.433687    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dacc5d09-5e79-4f2c-8e69-173c2012b81d-home\") pod \"ipp-route-737ef6-kserve-798dc55b55-wqgc9\" (UID: \"dacc5d09-5e79-4f2c-8e69-173c2012b81d\") " pod="ai-tenant-e2e-ipp-a-737ef6/ipp-route-737ef6-kserve-798dc55b55-wqgc9"
Jul 24 18:07:46.433910 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:46.433754    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dacc5d09-5e79-4f2c-8e69-173c2012b81d-dshm\") pod \"ipp-route-737ef6-kserve-798dc55b55-wqgc9\" (UID: \"dacc5d09-5e79-4f2c-8e69-173c2012b81d\") " pod="ai-tenant-e2e-ipp-a-737ef6/ipp-route-737ef6-kserve-798dc55b55-wqgc9"
Jul 24 18:07:46.433910 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:46.433776    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dacc5d09-5e79-4f2c-8e69-173c2012b81d-tmp-dir\") pod \"ipp-route-737ef6-kserve-798dc55b55-wqgc9\" (UID: \"dacc5d09-5e79-4f2c-8e69-173c2012b81d\") " pod="ai-tenant-e2e-ipp-a-737ef6/ipp-route-737ef6-kserve-798dc55b55-wqgc9"
Jul 24 18:07:46.433910 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:46.433793    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8f2bh\" (UniqueName: \"kubernetes.io/projected/dacc5d09-5e79-4f2c-8e69-173c2012b81d-kube-api-access-8f2bh\") pod \"ipp-route-737ef6-kserve-798dc55b55-wqgc9\" (UID: \"dacc5d09-5e79-4f2c-8e69-173c2012b81d\") " pod="ai-tenant-e2e-ipp-a-737ef6/ipp-route-737ef6-kserve-798dc55b55-wqgc9"
Jul 24 18:07:46.433910 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:46.433840    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dacc5d09-5e79-4f2c-8e69-173c2012b81d-model-cache\") pod \"ipp-route-737ef6-kserve-798dc55b55-wqgc9\" (UID: \"dacc5d09-5e79-4f2c-8e69-173c2012b81d\") " pod="ai-tenant-e2e-ipp-a-737ef6/ipp-route-737ef6-kserve-798dc55b55-wqgc9"
Jul 24 18:07:46.433910 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:46.433869    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dacc5d09-5e79-4f2c-8e69-173c2012b81d-tls-certs\") pod \"ipp-route-737ef6-kserve-798dc55b55-wqgc9\" (UID: \"dacc5d09-5e79-4f2c-8e69-173c2012b81d\") " pod="ai-tenant-e2e-ipp-a-737ef6/ipp-route-737ef6-kserve-798dc55b55-wqgc9"
Jul 24 18:07:46.434207 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:46.434163    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dacc5d09-5e79-4f2c-8e69-173c2012b81d-home\") pod \"ipp-route-737ef6-kserve-798dc55b55-wqgc9\" (UID: \"dacc5d09-5e79-4f2c-8e69-173c2012b81d\") " pod="ai-tenant-e2e-ipp-a-737ef6/ipp-route-737ef6-kserve-798dc55b55-wqgc9"
Jul 24 18:07:46.434276 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:46.434226    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dacc5d09-5e79-4f2c-8e69-173c2012b81d-tmp-dir\") pod \"ipp-route-737ef6-kserve-798dc55b55-wqgc9\" (UID: \"dacc5d09-5e79-4f2c-8e69-173c2012b81d\") " pod="ai-tenant-e2e-ipp-a-737ef6/ipp-route-737ef6-kserve-798dc55b55-wqgc9"
Jul 24 18:07:46.434362 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:46.434341    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dacc5d09-5e79-4f2c-8e69-173c2012b81d-model-cache\") pod \"ipp-route-737ef6-kserve-798dc55b55-wqgc9\" (UID: \"dacc5d09-5e79-4f2c-8e69-173c2012b81d\") " pod="ai-tenant-e2e-ipp-a-737ef6/ipp-route-737ef6-kserve-798dc55b55-wqgc9"
Jul 24 18:07:46.436010 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:46.435992    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dacc5d09-5e79-4f2c-8e69-173c2012b81d-dshm\") pod \"ipp-route-737ef6-kserve-798dc55b55-wqgc9\" (UID: \"dacc5d09-5e79-4f2c-8e69-173c2012b81d\") " pod="ai-tenant-e2e-ipp-a-737ef6/ipp-route-737ef6-kserve-798dc55b55-wqgc9"
Jul 24 18:07:46.436357 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:46.436341    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dacc5d09-5e79-4f2c-8e69-173c2012b81d-tls-certs\") pod \"ipp-route-737ef6-kserve-798dc55b55-wqgc9\" (UID: \"dacc5d09-5e79-4f2c-8e69-173c2012b81d\") " pod="ai-tenant-e2e-ipp-a-737ef6/ipp-route-737ef6-kserve-798dc55b55-wqgc9"
Jul 24 18:07:46.444025 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:46.443990    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8f2bh\" (UniqueName: \"kubernetes.io/projected/dacc5d09-5e79-4f2c-8e69-173c2012b81d-kube-api-access-8f2bh\") pod \"ipp-route-737ef6-kserve-798dc55b55-wqgc9\" (UID: \"dacc5d09-5e79-4f2c-8e69-173c2012b81d\") " pod="ai-tenant-e2e-ipp-a-737ef6/ipp-route-737ef6-kserve-798dc55b55-wqgc9"
Jul 24 18:07:46.597524 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:46.597427    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-737ef6/ipp-route-737ef6-kserve-798dc55b55-wqgc9"
Jul 24 18:07:46.734709 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:46.734685    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-737ef6/ipp-route-737ef6-kserve-798dc55b55-wqgc9"]
Jul 24 18:07:46.736547 ip-10-0-139-113 kubenswrapper[2575]: W0724 18:07:46.736511    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddacc5d09_5e79_4f2c_8e69_173c2012b81d.slice/crio-c3bf04edc4fe3d64e25cba04003fa375bcfefbacc84f71da62a52bd5638d4cc1 WatchSource:0}: Error finding container c3bf04edc4fe3d64e25cba04003fa375bcfefbacc84f71da62a52bd5638d4cc1: Status 404 returned error can't find the container with id c3bf04edc4fe3d64e25cba04003fa375bcfefbacc84f71da62a52bd5638d4cc1
Jul 24 18:07:46.863260 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:46.863159    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-737ef6/ipp-route-737ef6-kserve-798dc55b55-wqgc9" event={"ID":"dacc5d09-5e79-4f2c-8e69-173c2012b81d","Type":"ContainerStarted","Data":"80db33021468d4eff81b26d05d45622ebe71d1d691612d056badcd5dbcb72765"}
Jul 24 18:07:46.863260 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:46.863218    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-737ef6/ipp-route-737ef6-kserve-798dc55b55-wqgc9" event={"ID":"dacc5d09-5e79-4f2c-8e69-173c2012b81d","Type":"ContainerStarted","Data":"c3bf04edc4fe3d64e25cba04003fa375bcfefbacc84f71da62a52bd5638d4cc1"}
Jul 24 18:07:46.882213 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:46.882160    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-737ef6/ipp-route-737ef6-kserve-798dc55b55-wqgc9" podStartSLOduration=0.882142269 podStartE2EDuration="882.142269ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:07:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:07:46.881364138 +0000 UTC m=+3002.362739750" watchObservedRunningTime="2026-07-24 18:07:46.882142269 +0000 UTC m=+3002.363517889"
Jul 24 18:07:56.598004 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:56.597892    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-737ef6/ipp-route-737ef6-kserve-798dc55b55-wqgc9"
Jul 24 18:07:56.598004 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:56.597957    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-737ef6/ipp-route-737ef6-kserve-798dc55b55-wqgc9"
Jul 24 18:07:56.610488 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:56.610457    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-737ef6/ipp-route-737ef6-kserve-798dc55b55-wqgc9"
Jul 24 18:07:56.917108 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:07:56.917015    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-737ef6/ipp-route-737ef6-kserve-798dc55b55-wqgc9"
Jul 24 18:08:06.101269 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:06.101234    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:08:16.698668 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:16.698634    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-53e30e-7ffb4fcfc4-gf7fm_42072e38-1855-4e6c-91f0-6357ee97c10d/payload-processing/0.log"
Jul 24 18:08:17.003564 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:17.003465    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:08:17.317307 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:17.317271    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls"]
Jul 24 18:08:17.320639 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:17.320615    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls"
Jul 24 18:08:17.326125 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:17.326102    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-fb4092-openshift-default-dockercfg-pgbd7\""
Jul 24 18:08:17.337521 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:17.337492    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls"]
Jul 24 18:08:17.360151 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:17.360116    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:08:17.410370 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:17.410334    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8bef9d92-590a-40ea-ac90-c5c84f6e3e55-istio-podinfo\") pod \"e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls\" (UID: \"8bef9d92-590a-40ea-ac90-c5c84f6e3e55\") " pod="openshift-ingress/e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls"
Jul 24 18:08:17.410554 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:17.410378    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxxpz\" (UniqueName: \"kubernetes.io/projected/8bef9d92-590a-40ea-ac90-c5c84f6e3e55-kube-api-access-sxxpz\") pod \"e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls\" (UID: \"8bef9d92-590a-40ea-ac90-c5c84f6e3e55\") " pod="openshift-ingress/e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls"
Jul 24 18:08:17.410554 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:17.410477    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8bef9d92-590a-40ea-ac90-c5c84f6e3e55-istio-token\") pod \"e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls\" (UID: \"8bef9d92-590a-40ea-ac90-c5c84f6e3e55\") " pod="openshift-ingress/e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls"
Jul 24 18:08:17.410658 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:17.410559    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8bef9d92-590a-40ea-ac90-c5c84f6e3e55-istiod-ca-cert\") pod \"e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls\" (UID: \"8bef9d92-590a-40ea-ac90-c5c84f6e3e55\") " pod="openshift-ingress/e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls"
Jul 24 18:08:17.410658 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:17.410596    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8bef9d92-590a-40ea-ac90-c5c84f6e3e55-workload-socket\") pod \"e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls\" (UID: \"8bef9d92-590a-40ea-ac90-c5c84f6e3e55\") " pod="openshift-ingress/e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls"
Jul 24 18:08:17.410658 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:17.410622    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8bef9d92-590a-40ea-ac90-c5c84f6e3e55-workload-certs\") pod \"e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls\" (UID: \"8bef9d92-590a-40ea-ac90-c5c84f6e3e55\") " pod="openshift-ingress/e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls"
Jul 24 18:08:17.410777 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:17.410685    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8bef9d92-590a-40ea-ac90-c5c84f6e3e55-istio-data\") pod \"e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls\" (UID: \"8bef9d92-590a-40ea-ac90-c5c84f6e3e55\") " pod="openshift-ingress/e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls"
Jul 24 18:08:17.410777 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:17.410729    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8bef9d92-590a-40ea-ac90-c5c84f6e3e55-credential-socket\") pod \"e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls\" (UID: \"8bef9d92-590a-40ea-ac90-c5c84f6e3e55\") " pod="openshift-ingress/e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls"
Jul 24 18:08:17.410777 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:17.410746    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8bef9d92-590a-40ea-ac90-c5c84f6e3e55-istio-envoy\") pod \"e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls\" (UID: \"8bef9d92-590a-40ea-ac90-c5c84f6e3e55\") " pod="openshift-ingress/e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls"
Jul 24 18:08:17.511843 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:17.511788    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxxpz\" (UniqueName: \"kubernetes.io/projected/8bef9d92-590a-40ea-ac90-c5c84f6e3e55-kube-api-access-sxxpz\") pod \"e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls\" (UID: \"8bef9d92-590a-40ea-ac90-c5c84f6e3e55\") " pod="openshift-ingress/e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls"
Jul 24 18:08:17.512083 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:17.511869    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8bef9d92-590a-40ea-ac90-c5c84f6e3e55-istio-token\") pod \"e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls\" (UID: \"8bef9d92-590a-40ea-ac90-c5c84f6e3e55\") " pod="openshift-ingress/e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls"
Jul 24 18:08:17.512083 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:17.511922    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8bef9d92-590a-40ea-ac90-c5c84f6e3e55-istiod-ca-cert\") pod \"e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls\" (UID: \"8bef9d92-590a-40ea-ac90-c5c84f6e3e55\") " pod="openshift-ingress/e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls"
Jul 24 18:08:17.512083 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:17.511971    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8bef9d92-590a-40ea-ac90-c5c84f6e3e55-workload-socket\") pod \"e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls\" (UID: \"8bef9d92-590a-40ea-ac90-c5c84f6e3e55\") " pod="openshift-ingress/e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls"
Jul 24 18:08:17.512083 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:17.511994    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8bef9d92-590a-40ea-ac90-c5c84f6e3e55-workload-certs\") pod \"e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls\" (UID: \"8bef9d92-590a-40ea-ac90-c5c84f6e3e55\") " pod="openshift-ingress/e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls"
Jul 24 18:08:17.512083 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:17.512028    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8bef9d92-590a-40ea-ac90-c5c84f6e3e55-istio-data\") pod \"e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls\" (UID: \"8bef9d92-590a-40ea-ac90-c5c84f6e3e55\") " pod="openshift-ingress/e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls"
Jul 24 18:08:17.512083 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:17.512073    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8bef9d92-590a-40ea-ac90-c5c84f6e3e55-credential-socket\") pod \"e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls\" (UID: \"8bef9d92-590a-40ea-ac90-c5c84f6e3e55\") " pod="openshift-ingress/e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls"
Jul 24 18:08:17.512405 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:17.512192    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8bef9d92-590a-40ea-ac90-c5c84f6e3e55-istio-envoy\") pod \"e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls\" (UID: \"8bef9d92-590a-40ea-ac90-c5c84f6e3e55\") " pod="openshift-ingress/e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls"
Jul 24 18:08:17.512405 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:17.512241    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8bef9d92-590a-40ea-ac90-c5c84f6e3e55-istio-podinfo\") pod \"e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls\" (UID: \"8bef9d92-590a-40ea-ac90-c5c84f6e3e55\") " pod="openshift-ingress/e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls"
Jul 24 18:08:17.512553 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:17.512493    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8bef9d92-590a-40ea-ac90-c5c84f6e3e55-workload-certs\") pod \"e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls\" (UID: \"8bef9d92-590a-40ea-ac90-c5c84f6e3e55\") " pod="openshift-ingress/e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls"
Jul 24 18:08:17.512553 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:17.512540    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8bef9d92-590a-40ea-ac90-c5c84f6e3e55-istio-data\") pod \"e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls\" (UID: \"8bef9d92-590a-40ea-ac90-c5c84f6e3e55\") " pod="openshift-ingress/e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls"
Jul 24 18:08:17.512663 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:17.512589    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8bef9d92-590a-40ea-ac90-c5c84f6e3e55-credential-socket\") pod \"e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls\" (UID: \"8bef9d92-590a-40ea-ac90-c5c84f6e3e55\") " pod="openshift-ingress/e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls"
Jul 24 18:08:17.512663 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:17.512599    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8bef9d92-590a-40ea-ac90-c5c84f6e3e55-workload-socket\") pod \"e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls\" (UID: \"8bef9d92-590a-40ea-ac90-c5c84f6e3e55\") " pod="openshift-ingress/e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls"
Jul 24 18:08:17.512782 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:17.512765    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8bef9d92-590a-40ea-ac90-c5c84f6e3e55-istiod-ca-cert\") pod \"e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls\" (UID: \"8bef9d92-590a-40ea-ac90-c5c84f6e3e55\") " pod="openshift-ingress/e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls"
Jul 24 18:08:17.514548 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:17.514526    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8bef9d92-590a-40ea-ac90-c5c84f6e3e55-istio-envoy\") pod \"e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls\" (UID: \"8bef9d92-590a-40ea-ac90-c5c84f6e3e55\") " pod="openshift-ingress/e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls"
Jul 24 18:08:17.514733 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:17.514717    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8bef9d92-590a-40ea-ac90-c5c84f6e3e55-istio-podinfo\") pod \"e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls\" (UID: \"8bef9d92-590a-40ea-ac90-c5c84f6e3e55\") " pod="openshift-ingress/e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls"
Jul 24 18:08:17.528556 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:17.528530    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxxpz\" (UniqueName: \"kubernetes.io/projected/8bef9d92-590a-40ea-ac90-c5c84f6e3e55-kube-api-access-sxxpz\") pod \"e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls\" (UID: \"8bef9d92-590a-40ea-ac90-c5c84f6e3e55\") " pod="openshift-ingress/e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls"
Jul 24 18:08:17.529927 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:17.529909    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8bef9d92-590a-40ea-ac90-c5c84f6e3e55-istio-token\") pod \"e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls\" (UID: \"8bef9d92-590a-40ea-ac90-c5c84f6e3e55\") " pod="openshift-ingress/e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls"
Jul 24 18:08:17.631799 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:17.631706    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls"
Jul 24 18:08:17.770689 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:17.770646    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls"]
Jul 24 18:08:17.773336 ip-10-0-139-113 kubenswrapper[2575]: W0724 18:08:17.773304    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bef9d92_590a_40ea_ac90_c5c84f6e3e55.slice/crio-548a458c382ed16daf9b611c787ccebeaf29b12cf1da0db597c53ca598860682 WatchSource:0}: Error finding container 548a458c382ed16daf9b611c787ccebeaf29b12cf1da0db597c53ca598860682: Status 404 returned error can't find the container with id 548a458c382ed16daf9b611c787ccebeaf29b12cf1da0db597c53ca598860682
Jul 24 18:08:17.775522 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:17.775493    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 18:08:17.775589 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:17.775573    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 18:08:17.775630 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:17.775604    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 18:08:17.976473 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:17.976342    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:08:18.000030 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:17.999996    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls" event={"ID":"8bef9d92-590a-40ea-ac90-c5c84f6e3e55","Type":"ContainerStarted","Data":"a96dc0904d5fc3b870539921e537b9b8afc64bc8c3302f303020f062f9259fca"}
Jul 24 18:08:18.000200 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:18.000045    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls" event={"ID":"8bef9d92-590a-40ea-ac90-c5c84f6e3e55","Type":"ContainerStarted","Data":"548a458c382ed16daf9b611c787ccebeaf29b12cf1da0db597c53ca598860682"}
Jul 24 18:08:18.026724 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:18.026658    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls" podStartSLOduration=1.026634403 podStartE2EDuration="1.026634403s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:08:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:08:18.023421417 +0000 UTC m=+3033.504797037" watchObservedRunningTime="2026-07-24 18:08:18.026634403 +0000 UTC m=+3033.508010025"
Jul 24 18:08:18.632615 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:18.632569    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls"
Jul 24 18:08:18.637700 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:18.637674    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls"
Jul 24 18:08:19.004520 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:19.004435    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls"
Jul 24 18:08:19.005416 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:19.005397    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls"
Jul 24 18:08:20.025164 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:20.025124    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:08:20.125544 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:20.125513    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:08:20.346227 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:20.346198    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:08:20.919643 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:20.919609    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:08:21.013073 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:21.013035    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:08:21.113477 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:21.113445    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:08:21.144014 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:21.143980    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-fb4092-d995ff5db-j5qqg"]
Jul 24 18:08:21.147419 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:21.147399    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-fb4092-d995ff5db-j5qqg"
Jul 24 18:08:21.148778 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:21.148757    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grzvq\" (UniqueName: \"kubernetes.io/projected/3dc5df78-98c8-4cb6-b51c-cc5a84da1bce-kube-api-access-grzvq\") pod \"payload-processing-e2e-ipp-cleanup-fb4092-d995ff5db-j5qqg\" (UID: \"3dc5df78-98c8-4cb6-b51c-cc5a84da1bce\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-fb4092-d995ff5db-j5qqg"
Jul 24 18:08:21.148878 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:21.148815    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3dc5df78-98c8-4cb6-b51c-cc5a84da1bce-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-fb4092-d995ff5db-j5qqg\" (UID: \"3dc5df78-98c8-4cb6-b51c-cc5a84da1bce\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-fb4092-d995ff5db-j5qqg"
Jul 24 18:08:21.150154 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:21.150137    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-fb4092-dockercfg-q9qd8\""
Jul 24 18:08:21.150397 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:21.150376    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-fb4092\""
Jul 24 18:08:21.160298 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:21.160261    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-fb4092-d995ff5db-j5qqg"]
Jul 24 18:08:21.209957 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:21.209860    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fb4092-55986dfbb8-6gx2h"]
Jul 24 18:08:21.213145 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:21.213129    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fb4092-55986dfbb8-6gx2h"
Jul 24 18:08:21.224483 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:21.224454    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fb4092-55986dfbb8-6gx2h"]
Jul 24 18:08:21.249626 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:21.249577    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3dc5df78-98c8-4cb6-b51c-cc5a84da1bce-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-fb4092-d995ff5db-j5qqg\" (UID: \"3dc5df78-98c8-4cb6-b51c-cc5a84da1bce\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-fb4092-d995ff5db-j5qqg"
Jul 24 18:08:21.249921 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:21.249900    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grzvq\" (UniqueName: \"kubernetes.io/projected/3dc5df78-98c8-4cb6-b51c-cc5a84da1bce-kube-api-access-grzvq\") pod \"payload-processing-e2e-ipp-cleanup-fb4092-d995ff5db-j5qqg\" (UID: \"3dc5df78-98c8-4cb6-b51c-cc5a84da1bce\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-fb4092-d995ff5db-j5qqg"
Jul 24 18:08:21.250468 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:21.250446    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3dc5df78-98c8-4cb6-b51c-cc5a84da1bce-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-fb4092-d995ff5db-j5qqg\" (UID: \"3dc5df78-98c8-4cb6-b51c-cc5a84da1bce\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-fb4092-d995ff5db-j5qqg"
Jul 24 18:08:21.258875 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:21.258845    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grzvq\" (UniqueName: \"kubernetes.io/projected/3dc5df78-98c8-4cb6-b51c-cc5a84da1bce-kube-api-access-grzvq\") pod \"payload-processing-e2e-ipp-cleanup-fb4092-d995ff5db-j5qqg\" (UID: \"3dc5df78-98c8-4cb6-b51c-cc5a84da1bce\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-fb4092-d995ff5db-j5qqg"
Jul 24 18:08:21.350707 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:21.350667    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jm2s7\" (UniqueName: \"kubernetes.io/projected/45bc0d6b-8c25-4956-a30c-477938922193-kube-api-access-jm2s7\") pod \"payload-pre-processing-e2e-ipp-cleanup-fb4092-55986dfbb8-6gx2h\" (UID: \"45bc0d6b-8c25-4956-a30c-477938922193\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fb4092-55986dfbb8-6gx2h"
Jul 24 18:08:21.350878 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:21.350716    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45bc0d6b-8c25-4956-a30c-477938922193-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-fb4092-55986dfbb8-6gx2h\" (UID: \"45bc0d6b-8c25-4956-a30c-477938922193\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fb4092-55986dfbb8-6gx2h"
Jul 24 18:08:21.451558 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:21.451524    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jm2s7\" (UniqueName: \"kubernetes.io/projected/45bc0d6b-8c25-4956-a30c-477938922193-kube-api-access-jm2s7\") pod \"payload-pre-processing-e2e-ipp-cleanup-fb4092-55986dfbb8-6gx2h\" (UID: \"45bc0d6b-8c25-4956-a30c-477938922193\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fb4092-55986dfbb8-6gx2h"
Jul 24 18:08:21.451558 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:21.451564    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45bc0d6b-8c25-4956-a30c-477938922193-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-fb4092-55986dfbb8-6gx2h\" (UID: \"45bc0d6b-8c25-4956-a30c-477938922193\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fb4092-55986dfbb8-6gx2h"
Jul 24 18:08:21.452247 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:21.452229    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45bc0d6b-8c25-4956-a30c-477938922193-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-fb4092-55986dfbb8-6gx2h\" (UID: \"45bc0d6b-8c25-4956-a30c-477938922193\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fb4092-55986dfbb8-6gx2h"
Jul 24 18:08:21.462491 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:21.462430    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-fb4092-d995ff5db-j5qqg"
Jul 24 18:08:21.469124 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:21.469100    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jm2s7\" (UniqueName: \"kubernetes.io/projected/45bc0d6b-8c25-4956-a30c-477938922193-kube-api-access-jm2s7\") pod \"payload-pre-processing-e2e-ipp-cleanup-fb4092-55986dfbb8-6gx2h\" (UID: \"45bc0d6b-8c25-4956-a30c-477938922193\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fb4092-55986dfbb8-6gx2h"
Jul 24 18:08:21.522605 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:21.522567    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fb4092-55986dfbb8-6gx2h"
Jul 24 18:08:21.611912 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:21.611888    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-fb4092-d995ff5db-j5qqg"]
Jul 24 18:08:21.614478 ip-10-0-139-113 kubenswrapper[2575]: W0724 18:08:21.614446    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dc5df78_98c8_4cb6_b51c_cc5a84da1bce.slice/crio-fc03d7847afb7dc7898052c01d3122175488f5e05aba41af62280f8a67ac94dd WatchSource:0}: Error finding container fc03d7847afb7dc7898052c01d3122175488f5e05aba41af62280f8a67ac94dd: Status 404 returned error can't find the container with id fc03d7847afb7dc7898052c01d3122175488f5e05aba41af62280f8a67ac94dd
Jul 24 18:08:21.678724 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:21.678701    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fb4092-55986dfbb8-6gx2h"]
Jul 24 18:08:21.681704 ip-10-0-139-113 kubenswrapper[2575]: W0724 18:08:21.681676    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45bc0d6b_8c25_4956_a30c_477938922193.slice/crio-eeb77a30c29d716b56d7cf92af17ba2780f05b9177f7bad48a6a50ef92be84c9 WatchSource:0}: Error finding container eeb77a30c29d716b56d7cf92af17ba2780f05b9177f7bad48a6a50ef92be84c9: Status 404 returned error can't find the container with id eeb77a30c29d716b56d7cf92af17ba2780f05b9177f7bad48a6a50ef92be84c9
Jul 24 18:08:22.019314 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:22.019210    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-fb4092-d995ff5db-j5qqg" event={"ID":"3dc5df78-98c8-4cb6-b51c-cc5a84da1bce","Type":"ContainerStarted","Data":"04ddb4ca0bebab401aa7f5aa52dd05f75f7e1c9b0f658a0467155ea4187648b5"}
Jul 24 18:08:22.019314 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:22.019273    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-fb4092-d995ff5db-j5qqg" event={"ID":"3dc5df78-98c8-4cb6-b51c-cc5a84da1bce","Type":"ContainerStarted","Data":"fc03d7847afb7dc7898052c01d3122175488f5e05aba41af62280f8a67ac94dd"}
Jul 24 18:08:22.019314 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:22.019303    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-fb4092-d995ff5db-j5qqg"
Jul 24 18:08:22.020574 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:22.020552    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fb4092-55986dfbb8-6gx2h" event={"ID":"45bc0d6b-8c25-4956-a30c-477938922193","Type":"ContainerStarted","Data":"3be6ad5aee947f01ba53585f9634997e25a4191b7cced9d6a1cd70423d5ba2a7"}
Jul 24 18:08:22.020695 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:22.020590    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fb4092-55986dfbb8-6gx2h" event={"ID":"45bc0d6b-8c25-4956-a30c-477938922193","Type":"ContainerStarted","Data":"eeb77a30c29d716b56d7cf92af17ba2780f05b9177f7bad48a6a50ef92be84c9"}
Jul 24 18:08:22.020695 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:22.020637    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fb4092-55986dfbb8-6gx2h"
Jul 24 18:08:22.037763 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:22.037705    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-fb4092-d995ff5db-j5qqg" podStartSLOduration=1.037686635 podStartE2EDuration="1.037686635s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:08:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:08:22.035718379 +0000 UTC m=+3037.517093999" watchObservedRunningTime="2026-07-24 18:08:22.037686635 +0000 UTC m=+3037.519062290"
Jul 24 18:08:22.055422 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:22.055366    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fb4092-55986dfbb8-6gx2h" podStartSLOduration=1.055349884 podStartE2EDuration="1.055349884s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:08:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:08:22.053747382 +0000 UTC m=+3037.535123001" watchObservedRunningTime="2026-07-24 18:08:22.055349884 +0000 UTC m=+3037.536725503"
Jul 24 18:08:24.554583 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:24.554550    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:08:31.031225 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:31.031187    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:08:33.026987 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:33.026956    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-fb4092-d995ff5db-j5qqg"
Jul 24 18:08:33.027408 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:33.027124    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fb4092-55986dfbb8-6gx2h"
Jul 24 18:08:34.006525 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:34.006422    2575 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Jul 24 18:08:34.006525 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:34.006494    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls" podUID="8bef9d92-590a-40ea-ac90-c5c84f6e3e55" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Jul 24 18:08:34.087253 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:34.087220    2575 generic.go:356] "Generic (PLEG): container finished" podID="8bef9d92-590a-40ea-ac90-c5c84f6e3e55" containerID="a96dc0904d5fc3b870539921e537b9b8afc64bc8c3302f303020f062f9259fca" exitCode=0
Jul 24 18:08:34.087632 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:34.087301    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls" event={"ID":"8bef9d92-590a-40ea-ac90-c5c84f6e3e55","Type":"ContainerDied","Data":"a96dc0904d5fc3b870539921e537b9b8afc64bc8c3302f303020f062f9259fca"}
Jul 24 18:08:34.087822 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:34.087803    2575 scope.go:117] "RemoveContainer" containerID="a96dc0904d5fc3b870539921e537b9b8afc64bc8c3302f303020f062f9259fca"
Jul 24 18:08:34.088993 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:34.088968    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 18:08:34.089069 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:34.089033    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 18:08:34.089069 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:34.089062    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 24 18:08:35.093167 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:35.093132    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls" event={"ID":"8bef9d92-590a-40ea-ac90-c5c84f6e3e55","Type":"ContainerStarted","Data":"b5a948f94fffb4cb228345d41732061884064dc2c28639bc4364e5b87cd75f9a"}
Jul 24 18:08:35.632629 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:35.632588    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls"
Jul 24 18:08:35.632980 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:35.632912    2575 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Jul 24 18:08:35.633102 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:35.633018    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls" podUID="8bef9d92-590a-40ea-ac90-c5c84f6e3e55" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Jul 24 18:08:36.632687 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:36.632648    2575 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Jul 24 18:08:36.633377 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:36.633342    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls" podUID="8bef9d92-590a-40ea-ac90-c5c84f6e3e55" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Jul 24 18:08:37.633117 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:37.633069    2575 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Jul 24 18:08:37.633661 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:37.633139    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls" podUID="8bef9d92-590a-40ea-ac90-c5c84f6e3e55" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Jul 24 18:08:38.633319 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:38.633278    2575 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Jul 24 18:08:38.633930 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:38.633895    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls" podUID="8bef9d92-590a-40ea-ac90-c5c84f6e3e55" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Jul 24 18:08:39.636474 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:39.636438    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls"
Jul 24 18:08:39.636876 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:39.636859    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls"
Jul 24 18:08:39.637478 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:39.637460    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls"
Jul 24 18:08:43.146573 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:43.146501    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:08:46.271844 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:46.271804    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:08:46.292246 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:46.292210    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-fb4092-d995ff5db-j5qqg"]
Jul 24 18:08:46.292490 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:46.292462    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-fb4092-d995ff5db-j5qqg" podUID="3dc5df78-98c8-4cb6-b51c-cc5a84da1bce" containerName="payload-processing" containerID="cri-o://04ddb4ca0bebab401aa7f5aa52dd05f75f7e1c9b0f658a0467155ea4187648b5" gracePeriod=30
Jul 24 18:08:46.301512 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:46.301474    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fb4092-55986dfbb8-6gx2h"]
Jul 24 18:08:46.301758 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:46.301709    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fb4092-55986dfbb8-6gx2h" podUID="45bc0d6b-8c25-4956-a30c-477938922193" containerName="payload-pre-processing" containerID="cri-o://3be6ad5aee947f01ba53585f9634997e25a4191b7cced9d6a1cd70423d5ba2a7" gracePeriod=30
Jul 24 18:08:46.340480 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:46.340450    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:08:46.441132 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:46.441077    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:08:46.552608 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:46.552574    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-fb4092-d995ff5db-j5qqg"
Jul 24 18:08:46.577117 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:46.577092    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fb4092-55986dfbb8-6gx2h"
Jul 24 18:08:46.707612 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:46.707572    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-grzvq\" (UniqueName: \"kubernetes.io/projected/3dc5df78-98c8-4cb6-b51c-cc5a84da1bce-kube-api-access-grzvq\") pod \"3dc5df78-98c8-4cb6-b51c-cc5a84da1bce\" (UID: \"3dc5df78-98c8-4cb6-b51c-cc5a84da1bce\") "
Jul 24 18:08:46.707612 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:46.707612    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3dc5df78-98c8-4cb6-b51c-cc5a84da1bce-plugins-config-volume\") pod \"3dc5df78-98c8-4cb6-b51c-cc5a84da1bce\" (UID: \"3dc5df78-98c8-4cb6-b51c-cc5a84da1bce\") "
Jul 24 18:08:46.707916 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:46.707629    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jm2s7\" (UniqueName: \"kubernetes.io/projected/45bc0d6b-8c25-4956-a30c-477938922193-kube-api-access-jm2s7\") pod \"45bc0d6b-8c25-4956-a30c-477938922193\" (UID: \"45bc0d6b-8c25-4956-a30c-477938922193\") "
Jul 24 18:08:46.707916 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:46.707701    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45bc0d6b-8c25-4956-a30c-477938922193-plugins-config-volume\") pod \"45bc0d6b-8c25-4956-a30c-477938922193\" (UID: \"45bc0d6b-8c25-4956-a30c-477938922193\") "
Jul 24 18:08:46.708139 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:46.708113    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3dc5df78-98c8-4cb6-b51c-cc5a84da1bce-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3dc5df78-98c8-4cb6-b51c-cc5a84da1bce" (UID: "3dc5df78-98c8-4cb6-b51c-cc5a84da1bce"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:08:46.708209 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:46.708167    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45bc0d6b-8c25-4956-a30c-477938922193-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "45bc0d6b-8c25-4956-a30c-477938922193" (UID: "45bc0d6b-8c25-4956-a30c-477938922193"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:08:46.709871 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:46.709851    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45bc0d6b-8c25-4956-a30c-477938922193-kube-api-access-jm2s7" (OuterVolumeSpecName: "kube-api-access-jm2s7") pod "45bc0d6b-8c25-4956-a30c-477938922193" (UID: "45bc0d6b-8c25-4956-a30c-477938922193"). InnerVolumeSpecName "kube-api-access-jm2s7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:08:46.709928 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:46.709882    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3dc5df78-98c8-4cb6-b51c-cc5a84da1bce-kube-api-access-grzvq" (OuterVolumeSpecName: "kube-api-access-grzvq") pod "3dc5df78-98c8-4cb6-b51c-cc5a84da1bce" (UID: "3dc5df78-98c8-4cb6-b51c-cc5a84da1bce"). InnerVolumeSpecName "kube-api-access-grzvq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:08:46.808909 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:46.808869    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-grzvq\" (UniqueName: \"kubernetes.io/projected/3dc5df78-98c8-4cb6-b51c-cc5a84da1bce-kube-api-access-grzvq\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 18:08:46.808909 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:46.808902    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3dc5df78-98c8-4cb6-b51c-cc5a84da1bce-plugins-config-volume\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 18:08:46.808909 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:46.808914    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jm2s7\" (UniqueName: \"kubernetes.io/projected/45bc0d6b-8c25-4956-a30c-477938922193-kube-api-access-jm2s7\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 18:08:46.809180 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:46.808923    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45bc0d6b-8c25-4956-a30c-477938922193-plugins-config-volume\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 18:08:47.148547 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:47.148455    2575 generic.go:356] "Generic (PLEG): container finished" podID="3dc5df78-98c8-4cb6-b51c-cc5a84da1bce" containerID="04ddb4ca0bebab401aa7f5aa52dd05f75f7e1c9b0f658a0467155ea4187648b5" exitCode=0
Jul 24 18:08:47.148547 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:47.148502    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-fb4092-d995ff5db-j5qqg"
Jul 24 18:08:47.148547 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:47.148537    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-fb4092-d995ff5db-j5qqg" event={"ID":"3dc5df78-98c8-4cb6-b51c-cc5a84da1bce","Type":"ContainerDied","Data":"04ddb4ca0bebab401aa7f5aa52dd05f75f7e1c9b0f658a0467155ea4187648b5"}
Jul 24 18:08:47.148832 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:47.148594    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-fb4092-d995ff5db-j5qqg" event={"ID":"3dc5df78-98c8-4cb6-b51c-cc5a84da1bce","Type":"ContainerDied","Data":"fc03d7847afb7dc7898052c01d3122175488f5e05aba41af62280f8a67ac94dd"}
Jul 24 18:08:47.148832 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:47.148624    2575 scope.go:117] "RemoveContainer" containerID="04ddb4ca0bebab401aa7f5aa52dd05f75f7e1c9b0f658a0467155ea4187648b5"
Jul 24 18:08:47.149853 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:47.149829    2575 generic.go:356] "Generic (PLEG): container finished" podID="45bc0d6b-8c25-4956-a30c-477938922193" containerID="3be6ad5aee947f01ba53585f9634997e25a4191b7cced9d6a1cd70423d5ba2a7" exitCode=0
Jul 24 18:08:47.149919 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:47.149862    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fb4092-55986dfbb8-6gx2h"
Jul 24 18:08:47.149919 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:47.149888    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fb4092-55986dfbb8-6gx2h" event={"ID":"45bc0d6b-8c25-4956-a30c-477938922193","Type":"ContainerDied","Data":"3be6ad5aee947f01ba53585f9634997e25a4191b7cced9d6a1cd70423d5ba2a7"}
Jul 24 18:08:47.150025 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:47.149929    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fb4092-55986dfbb8-6gx2h" event={"ID":"45bc0d6b-8c25-4956-a30c-477938922193","Type":"ContainerDied","Data":"eeb77a30c29d716b56d7cf92af17ba2780f05b9177f7bad48a6a50ef92be84c9"}
Jul 24 18:08:47.158860 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:47.158835    2575 scope.go:117] "RemoveContainer" containerID="04ddb4ca0bebab401aa7f5aa52dd05f75f7e1c9b0f658a0467155ea4187648b5"
Jul 24 18:08:47.159193 ip-10-0-139-113 kubenswrapper[2575]: E0724 18:08:47.159170    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04ddb4ca0bebab401aa7f5aa52dd05f75f7e1c9b0f658a0467155ea4187648b5\": container with ID starting with 04ddb4ca0bebab401aa7f5aa52dd05f75f7e1c9b0f658a0467155ea4187648b5 not found: ID does not exist" containerID="04ddb4ca0bebab401aa7f5aa52dd05f75f7e1c9b0f658a0467155ea4187648b5"
Jul 24 18:08:47.159285 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:47.159198    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04ddb4ca0bebab401aa7f5aa52dd05f75f7e1c9b0f658a0467155ea4187648b5"} err="failed to get container status \"04ddb4ca0bebab401aa7f5aa52dd05f75f7e1c9b0f658a0467155ea4187648b5\": rpc error: code = NotFound desc = could not find container \"04ddb4ca0bebab401aa7f5aa52dd05f75f7e1c9b0f658a0467155ea4187648b5\": container with ID starting with 04ddb4ca0bebab401aa7f5aa52dd05f75f7e1c9b0f658a0467155ea4187648b5 not found: ID does not exist"
Jul 24 18:08:47.159285 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:47.159216    2575 scope.go:117] "RemoveContainer" containerID="3be6ad5aee947f01ba53585f9634997e25a4191b7cced9d6a1cd70423d5ba2a7"
Jul 24 18:08:47.167365 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:47.167348    2575 scope.go:117] "RemoveContainer" containerID="3be6ad5aee947f01ba53585f9634997e25a4191b7cced9d6a1cd70423d5ba2a7"
Jul 24 18:08:47.167640 ip-10-0-139-113 kubenswrapper[2575]: E0724 18:08:47.167621    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3be6ad5aee947f01ba53585f9634997e25a4191b7cced9d6a1cd70423d5ba2a7\": container with ID starting with 3be6ad5aee947f01ba53585f9634997e25a4191b7cced9d6a1cd70423d5ba2a7 not found: ID does not exist" containerID="3be6ad5aee947f01ba53585f9634997e25a4191b7cced9d6a1cd70423d5ba2a7"
Jul 24 18:08:47.167686 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:47.167648    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3be6ad5aee947f01ba53585f9634997e25a4191b7cced9d6a1cd70423d5ba2a7"} err="failed to get container status \"3be6ad5aee947f01ba53585f9634997e25a4191b7cced9d6a1cd70423d5ba2a7\": rpc error: code = NotFound desc = could not find container \"3be6ad5aee947f01ba53585f9634997e25a4191b7cced9d6a1cd70423d5ba2a7\": container with ID starting with 3be6ad5aee947f01ba53585f9634997e25a4191b7cced9d6a1cd70423d5ba2a7 not found: ID does not exist"
Jul 24 18:08:47.174523 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:47.174498    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-fb4092-d995ff5db-j5qqg"]
Jul 24 18:08:47.179192 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:47.179168    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-fb4092-d995ff5db-j5qqg"]
Jul 24 18:08:47.194411 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:47.194370    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fb4092-55986dfbb8-6gx2h"]
Jul 24 18:08:47.205014 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:47.204978    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3dc5df78-98c8-4cb6-b51c-cc5a84da1bce" path="/var/lib/kubelet/pods/3dc5df78-98c8-4cb6-b51c-cc5a84da1bce/volumes"
Jul 24 18:08:47.205953 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:47.205919    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fb4092-55986dfbb8-6gx2h"]
Jul 24 18:08:49.201695 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:49.201657    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45bc0d6b-8c25-4956-a30c-477938922193" path="/var/lib/kubelet/pods/45bc0d6b-8c25-4956-a30c-477938922193/volumes"
Jul 24 18:08:50.653029 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:50.652993    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:08:51.093026 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:51.092992    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:08:57.073304 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:57.073273    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:08:57.179092 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:57.179049    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:08:57.376585 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:57.376503    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls"]
Jul 24 18:08:57.376740 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:57.376718    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls" podUID="8bef9d92-590a-40ea-ac90-c5c84f6e3e55" containerName="istio-proxy" containerID="cri-o://b5a948f94fffb4cb228345d41732061884064dc2c28639bc4364e5b87cd75f9a" gracePeriod=30
Jul 24 18:08:57.405703 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:57.405665    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:08:57.619720 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:08:57.619688    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:09:02.629102 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:02.629070    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls"
Jul 24 18:09:02.655146 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:02.654792    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8bef9d92-590a-40ea-ac90-c5c84f6e3e55-istio-envoy\") pod \"8bef9d92-590a-40ea-ac90-c5c84f6e3e55\" (UID: \"8bef9d92-590a-40ea-ac90-c5c84f6e3e55\") "
Jul 24 18:09:02.655146 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:02.654849    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sxxpz\" (UniqueName: \"kubernetes.io/projected/8bef9d92-590a-40ea-ac90-c5c84f6e3e55-kube-api-access-sxxpz\") pod \"8bef9d92-590a-40ea-ac90-c5c84f6e3e55\" (UID: \"8bef9d92-590a-40ea-ac90-c5c84f6e3e55\") "
Jul 24 18:09:02.655146 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:02.654914    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8bef9d92-590a-40ea-ac90-c5c84f6e3e55-istio-data\") pod \"8bef9d92-590a-40ea-ac90-c5c84f6e3e55\" (UID: \"8bef9d92-590a-40ea-ac90-c5c84f6e3e55\") "
Jul 24 18:09:02.655146 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:02.654965    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8bef9d92-590a-40ea-ac90-c5c84f6e3e55-istiod-ca-cert\") pod \"8bef9d92-590a-40ea-ac90-c5c84f6e3e55\" (UID: \"8bef9d92-590a-40ea-ac90-c5c84f6e3e55\") "
Jul 24 18:09:02.655146 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:02.654981    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8bef9d92-590a-40ea-ac90-c5c84f6e3e55-workload-certs\") pod \"8bef9d92-590a-40ea-ac90-c5c84f6e3e55\" (UID: \"8bef9d92-590a-40ea-ac90-c5c84f6e3e55\") "
Jul 24 18:09:02.655146 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:02.655043    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8bef9d92-590a-40ea-ac90-c5c84f6e3e55-istio-token\") pod \"8bef9d92-590a-40ea-ac90-c5c84f6e3e55\" (UID: \"8bef9d92-590a-40ea-ac90-c5c84f6e3e55\") "
Jul 24 18:09:02.655146 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:02.655114    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8bef9d92-590a-40ea-ac90-c5c84f6e3e55-istio-podinfo\") pod \"8bef9d92-590a-40ea-ac90-c5c84f6e3e55\" (UID: \"8bef9d92-590a-40ea-ac90-c5c84f6e3e55\") "
Jul 24 18:09:02.655146 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:02.655151    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8bef9d92-590a-40ea-ac90-c5c84f6e3e55-workload-socket\") pod \"8bef9d92-590a-40ea-ac90-c5c84f6e3e55\" (UID: \"8bef9d92-590a-40ea-ac90-c5c84f6e3e55\") "
Jul 24 18:09:02.655671 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:02.655185    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8bef9d92-590a-40ea-ac90-c5c84f6e3e55-credential-socket\") pod \"8bef9d92-590a-40ea-ac90-c5c84f6e3e55\" (UID: \"8bef9d92-590a-40ea-ac90-c5c84f6e3e55\") "
Jul 24 18:09:02.655732 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:02.655660    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8bef9d92-590a-40ea-ac90-c5c84f6e3e55-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8bef9d92-590a-40ea-ac90-c5c84f6e3e55" (UID: "8bef9d92-590a-40ea-ac90-c5c84f6e3e55"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:09:02.656152 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:02.655851    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bef9d92-590a-40ea-ac90-c5c84f6e3e55-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8bef9d92-590a-40ea-ac90-c5c84f6e3e55" (UID: "8bef9d92-590a-40ea-ac90-c5c84f6e3e55"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 18:09:02.656152 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:02.656085    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bef9d92-590a-40ea-ac90-c5c84f6e3e55-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8bef9d92-590a-40ea-ac90-c5c84f6e3e55" (UID: "8bef9d92-590a-40ea-ac90-c5c84f6e3e55"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 18:09:02.656152 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:02.656135    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bef9d92-590a-40ea-ac90-c5c84f6e3e55-istio-data" (OuterVolumeSpecName: "istio-data") pod "8bef9d92-590a-40ea-ac90-c5c84f6e3e55" (UID: "8bef9d92-590a-40ea-ac90-c5c84f6e3e55"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 18:09:02.656434 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:02.656238    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bef9d92-590a-40ea-ac90-c5c84f6e3e55-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8bef9d92-590a-40ea-ac90-c5c84f6e3e55" (UID: "8bef9d92-590a-40ea-ac90-c5c84f6e3e55"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 18:09:02.658066 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:02.658022    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bef9d92-590a-40ea-ac90-c5c84f6e3e55-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8bef9d92-590a-40ea-ac90-c5c84f6e3e55" (UID: "8bef9d92-590a-40ea-ac90-c5c84f6e3e55"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 18:09:02.658407 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:02.658367    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8bef9d92-590a-40ea-ac90-c5c84f6e3e55-kube-api-access-sxxpz" (OuterVolumeSpecName: "kube-api-access-sxxpz") pod "8bef9d92-590a-40ea-ac90-c5c84f6e3e55" (UID: "8bef9d92-590a-40ea-ac90-c5c84f6e3e55"). InnerVolumeSpecName "kube-api-access-sxxpz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:09:02.658567 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:02.658418    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8bef9d92-590a-40ea-ac90-c5c84f6e3e55-istio-token" (OuterVolumeSpecName: "istio-token") pod "8bef9d92-590a-40ea-ac90-c5c84f6e3e55" (UID: "8bef9d92-590a-40ea-ac90-c5c84f6e3e55"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:09:02.658567 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:02.658443    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8bef9d92-590a-40ea-ac90-c5c84f6e3e55-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8bef9d92-590a-40ea-ac90-c5c84f6e3e55" (UID: "8bef9d92-590a-40ea-ac90-c5c84f6e3e55"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 18:09:02.756771 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:02.756734    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8bef9d92-590a-40ea-ac90-c5c84f6e3e55-istio-podinfo\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 18:09:02.756771 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:02.756763    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8bef9d92-590a-40ea-ac90-c5c84f6e3e55-workload-socket\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 18:09:02.756771 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:02.756775    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8bef9d92-590a-40ea-ac90-c5c84f6e3e55-credential-socket\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 18:09:02.757058 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:02.756785    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8bef9d92-590a-40ea-ac90-c5c84f6e3e55-istio-envoy\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 18:09:02.757058 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:02.756794    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sxxpz\" (UniqueName: \"kubernetes.io/projected/8bef9d92-590a-40ea-ac90-c5c84f6e3e55-kube-api-access-sxxpz\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 18:09:02.757058 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:02.756804    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8bef9d92-590a-40ea-ac90-c5c84f6e3e55-istio-data\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 18:09:02.757058 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:02.756826    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8bef9d92-590a-40ea-ac90-c5c84f6e3e55-istiod-ca-cert\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 18:09:02.757058 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:02.756834    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8bef9d92-590a-40ea-ac90-c5c84f6e3e55-workload-certs\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 18:09:02.757058 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:02.756841    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8bef9d92-590a-40ea-ac90-c5c84f6e3e55-istio-token\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 18:09:03.224436 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:03.224404    2575 generic.go:356] "Generic (PLEG): container finished" podID="8bef9d92-590a-40ea-ac90-c5c84f6e3e55" containerID="b5a948f94fffb4cb228345d41732061884064dc2c28639bc4364e5b87cd75f9a" exitCode=0
Jul 24 18:09:03.224601 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:03.224454    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls"
Jul 24 18:09:03.224601 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:03.224472    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls" event={"ID":"8bef9d92-590a-40ea-ac90-c5c84f6e3e55","Type":"ContainerDied","Data":"b5a948f94fffb4cb228345d41732061884064dc2c28639bc4364e5b87cd75f9a"}
Jul 24 18:09:03.224601 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:03.224520    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls" event={"ID":"8bef9d92-590a-40ea-ac90-c5c84f6e3e55","Type":"ContainerDied","Data":"548a458c382ed16daf9b611c787ccebeaf29b12cf1da0db597c53ca598860682"}
Jul 24 18:09:03.224601 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:03.224545    2575 scope.go:117] "RemoveContainer" containerID="b5a948f94fffb4cb228345d41732061884064dc2c28639bc4364e5b87cd75f9a"
Jul 24 18:09:03.232929 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:03.232912    2575 scope.go:117] "RemoveContainer" containerID="a96dc0904d5fc3b870539921e537b9b8afc64bc8c3302f303020f062f9259fca"
Jul 24 18:09:03.240720 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:03.240700    2575 scope.go:117] "RemoveContainer" containerID="b5a948f94fffb4cb228345d41732061884064dc2c28639bc4364e5b87cd75f9a"
Jul 24 18:09:03.240999 ip-10-0-139-113 kubenswrapper[2575]: E0724 18:09:03.240982    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5a948f94fffb4cb228345d41732061884064dc2c28639bc4364e5b87cd75f9a\": container with ID starting with b5a948f94fffb4cb228345d41732061884064dc2c28639bc4364e5b87cd75f9a not found: ID does not exist" containerID="b5a948f94fffb4cb228345d41732061884064dc2c28639bc4364e5b87cd75f9a"
Jul 24 18:09:03.241046 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:03.241007    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5a948f94fffb4cb228345d41732061884064dc2c28639bc4364e5b87cd75f9a"} err="failed to get container status \"b5a948f94fffb4cb228345d41732061884064dc2c28639bc4364e5b87cd75f9a\": rpc error: code = NotFound desc = could not find container \"b5a948f94fffb4cb228345d41732061884064dc2c28639bc4364e5b87cd75f9a\": container with ID starting with b5a948f94fffb4cb228345d41732061884064dc2c28639bc4364e5b87cd75f9a not found: ID does not exist"
Jul 24 18:09:03.241046 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:03.241025    2575 scope.go:117] "RemoveContainer" containerID="a96dc0904d5fc3b870539921e537b9b8afc64bc8c3302f303020f062f9259fca"
Jul 24 18:09:03.241278 ip-10-0-139-113 kubenswrapper[2575]: E0724 18:09:03.241259    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a96dc0904d5fc3b870539921e537b9b8afc64bc8c3302f303020f062f9259fca\": container with ID starting with a96dc0904d5fc3b870539921e537b9b8afc64bc8c3302f303020f062f9259fca not found: ID does not exist" containerID="a96dc0904d5fc3b870539921e537b9b8afc64bc8c3302f303020f062f9259fca"
Jul 24 18:09:03.241314 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:03.241285    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a96dc0904d5fc3b870539921e537b9b8afc64bc8c3302f303020f062f9259fca"} err="failed to get container status \"a96dc0904d5fc3b870539921e537b9b8afc64bc8c3302f303020f062f9259fca\": rpc error: code = NotFound desc = could not find container \"a96dc0904d5fc3b870539921e537b9b8afc64bc8c3302f303020f062f9259fca\": container with ID starting with a96dc0904d5fc3b870539921e537b9b8afc64bc8c3302f303020f062f9259fca not found: ID does not exist"
Jul 24 18:09:03.245137 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:03.245115    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls"]
Jul 24 18:09:03.249904 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:03.249885    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-fb4092-openshift-default-8cfc8c9cd-lmgls"]
Jul 24 18:09:05.201842 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:05.201807    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8bef9d92-590a-40ea-ac90-c5c84f6e3e55" path="/var/lib/kubelet/pods/8bef9d92-590a-40ea-ac90-c5c84f6e3e55/volumes"
Jul 24 18:09:17.057255 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:17.057215    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:09:17.185529 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:17.185488    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:09:17.280578 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:17.280546    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:09:21.458658 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:21.458622    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:09:21.880827 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:21.880790    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:09:26.854889 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:26.854853    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-737ef6/ipp-route-737ef6-kserve-798dc55b55-wqgc9"]
Jul 24 18:09:26.950993 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:26.950961    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:09:41.873837 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:41.873796    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-737ef6/ipp-route-737ef6-kserve-798dc55b55-wqgc9" podUID="dacc5d09-5e79-4f2c-8e69-173c2012b81d" containerName="main" containerID="cri-o://80db33021468d4eff81b26d05d45622ebe71d1d691612d056badcd5dbcb72765" gracePeriod=45
Jul 24 18:09:42.118948 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:42.118902    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-737ef6/ipp-route-737ef6-kserve-798dc55b55-wqgc9"
Jul 24 18:09:42.218657 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:42.218551    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dacc5d09-5e79-4f2c-8e69-173c2012b81d-model-cache\") pod \"dacc5d09-5e79-4f2c-8e69-173c2012b81d\" (UID: \"dacc5d09-5e79-4f2c-8e69-173c2012b81d\") "
Jul 24 18:09:42.218657 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:42.218607    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dacc5d09-5e79-4f2c-8e69-173c2012b81d-home\") pod \"dacc5d09-5e79-4f2c-8e69-173c2012b81d\" (UID: \"dacc5d09-5e79-4f2c-8e69-173c2012b81d\") "
Jul 24 18:09:42.218657 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:42.218627    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dacc5d09-5e79-4f2c-8e69-173c2012b81d-tls-certs\") pod \"dacc5d09-5e79-4f2c-8e69-173c2012b81d\" (UID: \"dacc5d09-5e79-4f2c-8e69-173c2012b81d\") "
Jul 24 18:09:42.218657 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:42.218655    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8f2bh\" (UniqueName: \"kubernetes.io/projected/dacc5d09-5e79-4f2c-8e69-173c2012b81d-kube-api-access-8f2bh\") pod \"dacc5d09-5e79-4f2c-8e69-173c2012b81d\" (UID: \"dacc5d09-5e79-4f2c-8e69-173c2012b81d\") "
Jul 24 18:09:42.219039 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:42.218695    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dacc5d09-5e79-4f2c-8e69-173c2012b81d-dshm\") pod \"dacc5d09-5e79-4f2c-8e69-173c2012b81d\" (UID: \"dacc5d09-5e79-4f2c-8e69-173c2012b81d\") "
Jul 24 18:09:42.219039 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:42.218717    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dacc5d09-5e79-4f2c-8e69-173c2012b81d-tmp-dir\") pod \"dacc5d09-5e79-4f2c-8e69-173c2012b81d\" (UID: \"dacc5d09-5e79-4f2c-8e69-173c2012b81d\") "
Jul 24 18:09:42.219039 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:42.218875    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dacc5d09-5e79-4f2c-8e69-173c2012b81d-model-cache" (OuterVolumeSpecName: "model-cache") pod "dacc5d09-5e79-4f2c-8e69-173c2012b81d" (UID: "dacc5d09-5e79-4f2c-8e69-173c2012b81d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 18:09:42.219039 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:42.218965    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dacc5d09-5e79-4f2c-8e69-173c2012b81d-home" (OuterVolumeSpecName: "home") pod "dacc5d09-5e79-4f2c-8e69-173c2012b81d" (UID: "dacc5d09-5e79-4f2c-8e69-173c2012b81d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 18:09:42.219195 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:42.219087    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dacc5d09-5e79-4f2c-8e69-173c2012b81d-model-cache\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 18:09:42.219195 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:42.219090    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dacc5d09-5e79-4f2c-8e69-173c2012b81d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "dacc5d09-5e79-4f2c-8e69-173c2012b81d" (UID: "dacc5d09-5e79-4f2c-8e69-173c2012b81d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 18:09:42.219195 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:42.219106    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dacc5d09-5e79-4f2c-8e69-173c2012b81d-home\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 18:09:42.221076 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:42.221054    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dacc5d09-5e79-4f2c-8e69-173c2012b81d-dshm" (OuterVolumeSpecName: "dshm") pod "dacc5d09-5e79-4f2c-8e69-173c2012b81d" (UID: "dacc5d09-5e79-4f2c-8e69-173c2012b81d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 18:09:42.221152 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:42.221094    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dacc5d09-5e79-4f2c-8e69-173c2012b81d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "dacc5d09-5e79-4f2c-8e69-173c2012b81d" (UID: "dacc5d09-5e79-4f2c-8e69-173c2012b81d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 18:09:42.221204 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:42.221185    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dacc5d09-5e79-4f2c-8e69-173c2012b81d-kube-api-access-8f2bh" (OuterVolumeSpecName: "kube-api-access-8f2bh") pod "dacc5d09-5e79-4f2c-8e69-173c2012b81d" (UID: "dacc5d09-5e79-4f2c-8e69-173c2012b81d"). InnerVolumeSpecName "kube-api-access-8f2bh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:09:42.320077 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:42.320038    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8f2bh\" (UniqueName: \"kubernetes.io/projected/dacc5d09-5e79-4f2c-8e69-173c2012b81d-kube-api-access-8f2bh\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 18:09:42.320077 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:42.320069    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dacc5d09-5e79-4f2c-8e69-173c2012b81d-dshm\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 18:09:42.320299 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:42.320080    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dacc5d09-5e79-4f2c-8e69-173c2012b81d-tmp-dir\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 18:09:42.320299 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:42.320098    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dacc5d09-5e79-4f2c-8e69-173c2012b81d-tls-certs\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 18:09:42.404170 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:42.404134    2575 generic.go:356] "Generic (PLEG): container finished" podID="dacc5d09-5e79-4f2c-8e69-173c2012b81d" containerID="80db33021468d4eff81b26d05d45622ebe71d1d691612d056badcd5dbcb72765" exitCode=0
Jul 24 18:09:42.404342 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:42.404186    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-737ef6/ipp-route-737ef6-kserve-798dc55b55-wqgc9"
Jul 24 18:09:42.404342 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:42.404199    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-737ef6/ipp-route-737ef6-kserve-798dc55b55-wqgc9" event={"ID":"dacc5d09-5e79-4f2c-8e69-173c2012b81d","Type":"ContainerDied","Data":"80db33021468d4eff81b26d05d45622ebe71d1d691612d056badcd5dbcb72765"}
Jul 24 18:09:42.404342 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:42.404233    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-737ef6/ipp-route-737ef6-kserve-798dc55b55-wqgc9" event={"ID":"dacc5d09-5e79-4f2c-8e69-173c2012b81d","Type":"ContainerDied","Data":"c3bf04edc4fe3d64e25cba04003fa375bcfefbacc84f71da62a52bd5638d4cc1"}
Jul 24 18:09:42.404342 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:42.404250    2575 scope.go:117] "RemoveContainer" containerID="80db33021468d4eff81b26d05d45622ebe71d1d691612d056badcd5dbcb72765"
Jul 24 18:09:42.414051 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:42.414028    2575 scope.go:117] "RemoveContainer" containerID="80db33021468d4eff81b26d05d45622ebe71d1d691612d056badcd5dbcb72765"
Jul 24 18:09:42.414310 ip-10-0-139-113 kubenswrapper[2575]: E0724 18:09:42.414292    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80db33021468d4eff81b26d05d45622ebe71d1d691612d056badcd5dbcb72765\": container with ID starting with 80db33021468d4eff81b26d05d45622ebe71d1d691612d056badcd5dbcb72765 not found: ID does not exist" containerID="80db33021468d4eff81b26d05d45622ebe71d1d691612d056badcd5dbcb72765"
Jul 24 18:09:42.414376 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:42.414323    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80db33021468d4eff81b26d05d45622ebe71d1d691612d056badcd5dbcb72765"} err="failed to get container status \"80db33021468d4eff81b26d05d45622ebe71d1d691612d056badcd5dbcb72765\": rpc error: code = NotFound desc = could not find container \"80db33021468d4eff81b26d05d45622ebe71d1d691612d056badcd5dbcb72765\": container with ID starting with 80db33021468d4eff81b26d05d45622ebe71d1d691612d056badcd5dbcb72765 not found: ID does not exist"
Jul 24 18:09:42.430357 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:42.430325    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-737ef6/ipp-route-737ef6-kserve-798dc55b55-wqgc9"]
Jul 24 18:09:42.441857 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:42.441818    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-737ef6/ipp-route-737ef6-kserve-798dc55b55-wqgc9"]
Jul 24 18:09:43.202052 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:09:43.202022    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dacc5d09-5e79-4f2c-8e69-173c2012b81d" path="/var/lib/kubelet/pods/dacc5d09-5e79-4f2c-8e69-173c2012b81d/volumes"
Jul 24 18:10:03.346000 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:03.345963    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:10:04.745979 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:04.745914    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:10:10.901485 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:10.901396    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:10:16.692869 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:16.692833    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:10:16.781032 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:16.780999    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:10:17.058676 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:17.058643    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:10:17.269643 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:17.269611    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:10:17.390477 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:17.390391    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-53e30e-cvstf"]
Jul 24 18:10:17.390710 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:17.390698    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bef9d92-590a-40ea-ac90-c5c84f6e3e55" containerName="istio-proxy"
Jul 24 18:10:17.390771 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:17.390712    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bef9d92-590a-40ea-ac90-c5c84f6e3e55" containerName="istio-proxy"
Jul 24 18:10:17.390771 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:17.390726    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dacc5d09-5e79-4f2c-8e69-173c2012b81d" containerName="main"
Jul 24 18:10:17.390771 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:17.390731    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="dacc5d09-5e79-4f2c-8e69-173c2012b81d" containerName="main"
Jul 24 18:10:17.390771 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:17.390739    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3dc5df78-98c8-4cb6-b51c-cc5a84da1bce" containerName="payload-processing"
Jul 24 18:10:17.390771 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:17.390746    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3dc5df78-98c8-4cb6-b51c-cc5a84da1bce" containerName="payload-processing"
Jul 24 18:10:17.390771 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:17.390754    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45bc0d6b-8c25-4956-a30c-477938922193" containerName="payload-pre-processing"
Jul 24 18:10:17.390771 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:17.390760    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="45bc0d6b-8c25-4956-a30c-477938922193" containerName="payload-pre-processing"
Jul 24 18:10:17.391043 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:17.390821    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3dc5df78-98c8-4cb6-b51c-cc5a84da1bce" containerName="payload-processing"
Jul 24 18:10:17.391043 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:17.390830    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="45bc0d6b-8c25-4956-a30c-477938922193" containerName="payload-pre-processing"
Jul 24 18:10:17.391043 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:17.390836    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8bef9d92-590a-40ea-ac90-c5c84f6e3e55" containerName="istio-proxy"
Jul 24 18:10:17.391043 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:17.390842    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="dacc5d09-5e79-4f2c-8e69-173c2012b81d" containerName="main"
Jul 24 18:10:17.391043 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:17.390847    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8bef9d92-590a-40ea-ac90-c5c84f6e3e55" containerName="istio-proxy"
Jul 24 18:10:17.392945 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:17.392918    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-53e30e-cvstf"
Jul 24 18:10:17.395381 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:17.395358    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 18:10:17.395474 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:17.395390    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c25tj\""
Jul 24 18:10:17.400905 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:17.400882    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-53e30e-cvstf"]
Jul 24 18:10:17.539959 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:17.539904    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/592666f9-e6f7-4c40-84f2-ea50fa5d0835-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-53e30e-cvstf\" (UID: \"592666f9-e6f7-4c40-84f2-ea50fa5d0835\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-53e30e-cvstf"
Jul 24 18:10:17.641191 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:17.641092    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/592666f9-e6f7-4c40-84f2-ea50fa5d0835-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-53e30e-cvstf\" (UID: \"592666f9-e6f7-4c40-84f2-ea50fa5d0835\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-53e30e-cvstf"
Jul 24 18:10:17.641740 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:17.641720    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/592666f9-e6f7-4c40-84f2-ea50fa5d0835-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-53e30e-cvstf\" (UID: \"592666f9-e6f7-4c40-84f2-ea50fa5d0835\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-53e30e-cvstf"
Jul 24 18:10:17.705126 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:17.705098    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-53e30e-cvstf"
Jul 24 18:10:17.837600 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:17.837580    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-53e30e-cvstf"]
Jul 24 18:10:17.839917 ip-10-0-139-113 kubenswrapper[2575]: W0724 18:10:17.839879    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod592666f9_e6f7_4c40_84f2_ea50fa5d0835.slice/crio-3c0734e39cc208f44ab775c4b063fd60d8e761e8bc21099370d8f2f156660712 WatchSource:0}: Error finding container 3c0734e39cc208f44ab775c4b063fd60d8e761e8bc21099370d8f2f156660712: Status 404 returned error can't find the container with id 3c0734e39cc208f44ab775c4b063fd60d8e761e8bc21099370d8f2f156660712
Jul 24 18:10:18.559527 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:18.559494    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-53e30e-cvstf" event={"ID":"592666f9-e6f7-4c40-84f2-ea50fa5d0835","Type":"ContainerStarted","Data":"3c0734e39cc208f44ab775c4b063fd60d8e761e8bc21099370d8f2f156660712"}
Jul 24 18:10:20.569960 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:20.569903    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-53e30e-cvstf" event={"ID":"592666f9-e6f7-4c40-84f2-ea50fa5d0835","Type":"ContainerStarted","Data":"d1d0f045e68496a6478e46550006dea2f2523e4269fabc61840cedce23365d67"}
Jul 24 18:10:20.587406 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:20.587347    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-53e30e-cvstf" podStartSLOduration=1.403711908 podStartE2EDuration="3.587323604s" totalImagesPullingTime="2.183611696s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:10:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:10:20.586599167 +0000 UTC m=+3156.067974792" watchObservedRunningTime="2026-07-24 18:10:20.587323604 +0000 UTC m=+3156.068699225"
Jul 24 18:10:21.576393 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:21.576354    2575 generic.go:356] "Generic (PLEG): container finished" podID="592666f9-e6f7-4c40-84f2-ea50fa5d0835" containerID="d1d0f045e68496a6478e46550006dea2f2523e4269fabc61840cedce23365d67" exitCode=0
Jul 24 18:10:21.576393 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:21.576395    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-53e30e-cvstf" event={"ID":"592666f9-e6f7-4c40-84f2-ea50fa5d0835","Type":"ContainerDied","Data":"d1d0f045e68496a6478e46550006dea2f2523e4269fabc61840cedce23365d67"}
Jul 24 18:10:22.709305 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:22.709281    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-53e30e-cvstf"
Jul 24 18:10:22.791249 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:22.791209    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/592666f9-e6f7-4c40-84f2-ea50fa5d0835-maas-api-service-ca\") pod \"592666f9-e6f7-4c40-84f2-ea50fa5d0835\" (UID: \"592666f9-e6f7-4c40-84f2-ea50fa5d0835\") "
Jul 24 18:10:22.791585 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:22.791557    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/592666f9-e6f7-4c40-84f2-ea50fa5d0835-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "592666f9-e6f7-4c40-84f2-ea50fa5d0835" (UID: "592666f9-e6f7-4c40-84f2-ea50fa5d0835"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:10:22.892115 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:22.892032    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/592666f9-e6f7-4c40-84f2-ea50fa5d0835-maas-api-service-ca\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 18:10:23.587089 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:23.587061    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-53e30e-cvstf"
Jul 24 18:10:23.587089 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:23.587077    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-53e30e-cvstf" event={"ID":"592666f9-e6f7-4c40-84f2-ea50fa5d0835","Type":"ContainerDied","Data":"3c0734e39cc208f44ab775c4b063fd60d8e761e8bc21099370d8f2f156660712"}
Jul 24 18:10:23.587304 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:23.587120    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3c0734e39cc208f44ab775c4b063fd60d8e761e8bc21099370d8f2f156660712"
Jul 24 18:10:27.998516 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:27.998476    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:10:28.036426 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:28.036389    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-53e30e-7ffb4fcfc4-gf7fm"]
Jul 24 18:10:28.036664 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:28.036638    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-53e30e-7ffb4fcfc4-gf7fm" podUID="42072e38-1855-4e6c-91f0-6357ee97c10d" containerName="payload-processing" containerID="cri-o://baff720d9256a9845512d10ae834225c3f35f616cddb87578ae93ee58de254cb" gracePeriod=30
Jul 24 18:10:28.084828 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:28.084790    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:10:28.186222 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:28.186191    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:10:28.287031 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:28.287000    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-53e30e-7ffb4fcfc4-gf7fm"
Jul 24 18:10:28.338277 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:28.338246    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-827tp\" (UniqueName: \"kubernetes.io/projected/42072e38-1855-4e6c-91f0-6357ee97c10d-kube-api-access-827tp\") pod \"42072e38-1855-4e6c-91f0-6357ee97c10d\" (UID: \"42072e38-1855-4e6c-91f0-6357ee97c10d\") "
Jul 24 18:10:28.338425 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:28.338320    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42072e38-1855-4e6c-91f0-6357ee97c10d-plugins-config-volume\") pod \"42072e38-1855-4e6c-91f0-6357ee97c10d\" (UID: \"42072e38-1855-4e6c-91f0-6357ee97c10d\") "
Jul 24 18:10:28.338705 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:28.338683    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42072e38-1855-4e6c-91f0-6357ee97c10d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "42072e38-1855-4e6c-91f0-6357ee97c10d" (UID: "42072e38-1855-4e6c-91f0-6357ee97c10d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:10:28.340449 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:28.340413    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42072e38-1855-4e6c-91f0-6357ee97c10d-kube-api-access-827tp" (OuterVolumeSpecName: "kube-api-access-827tp") pod "42072e38-1855-4e6c-91f0-6357ee97c10d" (UID: "42072e38-1855-4e6c-91f0-6357ee97c10d"). InnerVolumeSpecName "kube-api-access-827tp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:10:28.439539 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:28.439500    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-827tp\" (UniqueName: \"kubernetes.io/projected/42072e38-1855-4e6c-91f0-6357ee97c10d-kube-api-access-827tp\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 18:10:28.439539 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:28.439527    2575 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42072e38-1855-4e6c-91f0-6357ee97c10d-plugins-config-volume\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 18:10:28.614071 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:28.614039    2575 generic.go:356] "Generic (PLEG): container finished" podID="42072e38-1855-4e6c-91f0-6357ee97c10d" containerID="baff720d9256a9845512d10ae834225c3f35f616cddb87578ae93ee58de254cb" exitCode=0
Jul 24 18:10:28.614254 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:28.614081    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-53e30e-7ffb4fcfc4-gf7fm"
Jul 24 18:10:28.614254 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:28.614105    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-53e30e-7ffb4fcfc4-gf7fm" event={"ID":"42072e38-1855-4e6c-91f0-6357ee97c10d","Type":"ContainerDied","Data":"baff720d9256a9845512d10ae834225c3f35f616cddb87578ae93ee58de254cb"}
Jul 24 18:10:28.614254 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:28.614148    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-53e30e-7ffb4fcfc4-gf7fm" event={"ID":"42072e38-1855-4e6c-91f0-6357ee97c10d","Type":"ContainerDied","Data":"db04ee871353a7365631da682acc194594459ae7f241388427f82f47db062a42"}
Jul 24 18:10:28.614254 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:28.614170    2575 scope.go:117] "RemoveContainer" containerID="baff720d9256a9845512d10ae834225c3f35f616cddb87578ae93ee58de254cb"
Jul 24 18:10:28.622888 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:28.622871    2575 scope.go:117] "RemoveContainer" containerID="baff720d9256a9845512d10ae834225c3f35f616cddb87578ae93ee58de254cb"
Jul 24 18:10:28.623178 ip-10-0-139-113 kubenswrapper[2575]: E0724 18:10:28.623156    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"baff720d9256a9845512d10ae834225c3f35f616cddb87578ae93ee58de254cb\": container with ID starting with baff720d9256a9845512d10ae834225c3f35f616cddb87578ae93ee58de254cb not found: ID does not exist" containerID="baff720d9256a9845512d10ae834225c3f35f616cddb87578ae93ee58de254cb"
Jul 24 18:10:28.623249 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:28.623189    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"baff720d9256a9845512d10ae834225c3f35f616cddb87578ae93ee58de254cb"} err="failed to get container status \"baff720d9256a9845512d10ae834225c3f35f616cddb87578ae93ee58de254cb\": rpc error: code = NotFound desc = could not find container \"baff720d9256a9845512d10ae834225c3f35f616cddb87578ae93ee58de254cb\": container with ID starting with baff720d9256a9845512d10ae834225c3f35f616cddb87578ae93ee58de254cb not found: ID does not exist"
Jul 24 18:10:28.637091 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:28.637062    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-53e30e-7ffb4fcfc4-gf7fm"]
Jul 24 18:10:28.643179 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:28.643153    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-53e30e-7ffb4fcfc4-gf7fm"]
Jul 24 18:10:29.203076 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:29.203042    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42072e38-1855-4e6c-91f0-6357ee97c10d" path="/var/lib/kubelet/pods/42072e38-1855-4e6c-91f0-6357ee97c10d/volumes"
Jul 24 18:10:32.478379 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:32.478326    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-53e30e-cvstf"]
Jul 24 18:10:32.479165 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:32.479140    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:10:32.481787 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:32.481763    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-53e30e-cvstf"]
Jul 24 18:10:32.909182 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:32.909147    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:10:33.201179 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:33.201094    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="592666f9-e6f7-4c40-84f2-ea50fa5d0835" path="/var/lib/kubelet/pods/592666f9-e6f7-4c40-84f2-ea50fa5d0835/volumes"
Jul 24 18:10:39.170302 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:39.170272    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:10:39.243731 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:39.243689    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:10:39.491236 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:39.491149    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:10:39.747254 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:39.747168    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:10:39.894173 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:39.894140    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-257940-s67tz"]
Jul 24 18:10:39.894483 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:39.894471    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42072e38-1855-4e6c-91f0-6357ee97c10d" containerName="payload-processing"
Jul 24 18:10:39.894529 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:39.894484    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="42072e38-1855-4e6c-91f0-6357ee97c10d" containerName="payload-processing"
Jul 24 18:10:39.894529 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:39.894503    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bef9d92-590a-40ea-ac90-c5c84f6e3e55" containerName="istio-proxy"
Jul 24 18:10:39.894529 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:39.894509    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bef9d92-590a-40ea-ac90-c5c84f6e3e55" containerName="istio-proxy"
Jul 24 18:10:39.894529 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:39.894515    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="592666f9-e6f7-4c40-84f2-ea50fa5d0835" containerName="revoke-keys"
Jul 24 18:10:39.894529 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:39.894521    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="592666f9-e6f7-4c40-84f2-ea50fa5d0835" containerName="revoke-keys"
Jul 24 18:10:39.894683 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:39.894571    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="592666f9-e6f7-4c40-84f2-ea50fa5d0835" containerName="revoke-keys"
Jul 24 18:10:39.894683 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:39.894580    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="42072e38-1855-4e6c-91f0-6357ee97c10d" containerName="payload-processing"
Jul 24 18:10:39.897268 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:39.897252    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-257940-s67tz"
Jul 24 18:10:39.900048 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:39.900026    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 24 18:10:39.900412 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:39.900396    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-c25tj\""
Jul 24 18:10:39.908469 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:39.908441    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-257940-s67tz"]
Jul 24 18:10:40.045868 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:40.045832    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/32b34116-ab98-4462-8c9d-a21c0bd4790e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-257940-s67tz\" (UID: \"32b34116-ab98-4462-8c9d-a21c0bd4790e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-257940-s67tz"
Jul 24 18:10:40.147352 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:40.147313    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/32b34116-ab98-4462-8c9d-a21c0bd4790e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-257940-s67tz\" (UID: \"32b34116-ab98-4462-8c9d-a21c0bd4790e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-257940-s67tz"
Jul 24 18:10:40.148058 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:40.148036    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/32b34116-ab98-4462-8c9d-a21c0bd4790e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-257940-s67tz\" (UID: \"32b34116-ab98-4462-8c9d-a21c0bd4790e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-257940-s67tz"
Jul 24 18:10:40.207377 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:40.207341    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-257940-s67tz"
Jul 24 18:10:40.358355 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:40.358270    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-257940-s67tz"]
Jul 24 18:10:40.362122 ip-10-0-139-113 kubenswrapper[2575]: W0724 18:10:40.362097    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32b34116_ab98_4462_8c9d_a21c0bd4790e.slice/crio-75cdf59f0724cd6b19013fa14b262cbae4442192db1c63b8fb51f867c9feaad2 WatchSource:0}: Error finding container 75cdf59f0724cd6b19013fa14b262cbae4442192db1c63b8fb51f867c9feaad2: Status 404 returned error can't find the container with id 75cdf59f0724cd6b19013fa14b262cbae4442192db1c63b8fb51f867c9feaad2
Jul 24 18:10:40.669169 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:40.669132    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-257940-s67tz" event={"ID":"32b34116-ab98-4462-8c9d-a21c0bd4790e","Type":"ContainerStarted","Data":"8d51d40b7e78c8a1ae9567dfb0b448af0fab8b0832982f957f7687adabce84a6"}
Jul 24 18:10:40.669311 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:40.669193    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-257940-s67tz" event={"ID":"32b34116-ab98-4462-8c9d-a21c0bd4790e","Type":"ContainerStarted","Data":"75cdf59f0724cd6b19013fa14b262cbae4442192db1c63b8fb51f867c9feaad2"}
Jul 24 18:10:40.694156 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:40.694096    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-257940-s67tz" podStartSLOduration=1.694080958 podStartE2EDuration="1.694080958s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:10:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:10:40.692571235 +0000 UTC m=+3176.173946851" watchObservedRunningTime="2026-07-24 18:10:40.694080958 +0000 UTC m=+3176.175456580"
Jul 24 18:10:41.675286 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:41.675254    2575 generic.go:356] "Generic (PLEG): container finished" podID="32b34116-ab98-4462-8c9d-a21c0bd4790e" containerID="8d51d40b7e78c8a1ae9567dfb0b448af0fab8b0832982f957f7687adabce84a6" exitCode=0
Jul 24 18:10:41.675681 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:41.675341    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-257940-s67tz" event={"ID":"32b34116-ab98-4462-8c9d-a21c0bd4790e","Type":"ContainerDied","Data":"8d51d40b7e78c8a1ae9567dfb0b448af0fab8b0832982f957f7687adabce84a6"}
Jul 24 18:10:42.806217 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:42.806194    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-257940-s67tz"
Jul 24 18:10:42.873179 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:42.873141    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/32b34116-ab98-4462-8c9d-a21c0bd4790e-maas-api-service-ca\") pod \"32b34116-ab98-4462-8c9d-a21c0bd4790e\" (UID: \"32b34116-ab98-4462-8c9d-a21c0bd4790e\") "
Jul 24 18:10:42.873507 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:42.873485    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32b34116-ab98-4462-8c9d-a21c0bd4790e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "32b34116-ab98-4462-8c9d-a21c0bd4790e" (UID: "32b34116-ab98-4462-8c9d-a21c0bd4790e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:10:42.974158 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:42.974064    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/32b34116-ab98-4462-8c9d-a21c0bd4790e-maas-api-service-ca\") on node \"ip-10-0-139-113.ec2.internal\" DevicePath \"\""
Jul 24 18:10:43.684358 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:43.684322    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-257940-s67tz" event={"ID":"32b34116-ab98-4462-8c9d-a21c0bd4790e","Type":"ContainerDied","Data":"75cdf59f0724cd6b19013fa14b262cbae4442192db1c63b8fb51f867c9feaad2"}
Jul 24 18:10:43.684358 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:43.684349    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-257940-s67tz"
Jul 24 18:10:43.684577 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:43.684371    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="75cdf59f0724cd6b19013fa14b262cbae4442192db1c63b8fb51f867c9feaad2"
Jul 24 18:10:50.807546 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:50.807507    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:10:50.885921 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:50.885885    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:10:50.952498 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:50.952460    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:10:54.984408 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:54.984374    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-257940-s67tz"]
Jul 24 18:10:54.988191 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:54.988161    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-257940-s67tz"]
Jul 24 18:10:54.988981 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:54.988932    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:10:55.202354 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:55.202323    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32b34116-ab98-4462-8c9d-a21c0bd4790e" path="/var/lib/kubelet/pods/32b34116-ab98-4462-8c9d-a21c0bd4790e/volumes"
Jul 24 18:10:55.419482 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:10:55.419447    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:11:01.825813 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:01.825776    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:11:01.944859 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:01.944826    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:11:02.104897 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:02.104790    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:11:02.433977 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:02.433865    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:11:13.246786 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:13.246743    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:11:13.335660 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:13.335628    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:11:13.433827 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:13.433799    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:11:17.756093 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:17.756054    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:11:18.150294 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:18.150261    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:11:25.335874 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:25.335831    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:11:25.376480 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:25.376446    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-946dcd694-n6wsz_e1fb313c-b700-45db-bb6e-2dd310ba3b09/authorino/0.log"
Jul 24 18:11:25.412871 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:25.412838    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:11:31.874256 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:31.874225    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-cd4ln_ab850c2c-9f33-491a-a76a-3c509fa3e720/server/0.log"
Jul 24 18:11:31.995985 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:31.995954    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-j4wc7_25c071d9-06e5-4528-824d-6341188947a8/manager/0.log"
Jul 24 18:11:32.265766 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:32.265685    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8574785b6-qmn4c_ceb37084-0553-4277-a11b-de466ba79a69/copy-manifests/0.log"
Jul 24 18:11:32.273309 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:32.273278    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8574785b6-qmn4c_ceb37084-0553-4277-a11b-de466ba79a69/manager/0.log"
Jul 24 18:11:34.726353 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:34.726317    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-946dcd694-n6wsz_e1fb313c-b700-45db-bb6e-2dd310ba3b09/authorino/0.log"
Jul 24 18:11:36.091296 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:36.091223    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cszjjv_b6b553b3-f7fc-4795-b0fa-8cb7e0e1c4bd/istio-proxy/0.log"
Jul 24 18:11:36.493652 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:36.493566    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-956b69cf9-vgzmm_910690a0-1e47-4441-b88b-869470a0d93a/kube-auth-proxy/0.log"
Jul 24 18:11:37.443573 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:37.443544    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-fnmd2_08d61c7d-7ffe-4fce-9fbc-97c893f9faaf/main/0.log"
Jul 24 18:11:37.846023 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:37.845991    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fdmvhf_f7812213-30c5-4fbd-8f08-e993a602cea8/main/0.log"
Jul 24 18:11:38.104677 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:38.104586    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-wwfsz_37be2ab5-4911-4af6-9640-6127bda8fedf/main/0.log"
Jul 24 18:11:44.051708 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:44.051668    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:11:44.143233 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:44.143201    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:11:46.922810 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:46.922778    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-7wvn9_db784d54-1541-4c98-ae75-0f7234c48158/global-pull-secret-syncer/0.log"
Jul 24 18:11:47.077292 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:47.077259    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log"
Jul 24 18:11:47.275324 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:47.275242    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-113.ec2.internal_4461adb059f453352015b47510cb7325/haproxy/0.log"
Jul 24 18:11:52.327452 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:52.327412    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-946dcd694-n6wsz_e1fb313c-b700-45db-bb6e-2dd310ba3b09/authorino/0.log"
Jul 24 18:11:54.930395 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:54.930362    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-644697c47d-zr5lx_e74f0e6b-c2ad-4e3a-b27c-838bf43ae58c/metrics-server/0.log"
Jul 24 18:11:54.962793 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:54.962759    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-qtgkx_1a74d77f-95a5-48ec-be94-3e103e31db64/monitoring-plugin/0.log"
Jul 24 18:11:55.087712 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:55.087670    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fnl4m_79f06248-787f-439a-95a6-5ffa04758581/node-exporter/0.log"
Jul 24 18:11:55.111965 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:55.111926    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fnl4m_79f06248-787f-439a-95a6-5ffa04758581/kube-rbac-proxy/0.log"
Jul 24 18:11:55.136371 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:55.136344    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fnl4m_79f06248-787f-439a-95a6-5ffa04758581/init-textfile/0.log"
Jul 24 18:11:55.617876 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:55.617847    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-c55578b9d-ll8r9_90ed21d0-7d00-4791-8f71-d1df1f9b28c8/telemeter-client/0.log"
Jul 24 18:11:55.644833 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:55.644806    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-c55578b9d-ll8r9_90ed21d0-7d00-4791-8f71-d1df1f9b28c8/reload/0.log"
Jul 24 18:11:55.671756 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:55.671727    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-c55578b9d-ll8r9_90ed21d0-7d00-4791-8f71-d1df1f9b28c8/kube-rbac-proxy/0.log"
Jul 24 18:11:56.974634 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:56.974597    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xkcdq/perf-node-gather-daemonset-gfq9k"]
Jul 24 18:11:56.975045 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:56.974927    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32b34116-ab98-4462-8c9d-a21c0bd4790e" containerName="revoke-keys"
Jul 24 18:11:56.975045 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:56.974955    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="32b34116-ab98-4462-8c9d-a21c0bd4790e" containerName="revoke-keys"
Jul 24 18:11:56.975045 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:56.975032    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="32b34116-ab98-4462-8c9d-a21c0bd4790e" containerName="revoke-keys"
Jul 24 18:11:56.977626 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:56.977609    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xkcdq/perf-node-gather-daemonset-gfq9k"
Jul 24 18:11:56.982541 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:56.982517    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xkcdq\"/\"default-dockercfg-5k9qs\""
Jul 24 18:11:56.982681 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:56.982522    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xkcdq\"/\"openshift-service-ca.crt\""
Jul 24 18:11:56.982681 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:56.982522    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xkcdq\"/\"kube-root-ca.crt\""
Jul 24 18:11:56.994698 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:56.994669    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xkcdq/perf-node-gather-daemonset-gfq9k"]
Jul 24 18:11:57.018925 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:57.018889    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/27ff97ce-5031-4b28-9379-b7172a7d95c9-proc\") pod \"perf-node-gather-daemonset-gfq9k\" (UID: \"27ff97ce-5031-4b28-9379-b7172a7d95c9\") " pod="openshift-must-gather-xkcdq/perf-node-gather-daemonset-gfq9k"
Jul 24 18:11:57.019140 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:57.018983    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/27ff97ce-5031-4b28-9379-b7172a7d95c9-podres\") pod \"perf-node-gather-daemonset-gfq9k\" (UID: \"27ff97ce-5031-4b28-9379-b7172a7d95c9\") " pod="openshift-must-gather-xkcdq/perf-node-gather-daemonset-gfq9k"
Jul 24 18:11:57.019382 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:57.019358    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67vsf\" (UniqueName: \"kubernetes.io/projected/27ff97ce-5031-4b28-9379-b7172a7d95c9-kube-api-access-67vsf\") pod \"perf-node-gather-daemonset-gfq9k\" (UID: \"27ff97ce-5031-4b28-9379-b7172a7d95c9\") " pod="openshift-must-gather-xkcdq/perf-node-gather-daemonset-gfq9k"
Jul 24 18:11:57.019485 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:57.019403    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/27ff97ce-5031-4b28-9379-b7172a7d95c9-sys\") pod \"perf-node-gather-daemonset-gfq9k\" (UID: \"27ff97ce-5031-4b28-9379-b7172a7d95c9\") " pod="openshift-must-gather-xkcdq/perf-node-gather-daemonset-gfq9k"
Jul 24 18:11:57.019485 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:57.019426    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/27ff97ce-5031-4b28-9379-b7172a7d95c9-lib-modules\") pod \"perf-node-gather-daemonset-gfq9k\" (UID: \"27ff97ce-5031-4b28-9379-b7172a7d95c9\") " pod="openshift-must-gather-xkcdq/perf-node-gather-daemonset-gfq9k"
Jul 24 18:11:57.120647 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:57.120611    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67vsf\" (UniqueName: \"kubernetes.io/projected/27ff97ce-5031-4b28-9379-b7172a7d95c9-kube-api-access-67vsf\") pod \"perf-node-gather-daemonset-gfq9k\" (UID: \"27ff97ce-5031-4b28-9379-b7172a7d95c9\") " pod="openshift-must-gather-xkcdq/perf-node-gather-daemonset-gfq9k"
Jul 24 18:11:57.120647 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:57.120650    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/27ff97ce-5031-4b28-9379-b7172a7d95c9-sys\") pod \"perf-node-gather-daemonset-gfq9k\" (UID: \"27ff97ce-5031-4b28-9379-b7172a7d95c9\") " pod="openshift-must-gather-xkcdq/perf-node-gather-daemonset-gfq9k"
Jul 24 18:11:57.120920 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:57.120670    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/27ff97ce-5031-4b28-9379-b7172a7d95c9-lib-modules\") pod \"perf-node-gather-daemonset-gfq9k\" (UID: \"27ff97ce-5031-4b28-9379-b7172a7d95c9\") " pod="openshift-must-gather-xkcdq/perf-node-gather-daemonset-gfq9k"
Jul 24 18:11:57.120920 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:57.120697    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/27ff97ce-5031-4b28-9379-b7172a7d95c9-proc\") pod \"perf-node-gather-daemonset-gfq9k\" (UID: \"27ff97ce-5031-4b28-9379-b7172a7d95c9\") " pod="openshift-must-gather-xkcdq/perf-node-gather-daemonset-gfq9k"
Jul 24 18:11:57.120920 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:57.120753    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/27ff97ce-5031-4b28-9379-b7172a7d95c9-proc\") pod \"perf-node-gather-daemonset-gfq9k\" (UID: \"27ff97ce-5031-4b28-9379-b7172a7d95c9\") " pod="openshift-must-gather-xkcdq/perf-node-gather-daemonset-gfq9k"
Jul 24 18:11:57.120920 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:57.120759    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/27ff97ce-5031-4b28-9379-b7172a7d95c9-sys\") pod \"perf-node-gather-daemonset-gfq9k\" (UID: \"27ff97ce-5031-4b28-9379-b7172a7d95c9\") " pod="openshift-must-gather-xkcdq/perf-node-gather-daemonset-gfq9k"
Jul 24 18:11:57.120920 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:57.120807    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/27ff97ce-5031-4b28-9379-b7172a7d95c9-podres\") pod \"perf-node-gather-daemonset-gfq9k\" (UID: \"27ff97ce-5031-4b28-9379-b7172a7d95c9\") " pod="openshift-must-gather-xkcdq/perf-node-gather-daemonset-gfq9k"
Jul 24 18:11:57.120920 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:57.120816    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/27ff97ce-5031-4b28-9379-b7172a7d95c9-lib-modules\") pod \"perf-node-gather-daemonset-gfq9k\" (UID: \"27ff97ce-5031-4b28-9379-b7172a7d95c9\") " pod="openshift-must-gather-xkcdq/perf-node-gather-daemonset-gfq9k"
Jul 24 18:11:57.120920 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:57.120901    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/27ff97ce-5031-4b28-9379-b7172a7d95c9-podres\") pod \"perf-node-gather-daemonset-gfq9k\" (UID: \"27ff97ce-5031-4b28-9379-b7172a7d95c9\") " pod="openshift-must-gather-xkcdq/perf-node-gather-daemonset-gfq9k"
Jul 24 18:11:57.129412 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:57.129391    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67vsf\" (UniqueName: \"kubernetes.io/projected/27ff97ce-5031-4b28-9379-b7172a7d95c9-kube-api-access-67vsf\") pod \"perf-node-gather-daemonset-gfq9k\" (UID: \"27ff97ce-5031-4b28-9379-b7172a7d95c9\") " pod="openshift-must-gather-xkcdq/perf-node-gather-daemonset-gfq9k"
Jul 24 18:11:57.288115 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:57.288081    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xkcdq/perf-node-gather-daemonset-gfq9k"
Jul 24 18:11:57.439234 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:57.439199    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xkcdq/perf-node-gather-daemonset-gfq9k"]
Jul 24 18:11:57.442276 ip-10-0-139-113 kubenswrapper[2575]: W0724 18:11:57.442243    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod27ff97ce_5031_4b28_9379_b7172a7d95c9.slice/crio-a1c0c65b4dddd0d2af7fe3fb0ffb89a9f32bbd05e177b703f6c838f69de92918 WatchSource:0}: Error finding container a1c0c65b4dddd0d2af7fe3fb0ffb89a9f32bbd05e177b703f6c838f69de92918: Status 404 returned error can't find the container with id a1c0c65b4dddd0d2af7fe3fb0ffb89a9f32bbd05e177b703f6c838f69de92918
Jul 24 18:11:57.999883 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:57.999798    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xkcdq/perf-node-gather-daemonset-gfq9k" event={"ID":"27ff97ce-5031-4b28-9379-b7172a7d95c9","Type":"ContainerStarted","Data":"def2309147a0fe14e942776be459dbaf768540fe801b14c303afa4bc1b73044e"}
Jul 24 18:11:57.999883 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:57.999849    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xkcdq/perf-node-gather-daemonset-gfq9k" event={"ID":"27ff97ce-5031-4b28-9379-b7172a7d95c9","Type":"ContainerStarted","Data":"a1c0c65b4dddd0d2af7fe3fb0ffb89a9f32bbd05e177b703f6c838f69de92918"}
Jul 24 18:11:58.000396 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:57.999911    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-xkcdq/perf-node-gather-daemonset-gfq9k"
Jul 24 18:11:58.019373 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:11:58.019323    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xkcdq/perf-node-gather-daemonset-gfq9k" podStartSLOduration=2.019307665 podStartE2EDuration="2.019307665s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 18:11:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:11:58.018374184 +0000 UTC m=+3253.499749804" watchObservedRunningTime="2026-07-24 18:11:58.019307665 +0000 UTC m=+3253.500683285"
Jul 24 18:12:00.138723 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:12:00.138696    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5zr4j_a19606e2-4b58-418c-a6ad-8e70eb8ab5f5/dns/0.log"
Jul 24 18:12:00.165004 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:12:00.164851    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5zr4j_a19606e2-4b58-418c-a6ad-8e70eb8ab5f5/kube-rbac-proxy/0.log"
Jul 24 18:12:00.356831 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:12:00.356796    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zkp2w_7d278b8d-3bae-40ee-9eaa-ce1f87ae92b8/dns-node-resolver/0.log"
Jul 24 18:12:00.907738 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:12:00.907708    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-75f447c5bc-ntvsq_eea8a5dd-2177-4fab-ac03-57889c896c57/registry/0.log"
Jul 24 18:12:00.955495 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:12:00.955468    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tctfm_3973a6c6-5e57-490f-a57d-6eed74df9217/node-ca/0.log"
Jul 24 18:12:01.918616 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:12:01.918588    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cszjjv_b6b553b3-f7fc-4795-b0fa-8cb7e0e1c4bd/istio-proxy/0.log"
Jul 24 18:12:02.232545 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:12:02.232468    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-956b69cf9-vgzmm_910690a0-1e47-4441-b88b-869470a0d93a/kube-auth-proxy/0.log"
Jul 24 18:12:03.341013 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:12:03.340982    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pk8tw_04c5443f-c66f-4640-9773-2ffeed796fe6/serve-healthcheck-canary/0.log"
Jul 24 18:12:03.845060 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:12:03.845034    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6sxsj_04439a3e-ccd9-435d-925f-aaca4fbc2faf/kube-rbac-proxy/0.log"
Jul 24 18:12:03.875433 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:12:03.875409    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6sxsj_04439a3e-ccd9-435d-925f-aaca4fbc2faf/exporter/0.log"
Jul 24 18:12:03.900463 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:12:03.900433    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6sxsj_04439a3e-ccd9-435d-925f-aaca4fbc2faf/extractor/0.log"
Jul 24 18:12:04.013048 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:12:04.013018    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-xkcdq/perf-node-gather-daemonset-gfq9k"
Jul 24 18:12:05.162078 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:12:05.162038    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25crs_693c1bd3-2e67-417e-8f91-aac3759a07d8/konnectivity-agent/0.log" limit=1024
Jul 24 18:12:06.879491 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:12:06.879461    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-cd4ln_ab850c2c-9f33-491a-a76a-3c509fa3e720/server/0.log"
Jul 24 18:12:06.953821 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:12:06.953791    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-j4wc7_25c071d9-06e5-4528-824d-6341188947a8/manager/0.log"
Jul 24 18:12:07.140211 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:12:07.140189    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8574785b6-qmn4c_ceb37084-0553-4277-a11b-de466ba79a69/manager/0.log"
Jul 24 18:12:07.166318 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:12:07.166293    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8574785b6-qmn4c_ceb37084-0553-4277-a11b-de466ba79a69/copy-manifests/0.log"
Jul 24 18:12:08.061780 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:12:08.061748    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cszjjv_b6b553b3-f7fc-4795-b0fa-8cb7e0e1c4bd/istio-proxy/0.log"
Jul 24 18:12:08.399565 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:12:08.399540    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-956b69cf9-vgzmm_910690a0-1e47-4441-b88b-869470a0d93a/kube-auth-proxy/0.log"
Jul 24 18:12:08.726932 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:12:08.726902    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-cc7897f66-c88hv_4f03e9fc-56bd-4107-b19e-c3abe00b3a37/manager/0.log"
Jul 24 18:12:09.935350 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:12:09.935323    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cszjjv_b6b553b3-f7fc-4795-b0fa-8cb7e0e1c4bd/istio-proxy/0.log"
Jul 24 18:12:10.246158 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:12:10.246131    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-956b69cf9-vgzmm_910690a0-1e47-4441-b88b-869470a0d93a/kube-auth-proxy/0.log"
Jul 24 18:12:15.482139 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:12:15.482104    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7q78n_ae06c81f-d11d-4d26-9dc5-721f14bb9f7a/kube-multus-additional-cni-plugins/0.log"
Jul 24 18:12:15.505165 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:12:15.505143    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7q78n_ae06c81f-d11d-4d26-9dc5-721f14bb9f7a/egress-router-binary-copy/0.log"
Jul 24 18:12:15.530976 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:12:15.530927    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7q78n_ae06c81f-d11d-4d26-9dc5-721f14bb9f7a/cni-plugins/0.log"
Jul 24 18:12:15.557890 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:12:15.557856    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7q78n_ae06c81f-d11d-4d26-9dc5-721f14bb9f7a/bond-cni-plugin/0.log"
Jul 24 18:12:15.583710 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:12:15.583671    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7q78n_ae06c81f-d11d-4d26-9dc5-721f14bb9f7a/routeoverride-cni/0.log"
Jul 24 18:12:15.606444 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:12:15.606410    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7q78n_ae06c81f-d11d-4d26-9dc5-721f14bb9f7a/whereabouts-cni-bincopy/0.log"
Jul 24 18:12:15.631887 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:12:15.631859    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7q78n_ae06c81f-d11d-4d26-9dc5-721f14bb9f7a/whereabouts-cni/0.log"
Jul 24 18:12:15.893984 ip-10-0-139-113 kubenswrapper[2575]: I0724 18:12:15.893931    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-f275z_cfdea065-5a0b-47a4-b4e7-d3decf5b18f2/kube-multus/0.log"