Jul 08 16:32:12.089620 ip-10-0-142-172 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 08 16:32:12.089633 ip-10-0-142-172 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 08 16:32:12.089642 ip-10-0-142-172 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 08 16:32:12.089975 ip-10-0-142-172 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 08 16:32:22.090723 ip-10-0-142-172 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 08 16:32:22.090739 ip-10-0-142-172 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 351c324fa4ed4730bd9d9d2199a274a0 --
Jul 08 16:34:24.680484 ip-10-0-142-172 systemd[1]: Starting Kubernetes Kubelet...
Jul 08 16:34:25.087041 ip-10-0-142-172 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 16:34:25.087041 ip-10-0-142-172 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 08 16:34:25.087041 ip-10-0-142-172 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 16:34:25.087041 ip-10-0-142-172 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 08 16:34:25.087041 ip-10-0-142-172 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 16:34:25.087918 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.087835    2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 08 16:34:25.092694 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092638    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 16:34:25.092814 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092803    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 16:34:25.092814 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092813    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 16:34:25.092873 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092817    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 16:34:25.092873 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092820    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 16:34:25.092873 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092824    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 16:34:25.092873 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092827    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 16:34:25.092873 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092830    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 16:34:25.092873 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092833    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 16:34:25.092873 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092836    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 16:34:25.092873 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092838    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 16:34:25.092873 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092842    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 16:34:25.092873 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092845    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 16:34:25.092873 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092847    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 16:34:25.092873 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092850    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 16:34:25.092873 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092853    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 16:34:25.092873 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092856    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 16:34:25.092873 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092858    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 16:34:25.092873 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092861    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 16:34:25.092873 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092863    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 16:34:25.092873 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092866    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 16:34:25.092873 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092868    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 16:34:25.092873 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092871    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 16:34:25.093378 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092874    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 16:34:25.093378 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092876    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 16:34:25.093378 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092879    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 16:34:25.093378 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092882    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 16:34:25.093378 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092885    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 16:34:25.093378 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092888    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 16:34:25.093378 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092890    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 16:34:25.093378 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092893    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 16:34:25.093378 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092895    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 16:34:25.093378 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092898    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 16:34:25.093378 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092903    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 16:34:25.093378 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092908    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 16:34:25.093378 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092912    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 16:34:25.093378 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092915    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 16:34:25.093378 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092918    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 16:34:25.093378 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092921    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 16:34:25.093378 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092924    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 16:34:25.093378 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092927    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 16:34:25.093378 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092929    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 16:34:25.093869 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092932    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 16:34:25.093869 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092934    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 16:34:25.093869 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092937    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 16:34:25.093869 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092939    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 16:34:25.093869 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092942    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 16:34:25.093869 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092944    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 16:34:25.093869 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092946    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 16:34:25.093869 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092949    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 16:34:25.093869 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092951    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 16:34:25.093869 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092953    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 16:34:25.093869 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092956    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 16:34:25.093869 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092958    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 16:34:25.093869 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092961    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 16:34:25.093869 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092964    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 16:34:25.093869 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092968    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 16:34:25.093869 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092970    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 16:34:25.093869 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092974    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 16:34:25.093869 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092978    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 16:34:25.093869 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092980    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 16:34:25.094356 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092983    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 16:34:25.094356 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092985    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 16:34:25.094356 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092988    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 16:34:25.094356 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092992    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 16:34:25.094356 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092995    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 16:34:25.094356 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.092997    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 16:34:25.094356 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.093000    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 16:34:25.094356 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.093002    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 16:34:25.094356 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.093005    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 16:34:25.094356 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.093007    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 16:34:25.094356 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.093010    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 16:34:25.094356 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.093012    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 16:34:25.094356 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.093015    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 16:34:25.094356 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.093017    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 16:34:25.094356 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.093020    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 16:34:25.094356 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.093022    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 16:34:25.094356 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.093025    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 16:34:25.094356 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.093027    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 16:34:25.094356 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.093030    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 16:34:25.094356 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.093033    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 16:34:25.094833 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.093035    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 16:34:25.094833 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.093038    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 16:34:25.094833 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.093049    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 16:34:25.094833 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.093051    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 16:34:25.094833 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.093054    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 16:34:25.094833 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.093056    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 16:34:25.094833 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.093059    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 16:34:25.094833 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.093062    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 16:34:25.094833 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.093065    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 16:34:25.094833 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.093068    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 16:34:25.094833 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.093072    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 16:34:25.094833 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.093075    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 16:34:25.094833 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.093078    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 16:34:25.094833 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.093080    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 16:34:25.094833 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.093083    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 16:34:25.094833 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.093085    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 16:34:25.094833 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.093088    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 16:34:25.094833 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.093091    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 16:34:25.094833 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094593    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 16:34:25.094833 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094601    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 16:34:25.095336 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094604    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 16:34:25.095336 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094607    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 16:34:25.095336 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094610    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 16:34:25.095336 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094613    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 16:34:25.095336 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094617    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 16:34:25.095336 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094620    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 16:34:25.095336 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094623    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 16:34:25.095336 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094625    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 16:34:25.095336 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094629    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 16:34:25.095336 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094633    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 16:34:25.095336 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094636    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 16:34:25.095336 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094639    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 16:34:25.095336 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094641    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 16:34:25.095336 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094644    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 16:34:25.095336 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094646    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 16:34:25.095336 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094649    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 16:34:25.095336 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094652    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 16:34:25.095336 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094654    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 16:34:25.095336 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094658    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 16:34:25.095336 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094661    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 16:34:25.095819 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094663    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 16:34:25.095819 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094666    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 16:34:25.095819 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094669    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 16:34:25.095819 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094671    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 16:34:25.095819 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094674    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 16:34:25.095819 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094676    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 16:34:25.095819 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094679    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 16:34:25.095819 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094682    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 16:34:25.095819 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094684    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 16:34:25.095819 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094687    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 16:34:25.095819 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094689    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 16:34:25.095819 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094692    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 16:34:25.095819 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094694    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 16:34:25.095819 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094696    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 16:34:25.095819 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094699    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 16:34:25.095819 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094701    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 16:34:25.095819 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094703    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 16:34:25.095819 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094706    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 16:34:25.095819 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094708    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 16:34:25.095819 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094710    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 16:34:25.096323 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094713    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 16:34:25.096323 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094715    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 16:34:25.096323 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094718    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 16:34:25.096323 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094720    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 16:34:25.096323 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094722    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 16:34:25.096323 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094725    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 16:34:25.096323 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094728    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 16:34:25.096323 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094731    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 16:34:25.096323 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094733    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 16:34:25.096323 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094736    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 16:34:25.096323 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094739    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 16:34:25.096323 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094742    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 16:34:25.096323 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094745    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 16:34:25.096323 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094747    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 16:34:25.096323 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094750    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 16:34:25.096323 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094752    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 16:34:25.096323 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094754    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 16:34:25.096323 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094757    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 16:34:25.096323 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094759    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 16:34:25.096777 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094761    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 16:34:25.096777 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094763    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 16:34:25.096777 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094766    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 16:34:25.096777 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094768    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 16:34:25.096777 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094771    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 16:34:25.096777 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094773    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 16:34:25.096777 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094777    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 16:34:25.096777 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094780    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 16:34:25.096777 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094783    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 16:34:25.096777 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094785    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 16:34:25.096777 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094788    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 16:34:25.096777 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094791    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 16:34:25.096777 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094793    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 16:34:25.096777 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094796    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 16:34:25.096777 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094798    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 16:34:25.096777 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094801    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 16:34:25.096777 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094803    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 16:34:25.096777 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094806    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 16:34:25.096777 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094808    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 16:34:25.096777 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094810    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 16:34:25.097277 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094813    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 16:34:25.097277 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094815    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 16:34:25.097277 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094819    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 16:34:25.097277 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094822    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 16:34:25.097277 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094824    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 16:34:25.097277 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094827    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 16:34:25.097277 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094829    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 16:34:25.097277 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094832    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 16:34:25.097277 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094834    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 16:34:25.097277 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094837    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 16:34:25.097277 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094840    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 16:34:25.097277 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094842    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 16:34:25.097277 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094844    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 16:34:25.097277 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094847    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 16:34:25.097277 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094849    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 16:34:25.097277 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094853    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 16:34:25.097277 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094856    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 16:34:25.097277 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.094859    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 16:34:25.097277 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095245    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 16:34:25.097755 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095251    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 16:34:25.097755 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095253    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 16:34:25.097755 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095256    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 16:34:25.097755 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095259    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 16:34:25.097755 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095261    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 16:34:25.097755 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095263    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 16:34:25.097755 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095266    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 16:34:25.097755 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095268    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 16:34:25.097755 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095271    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 16:34:25.097755 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095274    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 16:34:25.097755 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095276    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 16:34:25.097755 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095279    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 16:34:25.097755 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095282    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 16:34:25.097755 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095284    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 16:34:25.097755 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095286    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 16:34:25.097755 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095289    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 16:34:25.097755 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095292    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 16:34:25.097755 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095294    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 16:34:25.097755 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095297    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 16:34:25.097755 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095299    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 16:34:25.098260 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095303    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 16:34:25.098260 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095307    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 16:34:25.098260 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095309    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 16:34:25.098260 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095313    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 16:34:25.098260 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095316    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 16:34:25.098260 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095319    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 16:34:25.098260 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095322    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 16:34:25.098260 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095325    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 16:34:25.098260 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095327    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 16:34:25.098260 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095330    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 16:34:25.098260 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095332    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 16:34:25.098260 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095335    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 16:34:25.098260 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095338    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 16:34:25.098260 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095340    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 16:34:25.098260 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095342    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 16:34:25.098260 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095345    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 16:34:25.098260 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095348    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 16:34:25.098260 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095351    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 16:34:25.098260 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095353    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 16:34:25.098753 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095356    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 16:34:25.098753 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095359    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 16:34:25.098753 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095361    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 16:34:25.098753 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095364    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 16:34:25.098753 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095366    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 16:34:25.098753 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095368    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 16:34:25.098753 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095371    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 16:34:25.098753 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095373    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 16:34:25.098753 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095375    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 16:34:25.098753 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095379    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 16:34:25.098753 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095382    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 16:34:25.098753 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095384    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 16:34:25.098753 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095386    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 16:34:25.098753 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095389    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 16:34:25.098753 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095391    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 16:34:25.098753 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095394    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 16:34:25.098753 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095397    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 16:34:25.098753 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095399    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 16:34:25.098753 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095401    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 16:34:25.099210 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095404    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 16:34:25.099210 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095406    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 16:34:25.099210 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095409    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 16:34:25.099210 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095411    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 16:34:25.099210 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095413    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 16:34:25.099210 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095416    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 16:34:25.099210 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095418    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 16:34:25.099210 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095420    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 16:34:25.099210 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095424    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 16:34:25.099210 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095428    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 16:34:25.099210 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095431    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 16:34:25.099210 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095434    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 16:34:25.099210 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095436    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 16:34:25.099210 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095439    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 16:34:25.099210 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095442    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 16:34:25.099210 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095444    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 16:34:25.099210 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095447    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 16:34:25.099210 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095449    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 16:34:25.099210 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095453    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 16:34:25.099210 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095455    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 16:34:25.099719 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095458    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 16:34:25.099719 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095460    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 16:34:25.099719 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095463    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 16:34:25.099719 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095466    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 16:34:25.099719 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095468    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 16:34:25.099719 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095471    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 16:34:25.099719 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095473    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 16:34:25.099719 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095476    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 16:34:25.099719 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095478    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 16:34:25.099719 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095480    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 16:34:25.099719 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095482    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 16:34:25.099719 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095485    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 16:34:25.099719 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095487    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 16:34:25.099719 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095489    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 16:34:25.099719 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095492    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 16:34:25.099719 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095494    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 16:34:25.099719 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095497    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 16:34:25.099719 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095499    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 16:34:25.099719 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095502    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 16:34:25.099719 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.095504    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 16:34:25.100240 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095583    2565 flags.go:64] FLAG: --address="0.0.0.0"
Jul 08 16:34:25.100240 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095590    2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 08 16:34:25.100240 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095596    2565 flags.go:64] FLAG: --anonymous-auth="true"
Jul 08 16:34:25.100240 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095600    2565 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 08 16:34:25.100240 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095604    2565 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 08 16:34:25.100240 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095607    2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 08 16:34:25.100240 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095611    2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 08 16:34:25.100240 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095615    2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 08 16:34:25.100240 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095618    2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 08 16:34:25.100240 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095621    2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 08 16:34:25.100240 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095624    2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 08 16:34:25.100240 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095627    2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 08 16:34:25.100240 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095630    2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 08 16:34:25.100240 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095633    2565 flags.go:64] FLAG: --cgroup-root=""
Jul 08 16:34:25.100240 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095635    2565 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 08 16:34:25.100240 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095638    2565 flags.go:64] FLAG: --client-ca-file=""
Jul 08 16:34:25.100240 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095642    2565 flags.go:64] FLAG: --cloud-provider="external"
Jul 08 16:34:25.100240 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095644    2565 flags.go:64] FLAG: --cluster-dns="[]"
Jul 08 16:34:25.100240 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095648    2565 flags.go:64] FLAG: --cluster-domain=""
Jul 08 16:34:25.100240 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095651    2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 08 16:34:25.100240 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095653    2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 08 16:34:25.100240 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095656    2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 08 16:34:25.100240 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095659    2565 flags.go:64] FLAG: --container-log-max-files="5"
Jul 08 16:34:25.100240 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095662    2565 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 08 16:34:25.100803 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095665    2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 08 16:34:25.100803 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095671    2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 08 16:34:25.100803 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095675    2565 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 08 16:34:25.100803 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095677    2565 flags.go:64] FLAG: --contention-profiling="false"
Jul 08 16:34:25.100803 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095680    2565 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 08 16:34:25.100803 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095683    2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 08 16:34:25.100803 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095686    2565 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 08 16:34:25.100803 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095689    2565 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 08 16:34:25.100803 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095692    2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 08 16:34:25.100803 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095695    2565 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 08 16:34:25.100803 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095698    2565 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 08 16:34:25.100803 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095701    2565 flags.go:64] FLAG: --enable-load-reader="false"
Jul 08 16:34:25.100803 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095703    2565 flags.go:64] FLAG: --enable-server="true"
Jul 08 16:34:25.100803 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095706    2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 08 16:34:25.100803 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095710    2565 flags.go:64] FLAG: --event-burst="100"
Jul 08 16:34:25.100803 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095713    2565 flags.go:64] FLAG: --event-qps="50"
Jul 08 16:34:25.100803 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095715    2565 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 08 16:34:25.100803 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095718    2565 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 08 16:34:25.100803 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095721    2565 flags.go:64] FLAG: --eviction-hard=""
Jul 08 16:34:25.100803 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095724    2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 08 16:34:25.100803 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095727    2565 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 08 16:34:25.100803 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095730    2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 08 16:34:25.100803 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095732    2565 flags.go:64] FLAG: --eviction-soft=""
Jul 08 16:34:25.100803 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095735    2565 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 08 16:34:25.100803 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095738    2565 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 08 16:34:25.101418 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095741    2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 08 16:34:25.101418 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095744    2565 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 08 16:34:25.101418 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095746    2565 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 08 16:34:25.101418 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095749    2565 flags.go:64] FLAG: --fail-swap-on="true"
Jul 08 16:34:25.101418 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095752    2565 flags.go:64] FLAG: --feature-gates=""
Jul 08 16:34:25.101418 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095755    2565 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 08 16:34:25.101418 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095758    2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 08 16:34:25.101418 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095761    2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 08 16:34:25.101418 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095763    2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 08 16:34:25.101418 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095766    2565 flags.go:64] FLAG: --healthz-port="10248"
Jul 08 16:34:25.101418 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095769    2565 flags.go:64] FLAG: --help="false"
Jul 08 16:34:25.101418 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095772    2565 flags.go:64] FLAG: --hostname-override="ip-10-0-142-172.ec2.internal"
Jul 08 16:34:25.101418 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095775    2565 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 08 16:34:25.101418 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095777    2565 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 08 16:34:25.101418 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095780    2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 08 16:34:25.101418 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095783    2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 08 16:34:25.101418 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095786    2565 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 08 16:34:25.101418 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095788    2565 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 08 16:34:25.101418 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095791    2565 flags.go:64] FLAG: --image-service-endpoint=""
Jul 08 16:34:25.101418 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095793    2565 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 08 16:34:25.101418 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095796    2565 flags.go:64] FLAG: --kube-api-burst="100"
Jul 08 16:34:25.101418 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095798    2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 08 16:34:25.101418 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095801    2565 flags.go:64] FLAG: --kube-api-qps="50"
Jul 08 16:34:25.101418 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095804    2565 flags.go:64] FLAG: --kube-reserved=""
Jul 08 16:34:25.102007 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095807    2565 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 08 16:34:25.102007 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095809    2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 08 16:34:25.102007 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095812    2565 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 08 16:34:25.102007 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095815    2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 08 16:34:25.102007 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095817    2565 flags.go:64] FLAG: --lock-file=""
Jul 08 16:34:25.102007 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095820    2565 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 08 16:34:25.102007 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095823    2565 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 08 16:34:25.102007 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095826    2565 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 08 16:34:25.102007 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095831    2565 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 08 16:34:25.102007 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095834    2565 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 08 16:34:25.102007 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095837    2565 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 08 16:34:25.102007 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095839    2565 flags.go:64] FLAG: --logging-format="text"
Jul 08 16:34:25.102007 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095842    2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 08 16:34:25.102007 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095845    2565 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 08 16:34:25.102007 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095848    2565 flags.go:64] FLAG: --manifest-url=""
Jul 08 16:34:25.102007 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095850    2565 flags.go:64] FLAG: --manifest-url-header=""
Jul 08 16:34:25.102007 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095856    2565 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 08 16:34:25.102007 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095859    2565 flags.go:64] FLAG: --max-open-files="1000000"
Jul 08 16:34:25.102007 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095863    2565 flags.go:64] FLAG: --max-pods="110"
Jul 08 16:34:25.102007 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095866    2565 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 08 16:34:25.102007 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095869    2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 08 16:34:25.102007 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095872    2565 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 08 16:34:25.102007 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095874    2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 08 16:34:25.102007 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095880    2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 08 16:34:25.102007 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095882    2565 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 08 16:34:25.102697 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095885    2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 08 16:34:25.102697 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095892    2565 flags.go:64] FLAG: --node-status-max-images="50"
Jul 08 16:34:25.102697 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095895    2565 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 08 16:34:25.102697 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095898    2565 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 08 16:34:25.102697 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095901    2565 flags.go:64] FLAG: --pod-cidr=""
Jul 08 16:34:25.102697 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095903    2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 08 16:34:25.102697 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095908    2565 flags.go:64] FLAG: --pod-manifest-path=""
Jul 08 16:34:25.102697 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095911    2565 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 08 16:34:25.102697 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095913    2565 flags.go:64] FLAG: --pods-per-core="0"
Jul 08 16:34:25.102697 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095916    2565 flags.go:64] FLAG: --port="10250"
Jul 08 16:34:25.102697 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095919    2565 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 08 16:34:25.102697 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095922    2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-026015a71f077decd"
Jul 08 16:34:25.102697 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095925    2565 flags.go:64] FLAG: --qos-reserved=""
Jul 08 16:34:25.102697 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095928    2565 flags.go:64] FLAG: --read-only-port="10255"
Jul 08 16:34:25.102697 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095930    2565 flags.go:64] FLAG: --register-node="true"
Jul 08 16:34:25.102697 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095933    2565 flags.go:64] FLAG: --register-with-taints=""
Jul 08 16:34:25.102697 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095936    2565 flags.go:64] FLAG: --registry-burst="10"
Jul 08 16:34:25.102697 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095939    2565 flags.go:64] FLAG: --registry-qps="5"
Jul 08 16:34:25.102697 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095942    2565 flags.go:64] FLAG: --reserved-cpus=""
Jul 08 16:34:25.102697 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095944    2565 flags.go:64] FLAG: --reserved-memory=""
Jul 08 16:34:25.102697 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095948    2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 08 16:34:25.102697 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095951    2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 08 16:34:25.102697 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095953    2565 flags.go:64] FLAG: --rotate-certificates="false"
Jul 08 16:34:25.102697 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095956    2565 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 08 16:34:25.102697 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095958    2565 flags.go:64] FLAG: --runonce="false"
Jul 08 16:34:25.103338 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095961    2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 08 16:34:25.103338 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095965    2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 08 16:34:25.103338 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095968    2565 flags.go:64] FLAG: --seccomp-default="false"
Jul 08 16:34:25.103338 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095971    2565 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 08 16:34:25.103338 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095973    2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 08 16:34:25.103338 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095976    2565 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 08 16:34:25.103338 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095980    2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 08 16:34:25.103338 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095983    2565 flags.go:64] FLAG: --storage-driver-password="root"
Jul 08 16:34:25.103338 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095986    2565 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 08 16:34:25.103338 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095988    2565 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 08 16:34:25.103338 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095991    2565 flags.go:64] FLAG: --storage-driver-user="root"
Jul 08 16:34:25.103338 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095993    2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 08 16:34:25.103338 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095996    2565 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 08 16:34:25.103338 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.095999    2565 flags.go:64] FLAG: --system-cgroups=""
Jul 08 16:34:25.103338 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.096002    2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 08 16:34:25.103338 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.096006    2565 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 08 16:34:25.103338 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.096009    2565 flags.go:64] FLAG: --tls-cert-file=""
Jul 08 16:34:25.103338 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.096012    2565 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 08 16:34:25.103338 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.096016    2565 flags.go:64] FLAG: --tls-min-version=""
Jul 08 16:34:25.103338 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.096018    2565 flags.go:64] FLAG: --tls-private-key-file=""
Jul 08 16:34:25.103338 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.096021    2565 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 08 16:34:25.103338 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.096023    2565 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 08 16:34:25.103338 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.096026    2565 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 08 16:34:25.103338 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.096029    2565 flags.go:64] FLAG: --v="2"
Jul 08 16:34:25.103338 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.096032    2565 flags.go:64] FLAG: --version="false"
Jul 08 16:34:25.103975 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.096039    2565 flags.go:64] FLAG: --vmodule=""
Jul 08 16:34:25.103975 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.096042    2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 08 16:34:25.103975 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.096045    2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 08 16:34:25.103975 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096155    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 16:34:25.103975 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096159    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 16:34:25.103975 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096162    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 16:34:25.103975 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096165    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 16:34:25.103975 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096168    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 16:34:25.103975 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096171    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 16:34:25.103975 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096174    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 16:34:25.103975 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096176    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 16:34:25.103975 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096179    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 16:34:25.103975 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096181    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 16:34:25.103975 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096185    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 16:34:25.103975 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096188    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 16:34:25.103975 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096190    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 16:34:25.103975 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096193    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 16:34:25.103975 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096195    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 16:34:25.103975 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096198    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 16:34:25.103975 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096200    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 16:34:25.104505 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096202    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 16:34:25.104505 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096205    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 16:34:25.104505 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096208    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 16:34:25.104505 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096212    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 16:34:25.104505 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096215    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 16:34:25.104505 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096233    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 16:34:25.104505 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096237    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 16:34:25.104505 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096240    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 16:34:25.104505 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096242    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 16:34:25.104505 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096245    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 16:34:25.104505 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096248    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 16:34:25.104505 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096250    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 16:34:25.104505 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096253    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 16:34:25.104505 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096256    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 16:34:25.104505 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096258    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 16:34:25.104505 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096261    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 16:34:25.104505 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096263    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 16:34:25.104505 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096266    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 16:34:25.104505 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096268    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 16:34:25.104973 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096270    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 16:34:25.104973 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096274    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 16:34:25.104973 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096276    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 16:34:25.104973 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096279    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 16:34:25.104973 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096281    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 16:34:25.104973 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096284    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 16:34:25.104973 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096288    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 16:34:25.104973 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096291    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 16:34:25.104973 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096293    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 16:34:25.104973 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096296    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 16:34:25.104973 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096298    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 16:34:25.104973 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096301    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 16:34:25.104973 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096303    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 16:34:25.104973 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096306    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 16:34:25.104973 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096308    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 16:34:25.104973 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096310    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 16:34:25.104973 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096313    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 16:34:25.104973 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096315    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 16:34:25.104973 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096317    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 16:34:25.104973 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096320    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 16:34:25.105518 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096322    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 16:34:25.105518 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096324    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 16:34:25.105518 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096327    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 16:34:25.105518 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096330    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 16:34:25.105518 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096333    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 16:34:25.105518 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096335    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 16:34:25.105518 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096338    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 16:34:25.105518 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096341    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 16:34:25.105518 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096344    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 16:34:25.105518 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096346    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 16:34:25.105518 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096348    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 16:34:25.105518 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096351    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 16:34:25.105518 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096353    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 16:34:25.105518 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096357    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 16:34:25.105518 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096361    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 16:34:25.105518 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096365    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 16:34:25.105518 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096368    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 16:34:25.105518 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096371    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 16:34:25.105518 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096374    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 16:34:25.105518 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096377    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 16:34:25.105989 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096379    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 16:34:25.105989 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096382    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 16:34:25.105989 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096384    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 16:34:25.105989 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096387    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 16:34:25.105989 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096389    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 16:34:25.105989 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096392    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 16:34:25.105989 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096394    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 16:34:25.105989 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096396    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 16:34:25.105989 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096399    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 16:34:25.105989 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096401    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 16:34:25.105989 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096403    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 16:34:25.105989 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096406    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 16:34:25.105989 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096408    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 16:34:25.105989 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096411    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 16:34:25.105989 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096413    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 16:34:25.105989 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096415    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 16:34:25.105989 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096418    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 16:34:25.105989 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096420    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 16:34:25.105989 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096423    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 16:34:25.105989 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096425    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 16:34:25.106505 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096428    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 16:34:25.106505 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096431    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 16:34:25.106505 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.096433    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 16:34:25.106505 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.097165    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 16:34:25.106505 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.103845    2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 08 16:34:25.106505 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.103862    2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 08 16:34:25.106505 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.104632    2565 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 08 16:34:25.106505 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.104640    2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 08 16:34:25.106505 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104698    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 16:34:25.106505 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104704    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 16:34:25.106505 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104707    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 16:34:25.106505 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104710    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 16:34:25.106505 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104713    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 16:34:25.106505 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104716    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 16:34:25.106855 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104719    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 16:34:25.106855 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104722    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 16:34:25.106855 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104724    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 16:34:25.106855 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104727    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 16:34:25.106855 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104730    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 16:34:25.106855 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104733    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 16:34:25.106855 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104735    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 16:34:25.106855 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104738    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 16:34:25.106855 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104741    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 16:34:25.106855 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104744    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 16:34:25.106855 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104748    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 16:34:25.106855 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104752    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 16:34:25.106855 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104754    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 16:34:25.106855 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104757    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 16:34:25.106855 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104760    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 16:34:25.106855 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104762    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 16:34:25.106855 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104765    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 16:34:25.106855 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104768    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 16:34:25.106855 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104770    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 16:34:25.106855 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104772    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 16:34:25.107359 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104775    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 16:34:25.107359 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104778    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 16:34:25.107359 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104780    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 16:34:25.107359 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104784    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 16:34:25.107359 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104787    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 16:34:25.107359 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104790    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 16:34:25.107359 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104792    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 16:34:25.107359 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104795    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 16:34:25.107359 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104798    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 16:34:25.107359 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104800    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 16:34:25.107359 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104803    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 16:34:25.107359 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104805    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 16:34:25.107359 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104808    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 16:34:25.107359 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104811    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 16:34:25.107359 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104813    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 16:34:25.107359 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104815    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 16:34:25.107359 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104818    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 16:34:25.107359 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104820    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 16:34:25.107359 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104823    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 16:34:25.107359 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104825    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 16:34:25.107874 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104827    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 16:34:25.107874 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104830    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 16:34:25.107874 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104832    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 16:34:25.107874 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104835    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 16:34:25.107874 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104837    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 16:34:25.107874 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104839    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 16:34:25.107874 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104843    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 16:34:25.107874 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104845    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 16:34:25.107874 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104848    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 16:34:25.107874 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104851    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 16:34:25.107874 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104854    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 16:34:25.107874 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104856    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 16:34:25.107874 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104859    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 16:34:25.107874 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104861    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 16:34:25.107874 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104864    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 16:34:25.107874 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104866    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 16:34:25.107874 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104870    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 16:34:25.107874 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104872    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 16:34:25.107874 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104875    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 16:34:25.108420 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104878    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 16:34:25.108420 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104880    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 16:34:25.108420 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104882    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 16:34:25.108420 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104885    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 16:34:25.108420 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104887    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 16:34:25.108420 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104890    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 16:34:25.108420 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104892    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 16:34:25.108420 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104895    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 16:34:25.108420 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104897    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 16:34:25.108420 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104900    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 16:34:25.108420 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104902    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 16:34:25.108420 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104904    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 16:34:25.108420 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104907    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 16:34:25.108420 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104909    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 16:34:25.108420 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104911    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 16:34:25.108420 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104914    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 16:34:25.108420 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104916    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 16:34:25.108420 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104919    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 16:34:25.108420 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104921    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 16:34:25.108420 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104924    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 16:34:25.108891 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104926    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 16:34:25.108891 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104929    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 16:34:25.108891 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104931    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 16:34:25.108891 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104934    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 16:34:25.108891 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104937    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 16:34:25.108891 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104942    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 16:34:25.108891 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104946    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 16:34:25.108891 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104949    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 16:34:25.108891 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104952    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 16:34:25.108891 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104955    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 16:34:25.108891 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104959    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 16:34:25.108891 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104961    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 16:34:25.108891 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104964    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 16:34:25.108891 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.104966    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 16:34:25.109261 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.104971    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 16:34:25.109261 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105084    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 16:34:25.109261 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105088    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 16:34:25.109261 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105091    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 16:34:25.109261 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105094    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 16:34:25.109261 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105097    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 16:34:25.109261 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105100    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 16:34:25.109261 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105102    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 16:34:25.109261 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105105    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 16:34:25.109261 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105107    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 16:34:25.109261 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105110    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 16:34:25.109261 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105113    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 16:34:25.109261 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105117    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 16:34:25.109261 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105119    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 16:34:25.109604 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105122    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 16:34:25.109604 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105124    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 16:34:25.109604 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105127    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 16:34:25.109604 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105129    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 16:34:25.109604 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105131    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 16:34:25.109604 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105134    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 16:34:25.109604 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105136    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 16:34:25.109604 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105138    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 16:34:25.109604 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105141    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 16:34:25.109604 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105144    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 16:34:25.109604 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105146    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 16:34:25.109604 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105149    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 16:34:25.109604 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105151    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 16:34:25.109604 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105153    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 16:34:25.109604 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105156    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 16:34:25.109604 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105159    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 16:34:25.109604 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105161    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 16:34:25.109604 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105163    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 16:34:25.109604 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105166    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 16:34:25.109604 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105168    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 16:34:25.110081 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105170    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 16:34:25.110081 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105173    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 16:34:25.110081 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105175    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 16:34:25.110081 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105177    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 16:34:25.110081 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105180    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 16:34:25.110081 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105182    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 16:34:25.110081 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105184    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 16:34:25.110081 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105187    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 16:34:25.110081 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105189    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 16:34:25.110081 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105192    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 16:34:25.110081 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105194    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 16:34:25.110081 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105196    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 16:34:25.110081 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105199    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 16:34:25.110081 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105201    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 16:34:25.110081 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105204    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 16:34:25.110081 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105206    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 16:34:25.110081 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105208    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 16:34:25.110081 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105211    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 16:34:25.110081 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105213    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 16:34:25.110081 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105228    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 16:34:25.110579 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105231    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 16:34:25.110579 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105233    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 16:34:25.110579 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105236    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 16:34:25.110579 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105239    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 16:34:25.110579 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105241    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 16:34:25.110579 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105244    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 16:34:25.110579 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105248    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 16:34:25.110579 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105251    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 16:34:25.110579 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105255    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 16:34:25.110579 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105257    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 16:34:25.110579 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105260    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 16:34:25.110579 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105263    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 16:34:25.110579 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105265    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 16:34:25.110579 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105268    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 16:34:25.110579 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105270    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 16:34:25.110579 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105273    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 16:34:25.110579 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105275    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 16:34:25.110579 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105277    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 16:34:25.110579 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105281    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 16:34:25.111029 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105284    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 16:34:25.111029 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105287    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 16:34:25.111029 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105290    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 16:34:25.111029 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105293    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 16:34:25.111029 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105295    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 16:34:25.111029 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105298    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 16:34:25.111029 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105301    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 16:34:25.111029 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105304    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 16:34:25.111029 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105306    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 16:34:25.111029 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105309    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 16:34:25.111029 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105312    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 16:34:25.111029 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105314    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 16:34:25.111029 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105317    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 16:34:25.111029 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105319    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 16:34:25.111029 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105321    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 16:34:25.111029 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105324    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 16:34:25.111029 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105326    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 16:34:25.111029 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105329    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 16:34:25.111029 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105331    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 16:34:25.111029 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105334    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 16:34:25.111517 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105336    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 16:34:25.111517 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105338    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 16:34:25.111517 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105341    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 16:34:25.111517 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105344    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 16:34:25.111517 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105346    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 16:34:25.111517 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105348    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 16:34:25.111517 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:25.105351    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 16:34:25.111517 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.105355    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 16:34:25.111517 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.105454    2565 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 08 16:34:25.111517 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.107510    2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 08 16:34:25.111517 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.108912    2565 server.go:1019] "Starting client certificate rotation"
Jul 08 16:34:25.111517 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.109007    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 08 16:34:25.111517 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.109035    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 08 16:34:25.112045 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.112032    2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 08 16:34:25.113967 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.113900    2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 08 16:34:25.123286 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.123267    2565 log.go:25] "Validated CRI v1 runtime API"
Jul 08 16:34:25.127147 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.127130    2565 log.go:25] "Validated CRI v1 image API"
Jul 08 16:34:25.127948 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.127933    2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 08 16:34:25.130187 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.130169    2565 fs.go:135] Filesystem UUIDs: map[100168bc-47db-48ce-ae31-440def331b9c:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 e4ee8b53-d59d-47a3-8a25-a8bb466bbcb5:/dev/nvme0n1p3]
Jul 08 16:34:25.130251 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.130187    2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 08 16:34:25.135133 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.135020    2565 manager.go:216] Machine: {Timestamp:2026-07-08 16:34:25.133667783 +0000 UTC m=+0.338282688 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101395 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec22adaa0aa93dd082ff377fb96af150 SystemUUID:ec22adaa-0aa9-3dd0-82ff-377fb96af150 BootID:351c324f-a4ed-4730-bd9d-9d2199a274a0 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:21:29:50:d4:41 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:21:29:50:d4:41 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:66:d4:62:9d:47:39 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 08 16:34:25.135133 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.135124    2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 08 16:34:25.135290 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.135214    2565 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 08 16:34:25.138742 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.138714    2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 08 16:34:25.138883 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.138743    2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-172.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 08 16:34:25.139774 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.139763    2565 topology_manager.go:138] "Creating topology manager with none policy"
Jul 08 16:34:25.139814 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.139777    2565 container_manager_linux.go:309] "Creating device plugin manager"
Jul 08 16:34:25.139814 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.139785    2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 08 16:34:25.140472 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.140456    2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 08 16:34:25.141712 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.141703    2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 08 16:34:25.142242 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.142208    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 08 16:34:25.144989 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.144976    2565 state_mem.go:36] "Initialized new in-memory state store"
Jul 08 16:34:25.145111 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.145102    2565 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 08 16:34:25.145152 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.145144    2565 kubelet.go:486] "Attempting to sync node with API server"
Jul 08 16:34:25.145181 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.145155    2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 08 16:34:25.145181 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.145170    2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 08 16:34:25.145181 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.145179    2565 kubelet.go:398] "Adding apiserver pod source"
Jul 08 16:34:25.145281 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.145187    2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 08 16:34:25.145623 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.145607    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 08 16:34:25.145664 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.145637    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 08 16:34:25.149803 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.149786    2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 08 16:34:25.151637 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.151624    2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 08 16:34:25.151685 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.151654    2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 08 16:34:25.153277 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.153263    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 08 16:34:25.153277 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.153280    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 08 16:34:25.153384 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.153286    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 08 16:34:25.153384 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.153291    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 08 16:34:25.153384 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.153300    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 08 16:34:25.153384 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.153305    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 08 16:34:25.153384 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.153313    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 08 16:34:25.153384 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.153318    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 08 16:34:25.153384 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.153327    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 08 16:34:25.153384 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.153333    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 08 16:34:25.153384 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.153341    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 08 16:34:25.153384 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.153346    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 08 16:34:25.155088 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.155078    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 08 16:34:25.155088 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.155088    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 08 16:34:25.158098 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:25.158070    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 08 16:34:25.158194 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.158080    2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-172.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 08 16:34:25.158194 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.158133    2565 server.go:1268] "Started kubelet"
Jul 08 16:34:25.158194 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:25.158125    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-172.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 08 16:34:25.158345 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.158246    2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 08 16:34:25.158492 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.158307    2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 08 16:34:25.158681 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.158657    2565 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 08 16:34:25.159014 ip-10-0-142-172 systemd[1]: Started Kubernetes Kubelet.
Jul 08 16:34:25.162142 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.162083    2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 08 16:34:25.163596 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.163580    2565 server.go:310] "Adding debug handlers to kubelet server"
Jul 08 16:34:25.164672 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:25.164625    2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 08 16:34:25.170570 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.170550    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 08 16:34:25.170657 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.170556    2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 08 16:34:25.170657 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:25.170648    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-172.ec2.internal\" not found"
Jul 08 16:34:25.171603 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.171376    2565 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 08 16:34:25.171603 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.171425    2565 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 08 16:34:25.171747 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.171696    2565 reconstruct.go:97] "Volume reconstruction finished"
Jul 08 16:34:25.171747 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.171705    2565 reconciler.go:29] "Reconciler: start to sync state"
Jul 08 16:34:25.171995 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.171977    2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 08 16:34:25.171995 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.171997    2565 factory.go:55] Registering systemd factory
Jul 08 16:34:25.171995 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.172006    2565 factory.go:223] Registration of the systemd container factory successfully
Jul 08 16:34:25.172154 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.172056    2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 08 16:34:25.172594 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.172575    2565 factory.go:153] Registering CRI-O factory
Jul 08 16:34:25.172594 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.172597    2565 factory.go:223] Registration of the crio container factory successfully
Jul 08 16:34:25.172779 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.172618    2565 factory.go:103] Registering Raw factory
Jul 08 16:34:25.172779 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.172634    2565 manager.go:1196] Started watching for new ooms in manager
Jul 08 16:34:25.173048 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.173026    2565 manager.go:349] Starting recovery of all containers
Jul 08 16:34:25.183602 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.183574    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rdhj2"
Jul 08 16:34:25.183682 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.183660    2565 manager.go:354] Recovery completed
Jul 08 16:34:25.183842 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:25.183820    2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-172.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 08 16:34:25.183904 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:25.183812    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 08 16:34:25.184782 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:25.183821    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-172.ec2.internal.18c05db0848bed55  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-172.ec2.internal,UID:ip-10-0-142-172.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-172.ec2.internal,},FirstTimestamp:2026-07-08 16:34:25.158106453 +0000 UTC m=+0.362721358,LastTimestamp:2026-07-08 16:34:25.158106453 +0000 UTC m=+0.362721358,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-172.ec2.internal,}"
Jul 08 16:34:25.187587 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.187574    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 16:34:25.189166 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.189151    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-172.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 16:34:25.189267 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.189182    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-172.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 16:34:25.189267 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.189197    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-172.ec2.internal" event="NodeHasSufficientPID"
Jul 08 16:34:25.189679 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.189664    2565 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 08 16:34:25.189679 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.189679    2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 08 16:34:25.189798 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.189695    2565 state_mem.go:36] "Initialized new in-memory state store"
Jul 08 16:34:25.189798 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.189706    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 16:34:25.190395 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.190378    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-172.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 16:34:25.190464 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.190410    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-172.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 16:34:25.190464 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.190425    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-172.ec2.internal" event="NodeHasSufficientPID"
Jul 08 16:34:25.190991 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.190976    2565 policy_none.go:49] "None policy: Start"
Jul 08 16:34:25.191039 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.190997    2565 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 08 16:34:25.191039 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.191010    2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 08 16:34:25.191204 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:25.191142    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-172.ec2.internal.18c05db08665dc61  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-172.ec2.internal,UID:ip-10-0-142-172.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-172.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-172.ec2.internal,},FirstTimestamp:2026-07-08 16:34:25.189166177 +0000 UTC m=+0.393781087,LastTimestamp:2026-07-08 16:34:25.189166177 +0000 UTC m=+0.393781087,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-172.ec2.internal,}"
Jul 08 16:34:25.191886 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.191872    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rdhj2"
Jul 08 16:34:25.192800 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.192787    2565 policy_none.go:47] "Start"
Jul 08 16:34:25.231799 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.231780    2565 manager.go:337] "Starting Device Plugin manager"
Jul 08 16:34:25.231875 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:25.231841    2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 08 16:34:25.231875 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.231854    2565 server.go:87] "Starting device plugin registration server"
Jul 08 16:34:25.232075 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.232060    2565 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 08 16:34:25.232149 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.232075    2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 08 16:34:25.232196 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.232157    2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 08 16:34:25.232289 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.232268    2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 08 16:34:25.232289 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.232278    2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 08 16:34:25.232695 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:25.232674    2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 08 16:34:25.232773 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:25.232728    2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-172.ec2.internal\" not found"
Jul 08 16:34:25.332435 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.332401    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 16:34:25.333614 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.333176    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-172.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 16:34:25.333614 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.333202    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-172.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 16:34:25.333614 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.333237    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-172.ec2.internal" event="NodeHasSufficientPID"
Jul 08 16:34:25.333614 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.333271    2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-172.ec2.internal"
Jul 08 16:34:25.342317 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.342300    2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-172.ec2.internal"
Jul 08 16:34:25.342395 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:25.342320    2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-172.ec2.internal\": node \"ip-10-0-142-172.ec2.internal\" not found"
Jul 08 16:34:25.359077 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:25.359056    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-172.ec2.internal\" not found"
Jul 08 16:34:25.377797 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.377769    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 08 16:34:25.379128 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.379110    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 08 16:34:25.379235 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.379143    2565 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 08 16:34:25.379235 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.379163    2565 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 08 16:34:25.379235 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:25.379200    2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 08 16:34:25.381582 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.381559    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 16:34:25.460020 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:25.459985    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-172.ec2.internal\" not found"
Jul 08 16:34:25.479511 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.479483    2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-172.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-172.ec2.internal"]
Jul 08 16:34:25.479606 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.479555    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 16:34:25.481199 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.481181    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-172.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 16:34:25.481297 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.481213    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-172.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 16:34:25.481297 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.481236    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-172.ec2.internal" event="NodeHasSufficientPID"
Jul 08 16:34:25.482573 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.482560    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 16:34:25.482729 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.482715    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-172.ec2.internal"
Jul 08 16:34:25.482767 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.482745    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 16:34:25.483421 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.483403    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-172.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 16:34:25.483512 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.483433    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-172.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 16:34:25.483512 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.483447    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-172.ec2.internal" event="NodeHasSufficientPID"
Jul 08 16:34:25.483512 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.483409    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-172.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 16:34:25.483512 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.483506    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-172.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 16:34:25.483688 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.483517    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-172.ec2.internal" event="NodeHasSufficientPID"
Jul 08 16:34:25.484680 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.484661    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-172.ec2.internal"
Jul 08 16:34:25.484763 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.484694    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 16:34:25.485394 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.485379    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-172.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 16:34:25.485479 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.485404    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-172.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 16:34:25.485479 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.485413    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-172.ec2.internal" event="NodeHasSufficientPID"
Jul 08 16:34:25.498771 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:25.498750    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-172.ec2.internal\" not found" node="ip-10-0-142-172.ec2.internal"
Jul 08 16:34:25.502600 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:25.502584    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-172.ec2.internal\" not found" node="ip-10-0-142-172.ec2.internal"
Jul 08 16:34:25.560273 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:25.560242    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-172.ec2.internal\" not found"
Jul 08 16:34:25.574790 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.574768    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/754280904498ad244daf8a18eea5a700-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-172.ec2.internal\" (UID: \"754280904498ad244daf8a18eea5a700\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-172.ec2.internal"
Jul 08 16:34:25.574877 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.574794    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/754280904498ad244daf8a18eea5a700-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-172.ec2.internal\" (UID: \"754280904498ad244daf8a18eea5a700\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-172.ec2.internal"
Jul 08 16:34:25.574877 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.574813    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/deb4e2f36b206a55798df1285a775313-config\") pod \"kube-apiserver-proxy-ip-10-0-142-172.ec2.internal\" (UID: \"deb4e2f36b206a55798df1285a775313\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-172.ec2.internal"
Jul 08 16:34:25.661344 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:25.661281    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-172.ec2.internal\" not found"
Jul 08 16:34:25.675674 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.675650    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/754280904498ad244daf8a18eea5a700-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-172.ec2.internal\" (UID: \"754280904498ad244daf8a18eea5a700\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-172.ec2.internal"
Jul 08 16:34:25.675674 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.675675    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/deb4e2f36b206a55798df1285a775313-config\") pod \"kube-apiserver-proxy-ip-10-0-142-172.ec2.internal\" (UID: \"deb4e2f36b206a55798df1285a775313\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-172.ec2.internal"
Jul 08 16:34:25.675853 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.675691    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/754280904498ad244daf8a18eea5a700-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-172.ec2.internal\" (UID: \"754280904498ad244daf8a18eea5a700\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-172.ec2.internal"
Jul 08 16:34:25.675853 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.675752    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/deb4e2f36b206a55798df1285a775313-config\") pod \"kube-apiserver-proxy-ip-10-0-142-172.ec2.internal\" (UID: \"deb4e2f36b206a55798df1285a775313\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-172.ec2.internal"
Jul 08 16:34:25.675853 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.675754    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/754280904498ad244daf8a18eea5a700-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-172.ec2.internal\" (UID: \"754280904498ad244daf8a18eea5a700\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-172.ec2.internal"
Jul 08 16:34:25.675853 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.675786    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/754280904498ad244daf8a18eea5a700-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-172.ec2.internal\" (UID: \"754280904498ad244daf8a18eea5a700\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-172.ec2.internal"
Jul 08 16:34:25.761862 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:25.761820    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-172.ec2.internal\" not found"
Jul 08 16:34:25.801415 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.801391    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-172.ec2.internal"
Jul 08 16:34:25.806588 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:25.805945    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-172.ec2.internal"
Jul 08 16:34:25.862386 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:25.862352    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-172.ec2.internal\" not found"
Jul 08 16:34:25.962992 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:25.962902    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-172.ec2.internal\" not found"
Jul 08 16:34:26.063509 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:26.063472    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-172.ec2.internal\" not found"
Jul 08 16:34:26.107799 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:26.107765    2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 08 16:34:26.108457 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:26.107865    2565 request.go:1196] "Unexpected error when reading response body" err="read tcp 10.0.142.172:57772->3.210.8.75:6443: use of closed network connection"
Jul 08 16:34:26.108457 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:26.107869    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 08 16:34:26.108457 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:26.107942    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: unexpected error when reading response body. Please retry. Original error: read tcp 10.0.142.172:57772->3.210.8.75:6443: use of closed network connection" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 08 16:34:26.164423 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:26.164397    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-172.ec2.internal\" not found"
Jul 08 16:34:27.300356 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:27.300330    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-07 16:29:26 +0000 UTC" deadline="2028-03-22 07:35:08.38914446 +0000 UTC"
Jul 08 16:34:27.300434 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:27.300357    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14943h0m41.088791626s"
Jul 08 16:34:27.368697 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:27.368600    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-172.ec2.internal\" not found"
Jul 08 16:34:27.469176 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:27.469144    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-172.ec2.internal\" not found"
Jul 08 16:34:27.516111 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:27.516076    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod754280904498ad244daf8a18eea5a700.slice/crio-046f65e3c88041306ef16354fd7b5268b8a156ee1efb7644187c6f1810cac12c WatchSource:0}: Error finding container 046f65e3c88041306ef16354fd7b5268b8a156ee1efb7644187c6f1810cac12c: Status 404 returned error can't find the container with id 046f65e3c88041306ef16354fd7b5268b8a156ee1efb7644187c6f1810cac12c
Jul 08 16:34:27.516457 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:27.516436    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddeb4e2f36b206a55798df1285a775313.slice/crio-3ad3205c6778fd8f7d28a93226c86a6bce742967add17e999557f419f9936c6f WatchSource:0}: Error finding container 3ad3205c6778fd8f7d28a93226c86a6bce742967add17e999557f419f9936c6f: Status 404 returned error can't find the container with id 3ad3205c6778fd8f7d28a93226c86a6bce742967add17e999557f419f9936c6f
Jul 08 16:34:27.521635 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:27.521618    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 16:34:27.526141 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:27.526112    2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 16:34:27.570277 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:27.570244    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-172.ec2.internal\" not found"
Jul 08 16:34:27.670838 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:27.670764    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-172.ec2.internal\" not found"
Jul 08 16:34:27.771611 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:27.771583    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-172.ec2.internal\" not found"
Jul 08 16:34:27.872184 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:27.872137    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-172.ec2.internal\" not found"
Jul 08 16:34:27.888314 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:27.888286    2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 16:34:27.972594 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:27.972562    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-172.ec2.internal\" not found"
Jul 08 16:34:28.073233 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:28.073193    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-172.ec2.internal\" not found"
Jul 08 16:34:28.173992 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:28.173961    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-172.ec2.internal\" not found"
Jul 08 16:34:28.274928 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:28.274848    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-172.ec2.internal\" not found"
Jul 08 16:34:28.375633 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:28.375594    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-172.ec2.internal\" not found"
Jul 08 16:34:28.476113 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:28.476076    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-172.ec2.internal\" not found"
Jul 08 16:34:28.481023 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:28.480996    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 16:34:28.488615 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:28.488564    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-172.ec2.internal" event={"ID":"deb4e2f36b206a55798df1285a775313","Type":"ContainerStarted","Data":"3ad3205c6778fd8f7d28a93226c86a6bce742967add17e999557f419f9936c6f"}
Jul 08 16:34:28.489769 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:28.489745    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-172.ec2.internal" event={"ID":"754280904498ad244daf8a18eea5a700","Type":"ContainerStarted","Data":"046f65e3c88041306ef16354fd7b5268b8a156ee1efb7644187c6f1810cac12c"}
Jul 08 16:34:28.577244 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:28.577143    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-172.ec2.internal\" not found"
Jul 08 16:34:28.677707 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:28.677671    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-172.ec2.internal\" not found"
Jul 08 16:34:28.778552 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:28.778516    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-172.ec2.internal\" not found"
Jul 08 16:34:28.879134 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:28.879058    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-172.ec2.internal\" not found"
Jul 08 16:34:28.976667 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:28.976634    2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 16:34:29.075309 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.075274    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-172.ec2.internal"
Jul 08 16:34:29.088969 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.088940    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 08 16:34:29.090079 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.090057    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-172.ec2.internal"
Jul 08 16:34:29.101772 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.101751    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 08 16:34:29.251690 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.251652    2565 apiserver.go:52] "Watching apiserver"
Jul 08 16:34:29.261754 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.260977    2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 08 16:34:29.261905 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.261855    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsmnd","openshift-cluster-node-tuning-operator/tuned-kkm4w","openshift-dns/node-resolver-jzrk9","openshift-network-diagnostics/network-check-target-fftjw","openshift-ovn-kubernetes/ovnkube-node-jxfhc","kube-system/kube-apiserver-proxy-ip-10-0-142-172.ec2.internal","openshift-image-registry/node-ca-t8k5z","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-172.ec2.internal","openshift-multus/multus-8jxnm","openshift-multus/multus-additional-cni-plugins-6xpv2","openshift-multus/network-metrics-daemon-psbhw","openshift-network-operator/iptables-alerter-qwddx","kube-system/global-pull-secret-syncer-6gvmb","kube-system/konnectivity-agent-plbcq"]
Jul 08 16:34:29.264059 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.264034    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-t8k5z"
Jul 08 16:34:29.265185 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.265166    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gvmb"
Jul 08 16:34:29.265314 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:29.265260    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gvmb" podUID="4606c816-49c0-450f-a21f-7594bf0aaa89"
Jul 08 16:34:29.267030 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.267011    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 08 16:34:29.267159 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.267143    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jx6j6\""
Jul 08 16:34:29.267429 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.267410    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 08 16:34:29.267698 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.267529    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 08 16:34:29.267698 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.267628    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jzrk9"
Jul 08 16:34:29.268883 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.268864    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fftjw"
Jul 08 16:34:29.268971 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:29.268931    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fftjw" podUID="24e40bdc-44ee-4c05-8e65-bd4a3842a5cd"
Jul 08 16:34:29.270134 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.270107    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:29.271062 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.271047    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 08 16:34:29.271156 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.271118    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 08 16:34:29.271361 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.271345    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-r75cz\""
Jul 08 16:34:29.271590 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.271574    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-plbcq"
Jul 08 16:34:29.272917 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.272898    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8jxnm"
Jul 08 16:34:29.274419 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.274399    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsmnd"
Jul 08 16:34:29.275463 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.275444    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 08 16:34:29.275799 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.275487    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 08 16:34:29.275799 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.275511    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 08 16:34:29.275799 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.275722    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9tkdh\""
Jul 08 16:34:29.275799 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.275760    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 08 16:34:29.275799 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.275797    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 08 16:34:29.276034 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.275883    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 08 16:34:29.276034 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.275988    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-m7czv\""
Jul 08 16:34:29.276034 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.275998    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 08 16:34:29.276034 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.276003    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 08 16:34:29.276432 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.276414    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 08 16:34:29.276660 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.276640    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 08 16:34:29.276755 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.276661    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 08 16:34:29.276755 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.276693    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 08 16:34:29.276880 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.276865    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kkm4w"
Jul 08 16:34:29.276960 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.276941    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 08 16:34:29.277023 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.276964    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-f2wl6\""
Jul 08 16:34:29.277139 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.277122    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 08 16:34:29.277312 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.277292    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 08 16:34:29.277654 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.277638    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 08 16:34:29.277727 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.277696    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-rcx72\""
Jul 08 16:34:29.278081 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.278064    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6xpv2"
Jul 08 16:34:29.279502 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.279483    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-psbhw"
Jul 08 16:34:29.279598 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:29.279544    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-psbhw" podUID="8eb4f440-8261-4651-a10a-1ccd5cb14f60"
Jul 08 16:34:29.280392 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.280373    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 08 16:34:29.280497 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.280411    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 08 16:34:29.280726 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.280702    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 08 16:34:29.281006 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.280988    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qwddx"
Jul 08 16:34:29.281266 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.281246    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-cbrbd\""
Jul 08 16:34:29.281443 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.281424    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-979db\""
Jul 08 16:34:29.281615 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.281596    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 08 16:34:29.284560 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.284407    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 08 16:34:29.284777 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.284750    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wmkgx\""
Jul 08 16:34:29.285972 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.285933    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 08 16:34:29.286451 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.286436    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 08 16:34:29.298488 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.296143    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8fec5c78-b2b7-4e3f-a4b3-75289b3bb33f-socket-dir\") pod \"aws-ebs-csi-driver-node-tsmnd\" (UID: \"8fec5c78-b2b7-4e3f-a4b3-75289b3bb33f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsmnd"
Jul 08 16:34:29.298488 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.296186    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/be4b1f03-839c-4f8d-a037-498b6a7bb608-etc-modprobe-d\") pod \"tuned-kkm4w\" (UID: \"be4b1f03-839c-4f8d-a037-498b6a7bb608\") " pod="openshift-cluster-node-tuning-operator/tuned-kkm4w"
Jul 08 16:34:29.298488 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.296241    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7fcc3970-f944-4fcf-b05e-f11d98a8c762-host-var-lib-cni-bin\") pod \"multus-8jxnm\" (UID: \"7fcc3970-f944-4fcf-b05e-f11d98a8c762\") " pod="openshift-multus/multus-8jxnm"
Jul 08 16:34:29.298488 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.296269    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4c07e006-6cb2-4bcf-9fba-751d0c4630b3-host-slash\") pod \"ovnkube-node-jxfhc\" (UID: \"4c07e006-6cb2-4bcf-9fba-751d0c4630b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:29.298488 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.296298    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c07e006-6cb2-4bcf-9fba-751d0c4630b3-var-lib-openvswitch\") pod \"ovnkube-node-jxfhc\" (UID: \"4c07e006-6cb2-4bcf-9fba-751d0c4630b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:29.298488 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.296330    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c07e006-6cb2-4bcf-9fba-751d0c4630b3-run-openvswitch\") pod \"ovnkube-node-jxfhc\" (UID: \"4c07e006-6cb2-4bcf-9fba-751d0c4630b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:29.298488 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.296360    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/462ebd3a-f548-4af5-8f83-20d342dc9441-agent-certs\") pod \"konnectivity-agent-plbcq\" (UID: \"462ebd3a-f548-4af5-8f83-20d342dc9441\") " pod="kube-system/konnectivity-agent-plbcq"
Jul 08 16:34:29.298488 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.296389    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/decd5d3d-7bca-4b32-bf8f-1d060e617e56-tmp-dir\") pod \"node-resolver-jzrk9\" (UID: \"decd5d3d-7bca-4b32-bf8f-1d060e617e56\") " pod="openshift-dns/node-resolver-jzrk9"
Jul 08 16:34:29.298488 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.296435    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9hnl\" (UniqueName: \"kubernetes.io/projected/decd5d3d-7bca-4b32-bf8f-1d060e617e56-kube-api-access-s9hnl\") pod \"node-resolver-jzrk9\" (UID: \"decd5d3d-7bca-4b32-bf8f-1d060e617e56\") " pod="openshift-dns/node-resolver-jzrk9"
Jul 08 16:34:29.298488 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.296464    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4c07e006-6cb2-4bcf-9fba-751d0c4630b3-host-cni-netd\") pod \"ovnkube-node-jxfhc\" (UID: \"4c07e006-6cb2-4bcf-9fba-751d0c4630b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:29.298488 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.296493    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5qdc\" (UniqueName: \"kubernetes.io/projected/8fec5c78-b2b7-4e3f-a4b3-75289b3bb33f-kube-api-access-g5qdc\") pod \"aws-ebs-csi-driver-node-tsmnd\" (UID: \"8fec5c78-b2b7-4e3f-a4b3-75289b3bb33f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsmnd"
Jul 08 16:34:29.298488 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.296522    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/462ebd3a-f548-4af5-8f83-20d342dc9441-konnectivity-ca\") pod \"konnectivity-agent-plbcq\" (UID: \"462ebd3a-f548-4af5-8f83-20d342dc9441\") " pod="kube-system/konnectivity-agent-plbcq"
Jul 08 16:34:29.298488 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.296549    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/be4b1f03-839c-4f8d-a037-498b6a7bb608-etc-systemd\") pod \"tuned-kkm4w\" (UID: \"be4b1f03-839c-4f8d-a037-498b6a7bb608\") " pod="openshift-cluster-node-tuning-operator/tuned-kkm4w"
Jul 08 16:34:29.298488 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.296572    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdjbl\" (UniqueName: \"kubernetes.io/projected/be4b1f03-839c-4f8d-a037-498b6a7bb608-kube-api-access-xdjbl\") pod \"tuned-kkm4w\" (UID: \"be4b1f03-839c-4f8d-a037-498b6a7bb608\") " pod="openshift-cluster-node-tuning-operator/tuned-kkm4w"
Jul 08 16:34:29.298488 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.296618    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4606c816-49c0-450f-a21f-7594bf0aaa89-original-pull-secret\") pod \"global-pull-secret-syncer-6gvmb\" (UID: \"4606c816-49c0-450f-a21f-7594bf0aaa89\") " pod="kube-system/global-pull-secret-syncer-6gvmb"
Jul 08 16:34:29.298488 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.296646    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4c07e006-6cb2-4bcf-9fba-751d0c4630b3-host-run-netns\") pod \"ovnkube-node-jxfhc\" (UID: \"4c07e006-6cb2-4bcf-9fba-751d0c4630b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:29.299246 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.296673    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4c07e006-6cb2-4bcf-9fba-751d0c4630b3-run-systemd\") pod \"ovnkube-node-jxfhc\" (UID: \"4c07e006-6cb2-4bcf-9fba-751d0c4630b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:29.299246 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.296703    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7fcc3970-f944-4fcf-b05e-f11d98a8c762-multus-conf-dir\") pod \"multus-8jxnm\" (UID: \"7fcc3970-f944-4fcf-b05e-f11d98a8c762\") " pod="openshift-multus/multus-8jxnm"
Jul 08 16:34:29.299246 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.296738    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c07e006-6cb2-4bcf-9fba-751d0c4630b3-host-run-ovn-kubernetes\") pod \"ovnkube-node-jxfhc\" (UID: \"4c07e006-6cb2-4bcf-9fba-751d0c4630b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:29.299246 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.296763    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4c07e006-6cb2-4bcf-9fba-751d0c4630b3-env-overrides\") pod \"ovnkube-node-jxfhc\" (UID: \"4c07e006-6cb2-4bcf-9fba-751d0c4630b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:29.299246 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.296790    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7fcc3970-f944-4fcf-b05e-f11d98a8c762-multus-socket-dir-parent\") pod \"multus-8jxnm\" (UID: \"7fcc3970-f944-4fcf-b05e-f11d98a8c762\") " pod="openshift-multus/multus-8jxnm"
Jul 08 16:34:29.299246 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.296818    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7fcc3970-f944-4fcf-b05e-f11d98a8c762-etc-kubernetes\") pod \"multus-8jxnm\" (UID: \"7fcc3970-f944-4fcf-b05e-f11d98a8c762\") " pod="openshift-multus/multus-8jxnm"
Jul 08 16:34:29.299246 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.296847    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8fec5c78-b2b7-4e3f-a4b3-75289b3bb33f-registration-dir\") pod \"aws-ebs-csi-driver-node-tsmnd\" (UID: \"8fec5c78-b2b7-4e3f-a4b3-75289b3bb33f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsmnd"
Jul 08 16:34:29.299246 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.296870    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8fec5c78-b2b7-4e3f-a4b3-75289b3bb33f-sys-fs\") pod \"aws-ebs-csi-driver-node-tsmnd\" (UID: \"8fec5c78-b2b7-4e3f-a4b3-75289b3bb33f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsmnd"
Jul 08 16:34:29.299246 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.296896    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c07e006-6cb2-4bcf-9fba-751d0c4630b3-host-kubelet\") pod \"ovnkube-node-jxfhc\" (UID: \"4c07e006-6cb2-4bcf-9fba-751d0c4630b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:29.299246 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.296923    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c07e006-6cb2-4bcf-9fba-751d0c4630b3-etc-openvswitch\") pod \"ovnkube-node-jxfhc\" (UID: \"4c07e006-6cb2-4bcf-9fba-751d0c4630b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:29.299246 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.296951    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4c07e006-6cb2-4bcf-9fba-751d0c4630b3-node-log\") pod \"ovnkube-node-jxfhc\" (UID: \"4c07e006-6cb2-4bcf-9fba-751d0c4630b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:29.299246 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.296978    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/be4b1f03-839c-4f8d-a037-498b6a7bb608-run\") pod \"tuned-kkm4w\" (UID: \"be4b1f03-839c-4f8d-a037-498b6a7bb608\") " pod="openshift-cluster-node-tuning-operator/tuned-kkm4w"
Jul 08 16:34:29.299246 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.297001    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be4b1f03-839c-4f8d-a037-498b6a7bb608-tmp\") pod \"tuned-kkm4w\" (UID: \"be4b1f03-839c-4f8d-a037-498b6a7bb608\") " pod="openshift-cluster-node-tuning-operator/tuned-kkm4w"
Jul 08 16:34:29.299246 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.297034    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/decd5d3d-7bca-4b32-bf8f-1d060e617e56-hosts-file\") pod \"node-resolver-jzrk9\" (UID: \"decd5d3d-7bca-4b32-bf8f-1d060e617e56\") " pod="openshift-dns/node-resolver-jzrk9"
Jul 08 16:34:29.299246 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.297069    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4c07e006-6cb2-4bcf-9fba-751d0c4630b3-log-socket\") pod \"ovnkube-node-jxfhc\" (UID: \"4c07e006-6cb2-4bcf-9fba-751d0c4630b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:29.299246 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.297100    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4c07e006-6cb2-4bcf-9fba-751d0c4630b3-ovnkube-script-lib\") pod \"ovnkube-node-jxfhc\" (UID: \"4c07e006-6cb2-4bcf-9fba-751d0c4630b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:29.299246 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.297129    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8fec5c78-b2b7-4e3f-a4b3-75289b3bb33f-device-dir\") pod \"aws-ebs-csi-driver-node-tsmnd\" (UID: \"8fec5c78-b2b7-4e3f-a4b3-75289b3bb33f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsmnd"
Jul 08 16:34:29.299927 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.297153    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8fec5c78-b2b7-4e3f-a4b3-75289b3bb33f-etc-selinux\") pod \"aws-ebs-csi-driver-node-tsmnd\" (UID: \"8fec5c78-b2b7-4e3f-a4b3-75289b3bb33f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsmnd"
Jul 08 16:34:29.299927 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.297188    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/be4b1f03-839c-4f8d-a037-498b6a7bb608-etc-kubernetes\") pod \"tuned-kkm4w\" (UID: \"be4b1f03-839c-4f8d-a037-498b6a7bb608\") " pod="openshift-cluster-node-tuning-operator/tuned-kkm4w"
Jul 08 16:34:29.299927 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.297212    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/be4b1f03-839c-4f8d-a037-498b6a7bb608-sys\") pod \"tuned-kkm4w\" (UID: \"be4b1f03-839c-4f8d-a037-498b6a7bb608\") " pod="openshift-cluster-node-tuning-operator/tuned-kkm4w"
Jul 08 16:34:29.299927 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.297261    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7fcc3970-f944-4fcf-b05e-f11d98a8c762-host-run-k8s-cni-cncf-io\") pod \"multus-8jxnm\" (UID: \"7fcc3970-f944-4fcf-b05e-f11d98a8c762\") " pod="openshift-multus/multus-8jxnm"
Jul 08 16:34:29.299927 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.297291    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/be4b1f03-839c-4f8d-a037-498b6a7bb608-lib-modules\") pod \"tuned-kkm4w\" (UID: \"be4b1f03-839c-4f8d-a037-498b6a7bb608\") " pod="openshift-cluster-node-tuning-operator/tuned-kkm4w"
Jul 08 16:34:29.299927 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.297320    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4c07e006-6cb2-4bcf-9fba-751d0c4630b3-ovnkube-config\") pod \"ovnkube-node-jxfhc\" (UID: \"4c07e006-6cb2-4bcf-9fba-751d0c4630b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:29.299927 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.297345    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8fec5c78-b2b7-4e3f-a4b3-75289b3bb33f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tsmnd\" (UID: \"8fec5c78-b2b7-4e3f-a4b3-75289b3bb33f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsmnd"
Jul 08 16:34:29.299927 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.297410    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/be4b1f03-839c-4f8d-a037-498b6a7bb608-etc-tuned\") pod \"tuned-kkm4w\" (UID: \"be4b1f03-839c-4f8d-a037-498b6a7bb608\") " pod="openshift-cluster-node-tuning-operator/tuned-kkm4w"
Jul 08 16:34:29.299927 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.297447    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/455653e2-cc9e-4e39-a2b6-013b392b9d47-host\") pod \"node-ca-t8k5z\" (UID: \"455653e2-cc9e-4e39-a2b6-013b392b9d47\") " pod="openshift-image-registry/node-ca-t8k5z"
Jul 08 16:34:29.299927 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.297504    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 08 16:34:29.299927 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.297601    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4606c816-49c0-450f-a21f-7594bf0aaa89-kubelet-config\") pod \"global-pull-secret-syncer-6gvmb\" (UID: \"4606c816-49c0-450f-a21f-7594bf0aaa89\") " pod="kube-system/global-pull-secret-syncer-6gvmb"
Jul 08 16:34:29.299927 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.297645    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4606c816-49c0-450f-a21f-7594bf0aaa89-dbus\") pod \"global-pull-secret-syncer-6gvmb\" (UID: \"4606c816-49c0-450f-a21f-7594bf0aaa89\") " pod="kube-system/global-pull-secret-syncer-6gvmb"
Jul 08 16:34:29.299927 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.297680    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7fcc3970-f944-4fcf-b05e-f11d98a8c762-cnibin\") pod \"multus-8jxnm\" (UID: \"7fcc3970-f944-4fcf-b05e-f11d98a8c762\") " pod="openshift-multus/multus-8jxnm"
Jul 08 16:34:29.299927 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.297726    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfnkm\" (UniqueName: \"kubernetes.io/projected/24e40bdc-44ee-4c05-8e65-bd4a3842a5cd-kube-api-access-zfnkm\") pod \"network-check-target-fftjw\" (UID: \"24e40bdc-44ee-4c05-8e65-bd4a3842a5cd\") " pod="openshift-network-diagnostics/network-check-target-fftjw"
Jul 08 16:34:29.299927 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.297760    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/455653e2-cc9e-4e39-a2b6-013b392b9d47-serviceca\") pod \"node-ca-t8k5z\" (UID: \"455653e2-cc9e-4e39-a2b6-013b392b9d47\") " pod="openshift-image-registry/node-ca-t8k5z"
Jul 08 16:34:29.299927 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.297795    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4c07e006-6cb2-4bcf-9fba-751d0c4630b3-host-cni-bin\") pod \"ovnkube-node-jxfhc\" (UID: \"4c07e006-6cb2-4bcf-9fba-751d0c4630b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:29.299927 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.297824    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7fcc3970-f944-4fcf-b05e-f11d98a8c762-system-cni-dir\") pod \"multus-8jxnm\" (UID: \"7fcc3970-f944-4fcf-b05e-f11d98a8c762\") " pod="openshift-multus/multus-8jxnm"
Jul 08 16:34:29.300527 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.297851    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7fcc3970-f944-4fcf-b05e-f11d98a8c762-os-release\") pod \"multus-8jxnm\" (UID: \"7fcc3970-f944-4fcf-b05e-f11d98a8c762\") " pod="openshift-multus/multus-8jxnm"
Jul 08 16:34:29.300527 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.297880    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7fcc3970-f944-4fcf-b05e-f11d98a8c762-host-run-netns\") pod \"multus-8jxnm\" (UID: \"7fcc3970-f944-4fcf-b05e-f11d98a8c762\") " pod="openshift-multus/multus-8jxnm"
Jul 08 16:34:29.300527 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.297926    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/be4b1f03-839c-4f8d-a037-498b6a7bb608-etc-sysconfig\") pod \"tuned-kkm4w\" (UID: \"be4b1f03-839c-4f8d-a037-498b6a7bb608\") " pod="openshift-cluster-node-tuning-operator/tuned-kkm4w"
Jul 08 16:34:29.300527 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.297950    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4c07e006-6cb2-4bcf-9fba-751d0c4630b3-systemd-units\") pod \"ovnkube-node-jxfhc\" (UID: \"4c07e006-6cb2-4bcf-9fba-751d0c4630b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:29.300527 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.297978    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7fcc3970-f944-4fcf-b05e-f11d98a8c762-host-var-lib-cni-multus\") pod \"multus-8jxnm\" (UID: \"7fcc3970-f944-4fcf-b05e-f11d98a8c762\") " pod="openshift-multus/multus-8jxnm"
Jul 08 16:34:29.300527 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.298006    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7fcc3970-f944-4fcf-b05e-f11d98a8c762-host-var-lib-kubelet\") pod \"multus-8jxnm\" (UID: \"7fcc3970-f944-4fcf-b05e-f11d98a8c762\") " pod="openshift-multus/multus-8jxnm"
Jul 08 16:34:29.300527 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.298062    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be4b1f03-839c-4f8d-a037-498b6a7bb608-var-lib-kubelet\") pod \"tuned-kkm4w\" (UID: \"be4b1f03-839c-4f8d-a037-498b6a7bb608\") " pod="openshift-cluster-node-tuning-operator/tuned-kkm4w"
Jul 08 16:34:29.300527 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.298089    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/be4b1f03-839c-4f8d-a037-498b6a7bb608-host\") pod \"tuned-kkm4w\" (UID: \"be4b1f03-839c-4f8d-a037-498b6a7bb608\") " pod="openshift-cluster-node-tuning-operator/tuned-kkm4w"
Jul 08 16:34:29.300527 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.298112    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mht5l\" (UniqueName: \"kubernetes.io/projected/455653e2-cc9e-4e39-a2b6-013b392b9d47-kube-api-access-mht5l\") pod \"node-ca-t8k5z\" (UID: \"455653e2-cc9e-4e39-a2b6-013b392b9d47\") " pod="openshift-image-registry/node-ca-t8k5z"
Jul 08 16:34:29.300527 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.298175    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7x67x\" (UniqueName: \"kubernetes.io/projected/4c07e006-6cb2-4bcf-9fba-751d0c4630b3-kube-api-access-7x67x\") pod \"ovnkube-node-jxfhc\" (UID: \"4c07e006-6cb2-4bcf-9fba-751d0c4630b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:29.300527 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.298198    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7fcc3970-f944-4fcf-b05e-f11d98a8c762-host-run-multus-certs\") pod \"multus-8jxnm\" (UID: \"7fcc3970-f944-4fcf-b05e-f11d98a8c762\") " pod="openshift-multus/multus-8jxnm"
Jul 08 16:34:29.300527 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.298246    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/be4b1f03-839c-4f8d-a037-498b6a7bb608-etc-sysctl-conf\") pod \"tuned-kkm4w\" (UID: \"be4b1f03-839c-4f8d-a037-498b6a7bb608\") " pod="openshift-cluster-node-tuning-operator/tuned-kkm4w"
Jul 08 16:34:29.300527 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.298276    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7fcc3970-f944-4fcf-b05e-f11d98a8c762-multus-cni-dir\") pod \"multus-8jxnm\" (UID: \"7fcc3970-f944-4fcf-b05e-f11d98a8c762\") " pod="openshift-multus/multus-8jxnm"
Jul 08 16:34:29.300527 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.298303    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7fcc3970-f944-4fcf-b05e-f11d98a8c762-cni-binary-copy\") pod \"multus-8jxnm\" (UID: \"7fcc3970-f944-4fcf-b05e-f11d98a8c762\") " pod="openshift-multus/multus-8jxnm"
Jul 08 16:34:29.300527 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.298325    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7fcc3970-f944-4fcf-b05e-f11d98a8c762-multus-daemon-config\") pod \"multus-8jxnm\" (UID: \"7fcc3970-f944-4fcf-b05e-f11d98a8c762\") " pod="openshift-multus/multus-8jxnm"
Jul 08 16:34:29.300527 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.298403    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4c07e006-6cb2-4bcf-9fba-751d0c4630b3-ovn-node-metrics-cert\") pod \"ovnkube-node-jxfhc\" (UID: \"4c07e006-6cb2-4bcf-9fba-751d0c4630b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:29.300527 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.298520    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85jl6\" (UniqueName: \"kubernetes.io/projected/7fcc3970-f944-4fcf-b05e-f11d98a8c762-kube-api-access-85jl6\") pod \"multus-8jxnm\" (UID: \"7fcc3970-f944-4fcf-b05e-f11d98a8c762\") " pod="openshift-multus/multus-8jxnm"
Jul 08 16:34:29.301029 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.298593    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/be4b1f03-839c-4f8d-a037-498b6a7bb608-etc-sysctl-d\") pod \"tuned-kkm4w\" (UID: \"be4b1f03-839c-4f8d-a037-498b6a7bb608\") " pod="openshift-cluster-node-tuning-operator/tuned-kkm4w"
Jul 08 16:34:29.301029 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.298630    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4c07e006-6cb2-4bcf-9fba-751d0c4630b3-run-ovn\") pod \"ovnkube-node-jxfhc\" (UID: \"4c07e006-6cb2-4bcf-9fba-751d0c4630b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:29.301029 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.298682    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c07e006-6cb2-4bcf-9fba-751d0c4630b3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jxfhc\" (UID: \"4c07e006-6cb2-4bcf-9fba-751d0c4630b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:29.301029 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.298745    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7fcc3970-f944-4fcf-b05e-f11d98a8c762-hostroot\") pod \"multus-8jxnm\" (UID: \"7fcc3970-f944-4fcf-b05e-f11d98a8c762\") " pod="openshift-multus/multus-8jxnm"
Jul 08 16:34:29.320349 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.320320    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-6wnfv"
Jul 08 16:34:29.330482 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.330452    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-6wnfv"
Jul 08 16:34:29.377148 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.376940    2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 08 16:34:29.399011 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.398980    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8eb4f440-8261-4651-a10a-1ccd5cb14f60-metrics-certs\") pod \"network-metrics-daemon-psbhw\" (UID: \"8eb4f440-8261-4651-a10a-1ccd5cb14f60\") " pod="openshift-multus/network-metrics-daemon-psbhw"
Jul 08 16:34:29.399112 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.399019    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pc22\" (UniqueName: \"kubernetes.io/projected/86d48853-e62e-4e54-be35-0ca4e37e6a46-kube-api-access-4pc22\") pod \"iptables-alerter-qwddx\" (UID: \"86d48853-e62e-4e54-be35-0ca4e37e6a46\") " pod="openshift-network-operator/iptables-alerter-qwddx"
Jul 08 16:34:29.399112 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.399039    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/be4b1f03-839c-4f8d-a037-498b6a7bb608-etc-sysctl-d\") pod \"tuned-kkm4w\" (UID: \"be4b1f03-839c-4f8d-a037-498b6a7bb608\") " pod="openshift-cluster-node-tuning-operator/tuned-kkm4w"
Jul 08 16:34:29.399112 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.399057    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4c07e006-6cb2-4bcf-9fba-751d0c4630b3-run-ovn\") pod \"ovnkube-node-jxfhc\" (UID: \"4c07e006-6cb2-4bcf-9fba-751d0c4630b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:29.399112 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.399103    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4c07e006-6cb2-4bcf-9fba-751d0c4630b3-run-ovn\") pod \"ovnkube-node-jxfhc\" (UID: \"4c07e006-6cb2-4bcf-9fba-751d0c4630b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:29.399371 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.399125    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c07e006-6cb2-4bcf-9fba-751d0c4630b3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jxfhc\" (UID: \"4c07e006-6cb2-4bcf-9fba-751d0c4630b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:29.399371 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.399142    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7fcc3970-f944-4fcf-b05e-f11d98a8c762-hostroot\") pod \"multus-8jxnm\" (UID: \"7fcc3970-f944-4fcf-b05e-f11d98a8c762\") " pod="openshift-multus/multus-8jxnm"
Jul 08 16:34:29.399371 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.399156    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8fec5c78-b2b7-4e3f-a4b3-75289b3bb33f-socket-dir\") pod \"aws-ebs-csi-driver-node-tsmnd\" (UID: \"8fec5c78-b2b7-4e3f-a4b3-75289b3bb33f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsmnd"
Jul 08 16:34:29.399371 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.399171    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/be4b1f03-839c-4f8d-a037-498b6a7bb608-etc-modprobe-d\") pod \"tuned-kkm4w\" (UID: \"be4b1f03-839c-4f8d-a037-498b6a7bb608\") " pod="openshift-cluster-node-tuning-operator/tuned-kkm4w"
Jul 08 16:34:29.399371 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.399165    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/be4b1f03-839c-4f8d-a037-498b6a7bb608-etc-sysctl-d\") pod \"tuned-kkm4w\" (UID: \"be4b1f03-839c-4f8d-a037-498b6a7bb608\") " pod="openshift-cluster-node-tuning-operator/tuned-kkm4w"
Jul 08 16:34:29.399371 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.399185    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c07e006-6cb2-4bcf-9fba-751d0c4630b3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jxfhc\" (UID: \"4c07e006-6cb2-4bcf-9fba-751d0c4630b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:29.399371 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.399185    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7fcc3970-f944-4fcf-b05e-f11d98a8c762-host-var-lib-cni-bin\") pod \"multus-8jxnm\" (UID: \"7fcc3970-f944-4fcf-b05e-f11d98a8c762\") " pod="openshift-multus/multus-8jxnm"
Jul 08 16:34:29.399371 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.399265    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7fcc3970-f944-4fcf-b05e-f11d98a8c762-host-var-lib-cni-bin\") pod \"multus-8jxnm\" (UID: \"7fcc3970-f944-4fcf-b05e-f11d98a8c762\") " pod="openshift-multus/multus-8jxnm"
Jul 08 16:34:29.399371 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.399265    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/682207f0-d9fc-46ac-a563-e0eb62eb3019-os-release\") pod \"multus-additional-cni-plugins-6xpv2\" (UID: \"682207f0-d9fc-46ac-a563-e0eb62eb3019\") " pod="openshift-multus/multus-additional-cni-plugins-6xpv2"
Jul 08 16:34:29.399371 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.399287    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8fec5c78-b2b7-4e3f-a4b3-75289b3bb33f-socket-dir\") pod \"aws-ebs-csi-driver-node-tsmnd\" (UID: \"8fec5c78-b2b7-4e3f-a4b3-75289b3bb33f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsmnd"
Jul 08 16:34:29.399371 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.399318    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7fcc3970-f944-4fcf-b05e-f11d98a8c762-hostroot\") pod \"multus-8jxnm\" (UID: \"7fcc3970-f944-4fcf-b05e-f11d98a8c762\") " pod="openshift-multus/multus-8jxnm"
Jul 08 16:34:29.399371 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.399318    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/be4b1f03-839c-4f8d-a037-498b6a7bb608-etc-modprobe-d\") pod \"tuned-kkm4w\" (UID: \"be4b1f03-839c-4f8d-a037-498b6a7bb608\") " pod="openshift-cluster-node-tuning-operator/tuned-kkm4w"
Jul 08 16:34:29.399371 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.399324    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4c07e006-6cb2-4bcf-9fba-751d0c4630b3-host-slash\") pod \"ovnkube-node-jxfhc\" (UID: \"4c07e006-6cb2-4bcf-9fba-751d0c4630b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:29.399371 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.399359    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4c07e006-6cb2-4bcf-9fba-751d0c4630b3-host-slash\") pod \"ovnkube-node-jxfhc\" (UID: \"4c07e006-6cb2-4bcf-9fba-751d0c4630b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:29.399891 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.399398    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c07e006-6cb2-4bcf-9fba-751d0c4630b3-var-lib-openvswitch\") pod \"ovnkube-node-jxfhc\" (UID: \"4c07e006-6cb2-4bcf-9fba-751d0c4630b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:29.399891 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.399423    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c07e006-6cb2-4bcf-9fba-751d0c4630b3-var-lib-openvswitch\") pod \"ovnkube-node-jxfhc\" (UID: \"4c07e006-6cb2-4bcf-9fba-751d0c4630b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:29.399891 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.399425    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c07e006-6cb2-4bcf-9fba-751d0c4630b3-run-openvswitch\") pod \"ovnkube-node-jxfhc\" (UID: \"4c07e006-6cb2-4bcf-9fba-751d0c4630b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:29.399891 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.399455    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c07e006-6cb2-4bcf-9fba-751d0c4630b3-run-openvswitch\") pod \"ovnkube-node-jxfhc\" (UID: \"4c07e006-6cb2-4bcf-9fba-751d0c4630b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:29.399891 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.399459    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/682207f0-d9fc-46ac-a563-e0eb62eb3019-cnibin\") pod \"multus-additional-cni-plugins-6xpv2\" (UID: \"682207f0-d9fc-46ac-a563-e0eb62eb3019\") " pod="openshift-multus/multus-additional-cni-plugins-6xpv2"
Jul 08 16:34:29.399891 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.399492    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/682207f0-d9fc-46ac-a563-e0eb62eb3019-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6xpv2\" (UID: \"682207f0-d9fc-46ac-a563-e0eb62eb3019\") " pod="openshift-multus/multus-additional-cni-plugins-6xpv2"
Jul 08 16:34:29.399891 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.399532    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkwc4\" (UniqueName: \"kubernetes.io/projected/682207f0-d9fc-46ac-a563-e0eb62eb3019-kube-api-access-gkwc4\") pod \"multus-additional-cni-plugins-6xpv2\" (UID: \"682207f0-d9fc-46ac-a563-e0eb62eb3019\") " pod="openshift-multus/multus-additional-cni-plugins-6xpv2"
Jul 08 16:34:29.399891 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.399550    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/462ebd3a-f548-4af5-8f83-20d342dc9441-agent-certs\") pod \"konnectivity-agent-plbcq\" (UID: \"462ebd3a-f548-4af5-8f83-20d342dc9441\") " pod="kube-system/konnectivity-agent-plbcq"
Jul 08 16:34:29.399891 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.399565    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/decd5d3d-7bca-4b32-bf8f-1d060e617e56-tmp-dir\") pod \"node-resolver-jzrk9\" (UID: \"decd5d3d-7bca-4b32-bf8f-1d060e617e56\") " pod="openshift-dns/node-resolver-jzrk9"
Jul 08 16:34:29.399891 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.399579    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9hnl\" (UniqueName: \"kubernetes.io/projected/decd5d3d-7bca-4b32-bf8f-1d060e617e56-kube-api-access-s9hnl\") pod \"node-resolver-jzrk9\" (UID: \"decd5d3d-7bca-4b32-bf8f-1d060e617e56\") " pod="openshift-dns/node-resolver-jzrk9"
Jul 08 16:34:29.399891 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.399594    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4c07e006-6cb2-4bcf-9fba-751d0c4630b3-host-cni-netd\") pod \"ovnkube-node-jxfhc\" (UID: \"4c07e006-6cb2-4bcf-9fba-751d0c4630b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:29.399891 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.399610    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5qdc\" (UniqueName: \"kubernetes.io/projected/8fec5c78-b2b7-4e3f-a4b3-75289b3bb33f-kube-api-access-g5qdc\") pod \"aws-ebs-csi-driver-node-tsmnd\" (UID: \"8fec5c78-b2b7-4e3f-a4b3-75289b3bb33f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsmnd"
Jul 08 16:34:29.399891 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.399633    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/462ebd3a-f548-4af5-8f83-20d342dc9441-konnectivity-ca\") pod \"konnectivity-agent-plbcq\" (UID: \"462ebd3a-f548-4af5-8f83-20d342dc9441\") " pod="kube-system/konnectivity-agent-plbcq"
Jul 08 16:34:29.399891 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.399658    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4c07e006-6cb2-4bcf-9fba-751d0c4630b3-host-cni-netd\") pod \"ovnkube-node-jxfhc\" (UID: \"4c07e006-6cb2-4bcf-9fba-751d0c4630b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:29.399891 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.399689    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/be4b1f03-839c-4f8d-a037-498b6a7bb608-etc-systemd\") pod \"tuned-kkm4w\" (UID: \"be4b1f03-839c-4f8d-a037-498b6a7bb608\") " pod="openshift-cluster-node-tuning-operator/tuned-kkm4w"
Jul 08 16:34:29.399891 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.399712    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdjbl\" (UniqueName: \"kubernetes.io/projected/be4b1f03-839c-4f8d-a037-498b6a7bb608-kube-api-access-xdjbl\") pod \"tuned-kkm4w\" (UID: \"be4b1f03-839c-4f8d-a037-498b6a7bb608\") " pod="openshift-cluster-node-tuning-operator/tuned-kkm4w"
Jul 08 16:34:29.399891 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.399734    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4606c816-49c0-450f-a21f-7594bf0aaa89-original-pull-secret\") pod \"global-pull-secret-syncer-6gvmb\" (UID: \"4606c816-49c0-450f-a21f-7594bf0aaa89\") " pod="kube-system/global-pull-secret-syncer-6gvmb"
Jul 08 16:34:29.400702 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.399758    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4c07e006-6cb2-4bcf-9fba-751d0c4630b3-host-run-netns\") pod \"ovnkube-node-jxfhc\" (UID: \"4c07e006-6cb2-4bcf-9fba-751d0c4630b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:29.400702 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.399780    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4c07e006-6cb2-4bcf-9fba-751d0c4630b3-run-systemd\") pod \"ovnkube-node-jxfhc\" (UID: \"4c07e006-6cb2-4bcf-9fba-751d0c4630b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:29.400702 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.399806    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7fcc3970-f944-4fcf-b05e-f11d98a8c762-multus-conf-dir\") pod \"multus-8jxnm\" (UID: \"7fcc3970-f944-4fcf-b05e-f11d98a8c762\") " pod="openshift-multus/multus-8jxnm"
Jul 08 16:34:29.400702 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.399830    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c07e006-6cb2-4bcf-9fba-751d0c4630b3-host-run-ovn-kubernetes\") pod \"ovnkube-node-jxfhc\" (UID: \"4c07e006-6cb2-4bcf-9fba-751d0c4630b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:29.400702 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.399852    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4c07e006-6cb2-4bcf-9fba-751d0c4630b3-env-overrides\") pod \"ovnkube-node-jxfhc\" (UID: \"4c07e006-6cb2-4bcf-9fba-751d0c4630b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:29.400702 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.399876    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7fcc3970-f944-4fcf-b05e-f11d98a8c762-multus-socket-dir-parent\") pod \"multus-8jxnm\" (UID: \"7fcc3970-f944-4fcf-b05e-f11d98a8c762\") " pod="openshift-multus/multus-8jxnm"
Jul 08 16:34:29.400702 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.399884    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/decd5d3d-7bca-4b32-bf8f-1d060e617e56-tmp-dir\") pod \"node-resolver-jzrk9\" (UID: \"decd5d3d-7bca-4b32-bf8f-1d060e617e56\") " pod="openshift-dns/node-resolver-jzrk9"
Jul 08 16:34:29.400702 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.399899    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7fcc3970-f944-4fcf-b05e-f11d98a8c762-etc-kubernetes\") pod \"multus-8jxnm\" (UID: \"7fcc3970-f944-4fcf-b05e-f11d98a8c762\") " pod="openshift-multus/multus-8jxnm"
Jul 08 16:34:29.400702 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:29.399904    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 16:34:29.400702 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.399915    2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 08 16:34:29.400702 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.399925    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6vt8\" (UniqueName: \"kubernetes.io/projected/8eb4f440-8261-4651-a10a-1ccd5cb14f60-kube-api-access-j6vt8\") pod \"network-metrics-daemon-psbhw\" (UID: \"8eb4f440-8261-4651-a10a-1ccd5cb14f60\") " pod="openshift-multus/network-metrics-daemon-psbhw"
Jul 08 16:34:29.400702 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.399949    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c07e006-6cb2-4bcf-9fba-751d0c4630b3-host-run-ovn-kubernetes\") pod \"ovnkube-node-jxfhc\" (UID: \"4c07e006-6cb2-4bcf-9fba-751d0c4630b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:29.400702 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.399953    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/86d48853-e62e-4e54-be35-0ca4e37e6a46-iptables-alerter-script\") pod \"iptables-alerter-qwddx\" (UID: \"86d48853-e62e-4e54-be35-0ca4e37e6a46\") " pod="openshift-network-operator/iptables-alerter-qwddx"
Jul 08 16:34:29.400702 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:29.400001    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4606c816-49c0-450f-a21f-7594bf0aaa89-original-pull-secret podName:4606c816-49c0-450f-a21f-7594bf0aaa89 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:29.899960483 +0000 UTC m=+4.000575031 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4606c816-49c0-450f-a21f-7594bf0aaa89-original-pull-secret") pod "global-pull-secret-syncer-6gvmb" (UID: "4606c816-49c0-450f-a21f-7594bf0aaa89") : object "kube-system"/"original-pull-secret" not registered
Jul 08 16:34:29.400702 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.400028    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4c07e006-6cb2-4bcf-9fba-751d0c4630b3-run-systemd\") pod \"ovnkube-node-jxfhc\" (UID: \"4c07e006-6cb2-4bcf-9fba-751d0c4630b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:29.400702 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.400067    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7fcc3970-f944-4fcf-b05e-f11d98a8c762-multus-conf-dir\") pod \"multus-8jxnm\" (UID: \"7fcc3970-f944-4fcf-b05e-f11d98a8c762\") " pod="openshift-multus/multus-8jxnm"
Jul 08 16:34:29.400702 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.400126    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/be4b1f03-839c-4f8d-a037-498b6a7bb608-etc-systemd\") pod \"tuned-kkm4w\" (UID: \"be4b1f03-839c-4f8d-a037-498b6a7bb608\") " pod="openshift-cluster-node-tuning-operator/tuned-kkm4w"
Jul 08 16:34:29.401599 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.400000    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4c07e006-6cb2-4bcf-9fba-751d0c4630b3-host-run-netns\") pod \"ovnkube-node-jxfhc\" (UID: \"4c07e006-6cb2-4bcf-9fba-751d0c4630b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:29.401599 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.400135    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7fcc3970-f944-4fcf-b05e-f11d98a8c762-multus-socket-dir-parent\") pod \"multus-8jxnm\" (UID: \"7fcc3970-f944-4fcf-b05e-f11d98a8c762\") " pod="openshift-multus/multus-8jxnm"
Jul 08 16:34:29.401599 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.400165    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7fcc3970-f944-4fcf-b05e-f11d98a8c762-etc-kubernetes\") pod \"multus-8jxnm\" (UID: \"7fcc3970-f944-4fcf-b05e-f11d98a8c762\") " pod="openshift-multus/multus-8jxnm"
Jul 08 16:34:29.401599 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.400241    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8fec5c78-b2b7-4e3f-a4b3-75289b3bb33f-registration-dir\") pod \"aws-ebs-csi-driver-node-tsmnd\" (UID: \"8fec5c78-b2b7-4e3f-a4b3-75289b3bb33f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsmnd"
Jul 08 16:34:29.401599 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.400292    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8fec5c78-b2b7-4e3f-a4b3-75289b3bb33f-sys-fs\") pod \"aws-ebs-csi-driver-node-tsmnd\" (UID: \"8fec5c78-b2b7-4e3f-a4b3-75289b3bb33f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsmnd"
Jul 08 16:34:29.401599 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.400315    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c07e006-6cb2-4bcf-9fba-751d0c4630b3-host-kubelet\") pod \"ovnkube-node-jxfhc\" (UID: \"4c07e006-6cb2-4bcf-9fba-751d0c4630b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:29.401599 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.400335    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c07e006-6cb2-4bcf-9fba-751d0c4630b3-etc-openvswitch\") pod \"ovnkube-node-jxfhc\" (UID: \"4c07e006-6cb2-4bcf-9fba-751d0c4630b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:29.401599 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.400347    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8fec5c78-b2b7-4e3f-a4b3-75289b3bb33f-registration-dir\") pod \"aws-ebs-csi-driver-node-tsmnd\" (UID: \"8fec5c78-b2b7-4e3f-a4b3-75289b3bb33f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsmnd"
Jul 08 16:34:29.401599 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.400355    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4c07e006-6cb2-4bcf-9fba-751d0c4630b3-node-log\") pod \"ovnkube-node-jxfhc\" (UID: \"4c07e006-6cb2-4bcf-9fba-751d0c4630b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:29.401599 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.400369    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8fec5c78-b2b7-4e3f-a4b3-75289b3bb33f-sys-fs\") pod \"aws-ebs-csi-driver-node-tsmnd\" (UID: \"8fec5c78-b2b7-4e3f-a4b3-75289b3bb33f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsmnd"
Jul 08 16:34:29.401599 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.400375    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/be4b1f03-839c-4f8d-a037-498b6a7bb608-run\") pod \"tuned-kkm4w\" (UID: \"be4b1f03-839c-4f8d-a037-498b6a7bb608\") " pod="openshift-cluster-node-tuning-operator/tuned-kkm4w"
Jul 08 16:34:29.401599 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.400394    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c07e006-6cb2-4bcf-9fba-751d0c4630b3-host-kubelet\") pod \"ovnkube-node-jxfhc\" (UID: \"4c07e006-6cb2-4bcf-9fba-751d0c4630b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:29.401599 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.400398    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/462ebd3a-f548-4af5-8f83-20d342dc9441-konnectivity-ca\") pod \"konnectivity-agent-plbcq\" (UID: \"462ebd3a-f548-4af5-8f83-20d342dc9441\") " pod="kube-system/konnectivity-agent-plbcq"
Jul 08 16:34:29.401599 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.400424    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be4b1f03-839c-4f8d-a037-498b6a7bb608-tmp\") pod \"tuned-kkm4w\" (UID: \"be4b1f03-839c-4f8d-a037-498b6a7bb608\") " pod="openshift-cluster-node-tuning-operator/tuned-kkm4w"
Jul 08 16:34:29.401599 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.400433    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4c07e006-6cb2-4bcf-9fba-751d0c4630b3-env-overrides\") pod \"ovnkube-node-jxfhc\" (UID: \"4c07e006-6cb2-4bcf-9fba-751d0c4630b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:29.401599 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.400413    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/be4b1f03-839c-4f8d-a037-498b6a7bb608-run\") pod \"tuned-kkm4w\" (UID: \"be4b1f03-839c-4f8d-a037-498b6a7bb608\") " pod="openshift-cluster-node-tuning-operator/tuned-kkm4w"
Jul 08 16:34:29.401599 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.400454    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/decd5d3d-7bca-4b32-bf8f-1d060e617e56-hosts-file\") pod \"node-resolver-jzrk9\" (UID: \"decd5d3d-7bca-4b32-bf8f-1d060e617e56\") " pod="openshift-dns/node-resolver-jzrk9"
Jul 08 16:34:29.401599 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.400436    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c07e006-6cb2-4bcf-9fba-751d0c4630b3-etc-openvswitch\") pod \"ovnkube-node-jxfhc\" (UID: \"4c07e006-6cb2-4bcf-9fba-751d0c4630b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:29.402741 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.400439    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4c07e006-6cb2-4bcf-9fba-751d0c4630b3-node-log\") pod \"ovnkube-node-jxfhc\" (UID: \"4c07e006-6cb2-4bcf-9fba-751d0c4630b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:29.402741 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.400489    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4c07e006-6cb2-4bcf-9fba-751d0c4630b3-log-socket\") pod \"ovnkube-node-jxfhc\" (UID: \"4c07e006-6cb2-4bcf-9fba-751d0c4630b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:29.402741 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.400519    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/decd5d3d-7bca-4b32-bf8f-1d060e617e56-hosts-file\") pod \"node-resolver-jzrk9\" (UID: \"decd5d3d-7bca-4b32-bf8f-1d060e617e56\") " pod="openshift-dns/node-resolver-jzrk9"
Jul 08 16:34:29.402741 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.400558    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4c07e006-6cb2-4bcf-9fba-751d0c4630b3-ovnkube-script-lib\") pod \"ovnkube-node-jxfhc\" (UID: \"4c07e006-6cb2-4bcf-9fba-751d0c4630b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:29.402741 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.400569    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4c07e006-6cb2-4bcf-9fba-751d0c4630b3-log-socket\") pod \"ovnkube-node-jxfhc\" (UID: \"4c07e006-6cb2-4bcf-9fba-751d0c4630b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:29.402741 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.400603    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8fec5c78-b2b7-4e3f-a4b3-75289b3bb33f-device-dir\") pod \"aws-ebs-csi-driver-node-tsmnd\" (UID: \"8fec5c78-b2b7-4e3f-a4b3-75289b3bb33f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsmnd"
Jul 08 16:34:29.402741 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.400653    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8fec5c78-b2b7-4e3f-a4b3-75289b3bb33f-device-dir\") pod \"aws-ebs-csi-driver-node-tsmnd\" (UID: \"8fec5c78-b2b7-4e3f-a4b3-75289b3bb33f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsmnd"
Jul 08 16:34:29.402741 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.400668    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8fec5c78-b2b7-4e3f-a4b3-75289b3bb33f-etc-selinux\") pod \"aws-ebs-csi-driver-node-tsmnd\" (UID: \"8fec5c78-b2b7-4e3f-a4b3-75289b3bb33f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsmnd"
Jul 08 16:34:29.402741 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.400698    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/be4b1f03-839c-4f8d-a037-498b6a7bb608-etc-kubernetes\") pod \"tuned-kkm4w\" (UID: \"be4b1f03-839c-4f8d-a037-498b6a7bb608\") " pod="openshift-cluster-node-tuning-operator/tuned-kkm4w"
Jul 08 16:34:29.402741 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.400702    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8fec5c78-b2b7-4e3f-a4b3-75289b3bb33f-etc-selinux\") pod \"aws-ebs-csi-driver-node-tsmnd\" (UID: \"8fec5c78-b2b7-4e3f-a4b3-75289b3bb33f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsmnd"
Jul 08 16:34:29.402741 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.400719    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/be4b1f03-839c-4f8d-a037-498b6a7bb608-sys\") pod \"tuned-kkm4w\" (UID: \"be4b1f03-839c-4f8d-a037-498b6a7bb608\") " pod="openshift-cluster-node-tuning-operator/tuned-kkm4w"
Jul 08 16:34:29.402741 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.400746    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7fcc3970-f944-4fcf-b05e-f11d98a8c762-host-run-k8s-cni-cncf-io\") pod \"multus-8jxnm\" (UID: \"7fcc3970-f944-4fcf-b05e-f11d98a8c762\") " pod="openshift-multus/multus-8jxnm"
Jul 08 16:34:29.402741 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.400752    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/be4b1f03-839c-4f8d-a037-498b6a7bb608-etc-kubernetes\") pod \"tuned-kkm4w\" (UID: \"be4b1f03-839c-4f8d-a037-498b6a7bb608\") " pod="openshift-cluster-node-tuning-operator/tuned-kkm4w"
Jul 08 16:34:29.402741 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.400775    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/be4b1f03-839c-4f8d-a037-498b6a7bb608-lib-modules\") pod \"tuned-kkm4w\" (UID: \"be4b1f03-839c-4f8d-a037-498b6a7bb608\") " pod="openshift-cluster-node-tuning-operator/tuned-kkm4w"
Jul 08 16:34:29.402741 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.400796    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4c07e006-6cb2-4bcf-9fba-751d0c4630b3-ovnkube-config\") pod \"ovnkube-node-jxfhc\" (UID: \"4c07e006-6cb2-4bcf-9fba-751d0c4630b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:29.402741 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.400823    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8fec5c78-b2b7-4e3f-a4b3-75289b3bb33f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tsmnd\" (UID: \"8fec5c78-b2b7-4e3f-a4b3-75289b3bb33f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsmnd"
Jul 08 16:34:29.402741 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.400848    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/be4b1f03-839c-4f8d-a037-498b6a7bb608-etc-tuned\") pod \"tuned-kkm4w\" (UID: \"be4b1f03-839c-4f8d-a037-498b6a7bb608\") " pod="openshift-cluster-node-tuning-operator/tuned-kkm4w"
Jul 08 16:34:29.403876 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.400869    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/be4b1f03-839c-4f8d-a037-498b6a7bb608-lib-modules\") pod \"tuned-kkm4w\" (UID: \"be4b1f03-839c-4f8d-a037-498b6a7bb608\") " pod="openshift-cluster-node-tuning-operator/tuned-kkm4w"
Jul 08 16:34:29.403876 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.400872    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/455653e2-cc9e-4e39-a2b6-013b392b9d47-host\") pod \"node-ca-t8k5z\" (UID: \"455653e2-cc9e-4e39-a2b6-013b392b9d47\") " pod="openshift-image-registry/node-ca-t8k5z"
Jul 08 16:34:29.403876 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.400905    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/455653e2-cc9e-4e39-a2b6-013b392b9d47-host\") pod \"node-ca-t8k5z\" (UID: \"455653e2-cc9e-4e39-a2b6-013b392b9d47\") " pod="openshift-image-registry/node-ca-t8k5z"
Jul 08 16:34:29.403876 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.400796    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7fcc3970-f944-4fcf-b05e-f11d98a8c762-host-run-k8s-cni-cncf-io\") pod \"multus-8jxnm\" (UID: \"7fcc3970-f944-4fcf-b05e-f11d98a8c762\") " pod="openshift-multus/multus-8jxnm"
Jul 08 16:34:29.403876 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.400907    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4606c816-49c0-450f-a21f-7594bf0aaa89-kubelet-config\") pod \"global-pull-secret-syncer-6gvmb\" (UID: \"4606c816-49c0-450f-a21f-7594bf0aaa89\") " pod="kube-system/global-pull-secret-syncer-6gvmb"
Jul 08 16:34:29.403876 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.400958    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8fec5c78-b2b7-4e3f-a4b3-75289b3bb33f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tsmnd\" (UID: \"8fec5c78-b2b7-4e3f-a4b3-75289b3bb33f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsmnd"
Jul 08 16:34:29.403876 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.400961    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4606c816-49c0-450f-a21f-7594bf0aaa89-dbus\") pod \"global-pull-secret-syncer-6gvmb\" (UID: \"4606c816-49c0-450f-a21f-7594bf0aaa89\") " pod="kube-system/global-pull-secret-syncer-6gvmb"
Jul 08 16:34:29.403876 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.400823    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/be4b1f03-839c-4f8d-a037-498b6a7bb608-sys\") pod \"tuned-kkm4w\" (UID: \"be4b1f03-839c-4f8d-a037-498b6a7bb608\") " pod="openshift-cluster-node-tuning-operator/tuned-kkm4w"
Jul 08 16:34:29.403876 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.400991    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7fcc3970-f944-4fcf-b05e-f11d98a8c762-cnibin\") pod \"multus-8jxnm\" (UID: \"7fcc3970-f944-4fcf-b05e-f11d98a8c762\") " pod="openshift-multus/multus-8jxnm"
Jul 08 16:34:29.403876 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.401018    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/682207f0-d9fc-46ac-a563-e0eb62eb3019-cni-binary-copy\") pod \"multus-additional-cni-plugins-6xpv2\" (UID: \"682207f0-d9fc-46ac-a563-e0eb62eb3019\") " pod="openshift-multus/multus-additional-cni-plugins-6xpv2"
Jul 08 16:34:29.403876 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.401045    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/682207f0-d9fc-46ac-a563-e0eb62eb3019-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6xpv2\" (UID: \"682207f0-d9fc-46ac-a563-e0eb62eb3019\") " pod="openshift-multus/multus-additional-cni-plugins-6xpv2"
Jul 08 16:34:29.403876 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.401055    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4606c816-49c0-450f-a21f-7594bf0aaa89-dbus\") pod \"global-pull-secret-syncer-6gvmb\" (UID: \"4606c816-49c0-450f-a21f-7594bf0aaa89\") " pod="kube-system/global-pull-secret-syncer-6gvmb"
Jul 08 16:34:29.403876 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.401072    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfnkm\" (UniqueName: \"kubernetes.io/projected/24e40bdc-44ee-4c05-8e65-bd4a3842a5cd-kube-api-access-zfnkm\") pod \"network-check-target-fftjw\" (UID: \"24e40bdc-44ee-4c05-8e65-bd4a3842a5cd\") " pod="openshift-network-diagnostics/network-check-target-fftjw"
Jul 08 16:34:29.403876 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.401096    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/455653e2-cc9e-4e39-a2b6-013b392b9d47-serviceca\") pod \"node-ca-t8k5z\" (UID: \"455653e2-cc9e-4e39-a2b6-013b392b9d47\") " pod="openshift-image-registry/node-ca-t8k5z"
Jul 08 16:34:29.403876 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.401100    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4606c816-49c0-450f-a21f-7594bf0aaa89-kubelet-config\") pod \"global-pull-secret-syncer-6gvmb\" (UID: \"4606c816-49c0-450f-a21f-7594bf0aaa89\") " pod="kube-system/global-pull-secret-syncer-6gvmb"
Jul 08 16:34:29.403876 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.401120    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4c07e006-6cb2-4bcf-9fba-751d0c4630b3-host-cni-bin\") pod \"ovnkube-node-jxfhc\" (UID: \"4c07e006-6cb2-4bcf-9fba-751d0c4630b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:29.403876 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.401145    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7fcc3970-f944-4fcf-b05e-f11d98a8c762-system-cni-dir\") pod \"multus-8jxnm\" (UID: \"7fcc3970-f944-4fcf-b05e-f11d98a8c762\") " pod="openshift-multus/multus-8jxnm"
Jul 08 16:34:29.403876 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.401176    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7fcc3970-f944-4fcf-b05e-f11d98a8c762-os-release\") pod \"multus-8jxnm\" (UID: \"7fcc3970-f944-4fcf-b05e-f11d98a8c762\") " pod="openshift-multus/multus-8jxnm"
Jul 08 16:34:29.405049 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.401201    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7fcc3970-f944-4fcf-b05e-f11d98a8c762-host-run-netns\") pod \"multus-8jxnm\" (UID: \"7fcc3970-f944-4fcf-b05e-f11d98a8c762\") " pod="openshift-multus/multus-8jxnm"
Jul 08 16:34:29.405049 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.401234    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4c07e006-6cb2-4bcf-9fba-751d0c4630b3-ovnkube-script-lib\") pod \"ovnkube-node-jxfhc\" (UID: \"4c07e006-6cb2-4bcf-9fba-751d0c4630b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:29.405049 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.401283    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/86d48853-e62e-4e54-be35-0ca4e37e6a46-host-slash\") pod \"iptables-alerter-qwddx\" (UID: \"86d48853-e62e-4e54-be35-0ca4e37e6a46\") " pod="openshift-network-operator/iptables-alerter-qwddx"
Jul 08 16:34:29.405049 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.401288    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7fcc3970-f944-4fcf-b05e-f11d98a8c762-host-run-netns\") pod \"multus-8jxnm\" (UID: \"7fcc3970-f944-4fcf-b05e-f11d98a8c762\") " pod="openshift-multus/multus-8jxnm"
Jul 08 16:34:29.405049 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.401288    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4c07e006-6cb2-4bcf-9fba-751d0c4630b3-ovnkube-config\") pod \"ovnkube-node-jxfhc\" (UID: \"4c07e006-6cb2-4bcf-9fba-751d0c4630b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:29.405049 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.401337    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7fcc3970-f944-4fcf-b05e-f11d98a8c762-cnibin\") pod \"multus-8jxnm\" (UID: \"7fcc3970-f944-4fcf-b05e-f11d98a8c762\") " pod="openshift-multus/multus-8jxnm"
Jul 08 16:34:29.405049 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.401359    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/be4b1f03-839c-4f8d-a037-498b6a7bb608-etc-sysconfig\") pod \"tuned-kkm4w\" (UID: \"be4b1f03-839c-4f8d-a037-498b6a7bb608\") " pod="openshift-cluster-node-tuning-operator/tuned-kkm4w"
Jul 08 16:34:29.405049 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.401388    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4c07e006-6cb2-4bcf-9fba-751d0c4630b3-host-cni-bin\") pod \"ovnkube-node-jxfhc\" (UID: \"4c07e006-6cb2-4bcf-9fba-751d0c4630b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:29.405049 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.401425    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4c07e006-6cb2-4bcf-9fba-751d0c4630b3-systemd-units\") pod \"ovnkube-node-jxfhc\" (UID: \"4c07e006-6cb2-4bcf-9fba-751d0c4630b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:29.405049 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.401437    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/be4b1f03-839c-4f8d-a037-498b6a7bb608-etc-sysconfig\") pod \"tuned-kkm4w\" (UID: \"be4b1f03-839c-4f8d-a037-498b6a7bb608\") " pod="openshift-cluster-node-tuning-operator/tuned-kkm4w"
Jul 08 16:34:29.405049 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.401439    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7fcc3970-f944-4fcf-b05e-f11d98a8c762-os-release\") pod \"multus-8jxnm\" (UID: \"7fcc3970-f944-4fcf-b05e-f11d98a8c762\") " pod="openshift-multus/multus-8jxnm"
Jul 08 16:34:29.405049 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.401453    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7fcc3970-f944-4fcf-b05e-f11d98a8c762-host-var-lib-cni-multus\") pod \"multus-8jxnm\" (UID: \"7fcc3970-f944-4fcf-b05e-f11d98a8c762\") " pod="openshift-multus/multus-8jxnm"
Jul 08 16:34:29.405049 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.401485    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7fcc3970-f944-4fcf-b05e-f11d98a8c762-system-cni-dir\") pod \"multus-8jxnm\" (UID: \"7fcc3970-f944-4fcf-b05e-f11d98a8c762\") " pod="openshift-multus/multus-8jxnm"
Jul 08 16:34:29.405049 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.401478    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4c07e006-6cb2-4bcf-9fba-751d0c4630b3-systemd-units\") pod \"ovnkube-node-jxfhc\" (UID: \"4c07e006-6cb2-4bcf-9fba-751d0c4630b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:29.405049 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.401540    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7fcc3970-f944-4fcf-b05e-f11d98a8c762-host-var-lib-cni-multus\") pod \"multus-8jxnm\" (UID: \"7fcc3970-f944-4fcf-b05e-f11d98a8c762\") " pod="openshift-multus/multus-8jxnm"
Jul 08 16:34:29.405049 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.401568    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7fcc3970-f944-4fcf-b05e-f11d98a8c762-host-var-lib-kubelet\") pod \"multus-8jxnm\" (UID: \"7fcc3970-f944-4fcf-b05e-f11d98a8c762\") " pod="openshift-multus/multus-8jxnm"
Jul 08 16:34:29.405049 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.401610    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/682207f0-d9fc-46ac-a563-e0eb62eb3019-system-cni-dir\") pod \"multus-additional-cni-plugins-6xpv2\" (UID: \"682207f0-d9fc-46ac-a563-e0eb62eb3019\") " pod="openshift-multus/multus-additional-cni-plugins-6xpv2"
Jul 08 16:34:29.405049 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.401621    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7fcc3970-f944-4fcf-b05e-f11d98a8c762-host-var-lib-kubelet\") pod \"multus-8jxnm\" (UID: \"7fcc3970-f944-4fcf-b05e-f11d98a8c762\") " pod="openshift-multus/multus-8jxnm"
Jul 08 16:34:29.405981 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.401660    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be4b1f03-839c-4f8d-a037-498b6a7bb608-var-lib-kubelet\") pod \"tuned-kkm4w\" (UID: \"be4b1f03-839c-4f8d-a037-498b6a7bb608\") " pod="openshift-cluster-node-tuning-operator/tuned-kkm4w"
Jul 08 16:34:29.405981 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.401695    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/be4b1f03-839c-4f8d-a037-498b6a7bb608-host\") pod \"tuned-kkm4w\" (UID: \"be4b1f03-839c-4f8d-a037-498b6a7bb608\") " pod="openshift-cluster-node-tuning-operator/tuned-kkm4w"
Jul 08 16:34:29.405981 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.401725    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be4b1f03-839c-4f8d-a037-498b6a7bb608-var-lib-kubelet\") pod \"tuned-kkm4w\" (UID: \"be4b1f03-839c-4f8d-a037-498b6a7bb608\") " pod="openshift-cluster-node-tuning-operator/tuned-kkm4w"
Jul 08 16:34:29.405981 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.401727    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mht5l\" (UniqueName: \"kubernetes.io/projected/455653e2-cc9e-4e39-a2b6-013b392b9d47-kube-api-access-mht5l\") pod \"node-ca-t8k5z\" (UID: \"455653e2-cc9e-4e39-a2b6-013b392b9d47\") " pod="openshift-image-registry/node-ca-t8k5z"
Jul 08 16:34:29.405981 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.401749    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/be4b1f03-839c-4f8d-a037-498b6a7bb608-host\") pod \"tuned-kkm4w\" (UID: \"be4b1f03-839c-4f8d-a037-498b6a7bb608\") " pod="openshift-cluster-node-tuning-operator/tuned-kkm4w"
Jul 08 16:34:29.405981 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.401818    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7x67x\" (UniqueName: \"kubernetes.io/projected/4c07e006-6cb2-4bcf-9fba-751d0c4630b3-kube-api-access-7x67x\") pod \"ovnkube-node-jxfhc\" (UID: \"4c07e006-6cb2-4bcf-9fba-751d0c4630b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:29.405981 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.401865    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7fcc3970-f944-4fcf-b05e-f11d98a8c762-host-run-multus-certs\") pod \"multus-8jxnm\" (UID: \"7fcc3970-f944-4fcf-b05e-f11d98a8c762\") " pod="openshift-multus/multus-8jxnm"
Jul 08 16:34:29.405981 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.401896    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/682207f0-d9fc-46ac-a563-e0eb62eb3019-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6xpv2\" (UID: \"682207f0-d9fc-46ac-a563-e0eb62eb3019\") " pod="openshift-multus/multus-additional-cni-plugins-6xpv2"
Jul 08 16:34:29.405981 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.401918    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7fcc3970-f944-4fcf-b05e-f11d98a8c762-host-run-multus-certs\") pod \"multus-8jxnm\" (UID: \"7fcc3970-f944-4fcf-b05e-f11d98a8c762\") " pod="openshift-multus/multus-8jxnm"
Jul 08 16:34:29.405981 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.401923    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/be4b1f03-839c-4f8d-a037-498b6a7bb608-etc-sysctl-conf\") pod \"tuned-kkm4w\" (UID: \"be4b1f03-839c-4f8d-a037-498b6a7bb608\") " pod="openshift-cluster-node-tuning-operator/tuned-kkm4w"
Jul 08 16:34:29.405981 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.401972    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7fcc3970-f944-4fcf-b05e-f11d98a8c762-multus-cni-dir\") pod \"multus-8jxnm\" (UID: \"7fcc3970-f944-4fcf-b05e-f11d98a8c762\") " pod="openshift-multus/multus-8jxnm"
Jul 08 16:34:29.405981 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.402009    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/be4b1f03-839c-4f8d-a037-498b6a7bb608-etc-sysctl-conf\") pod \"tuned-kkm4w\" (UID: \"be4b1f03-839c-4f8d-a037-498b6a7bb608\") " pod="openshift-cluster-node-tuning-operator/tuned-kkm4w"
Jul 08 16:34:29.405981 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.401996    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7fcc3970-f944-4fcf-b05e-f11d98a8c762-cni-binary-copy\") pod \"multus-8jxnm\" (UID: \"7fcc3970-f944-4fcf-b05e-f11d98a8c762\") " pod="openshift-multus/multus-8jxnm"
Jul 08 16:34:29.405981 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.402046    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7fcc3970-f944-4fcf-b05e-f11d98a8c762-multus-daemon-config\") pod \"multus-8jxnm\" (UID: \"7fcc3970-f944-4fcf-b05e-f11d98a8c762\") " pod="openshift-multus/multus-8jxnm"
Jul 08 16:34:29.405981 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.402074    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4c07e006-6cb2-4bcf-9fba-751d0c4630b3-ovn-node-metrics-cert\") pod \"ovnkube-node-jxfhc\" (UID: \"4c07e006-6cb2-4bcf-9fba-751d0c4630b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:29.405981 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.402077    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7fcc3970-f944-4fcf-b05e-f11d98a8c762-multus-cni-dir\") pod \"multus-8jxnm\" (UID: \"7fcc3970-f944-4fcf-b05e-f11d98a8c762\") " pod="openshift-multus/multus-8jxnm"
Jul 08 16:34:29.405981 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.402099    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85jl6\" (UniqueName: \"kubernetes.io/projected/7fcc3970-f944-4fcf-b05e-f11d98a8c762-kube-api-access-85jl6\") pod \"multus-8jxnm\" (UID: \"7fcc3970-f944-4fcf-b05e-f11d98a8c762\") " pod="openshift-multus/multus-8jxnm"
Jul 08 16:34:29.405981 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.402668    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/455653e2-cc9e-4e39-a2b6-013b392b9d47-serviceca\") pod \"node-ca-t8k5z\" (UID: \"455653e2-cc9e-4e39-a2b6-013b392b9d47\") " pod="openshift-image-registry/node-ca-t8k5z"
Jul 08 16:34:29.406899 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.403182    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7fcc3970-f944-4fcf-b05e-f11d98a8c762-cni-binary-copy\") pod \"multus-8jxnm\" (UID: \"7fcc3970-f944-4fcf-b05e-f11d98a8c762\") " pod="openshift-multus/multus-8jxnm"
Jul 08 16:34:29.406899 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.403263    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7fcc3970-f944-4fcf-b05e-f11d98a8c762-multus-daemon-config\") pod \"multus-8jxnm\" (UID: \"7fcc3970-f944-4fcf-b05e-f11d98a8c762\") " pod="openshift-multus/multus-8jxnm"
Jul 08 16:34:29.406899 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.403681    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be4b1f03-839c-4f8d-a037-498b6a7bb608-tmp\") pod \"tuned-kkm4w\" (UID: \"be4b1f03-839c-4f8d-a037-498b6a7bb608\") " pod="openshift-cluster-node-tuning-operator/tuned-kkm4w"
Jul 08 16:34:29.406899 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.403896    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/462ebd3a-f548-4af5-8f83-20d342dc9441-agent-certs\") pod \"konnectivity-agent-plbcq\" (UID: \"462ebd3a-f548-4af5-8f83-20d342dc9441\") " pod="kube-system/konnectivity-agent-plbcq"
Jul 08 16:34:29.406899 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.404705    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/be4b1f03-839c-4f8d-a037-498b6a7bb608-etc-tuned\") pod \"tuned-kkm4w\" (UID: \"be4b1f03-839c-4f8d-a037-498b6a7bb608\") " pod="openshift-cluster-node-tuning-operator/tuned-kkm4w"
Jul 08 16:34:29.406899 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.405144    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4c07e006-6cb2-4bcf-9fba-751d0c4630b3-ovn-node-metrics-cert\") pod \"ovnkube-node-jxfhc\" (UID: \"4c07e006-6cb2-4bcf-9fba-751d0c4630b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:29.418214 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:29.418188    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 16:34:29.418214 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:29.418235    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 16:34:29.418498 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:29.418250    2565 projected.go:196] Error preparing data for projected volume kube-api-access-zfnkm for pod openshift-network-diagnostics/network-check-target-fftjw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 16:34:29.418498 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:29.418336    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/24e40bdc-44ee-4c05-8e65-bd4a3842a5cd-kube-api-access-zfnkm podName:24e40bdc-44ee-4c05-8e65-bd4a3842a5cd nodeName:}" failed. No retries permitted until 2026-07-08 16:34:29.918318516 +0000 UTC m=+4.018933064 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-zfnkm" (UniqueName: "kubernetes.io/projected/24e40bdc-44ee-4c05-8e65-bd4a3842a5cd-kube-api-access-zfnkm") pod "network-check-target-fftjw" (UID: "24e40bdc-44ee-4c05-8e65-bd4a3842a5cd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 16:34:29.418648 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.418627    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdjbl\" (UniqueName: \"kubernetes.io/projected/be4b1f03-839c-4f8d-a037-498b6a7bb608-kube-api-access-xdjbl\") pod \"tuned-kkm4w\" (UID: \"be4b1f03-839c-4f8d-a037-498b6a7bb608\") " pod="openshift-cluster-node-tuning-operator/tuned-kkm4w"
Jul 08 16:34:29.420304 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.420017    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7x67x\" (UniqueName: \"kubernetes.io/projected/4c07e006-6cb2-4bcf-9fba-751d0c4630b3-kube-api-access-7x67x\") pod \"ovnkube-node-jxfhc\" (UID: \"4c07e006-6cb2-4bcf-9fba-751d0c4630b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:29.420304 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.420154    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9hnl\" (UniqueName: \"kubernetes.io/projected/decd5d3d-7bca-4b32-bf8f-1d060e617e56-kube-api-access-s9hnl\") pod \"node-resolver-jzrk9\" (UID: \"decd5d3d-7bca-4b32-bf8f-1d060e617e56\") " pod="openshift-dns/node-resolver-jzrk9"
Jul 08 16:34:29.420502 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.420482    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85jl6\" (UniqueName: \"kubernetes.io/projected/7fcc3970-f944-4fcf-b05e-f11d98a8c762-kube-api-access-85jl6\") pod \"multus-8jxnm\" (UID: \"7fcc3970-f944-4fcf-b05e-f11d98a8c762\") " pod="openshift-multus/multus-8jxnm"
Jul 08 16:34:29.420766 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.420743    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mht5l\" (UniqueName: \"kubernetes.io/projected/455653e2-cc9e-4e39-a2b6-013b392b9d47-kube-api-access-mht5l\") pod \"node-ca-t8k5z\" (UID: \"455653e2-cc9e-4e39-a2b6-013b392b9d47\") " pod="openshift-image-registry/node-ca-t8k5z"
Jul 08 16:34:29.421825 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.421806    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5qdc\" (UniqueName: \"kubernetes.io/projected/8fec5c78-b2b7-4e3f-a4b3-75289b3bb33f-kube-api-access-g5qdc\") pod \"aws-ebs-csi-driver-node-tsmnd\" (UID: \"8fec5c78-b2b7-4e3f-a4b3-75289b3bb33f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsmnd"
Jul 08 16:34:29.502662 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.502565    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/682207f0-d9fc-46ac-a563-e0eb62eb3019-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6xpv2\" (UID: \"682207f0-d9fc-46ac-a563-e0eb62eb3019\") " pod="openshift-multus/multus-additional-cni-plugins-6xpv2"
Jul 08 16:34:29.502662 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.502604    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8eb4f440-8261-4651-a10a-1ccd5cb14f60-metrics-certs\") pod \"network-metrics-daemon-psbhw\" (UID: \"8eb4f440-8261-4651-a10a-1ccd5cb14f60\") " pod="openshift-multus/network-metrics-daemon-psbhw"
Jul 08 16:34:29.502662 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.502621    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pc22\" (UniqueName: \"kubernetes.io/projected/86d48853-e62e-4e54-be35-0ca4e37e6a46-kube-api-access-4pc22\") pod \"iptables-alerter-qwddx\" (UID: \"86d48853-e62e-4e54-be35-0ca4e37e6a46\") " pod="openshift-network-operator/iptables-alerter-qwddx"
Jul 08 16:34:29.502662 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.502641    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/682207f0-d9fc-46ac-a563-e0eb62eb3019-os-release\") pod \"multus-additional-cni-plugins-6xpv2\" (UID: \"682207f0-d9fc-46ac-a563-e0eb62eb3019\") " pod="openshift-multus/multus-additional-cni-plugins-6xpv2"
Jul 08 16:34:29.502662 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.502659    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/682207f0-d9fc-46ac-a563-e0eb62eb3019-cnibin\") pod \"multus-additional-cni-plugins-6xpv2\" (UID: \"682207f0-d9fc-46ac-a563-e0eb62eb3019\") " pod="openshift-multus/multus-additional-cni-plugins-6xpv2"
Jul 08 16:34:29.502980 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.502675    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/682207f0-d9fc-46ac-a563-e0eb62eb3019-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6xpv2\" (UID: \"682207f0-d9fc-46ac-a563-e0eb62eb3019\") " pod="openshift-multus/multus-additional-cni-plugins-6xpv2"
Jul 08 16:34:29.502980 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.502698    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkwc4\" (UniqueName: \"kubernetes.io/projected/682207f0-d9fc-46ac-a563-e0eb62eb3019-kube-api-access-gkwc4\") pod \"multus-additional-cni-plugins-6xpv2\" (UID: \"682207f0-d9fc-46ac-a563-e0eb62eb3019\") " pod="openshift-multus/multus-additional-cni-plugins-6xpv2"
Jul 08 16:34:29.502980 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:29.502781    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 16:34:29.503147 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.503120    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/682207f0-d9fc-46ac-a563-e0eb62eb3019-cnibin\") pod \"multus-additional-cni-plugins-6xpv2\" (UID: \"682207f0-d9fc-46ac-a563-e0eb62eb3019\") " pod="openshift-multus/multus-additional-cni-plugins-6xpv2"
Jul 08 16:34:29.503239 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.503191    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/682207f0-d9fc-46ac-a563-e0eb62eb3019-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6xpv2\" (UID: \"682207f0-d9fc-46ac-a563-e0eb62eb3019\") " pod="openshift-multus/multus-additional-cni-plugins-6xpv2"
Jul 08 16:34:29.503848 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:29.503379    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8eb4f440-8261-4651-a10a-1ccd5cb14f60-metrics-certs podName:8eb4f440-8261-4651-a10a-1ccd5cb14f60 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:30.002827616 +0000 UTC m=+4.103442183 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8eb4f440-8261-4651-a10a-1ccd5cb14f60-metrics-certs") pod "network-metrics-daemon-psbhw" (UID: "8eb4f440-8261-4651-a10a-1ccd5cb14f60") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 16:34:29.503848 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.503404    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/682207f0-d9fc-46ac-a563-e0eb62eb3019-os-release\") pod \"multus-additional-cni-plugins-6xpv2\" (UID: \"682207f0-d9fc-46ac-a563-e0eb62eb3019\") " pod="openshift-multus/multus-additional-cni-plugins-6xpv2"
Jul 08 16:34:29.503848 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.503424    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6vt8\" (UniqueName: \"kubernetes.io/projected/8eb4f440-8261-4651-a10a-1ccd5cb14f60-kube-api-access-j6vt8\") pod \"network-metrics-daemon-psbhw\" (UID: \"8eb4f440-8261-4651-a10a-1ccd5cb14f60\") " pod="openshift-multus/network-metrics-daemon-psbhw"
Jul 08 16:34:29.503848 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.503468    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/86d48853-e62e-4e54-be35-0ca4e37e6a46-iptables-alerter-script\") pod \"iptables-alerter-qwddx\" (UID: \"86d48853-e62e-4e54-be35-0ca4e37e6a46\") " pod="openshift-network-operator/iptables-alerter-qwddx"
Jul 08 16:34:29.503848 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.503520    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/682207f0-d9fc-46ac-a563-e0eb62eb3019-cni-binary-copy\") pod \"multus-additional-cni-plugins-6xpv2\" (UID: \"682207f0-d9fc-46ac-a563-e0eb62eb3019\") " pod="openshift-multus/multus-additional-cni-plugins-6xpv2"
Jul 08 16:34:29.503848 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.503561    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/682207f0-d9fc-46ac-a563-e0eb62eb3019-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6xpv2\" (UID: \"682207f0-d9fc-46ac-a563-e0eb62eb3019\") " pod="openshift-multus/multus-additional-cni-plugins-6xpv2"
Jul 08 16:34:29.503848 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.503573    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/682207f0-d9fc-46ac-a563-e0eb62eb3019-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6xpv2\" (UID: \"682207f0-d9fc-46ac-a563-e0eb62eb3019\") " pod="openshift-multus/multus-additional-cni-plugins-6xpv2"
Jul 08 16:34:29.503848 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.503747    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-172.ec2.internal" event={"ID":"deb4e2f36b206a55798df1285a775313","Type":"ContainerStarted","Data":"2b451b5c03fbe9afa80f72a54383350fc6ba023b471ea2b2e7c51b23fa6594d9"}
Jul 08 16:34:29.504331 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.503973    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/86d48853-e62e-4e54-be35-0ca4e37e6a46-host-slash\") pod \"iptables-alerter-qwddx\" (UID: \"86d48853-e62e-4e54-be35-0ca4e37e6a46\") " pod="openshift-network-operator/iptables-alerter-qwddx"
Jul 08 16:34:29.504331 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.504011    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/682207f0-d9fc-46ac-a563-e0eb62eb3019-system-cni-dir\") pod \"multus-additional-cni-plugins-6xpv2\" (UID: \"682207f0-d9fc-46ac-a563-e0eb62eb3019\") " pod="openshift-multus/multus-additional-cni-plugins-6xpv2"
Jul 08 16:34:29.504331 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.504180    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/682207f0-d9fc-46ac-a563-e0eb62eb3019-system-cni-dir\") pod \"multus-additional-cni-plugins-6xpv2\" (UID: \"682207f0-d9fc-46ac-a563-e0eb62eb3019\") " pod="openshift-multus/multus-additional-cni-plugins-6xpv2"
Jul 08 16:34:29.504458 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.504381    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/682207f0-d9fc-46ac-a563-e0eb62eb3019-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6xpv2\" (UID: \"682207f0-d9fc-46ac-a563-e0eb62eb3019\") " pod="openshift-multus/multus-additional-cni-plugins-6xpv2"
Jul 08 16:34:29.504506 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.504461    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/86d48853-e62e-4e54-be35-0ca4e37e6a46-iptables-alerter-script\") pod \"iptables-alerter-qwddx\" (UID: \"86d48853-e62e-4e54-be35-0ca4e37e6a46\") " pod="openshift-network-operator/iptables-alerter-qwddx"
Jul 08 16:34:29.504552 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.504497    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/86d48853-e62e-4e54-be35-0ca4e37e6a46-host-slash\") pod \"iptables-alerter-qwddx\" (UID: \"86d48853-e62e-4e54-be35-0ca4e37e6a46\") " pod="openshift-network-operator/iptables-alerter-qwddx"
Jul 08 16:34:29.504600 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.504553    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/682207f0-d9fc-46ac-a563-e0eb62eb3019-cni-binary-copy\") pod \"multus-additional-cni-plugins-6xpv2\" (UID: \"682207f0-d9fc-46ac-a563-e0eb62eb3019\") " pod="openshift-multus/multus-additional-cni-plugins-6xpv2"
Jul 08 16:34:29.516070 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.516032    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pc22\" (UniqueName: \"kubernetes.io/projected/86d48853-e62e-4e54-be35-0ca4e37e6a46-kube-api-access-4pc22\") pod \"iptables-alerter-qwddx\" (UID: \"86d48853-e62e-4e54-be35-0ca4e37e6a46\") " pod="openshift-network-operator/iptables-alerter-qwddx"
Jul 08 16:34:29.516250 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.516206    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkwc4\" (UniqueName: \"kubernetes.io/projected/682207f0-d9fc-46ac-a563-e0eb62eb3019-kube-api-access-gkwc4\") pod \"multus-additional-cni-plugins-6xpv2\" (UID: \"682207f0-d9fc-46ac-a563-e0eb62eb3019\") " pod="openshift-multus/multus-additional-cni-plugins-6xpv2"
Jul 08 16:34:29.516556 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.516535    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6vt8\" (UniqueName: \"kubernetes.io/projected/8eb4f440-8261-4651-a10a-1ccd5cb14f60-kube-api-access-j6vt8\") pod \"network-metrics-daemon-psbhw\" (UID: \"8eb4f440-8261-4651-a10a-1ccd5cb14f60\") " pod="openshift-multus/network-metrics-daemon-psbhw"
Jul 08 16:34:29.576567 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.576531    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-t8k5z"
Jul 08 16:34:29.583861 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.583836    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jzrk9"
Jul 08 16:34:29.590709 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.590682    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:29.592310 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:29.592289    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddecd5d3d_7bca_4b32_bf8f_1d060e617e56.slice/crio-3c70dd1d88969f1d398fd826a929e7a2021ba1ba0bd5687068a42e9f2e9a0602 WatchSource:0}: Error finding container 3c70dd1d88969f1d398fd826a929e7a2021ba1ba0bd5687068a42e9f2e9a0602: Status 404 returned error can't find the container with id 3c70dd1d88969f1d398fd826a929e7a2021ba1ba0bd5687068a42e9f2e9a0602
Jul 08 16:34:29.600871 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.600846    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-plbcq"
Jul 08 16:34:29.602908 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:29.602884    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c07e006_6cb2_4bcf_9fba_751d0c4630b3.slice/crio-f9953bc937b4ca73f1deeacdb57bd254d2e710d9f80e350813f8b4cf9850e63c WatchSource:0}: Error finding container f9953bc937b4ca73f1deeacdb57bd254d2e710d9f80e350813f8b4cf9850e63c: Status 404 returned error can't find the container with id f9953bc937b4ca73f1deeacdb57bd254d2e710d9f80e350813f8b4cf9850e63c
Jul 08 16:34:29.608408 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.608386    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8jxnm"
Jul 08 16:34:29.613202 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:29.613173    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod462ebd3a_f548_4af5_8f83_20d342dc9441.slice/crio-209dfde0c4167111d7dc612b7b909a4b736a91dbe6c0bac18313c8dafd0bafcf WatchSource:0}: Error finding container 209dfde0c4167111d7dc612b7b909a4b736a91dbe6c0bac18313c8dafd0bafcf: Status 404 returned error can't find the container with id 209dfde0c4167111d7dc612b7b909a4b736a91dbe6c0bac18313c8dafd0bafcf
Jul 08 16:34:29.616275 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.616186    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsmnd"
Jul 08 16:34:29.617297 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.617236    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-172.ec2.internal" podStartSLOduration=0.617200329 podStartE2EDuration="617.200329ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:34:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:34:29.616363033 +0000 UTC m=+3.716977787" watchObservedRunningTime="2026-07-08 16:34:29.617200329 +0000 UTC m=+3.717814903"
Jul 08 16:34:29.619058 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:29.619036    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fcc3970_f944_4fcf_b05e_f11d98a8c762.slice/crio-4486d9d604b0d5dcee86f0d486dd98b53f713f6c3fccc3b16c786c2f433b2d70 WatchSource:0}: Error finding container 4486d9d604b0d5dcee86f0d486dd98b53f713f6c3fccc3b16c786c2f433b2d70: Status 404 returned error can't find the container with id 4486d9d604b0d5dcee86f0d486dd98b53f713f6c3fccc3b16c786c2f433b2d70
Jul 08 16:34:29.624146 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.624125    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kkm4w"
Jul 08 16:34:29.628520 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.628491    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6xpv2"
Jul 08 16:34:29.631124 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:29.631100    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fec5c78_b2b7_4e3f_a4b3_75289b3bb33f.slice/crio-9bbe5da5057d2e5fdd89273e85d0857b51844ca3785ab4471b934621fb1cf6aa WatchSource:0}: Error finding container 9bbe5da5057d2e5fdd89273e85d0857b51844ca3785ab4471b934621fb1cf6aa: Status 404 returned error can't find the container with id 9bbe5da5057d2e5fdd89273e85d0857b51844ca3785ab4471b934621fb1cf6aa
Jul 08 16:34:29.631844 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:29.631824    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe4b1f03_839c_4f8d_a037_498b6a7bb608.slice/crio-de5d216accf7fc86b33b1aa3b387278165df9960a32a83584ce23f06bc07686e WatchSource:0}: Error finding container de5d216accf7fc86b33b1aa3b387278165df9960a32a83584ce23f06bc07686e: Status 404 returned error can't find the container with id de5d216accf7fc86b33b1aa3b387278165df9960a32a83584ce23f06bc07686e
Jul 08 16:34:29.633507 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.633487    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qwddx"
Jul 08 16:34:29.637495 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:29.637467    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod682207f0_d9fc_46ac_a563_e0eb62eb3019.slice/crio-2f0b62e76a6ae66525f7989932491d319179fc61b50bc1aef692159b637c7153 WatchSource:0}: Error finding container 2f0b62e76a6ae66525f7989932491d319179fc61b50bc1aef692159b637c7153: Status 404 returned error can't find the container with id 2f0b62e76a6ae66525f7989932491d319179fc61b50bc1aef692159b637c7153
Jul 08 16:34:29.643617 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:34:29.643595    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86d48853_e62e_4e54_be35_0ca4e37e6a46.slice/crio-e9c9a4935e84ff41f5aed0990d6e22d48dd1db9f888d9103beffeaa361215cdc WatchSource:0}: Error finding container e9c9a4935e84ff41f5aed0990d6e22d48dd1db9f888d9103beffeaa361215cdc: Status 404 returned error can't find the container with id e9c9a4935e84ff41f5aed0990d6e22d48dd1db9f888d9103beffeaa361215cdc
Jul 08 16:34:29.905959 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:29.905881    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4606c816-49c0-450f-a21f-7594bf0aaa89-original-pull-secret\") pod \"global-pull-secret-syncer-6gvmb\" (UID: \"4606c816-49c0-450f-a21f-7594bf0aaa89\") " pod="kube-system/global-pull-secret-syncer-6gvmb"
Jul 08 16:34:29.906091 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:29.906025    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 16:34:29.906091 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:29.906085    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4606c816-49c0-450f-a21f-7594bf0aaa89-original-pull-secret podName:4606c816-49c0-450f-a21f-7594bf0aaa89 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:30.906069112 +0000 UTC m=+5.006683660 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4606c816-49c0-450f-a21f-7594bf0aaa89-original-pull-secret") pod "global-pull-secret-syncer-6gvmb" (UID: "4606c816-49c0-450f-a21f-7594bf0aaa89") : object "kube-system"/"original-pull-secret" not registered
Jul 08 16:34:30.007333 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:30.007282    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfnkm\" (UniqueName: \"kubernetes.io/projected/24e40bdc-44ee-4c05-8e65-bd4a3842a5cd-kube-api-access-zfnkm\") pod \"network-check-target-fftjw\" (UID: \"24e40bdc-44ee-4c05-8e65-bd4a3842a5cd\") " pod="openshift-network-diagnostics/network-check-target-fftjw"
Jul 08 16:34:30.007515 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:30.007342    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8eb4f440-8261-4651-a10a-1ccd5cb14f60-metrics-certs\") pod \"network-metrics-daemon-psbhw\" (UID: \"8eb4f440-8261-4651-a10a-1ccd5cb14f60\") " pod="openshift-multus/network-metrics-daemon-psbhw"
Jul 08 16:34:30.007515 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:30.007475    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 16:34:30.007607 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:30.007532    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8eb4f440-8261-4651-a10a-1ccd5cb14f60-metrics-certs podName:8eb4f440-8261-4651-a10a-1ccd5cb14f60 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:31.007515288 +0000 UTC m=+5.108129853 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8eb4f440-8261-4651-a10a-1ccd5cb14f60-metrics-certs") pod "network-metrics-daemon-psbhw" (UID: "8eb4f440-8261-4651-a10a-1ccd5cb14f60") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 16:34:30.007804 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:30.007773    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 16:34:30.007804 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:30.007804    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 16:34:30.007978 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:30.007818    2565 projected.go:196] Error preparing data for projected volume kube-api-access-zfnkm for pod openshift-network-diagnostics/network-check-target-fftjw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 16:34:30.007978 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:30.007885    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/24e40bdc-44ee-4c05-8e65-bd4a3842a5cd-kube-api-access-zfnkm podName:24e40bdc-44ee-4c05-8e65-bd4a3842a5cd nodeName:}" failed. No retries permitted until 2026-07-08 16:34:31.007867881 +0000 UTC m=+5.108482440 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-zfnkm" (UniqueName: "kubernetes.io/projected/24e40bdc-44ee-4c05-8e65-bd4a3842a5cd-kube-api-access-zfnkm") pod "network-check-target-fftjw" (UID: "24e40bdc-44ee-4c05-8e65-bd4a3842a5cd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 16:34:30.333098 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:30.333055    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 16:29:29 +0000 UTC" deadline="2028-03-02 19:35:29.967951915 +0000 UTC"
Jul 08 16:34:30.333098 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:30.333096    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14475h0m59.634860448s"
Jul 08 16:34:30.486888 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:30.486856    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fftjw"
Jul 08 16:34:30.487075 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:30.486991    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fftjw" podUID="24e40bdc-44ee-4c05-8e65-bd4a3842a5cd"
Jul 08 16:34:30.519276 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:30.519240    2565 generic.go:356] "Generic (PLEG): container finished" podID="754280904498ad244daf8a18eea5a700" containerID="23de2d9c42440f9e916a0cad1f2c2318d8694dbc0a35131bc13f0e6846b148c9" exitCode=0
Jul 08 16:34:30.519444 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:30.519344    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-172.ec2.internal" event={"ID":"754280904498ad244daf8a18eea5a700","Type":"ContainerDied","Data":"23de2d9c42440f9e916a0cad1f2c2318d8694dbc0a35131bc13f0e6846b148c9"}
Jul 08 16:34:30.530429 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:30.530400    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qwddx" event={"ID":"86d48853-e62e-4e54-be35-0ca4e37e6a46","Type":"ContainerStarted","Data":"e9c9a4935e84ff41f5aed0990d6e22d48dd1db9f888d9103beffeaa361215cdc"}
Jul 08 16:34:30.542780 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:30.542661    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6xpv2" event={"ID":"682207f0-d9fc-46ac-a563-e0eb62eb3019","Type":"ContainerStarted","Data":"2f0b62e76a6ae66525f7989932491d319179fc61b50bc1aef692159b637c7153"}
Jul 08 16:34:30.550072 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:30.550040    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsmnd" event={"ID":"8fec5c78-b2b7-4e3f-a4b3-75289b3bb33f","Type":"ContainerStarted","Data":"9bbe5da5057d2e5fdd89273e85d0857b51844ca3785ab4471b934621fb1cf6aa"}
Jul 08 16:34:30.553018 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:30.552990    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8jxnm" event={"ID":"7fcc3970-f944-4fcf-b05e-f11d98a8c762","Type":"ContainerStarted","Data":"4486d9d604b0d5dcee86f0d486dd98b53f713f6c3fccc3b16c786c2f433b2d70"}
Jul 08 16:34:30.556723 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:30.556696    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-plbcq" event={"ID":"462ebd3a-f548-4af5-8f83-20d342dc9441","Type":"ContainerStarted","Data":"209dfde0c4167111d7dc612b7b909a4b736a91dbe6c0bac18313c8dafd0bafcf"}
Jul 08 16:34:30.568761 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:30.568736    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc" event={"ID":"4c07e006-6cb2-4bcf-9fba-751d0c4630b3","Type":"ContainerStarted","Data":"f9953bc937b4ca73f1deeacdb57bd254d2e710d9f80e350813f8b4cf9850e63c"}
Jul 08 16:34:30.585956 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:30.585818    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kkm4w" event={"ID":"be4b1f03-839c-4f8d-a037-498b6a7bb608","Type":"ContainerStarted","Data":"de5d216accf7fc86b33b1aa3b387278165df9960a32a83584ce23f06bc07686e"}
Jul 08 16:34:30.600542 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:30.600394    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jzrk9" event={"ID":"decd5d3d-7bca-4b32-bf8f-1d060e617e56","Type":"ContainerStarted","Data":"3c70dd1d88969f1d398fd826a929e7a2021ba1ba0bd5687068a42e9f2e9a0602"}
Jul 08 16:34:30.605127 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:30.605057    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-t8k5z" event={"ID":"455653e2-cc9e-4e39-a2b6-013b392b9d47","Type":"ContainerStarted","Data":"f19cff01f86623a9641f0afed9c3b2169250dccbf57a3602480bc0f965ac956e"}
Jul 08 16:34:30.920062 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:30.919421    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4606c816-49c0-450f-a21f-7594bf0aaa89-original-pull-secret\") pod \"global-pull-secret-syncer-6gvmb\" (UID: \"4606c816-49c0-450f-a21f-7594bf0aaa89\") " pod="kube-system/global-pull-secret-syncer-6gvmb"
Jul 08 16:34:30.920062 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:30.919597    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 16:34:30.920062 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:30.919660    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4606c816-49c0-450f-a21f-7594bf0aaa89-original-pull-secret podName:4606c816-49c0-450f-a21f-7594bf0aaa89 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:32.919641975 +0000 UTC m=+7.020256528 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4606c816-49c0-450f-a21f-7594bf0aaa89-original-pull-secret") pod "global-pull-secret-syncer-6gvmb" (UID: "4606c816-49c0-450f-a21f-7594bf0aaa89") : object "kube-system"/"original-pull-secret" not registered
Jul 08 16:34:31.019848 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:31.019804    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfnkm\" (UniqueName: \"kubernetes.io/projected/24e40bdc-44ee-4c05-8e65-bd4a3842a5cd-kube-api-access-zfnkm\") pod \"network-check-target-fftjw\" (UID: \"24e40bdc-44ee-4c05-8e65-bd4a3842a5cd\") " pod="openshift-network-diagnostics/network-check-target-fftjw"
Jul 08 16:34:31.020031 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:31.019875    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8eb4f440-8261-4651-a10a-1ccd5cb14f60-metrics-certs\") pod \"network-metrics-daemon-psbhw\" (UID: \"8eb4f440-8261-4651-a10a-1ccd5cb14f60\") " pod="openshift-multus/network-metrics-daemon-psbhw"
Jul 08 16:34:31.020083 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:31.020035    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 16:34:31.020127 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:31.020102    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8eb4f440-8261-4651-a10a-1ccd5cb14f60-metrics-certs podName:8eb4f440-8261-4651-a10a-1ccd5cb14f60 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:33.020081348 +0000 UTC m=+7.120695908 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8eb4f440-8261-4651-a10a-1ccd5cb14f60-metrics-certs") pod "network-metrics-daemon-psbhw" (UID: "8eb4f440-8261-4651-a10a-1ccd5cb14f60") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 16:34:31.020581 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:31.020559    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 16:34:31.020674 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:31.020592    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 16:34:31.020674 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:31.020606    2565 projected.go:196] Error preparing data for projected volume kube-api-access-zfnkm for pod openshift-network-diagnostics/network-check-target-fftjw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 16:34:31.020674 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:31.020656    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/24e40bdc-44ee-4c05-8e65-bd4a3842a5cd-kube-api-access-zfnkm podName:24e40bdc-44ee-4c05-8e65-bd4a3842a5cd nodeName:}" failed. No retries permitted until 2026-07-08 16:34:33.020638405 +0000 UTC m=+7.121252960 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-zfnkm" (UniqueName: "kubernetes.io/projected/24e40bdc-44ee-4c05-8e65-bd4a3842a5cd-kube-api-access-zfnkm") pod "network-check-target-fftjw" (UID: "24e40bdc-44ee-4c05-8e65-bd4a3842a5cd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 16:34:31.334196 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:31.334131    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 16:29:29 +0000 UTC" deadline="2028-03-19 18:43:15.752249144 +0000 UTC"
Jul 08 16:34:31.334196 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:31.334192    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14882h8m44.418061106s"
Jul 08 16:34:31.484127 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:31.483468    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gvmb"
Jul 08 16:34:31.484127 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:31.483593    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gvmb" podUID="4606c816-49c0-450f-a21f-7594bf0aaa89"
Jul 08 16:34:31.484127 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:31.483979    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-psbhw"
Jul 08 16:34:31.484127 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:31.484067    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-psbhw" podUID="8eb4f440-8261-4651-a10a-1ccd5cb14f60"
Jul 08 16:34:31.631082 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:31.631002    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-172.ec2.internal" event={"ID":"754280904498ad244daf8a18eea5a700","Type":"ContainerStarted","Data":"60189db72d68702c2da468dc6f9fd803f7081dfe9981f103d36a14bb3c89fe91"}
Jul 08 16:34:31.656654 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:31.655978    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-172.ec2.internal" podStartSLOduration=2.655958965 podStartE2EDuration="2.655958965s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:34:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:34:31.655203171 +0000 UTC m=+5.755817743" watchObservedRunningTime="2026-07-08 16:34:31.655958965 +0000 UTC m=+5.756573536"
Jul 08 16:34:32.486527 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:32.486499    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fftjw"
Jul 08 16:34:32.486966 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:32.486631    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fftjw" podUID="24e40bdc-44ee-4c05-8e65-bd4a3842a5cd"
Jul 08 16:34:32.938418 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:32.938110    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4606c816-49c0-450f-a21f-7594bf0aaa89-original-pull-secret\") pod \"global-pull-secret-syncer-6gvmb\" (UID: \"4606c816-49c0-450f-a21f-7594bf0aaa89\") " pod="kube-system/global-pull-secret-syncer-6gvmb"
Jul 08 16:34:32.938418 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:32.938404    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 16:34:32.938631 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:32.938483    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4606c816-49c0-450f-a21f-7594bf0aaa89-original-pull-secret podName:4606c816-49c0-450f-a21f-7594bf0aaa89 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:36.93846345 +0000 UTC m=+11.039077999 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4606c816-49c0-450f-a21f-7594bf0aaa89-original-pull-secret") pod "global-pull-secret-syncer-6gvmb" (UID: "4606c816-49c0-450f-a21f-7594bf0aaa89") : object "kube-system"/"original-pull-secret" not registered
Jul 08 16:34:33.039416 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:33.039377    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfnkm\" (UniqueName: \"kubernetes.io/projected/24e40bdc-44ee-4c05-8e65-bd4a3842a5cd-kube-api-access-zfnkm\") pod \"network-check-target-fftjw\" (UID: \"24e40bdc-44ee-4c05-8e65-bd4a3842a5cd\") " pod="openshift-network-diagnostics/network-check-target-fftjw"
Jul 08 16:34:33.039599 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:33.039443    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8eb4f440-8261-4651-a10a-1ccd5cb14f60-metrics-certs\") pod \"network-metrics-daemon-psbhw\" (UID: \"8eb4f440-8261-4651-a10a-1ccd5cb14f60\") " pod="openshift-multus/network-metrics-daemon-psbhw"
Jul 08 16:34:33.039665 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:33.039608    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 16:34:33.039713 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:33.039674    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8eb4f440-8261-4651-a10a-1ccd5cb14f60-metrics-certs podName:8eb4f440-8261-4651-a10a-1ccd5cb14f60 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:37.039655393 +0000 UTC m=+11.140269943 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8eb4f440-8261-4651-a10a-1ccd5cb14f60-metrics-certs") pod "network-metrics-daemon-psbhw" (UID: "8eb4f440-8261-4651-a10a-1ccd5cb14f60") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 16:34:33.040082 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:33.040058    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 16:34:33.040082 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:33.040085    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 16:34:33.040267 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:33.040098    2565 projected.go:196] Error preparing data for projected volume kube-api-access-zfnkm for pod openshift-network-diagnostics/network-check-target-fftjw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 16:34:33.040267 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:33.040145    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/24e40bdc-44ee-4c05-8e65-bd4a3842a5cd-kube-api-access-zfnkm podName:24e40bdc-44ee-4c05-8e65-bd4a3842a5cd nodeName:}" failed. No retries permitted until 2026-07-08 16:34:37.040129295 +0000 UTC m=+11.140743847 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-zfnkm" (UniqueName: "kubernetes.io/projected/24e40bdc-44ee-4c05-8e65-bd4a3842a5cd-kube-api-access-zfnkm") pod "network-check-target-fftjw" (UID: "24e40bdc-44ee-4c05-8e65-bd4a3842a5cd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 16:34:33.484123 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:33.484094    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-psbhw"
Jul 08 16:34:33.484359 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:33.484245    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-psbhw" podUID="8eb4f440-8261-4651-a10a-1ccd5cb14f60"
Jul 08 16:34:33.484610 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:33.484581    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gvmb"
Jul 08 16:34:33.484702 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:33.484672    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gvmb" podUID="4606c816-49c0-450f-a21f-7594bf0aaa89"
Jul 08 16:34:34.486238 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:34.486198    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fftjw"
Jul 08 16:34:34.486713 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:34.486346    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fftjw" podUID="24e40bdc-44ee-4c05-8e65-bd4a3842a5cd"
Jul 08 16:34:35.483782 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:35.483732    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gvmb"
Jul 08 16:34:35.483962 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:35.483854    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gvmb" podUID="4606c816-49c0-450f-a21f-7594bf0aaa89"
Jul 08 16:34:35.484134 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:35.483737    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-psbhw"
Jul 08 16:34:35.484276 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:35.484215    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-psbhw" podUID="8eb4f440-8261-4651-a10a-1ccd5cb14f60"
Jul 08 16:34:36.486135 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:36.486092    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fftjw"
Jul 08 16:34:36.487127 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:36.487082    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fftjw" podUID="24e40bdc-44ee-4c05-8e65-bd4a3842a5cd"
Jul 08 16:34:36.976774 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:36.976695    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4606c816-49c0-450f-a21f-7594bf0aaa89-original-pull-secret\") pod \"global-pull-secret-syncer-6gvmb\" (UID: \"4606c816-49c0-450f-a21f-7594bf0aaa89\") " pod="kube-system/global-pull-secret-syncer-6gvmb"
Jul 08 16:34:36.976973 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:36.976865    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 16:34:36.976973 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:36.976931    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4606c816-49c0-450f-a21f-7594bf0aaa89-original-pull-secret podName:4606c816-49c0-450f-a21f-7594bf0aaa89 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:44.976910236 +0000 UTC m=+19.077524790 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4606c816-49c0-450f-a21f-7594bf0aaa89-original-pull-secret") pod "global-pull-secret-syncer-6gvmb" (UID: "4606c816-49c0-450f-a21f-7594bf0aaa89") : object "kube-system"/"original-pull-secret" not registered
Jul 08 16:34:37.077880 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:37.077845    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8eb4f440-8261-4651-a10a-1ccd5cb14f60-metrics-certs\") pod \"network-metrics-daemon-psbhw\" (UID: \"8eb4f440-8261-4651-a10a-1ccd5cb14f60\") " pod="openshift-multus/network-metrics-daemon-psbhw"
Jul 08 16:34:37.078059 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:37.077932    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfnkm\" (UniqueName: \"kubernetes.io/projected/24e40bdc-44ee-4c05-8e65-bd4a3842a5cd-kube-api-access-zfnkm\") pod \"network-check-target-fftjw\" (UID: \"24e40bdc-44ee-4c05-8e65-bd4a3842a5cd\") " pod="openshift-network-diagnostics/network-check-target-fftjw"
Jul 08 16:34:37.078059 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:37.078048    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 16:34:37.078185 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:37.078064    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 16:34:37.078185 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:37.078073    2565 projected.go:196] Error preparing data for projected volume kube-api-access-zfnkm for pod openshift-network-diagnostics/network-check-target-fftjw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 16:34:37.078185 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:37.078131    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/24e40bdc-44ee-4c05-8e65-bd4a3842a5cd-kube-api-access-zfnkm podName:24e40bdc-44ee-4c05-8e65-bd4a3842a5cd nodeName:}" failed. No retries permitted until 2026-07-08 16:34:45.078105324 +0000 UTC m=+19.178719876 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-zfnkm" (UniqueName: "kubernetes.io/projected/24e40bdc-44ee-4c05-8e65-bd4a3842a5cd-kube-api-access-zfnkm") pod "network-check-target-fftjw" (UID: "24e40bdc-44ee-4c05-8e65-bd4a3842a5cd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 16:34:37.078366 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:37.078202    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 16:34:37.078366 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:37.078248    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8eb4f440-8261-4651-a10a-1ccd5cb14f60-metrics-certs podName:8eb4f440-8261-4651-a10a-1ccd5cb14f60 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:45.078237848 +0000 UTC m=+19.178852396 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8eb4f440-8261-4651-a10a-1ccd5cb14f60-metrics-certs") pod "network-metrics-daemon-psbhw" (UID: "8eb4f440-8261-4651-a10a-1ccd5cb14f60") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 16:34:37.484026 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:37.483992    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gvmb"
Jul 08 16:34:37.484026 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:37.484032    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-psbhw"
Jul 08 16:34:37.484295 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:37.484130    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gvmb" podUID="4606c816-49c0-450f-a21f-7594bf0aaa89"
Jul 08 16:34:37.484360 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:37.484294    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-psbhw" podUID="8eb4f440-8261-4651-a10a-1ccd5cb14f60"
Jul 08 16:34:38.487814 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:38.487411    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fftjw"
Jul 08 16:34:38.487814 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:38.487529    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fftjw" podUID="24e40bdc-44ee-4c05-8e65-bd4a3842a5cd"
Jul 08 16:34:39.484352 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:39.484314    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gvmb"
Jul 08 16:34:39.484502 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:39.484326    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-psbhw"
Jul 08 16:34:39.484502 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:39.484430    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gvmb" podUID="4606c816-49c0-450f-a21f-7594bf0aaa89"
Jul 08 16:34:39.484605 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:39.484549    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-psbhw" podUID="8eb4f440-8261-4651-a10a-1ccd5cb14f60"
Jul 08 16:34:40.483655 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:40.483634    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fftjw"
Jul 08 16:34:40.483910 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:40.483745    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fftjw" podUID="24e40bdc-44ee-4c05-8e65-bd4a3842a5cd"
Jul 08 16:34:41.484132 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:41.484095    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gvmb"
Jul 08 16:34:41.484630 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:41.484214    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gvmb" podUID="4606c816-49c0-450f-a21f-7594bf0aaa89"
Jul 08 16:34:41.484630 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:41.484247    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-psbhw"
Jul 08 16:34:41.484630 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:41.484335    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-psbhw" podUID="8eb4f440-8261-4651-a10a-1ccd5cb14f60"
Jul 08 16:34:42.484417 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:42.484383    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fftjw"
Jul 08 16:34:42.484822 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:42.484494    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fftjw" podUID="24e40bdc-44ee-4c05-8e65-bd4a3842a5cd"
Jul 08 16:34:43.483964 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:43.483935    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gvmb"
Jul 08 16:34:43.484243 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:43.483945    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-psbhw"
Jul 08 16:34:43.484243 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:43.484051    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gvmb" podUID="4606c816-49c0-450f-a21f-7594bf0aaa89"
Jul 08 16:34:43.484243 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:43.484154    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-psbhw" podUID="8eb4f440-8261-4651-a10a-1ccd5cb14f60"
Jul 08 16:34:44.484343 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:44.484311    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fftjw"
Jul 08 16:34:44.484796 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:44.484424    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fftjw" podUID="24e40bdc-44ee-4c05-8e65-bd4a3842a5cd"
Jul 08 16:34:45.039325 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:45.039285    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4606c816-49c0-450f-a21f-7594bf0aaa89-original-pull-secret\") pod \"global-pull-secret-syncer-6gvmb\" (UID: \"4606c816-49c0-450f-a21f-7594bf0aaa89\") " pod="kube-system/global-pull-secret-syncer-6gvmb"
Jul 08 16:34:45.039511 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:45.039440    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 16:34:45.039511 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:45.039506    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4606c816-49c0-450f-a21f-7594bf0aaa89-original-pull-secret podName:4606c816-49c0-450f-a21f-7594bf0aaa89 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:01.039490369 +0000 UTC m=+35.140104916 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4606c816-49c0-450f-a21f-7594bf0aaa89-original-pull-secret") pod "global-pull-secret-syncer-6gvmb" (UID: "4606c816-49c0-450f-a21f-7594bf0aaa89") : object "kube-system"/"original-pull-secret" not registered
Jul 08 16:34:45.140046 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:45.140005    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfnkm\" (UniqueName: \"kubernetes.io/projected/24e40bdc-44ee-4c05-8e65-bd4a3842a5cd-kube-api-access-zfnkm\") pod \"network-check-target-fftjw\" (UID: \"24e40bdc-44ee-4c05-8e65-bd4a3842a5cd\") " pod="openshift-network-diagnostics/network-check-target-fftjw"
Jul 08 16:34:45.140236 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:45.140068    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8eb4f440-8261-4651-a10a-1ccd5cb14f60-metrics-certs\") pod \"network-metrics-daemon-psbhw\" (UID: \"8eb4f440-8261-4651-a10a-1ccd5cb14f60\") " pod="openshift-multus/network-metrics-daemon-psbhw"
Jul 08 16:34:45.140236 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:45.140163    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 16:34:45.140236 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:45.140193    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 16:34:45.140236 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:45.140203    2565 projected.go:196] Error preparing data for projected volume kube-api-access-zfnkm for pod openshift-network-diagnostics/network-check-target-fftjw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 16:34:45.140422 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:45.140167    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 16:34:45.140422 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:45.140271    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/24e40bdc-44ee-4c05-8e65-bd4a3842a5cd-kube-api-access-zfnkm podName:24e40bdc-44ee-4c05-8e65-bd4a3842a5cd nodeName:}" failed. No retries permitted until 2026-07-08 16:35:01.140252479 +0000 UTC m=+35.240867030 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-zfnkm" (UniqueName: "kubernetes.io/projected/24e40bdc-44ee-4c05-8e65-bd4a3842a5cd-kube-api-access-zfnkm") pod "network-check-target-fftjw" (UID: "24e40bdc-44ee-4c05-8e65-bd4a3842a5cd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 16:34:45.140422 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:45.140319    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8eb4f440-8261-4651-a10a-1ccd5cb14f60-metrics-certs podName:8eb4f440-8261-4651-a10a-1ccd5cb14f60 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:01.140299522 +0000 UTC m=+35.240914092 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8eb4f440-8261-4651-a10a-1ccd5cb14f60-metrics-certs") pod "network-metrics-daemon-psbhw" (UID: "8eb4f440-8261-4651-a10a-1ccd5cb14f60") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 16:34:45.483764 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:45.483736    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-psbhw"
Jul 08 16:34:45.483947 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:45.483736    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gvmb"
Jul 08 16:34:45.483947 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:45.483849    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-psbhw" podUID="8eb4f440-8261-4651-a10a-1ccd5cb14f60"
Jul 08 16:34:45.484041 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:45.483945    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gvmb" podUID="4606c816-49c0-450f-a21f-7594bf0aaa89"
Jul 08 16:34:46.484279 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:46.484245    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fftjw"
Jul 08 16:34:46.484687 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:46.484341    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fftjw" podUID="24e40bdc-44ee-4c05-8e65-bd4a3842a5cd"
Jul 08 16:34:47.483412 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:47.483373    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-psbhw"
Jul 08 16:34:47.483412 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:47.483384    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gvmb"
Jul 08 16:34:47.483627 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:47.483533    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-psbhw" podUID="8eb4f440-8261-4651-a10a-1ccd5cb14f60"
Jul 08 16:34:47.483671 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:47.483648    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gvmb" podUID="4606c816-49c0-450f-a21f-7594bf0aaa89"
Jul 08 16:34:48.486313 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:48.486289    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fftjw"
Jul 08 16:34:48.486763 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:48.486407    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fftjw" podUID="24e40bdc-44ee-4c05-8e65-bd4a3842a5cd"
Jul 08 16:34:48.666980 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:48.666742    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc" event={"ID":"4c07e006-6cb2-4bcf-9fba-751d0c4630b3","Type":"ContainerStarted","Data":"5415f5c5b284422c417f3be7a6a7f441a96433cd5a511a93f0ee41e60c7986a5"}
Jul 08 16:34:48.668832 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:48.668798    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kkm4w" event={"ID":"be4b1f03-839c-4f8d-a037-498b6a7bb608","Type":"ContainerStarted","Data":"4dd9a259fbf4613233b435adb078b54c7ab508144aab29d813f6d2156c11d7b8"}
Jul 08 16:34:48.670887 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:48.670864    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jzrk9" event={"ID":"decd5d3d-7bca-4b32-bf8f-1d060e617e56","Type":"ContainerStarted","Data":"8e7a55686e59b687565294a23ed791643675bf500c4b623a1a3634e14f1b070e"}
Jul 08 16:34:48.673181 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:48.672904    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-t8k5z" event={"ID":"455653e2-cc9e-4e39-a2b6-013b392b9d47","Type":"ContainerStarted","Data":"ba1948438ed064ccf5b5e91cf422fb56d93f4801dd4518260d6bf0d28bde25c7"}
Jul 08 16:34:48.674991 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:48.674894    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6xpv2" event={"ID":"682207f0-d9fc-46ac-a563-e0eb62eb3019","Type":"ContainerStarted","Data":"75f10e8e86d0174b04c9f53743a8e98199b69a111ea37028757b56513f849a3b"}
Jul 08 16:34:48.676916 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:48.676879    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsmnd" event={"ID":"8fec5c78-b2b7-4e3f-a4b3-75289b3bb33f","Type":"ContainerStarted","Data":"808dfd20b2dff7ebe3fd33fbe540ebc03e8af8eff8f5c7cc97ddb7b50d987d2b"}
Jul 08 16:34:48.678672 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:48.678653    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8jxnm" event={"ID":"7fcc3970-f944-4fcf-b05e-f11d98a8c762","Type":"ContainerStarted","Data":"fa097d66d075a4309724e489258ca8b919abddc04ad9ff6d574a228f83b13e0b"}
Jul 08 16:34:48.680698 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:48.680668    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-plbcq" event={"ID":"462ebd3a-f548-4af5-8f83-20d342dc9441","Type":"ContainerStarted","Data":"3c15909b854f936d3c59d689df7c73955d5f034eca9f09b9b6899d5e2aa4905c"}
Jul 08 16:34:48.692236 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:48.691871    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-kkm4w" podStartSLOduration=3.917971942 podStartE2EDuration="22.691852837s" totalImagesPullingTime="18.773880895s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:34:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:34:48.690992315 +0000 UTC m=+22.791606887" watchObservedRunningTime="2026-07-08 16:34:48.691852837 +0000 UTC m=+22.792467408"
Jul 08 16:34:48.708905 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:48.708855    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-jzrk9" podStartSLOduration=3.899220826 podStartE2EDuration="22.708833877s" totalImagesPullingTime="18.809613051s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:34:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:34:48.708385312 +0000 UTC m=+22.808999905" watchObservedRunningTime="2026-07-08 16:34:48.708833877 +0000 UTC m=+22.809448460"
Jul 08 16:34:48.758019 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:48.757970    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-8jxnm" podStartSLOduration=3.896402848 podStartE2EDuration="22.757953542s" totalImagesPullingTime="18.861550694s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:34:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:34:48.728976503 +0000 UTC m=+22.829591083" watchObservedRunningTime="2026-07-08 16:34:48.757953542 +0000 UTC m=+22.858568110"
Jul 08 16:34:48.799363 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:48.799312    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-t8k5z" podStartSLOduration=3.98131798 podStartE2EDuration="22.799298412s" totalImagesPullingTime="18.817980432s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:34:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:34:48.776873861 +0000 UTC m=+22.877488430" watchObservedRunningTime="2026-07-08 16:34:48.799298412 +0000 UTC m=+22.899912977"
Jul 08 16:34:48.799693 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:48.799665    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-plbcq" podStartSLOduration=11.938631374 podStartE2EDuration="22.799654303s" totalImagesPullingTime="10.861022929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:34:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:34:48.798926327 +0000 UTC m=+22.899540908" watchObservedRunningTime="2026-07-08 16:34:48.799654303 +0000 UTC m=+22.900268872"
Jul 08 16:34:49.483787 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:49.483762    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gvmb"
Jul 08 16:34:49.483916 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:49.483772    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-psbhw"
Jul 08 16:34:49.483916 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:49.483858    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gvmb" podUID="4606c816-49c0-450f-a21f-7594bf0aaa89"
Jul 08 16:34:49.484000 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:49.483983    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-psbhw" podUID="8eb4f440-8261-4651-a10a-1ccd5cb14f60"
Jul 08 16:34:49.683751 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:49.683689    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qwddx" event={"ID":"86d48853-e62e-4e54-be35-0ca4e37e6a46","Type":"ContainerStarted","Data":"d3da859fbb3c87f8aae653a0d45149149240481e329283b7fdc499b21646d201"}
Jul 08 16:34:49.685041 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:49.685020    2565 generic.go:356] "Generic (PLEG): container finished" podID="682207f0-d9fc-46ac-a563-e0eb62eb3019" containerID="75f10e8e86d0174b04c9f53743a8e98199b69a111ea37028757b56513f849a3b" exitCode=0
Jul 08 16:34:49.685138 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:49.685099    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6xpv2" event={"ID":"682207f0-d9fc-46ac-a563-e0eb62eb3019","Type":"ContainerDied","Data":"75f10e8e86d0174b04c9f53743a8e98199b69a111ea37028757b56513f849a3b"}
Jul 08 16:34:49.688000 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:49.687980    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc" event={"ID":"4c07e006-6cb2-4bcf-9fba-751d0c4630b3","Type":"ContainerStarted","Data":"2fea28fec71d1aaf5871af863848fbc263bec631a1cf662cc4890d0a9ea8e3b3"}
Jul 08 16:34:49.688091 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:49.688058    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc" event={"ID":"4c07e006-6cb2-4bcf-9fba-751d0c4630b3","Type":"ContainerStarted","Data":"1db075655bdb91074e70811402a078f8d9fa7fab0ab795d20df6486e96d65423"}
Jul 08 16:34:49.688133 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:49.688095    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc" event={"ID":"4c07e006-6cb2-4bcf-9fba-751d0c4630b3","Type":"ContainerStarted","Data":"d340f4d3219c8d7b916002c3171450d3d0683b87ea6342b6c5ab847cb3398492"}
Jul 08 16:34:49.688186 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:49.688138    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc" event={"ID":"4c07e006-6cb2-4bcf-9fba-751d0c4630b3","Type":"ContainerStarted","Data":"fb0295986f4f12daa2d8803b588e7a9c64560e4aa185a379ee95cc4a890c64ec"}
Jul 08 16:34:49.688186 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:49.688169    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc" event={"ID":"4c07e006-6cb2-4bcf-9fba-751d0c4630b3","Type":"ContainerStarted","Data":"46abe66d0d4b0d8da22cb52ce0073c5288b26b67374fbe34308b9306b6b5fe60"}
Jul 08 16:34:49.704362 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:49.704330    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qwddx" podStartSLOduration=12.87253739 podStartE2EDuration="23.704317904s" totalImagesPullingTime="10.831780514s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:34:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:34:49.70417851 +0000 UTC m=+23.804793080" watchObservedRunningTime="2026-07-08 16:34:49.704317904 +0000 UTC m=+23.804932471"
Jul 08 16:34:49.914888 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:49.914750    2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 08 16:34:50.350423 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:50.350308    2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-08T16:34:49.914885094Z","UUID":"171fd170-6b01-4a5b-b3c4-33cc188cf87e","Handler":null,"Name":"","Endpoint":""}
Jul 08 16:34:50.351982 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:50.351960    2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 08 16:34:50.352115 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:50.351997    2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 08 16:34:50.483927 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:50.483899    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fftjw"
Jul 08 16:34:50.484145 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:50.484023    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fftjw" podUID="24e40bdc-44ee-4c05-8e65-bd4a3842a5cd"
Jul 08 16:34:50.693401 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:50.693372    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsmnd" event={"ID":"8fec5c78-b2b7-4e3f-a4b3-75289b3bb33f","Type":"ContainerStarted","Data":"67d79fa0532d78e76ec14a2047109f3c38b628aa369677e16a165d7df080025f"}
Jul 08 16:34:51.483898 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:51.483817    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-psbhw"
Jul 08 16:34:51.483898 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:51.483858    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gvmb"
Jul 08 16:34:51.484106 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:51.483945    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-psbhw" podUID="8eb4f440-8261-4651-a10a-1ccd5cb14f60"
Jul 08 16:34:51.484106 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:51.484020    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gvmb" podUID="4606c816-49c0-450f-a21f-7594bf0aaa89"
Jul 08 16:34:51.697549 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:51.697511    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsmnd" event={"ID":"8fec5c78-b2b7-4e3f-a4b3-75289b3bb33f","Type":"ContainerStarted","Data":"4911e81de2a32191391a56680122804c74e873be9c09a44984a84a7ac96bbffe"}
Jul 08 16:34:51.701041 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:51.701009    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc" event={"ID":"4c07e006-6cb2-4bcf-9fba-751d0c4630b3","Type":"ContainerStarted","Data":"c0abc32f61ea188a3d96b435b8c74e61fe013b7fc4cd397d18b01b59569f1bb5"}
Jul 08 16:34:51.718927 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:51.718879    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tsmnd" podStartSLOduration=4.424748583 podStartE2EDuration="25.718865927s" totalImagesPullingTime="21.294117344s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:34:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:34:51.718781232 +0000 UTC m=+25.819395803" watchObservedRunningTime="2026-07-08 16:34:51.718865927 +0000 UTC m=+25.819480497"
Jul 08 16:34:52.483913 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:52.483876    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fftjw"
Jul 08 16:34:52.484088 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:52.484005    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fftjw" podUID="24e40bdc-44ee-4c05-8e65-bd4a3842a5cd"
Jul 08 16:34:53.368551 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:53.368518    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-plbcq"
Jul 08 16:34:53.369661 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:53.369636    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-plbcq"
Jul 08 16:34:53.483776 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:53.483745    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gvmb"
Jul 08 16:34:53.483918 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:53.483872    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gvmb" podUID="4606c816-49c0-450f-a21f-7594bf0aaa89"
Jul 08 16:34:53.483918 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:53.483911    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-psbhw"
Jul 08 16:34:53.484044 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:53.484023    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-psbhw" podUID="8eb4f440-8261-4651-a10a-1ccd5cb14f60"
Jul 08 16:34:53.706978 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:53.706944    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-plbcq"
Jul 08 16:34:53.707502 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:53.707484    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-plbcq"
Jul 08 16:34:54.483964 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:54.483940    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fftjw"
Jul 08 16:34:54.484558 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:54.484069    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fftjw" podUID="24e40bdc-44ee-4c05-8e65-bd4a3842a5cd"
Jul 08 16:34:54.710158 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:54.710094    2565 generic.go:356] "Generic (PLEG): container finished" podID="682207f0-d9fc-46ac-a563-e0eb62eb3019" containerID="9c6bce50e697abd6281693ff821990375302a47ba0d7877ce39c656e1ea47d01" exitCode=0
Jul 08 16:34:54.710339 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:54.710185    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6xpv2" event={"ID":"682207f0-d9fc-46ac-a563-e0eb62eb3019","Type":"ContainerDied","Data":"9c6bce50e697abd6281693ff821990375302a47ba0d7877ce39c656e1ea47d01"}
Jul 08 16:34:54.713893 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:54.713872    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc" event={"ID":"4c07e006-6cb2-4bcf-9fba-751d0c4630b3","Type":"ContainerStarted","Data":"47c626fb39757a24e72b8d7961123a73ba15daf5e7f33ed8ddb1bc4964982727"}
Jul 08 16:34:54.714169 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:54.714111    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:54.714291 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:54.714200    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:54.730119 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:54.730093    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:54.789482 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:54.789404    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc" podStartSLOduration=9.916775353 podStartE2EDuration="28.789390821s" totalImagesPullingTime="18.872615468s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:34:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:34:54.784641538 +0000 UTC m=+28.885256107" watchObservedRunningTime="2026-07-08 16:34:54.789390821 +0000 UTC m=+28.890005385"
Jul 08 16:34:55.483968 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:55.483938    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gvmb"
Jul 08 16:34:55.484497 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:55.484056    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gvmb" podUID="4606c816-49c0-450f-a21f-7594bf0aaa89"
Jul 08 16:34:55.484497 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:55.484106    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-psbhw"
Jul 08 16:34:55.484497 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:55.484198    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-psbhw" podUID="8eb4f440-8261-4651-a10a-1ccd5cb14f60"
Jul 08 16:34:55.716539 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:55.716508    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:55.731958 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:55.731932    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:34:56.223349 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:56.223135    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fftjw"]
Jul 08 16:34:56.223539 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:56.223467    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fftjw"
Jul 08 16:34:56.223610 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:56.223576    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fftjw" podUID="24e40bdc-44ee-4c05-8e65-bd4a3842a5cd"
Jul 08 16:34:56.223867 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:56.223848    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6gvmb"]
Jul 08 16:34:56.223941 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:56.223927    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gvmb"
Jul 08 16:34:56.224035 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:56.224019    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gvmb" podUID="4606c816-49c0-450f-a21f-7594bf0aaa89"
Jul 08 16:34:56.228035 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:56.228010    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-psbhw"]
Jul 08 16:34:56.228160 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:56.228102    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-psbhw"
Jul 08 16:34:56.228237 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:56.228196    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-psbhw" podUID="8eb4f440-8261-4651-a10a-1ccd5cb14f60"
Jul 08 16:34:56.719664 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:56.719632    2565 generic.go:356] "Generic (PLEG): container finished" podID="682207f0-d9fc-46ac-a563-e0eb62eb3019" containerID="58e4d7cdaee542c4f14a4d71572c4126281567eb24853b52d8fe8537ee5b7b43" exitCode=0
Jul 08 16:34:56.720376 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:56.719709    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6xpv2" event={"ID":"682207f0-d9fc-46ac-a563-e0eb62eb3019","Type":"ContainerDied","Data":"58e4d7cdaee542c4f14a4d71572c4126281567eb24853b52d8fe8537ee5b7b43"}
Jul 08 16:34:57.484350 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:57.484318    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-psbhw"
Jul 08 16:34:57.484576 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:57.484433    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-psbhw" podUID="8eb4f440-8261-4651-a10a-1ccd5cb14f60"
Jul 08 16:34:58.484299 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:58.484265    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gvmb"
Jul 08 16:34:58.484299 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:58.484292    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fftjw"
Jul 08 16:34:58.484912 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:58.484372    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gvmb" podUID="4606c816-49c0-450f-a21f-7594bf0aaa89"
Jul 08 16:34:58.484912 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:58.484482    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fftjw" podUID="24e40bdc-44ee-4c05-8e65-bd4a3842a5cd"
Jul 08 16:34:58.725734 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:58.725700    2565 generic.go:356] "Generic (PLEG): container finished" podID="682207f0-d9fc-46ac-a563-e0eb62eb3019" containerID="1f9e6d2dfb11b02372fb0af06b6bb320a3b90040a923d6dfae75a2e6a7eea9a7" exitCode=0
Jul 08 16:34:58.725871 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:58.725731    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6xpv2" event={"ID":"682207f0-d9fc-46ac-a563-e0eb62eb3019","Type":"ContainerDied","Data":"1f9e6d2dfb11b02372fb0af06b6bb320a3b90040a923d6dfae75a2e6a7eea9a7"}
Jul 08 16:34:59.483421 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:34:59.483389    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-psbhw"
Jul 08 16:34:59.483591 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:34:59.483530    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-psbhw" podUID="8eb4f440-8261-4651-a10a-1ccd5cb14f60"
Jul 08 16:35:00.483667 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:00.483489    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fftjw"
Jul 08 16:35:00.484088 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:00.483560    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gvmb"
Jul 08 16:35:00.484088 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:35:00.483742    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fftjw" podUID="24e40bdc-44ee-4c05-8e65-bd4a3842a5cd"
Jul 08 16:35:00.484088 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:35:00.483815    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gvmb" podUID="4606c816-49c0-450f-a21f-7594bf0aaa89"
Jul 08 16:35:01.057584 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:01.057550    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4606c816-49c0-450f-a21f-7594bf0aaa89-original-pull-secret\") pod \"global-pull-secret-syncer-6gvmb\" (UID: \"4606c816-49c0-450f-a21f-7594bf0aaa89\") " pod="kube-system/global-pull-secret-syncer-6gvmb"
Jul 08 16:35:01.057713 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:35:01.057671    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 16:35:01.057763 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:35:01.057746    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4606c816-49c0-450f-a21f-7594bf0aaa89-original-pull-secret podName:4606c816-49c0-450f-a21f-7594bf0aaa89 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:33.057723566 +0000 UTC m=+67.158338119 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4606c816-49c0-450f-a21f-7594bf0aaa89-original-pull-secret") pod "global-pull-secret-syncer-6gvmb" (UID: "4606c816-49c0-450f-a21f-7594bf0aaa89") : object "kube-system"/"original-pull-secret" not registered
Jul 08 16:35:01.144004 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:01.143982    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-172.ec2.internal" event="NodeReady"
Jul 08 16:35:01.144156 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:01.144108    2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 08 16:35:01.159014 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:01.158626    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8eb4f440-8261-4651-a10a-1ccd5cb14f60-metrics-certs\") pod \"network-metrics-daemon-psbhw\" (UID: \"8eb4f440-8261-4651-a10a-1ccd5cb14f60\") " pod="openshift-multus/network-metrics-daemon-psbhw"
Jul 08 16:35:01.159014 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:01.158708    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfnkm\" (UniqueName: \"kubernetes.io/projected/24e40bdc-44ee-4c05-8e65-bd4a3842a5cd-kube-api-access-zfnkm\") pod \"network-check-target-fftjw\" (UID: \"24e40bdc-44ee-4c05-8e65-bd4a3842a5cd\") " pod="openshift-network-diagnostics/network-check-target-fftjw"
Jul 08 16:35:01.159014 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:35:01.158729    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 16:35:01.159014 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:35:01.158784    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8eb4f440-8261-4651-a10a-1ccd5cb14f60-metrics-certs podName:8eb4f440-8261-4651-a10a-1ccd5cb14f60 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:33.158770682 +0000 UTC m=+67.259385234 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8eb4f440-8261-4651-a10a-1ccd5cb14f60-metrics-certs") pod "network-metrics-daemon-psbhw" (UID: "8eb4f440-8261-4651-a10a-1ccd5cb14f60") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 16:35:01.159014 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:35:01.158827    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 16:35:01.159014 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:35:01.158846    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 16:35:01.159014 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:35:01.158858    2565 projected.go:196] Error preparing data for projected volume kube-api-access-zfnkm for pod openshift-network-diagnostics/network-check-target-fftjw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 16:35:01.159014 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:35:01.158904    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/24e40bdc-44ee-4c05-8e65-bd4a3842a5cd-kube-api-access-zfnkm podName:24e40bdc-44ee-4c05-8e65-bd4a3842a5cd nodeName:}" failed. No retries permitted until 2026-07-08 16:35:33.158888649 +0000 UTC m=+67.259503215 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-zfnkm" (UniqueName: "kubernetes.io/projected/24e40bdc-44ee-4c05-8e65-bd4a3842a5cd-kube-api-access-zfnkm") pod "network-check-target-fftjw" (UID: "24e40bdc-44ee-4c05-8e65-bd4a3842a5cd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 16:35:01.206907 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:01.206875    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-bcc5n"]
Jul 08 16:35:01.208756 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:01.208738    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-n8m9r"]
Jul 08 16:35:01.208865 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:01.208849    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bcc5n"
Jul 08 16:35:01.211327 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:01.211308    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n8m9r"
Jul 08 16:35:01.211427 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:01.211393    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 08 16:35:01.211870 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:01.211856    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 08 16:35:01.211939 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:01.211908    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-tghtj\""
Jul 08 16:35:01.212074 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:01.212062    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 08 16:35:01.213603 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:01.213588    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 08 16:35:01.213714 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:01.213699    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qx96f\""
Jul 08 16:35:01.213785 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:01.213748    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 08 16:35:01.219474 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:01.219455    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bcc5n"]
Jul 08 16:35:01.223735 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:01.223713    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-n8m9r"]
Jul 08 16:35:01.360281 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:01.360178    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g65r5\" (UniqueName: \"kubernetes.io/projected/482c6fe9-2188-43e0-ba22-d1589eda4e39-kube-api-access-g65r5\") pod \"dns-default-n8m9r\" (UID: \"482c6fe9-2188-43e0-ba22-d1589eda4e39\") " pod="openshift-dns/dns-default-n8m9r"
Jul 08 16:35:01.360281 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:01.360216    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f1c0f82a-fa63-47b7-a3fc-5443f44a07ac-cert\") pod \"ingress-canary-bcc5n\" (UID: \"f1c0f82a-fa63-47b7-a3fc-5443f44a07ac\") " pod="openshift-ingress-canary/ingress-canary-bcc5n"
Jul 08 16:35:01.360281 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:01.360256    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/482c6fe9-2188-43e0-ba22-d1589eda4e39-metrics-tls\") pod \"dns-default-n8m9r\" (UID: \"482c6fe9-2188-43e0-ba22-d1589eda4e39\") " pod="openshift-dns/dns-default-n8m9r"
Jul 08 16:35:01.360281 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:01.360275    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/482c6fe9-2188-43e0-ba22-d1589eda4e39-config-volume\") pod \"dns-default-n8m9r\" (UID: \"482c6fe9-2188-43e0-ba22-d1589eda4e39\") " pod="openshift-dns/dns-default-n8m9r"
Jul 08 16:35:01.360505 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:01.360292    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2pqz\" (UniqueName: \"kubernetes.io/projected/f1c0f82a-fa63-47b7-a3fc-5443f44a07ac-kube-api-access-q2pqz\") pod \"ingress-canary-bcc5n\" (UID: \"f1c0f82a-fa63-47b7-a3fc-5443f44a07ac\") " pod="openshift-ingress-canary/ingress-canary-bcc5n"
Jul 08 16:35:01.360505 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:01.360324    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/482c6fe9-2188-43e0-ba22-d1589eda4e39-tmp-dir\") pod \"dns-default-n8m9r\" (UID: \"482c6fe9-2188-43e0-ba22-d1589eda4e39\") " pod="openshift-dns/dns-default-n8m9r"
Jul 08 16:35:01.461579 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:01.461540    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2pqz\" (UniqueName: \"kubernetes.io/projected/f1c0f82a-fa63-47b7-a3fc-5443f44a07ac-kube-api-access-q2pqz\") pod \"ingress-canary-bcc5n\" (UID: \"f1c0f82a-fa63-47b7-a3fc-5443f44a07ac\") " pod="openshift-ingress-canary/ingress-canary-bcc5n"
Jul 08 16:35:01.461727 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:01.461608    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/482c6fe9-2188-43e0-ba22-d1589eda4e39-tmp-dir\") pod \"dns-default-n8m9r\" (UID: \"482c6fe9-2188-43e0-ba22-d1589eda4e39\") " pod="openshift-dns/dns-default-n8m9r"
Jul 08 16:35:01.461727 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:01.461642    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g65r5\" (UniqueName: \"kubernetes.io/projected/482c6fe9-2188-43e0-ba22-d1589eda4e39-kube-api-access-g65r5\") pod \"dns-default-n8m9r\" (UID: \"482c6fe9-2188-43e0-ba22-d1589eda4e39\") " pod="openshift-dns/dns-default-n8m9r"
Jul 08 16:35:01.461727 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:01.461672    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f1c0f82a-fa63-47b7-a3fc-5443f44a07ac-cert\") pod \"ingress-canary-bcc5n\" (UID: \"f1c0f82a-fa63-47b7-a3fc-5443f44a07ac\") " pod="openshift-ingress-canary/ingress-canary-bcc5n"
Jul 08 16:35:01.461727 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:01.461693    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/482c6fe9-2188-43e0-ba22-d1589eda4e39-metrics-tls\") pod \"dns-default-n8m9r\" (UID: \"482c6fe9-2188-43e0-ba22-d1589eda4e39\") " pod="openshift-dns/dns-default-n8m9r"
Jul 08 16:35:01.461727 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:01.461712    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/482c6fe9-2188-43e0-ba22-d1589eda4e39-config-volume\") pod \"dns-default-n8m9r\" (UID: \"482c6fe9-2188-43e0-ba22-d1589eda4e39\") " pod="openshift-dns/dns-default-n8m9r"
Jul 08 16:35:01.462006 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:01.461979    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/482c6fe9-2188-43e0-ba22-d1589eda4e39-tmp-dir\") pod \"dns-default-n8m9r\" (UID: \"482c6fe9-2188-43e0-ba22-d1589eda4e39\") " pod="openshift-dns/dns-default-n8m9r"
Jul 08 16:35:01.462156 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:35:01.462115    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 16:35:01.462283 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:35:01.462196    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/482c6fe9-2188-43e0-ba22-d1589eda4e39-metrics-tls podName:482c6fe9-2188-43e0-ba22-d1589eda4e39 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:01.962180065 +0000 UTC m=+36.062794613 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/482c6fe9-2188-43e0-ba22-d1589eda4e39-metrics-tls") pod "dns-default-n8m9r" (UID: "482c6fe9-2188-43e0-ba22-d1589eda4e39") : secret "dns-default-metrics-tls" not found
Jul 08 16:35:01.462338 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:01.462315    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/482c6fe9-2188-43e0-ba22-d1589eda4e39-config-volume\") pod \"dns-default-n8m9r\" (UID: \"482c6fe9-2188-43e0-ba22-d1589eda4e39\") " pod="openshift-dns/dns-default-n8m9r"
Jul 08 16:35:01.466447 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:01.466425    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f1c0f82a-fa63-47b7-a3fc-5443f44a07ac-cert\") pod \"ingress-canary-bcc5n\" (UID: \"f1c0f82a-fa63-47b7-a3fc-5443f44a07ac\") " pod="openshift-ingress-canary/ingress-canary-bcc5n"
Jul 08 16:35:01.478119 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:01.478088    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g65r5\" (UniqueName: \"kubernetes.io/projected/482c6fe9-2188-43e0-ba22-d1589eda4e39-kube-api-access-g65r5\") pod \"dns-default-n8m9r\" (UID: \"482c6fe9-2188-43e0-ba22-d1589eda4e39\") " pod="openshift-dns/dns-default-n8m9r"
Jul 08 16:35:01.478720 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:01.478694    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2pqz\" (UniqueName: \"kubernetes.io/projected/f1c0f82a-fa63-47b7-a3fc-5443f44a07ac-kube-api-access-q2pqz\") pod \"ingress-canary-bcc5n\" (UID: \"f1c0f82a-fa63-47b7-a3fc-5443f44a07ac\") " pod="openshift-ingress-canary/ingress-canary-bcc5n"
Jul 08 16:35:01.484012 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:01.483991    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-psbhw"
Jul 08 16:35:01.486746 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:01.486724    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 08 16:35:01.486848 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:01.486732    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-g78k4\""
Jul 08 16:35:01.518801 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:01.518783    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bcc5n"
Jul 08 16:35:01.868419 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:01.868388    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-gv9xz"]
Jul 08 16:35:01.870439 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:01.870412    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-gv9xz"
Jul 08 16:35:01.873332 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:01.873310    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-vn9wz\""
Jul 08 16:35:01.874474 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:01.874215    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 08 16:35:01.874474 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:01.874238    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 08 16:35:01.881382 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:01.881356    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-gv9xz"]
Jul 08 16:35:01.966525 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:01.966495    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xt22\" (UniqueName: \"kubernetes.io/projected/f3323fe9-140a-4c0a-aefd-260318e9364c-kube-api-access-2xt22\") pod \"network-check-source-989f8b8dc-gv9xz\" (UID: \"f3323fe9-140a-4c0a-aefd-260318e9364c\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-gv9xz"
Jul 08 16:35:01.966682 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:01.966556    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/482c6fe9-2188-43e0-ba22-d1589eda4e39-metrics-tls\") pod \"dns-default-n8m9r\" (UID: \"482c6fe9-2188-43e0-ba22-d1589eda4e39\") " pod="openshift-dns/dns-default-n8m9r"
Jul 08 16:35:01.966740 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:35:01.966710    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 16:35:01.966816 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:35:01.966804    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/482c6fe9-2188-43e0-ba22-d1589eda4e39-metrics-tls podName:482c6fe9-2188-43e0-ba22-d1589eda4e39 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:02.966785201 +0000 UTC m=+37.067399754 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/482c6fe9-2188-43e0-ba22-d1589eda4e39-metrics-tls") pod "dns-default-n8m9r" (UID: "482c6fe9-2188-43e0-ba22-d1589eda4e39") : secret "dns-default-metrics-tls" not found
Jul 08 16:35:02.067897 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:02.067862    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xt22\" (UniqueName: \"kubernetes.io/projected/f3323fe9-140a-4c0a-aefd-260318e9364c-kube-api-access-2xt22\") pod \"network-check-source-989f8b8dc-gv9xz\" (UID: \"f3323fe9-140a-4c0a-aefd-260318e9364c\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-gv9xz"
Jul 08 16:35:02.079041 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:02.079011    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xt22\" (UniqueName: \"kubernetes.io/projected/f3323fe9-140a-4c0a-aefd-260318e9364c-kube-api-access-2xt22\") pod \"network-check-source-989f8b8dc-gv9xz\" (UID: \"f3323fe9-140a-4c0a-aefd-260318e9364c\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-gv9xz"
Jul 08 16:35:02.181196 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:02.181122    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-gv9xz"
Jul 08 16:35:02.483545 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:02.483512    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fftjw"
Jul 08 16:35:02.483709 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:02.483523    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gvmb"
Jul 08 16:35:02.486769 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:02.486747    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zs6bx\""
Jul 08 16:35:02.487734 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:02.487685    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 08 16:35:02.975840 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:02.975807    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/482c6fe9-2188-43e0-ba22-d1589eda4e39-metrics-tls\") pod \"dns-default-n8m9r\" (UID: \"482c6fe9-2188-43e0-ba22-d1589eda4e39\") " pod="openshift-dns/dns-default-n8m9r"
Jul 08 16:35:02.976005 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:35:02.975985    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 16:35:02.976072 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:35:02.976061    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/482c6fe9-2188-43e0-ba22-d1589eda4e39-metrics-tls podName:482c6fe9-2188-43e0-ba22-d1589eda4e39 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:04.976038203 +0000 UTC m=+39.076652754 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/482c6fe9-2188-43e0-ba22-d1589eda4e39-metrics-tls") pod "dns-default-n8m9r" (UID: "482c6fe9-2188-43e0-ba22-d1589eda4e39") : secret "dns-default-metrics-tls" not found
Jul 08 16:35:03.001711 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:03.001687    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bcc5n"]
Jul 08 16:35:03.005300 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:35:03.005275    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1c0f82a_fa63_47b7_a3fc_5443f44a07ac.slice/crio-e16b47b74928614102ae36262dc5369f6b2fe77f9b22461c06d30f6b8a2887f3 WatchSource:0}: Error finding container e16b47b74928614102ae36262dc5369f6b2fe77f9b22461c06d30f6b8a2887f3: Status 404 returned error can't find the container with id e16b47b74928614102ae36262dc5369f6b2fe77f9b22461c06d30f6b8a2887f3
Jul 08 16:35:03.008872 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:03.008300    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-gv9xz"]
Jul 08 16:35:03.012087 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:35:03.012065    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3323fe9_140a_4c0a_aefd_260318e9364c.slice/crio-2d67b7a5f65429ec96d9eb251581eabd12584fbf58a74cf9c04a55cb92a710d6 WatchSource:0}: Error finding container 2d67b7a5f65429ec96d9eb251581eabd12584fbf58a74cf9c04a55cb92a710d6: Status 404 returned error can't find the container with id 2d67b7a5f65429ec96d9eb251581eabd12584fbf58a74cf9c04a55cb92a710d6
Jul 08 16:35:03.461148 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:03.460981    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-nk8jb"]
Jul 08 16:35:03.464349 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:03.464323    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nk8jb"
Jul 08 16:35:03.469013 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:03.468987    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 08 16:35:03.469567 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:03.469551    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 08 16:35:03.470204 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:03.470183    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-cshmv\""
Jul 08 16:35:03.470399 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:03.470379    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 08 16:35:03.471598 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:03.471580    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 08 16:35:03.492247 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:03.492209    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nk8jb"]
Jul 08 16:35:03.580754 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:03.580722    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a1f9ebe4-e7cd-4413-a587-0c86effbd290-crio-socket\") pod \"insights-runtime-extractor-nk8jb\" (UID: \"a1f9ebe4-e7cd-4413-a587-0c86effbd290\") " pod="openshift-insights/insights-runtime-extractor-nk8jb"
Jul 08 16:35:03.580920 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:03.580779    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1f9ebe4-e7cd-4413-a587-0c86effbd290-data-volume\") pod \"insights-runtime-extractor-nk8jb\" (UID: \"a1f9ebe4-e7cd-4413-a587-0c86effbd290\") " pod="openshift-insights/insights-runtime-extractor-nk8jb"
Jul 08 16:35:03.580920 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:03.580808    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a1f9ebe4-e7cd-4413-a587-0c86effbd290-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nk8jb\" (UID: \"a1f9ebe4-e7cd-4413-a587-0c86effbd290\") " pod="openshift-insights/insights-runtime-extractor-nk8jb"
Jul 08 16:35:03.581008 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:03.580962    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a1f9ebe4-e7cd-4413-a587-0c86effbd290-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nk8jb\" (UID: \"a1f9ebe4-e7cd-4413-a587-0c86effbd290\") " pod="openshift-insights/insights-runtime-extractor-nk8jb"
Jul 08 16:35:03.581008 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:03.580992    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pj7xr\" (UniqueName: \"kubernetes.io/projected/a1f9ebe4-e7cd-4413-a587-0c86effbd290-kube-api-access-pj7xr\") pod \"insights-runtime-extractor-nk8jb\" (UID: \"a1f9ebe4-e7cd-4413-a587-0c86effbd290\") " pod="openshift-insights/insights-runtime-extractor-nk8jb"
Jul 08 16:35:03.682078 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:03.682041    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a1f9ebe4-e7cd-4413-a587-0c86effbd290-crio-socket\") pod \"insights-runtime-extractor-nk8jb\" (UID: \"a1f9ebe4-e7cd-4413-a587-0c86effbd290\") " pod="openshift-insights/insights-runtime-extractor-nk8jb"
Jul 08 16:35:03.682078 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:03.682084    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1f9ebe4-e7cd-4413-a587-0c86effbd290-data-volume\") pod \"insights-runtime-extractor-nk8jb\" (UID: \"a1f9ebe4-e7cd-4413-a587-0c86effbd290\") " pod="openshift-insights/insights-runtime-extractor-nk8jb"
Jul 08 16:35:03.682338 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:03.682117    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a1f9ebe4-e7cd-4413-a587-0c86effbd290-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nk8jb\" (UID: \"a1f9ebe4-e7cd-4413-a587-0c86effbd290\") " pod="openshift-insights/insights-runtime-extractor-nk8jb"
Jul 08 16:35:03.682338 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:03.682195    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a1f9ebe4-e7cd-4413-a587-0c86effbd290-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nk8jb\" (UID: \"a1f9ebe4-e7cd-4413-a587-0c86effbd290\") " pod="openshift-insights/insights-runtime-extractor-nk8jb"
Jul 08 16:35:03.682338 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:03.682237    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pj7xr\" (UniqueName: \"kubernetes.io/projected/a1f9ebe4-e7cd-4413-a587-0c86effbd290-kube-api-access-pj7xr\") pod \"insights-runtime-extractor-nk8jb\" (UID: \"a1f9ebe4-e7cd-4413-a587-0c86effbd290\") " pod="openshift-insights/insights-runtime-extractor-nk8jb"
Jul 08 16:35:03.682782 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:03.682757    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a1f9ebe4-e7cd-4413-a587-0c86effbd290-crio-socket\") pod \"insights-runtime-extractor-nk8jb\" (UID: \"a1f9ebe4-e7cd-4413-a587-0c86effbd290\") " pod="openshift-insights/insights-runtime-extractor-nk8jb"
Jul 08 16:35:03.682878 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:35:03.682867    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 16:35:03.682936 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:35:03.682920    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1f9ebe4-e7cd-4413-a587-0c86effbd290-insights-runtime-extractor-tls podName:a1f9ebe4-e7cd-4413-a587-0c86effbd290 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:04.18290125 +0000 UTC m=+38.283515805 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a1f9ebe4-e7cd-4413-a587-0c86effbd290-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nk8jb" (UID: "a1f9ebe4-e7cd-4413-a587-0c86effbd290") : secret "insights-runtime-extractor-tls" not found
Jul 08 16:35:03.683127 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:35:03.683114    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 16:35:03.683209 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:35:03.683163    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a1f9ebe4-e7cd-4413-a587-0c86effbd290-kube-rbac-proxy-cm podName:a1f9ebe4-e7cd-4413-a587-0c86effbd290 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:04.183149839 +0000 UTC m=+38.283764391 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a1f9ebe4-e7cd-4413-a587-0c86effbd290-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nk8jb" (UID: "a1f9ebe4-e7cd-4413-a587-0c86effbd290") : configmap "kube-rbac-proxy" not found
Jul 08 16:35:03.683209 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:03.683158    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1f9ebe4-e7cd-4413-a587-0c86effbd290-data-volume\") pod \"insights-runtime-extractor-nk8jb\" (UID: \"a1f9ebe4-e7cd-4413-a587-0c86effbd290\") " pod="openshift-insights/insights-runtime-extractor-nk8jb"
Jul 08 16:35:03.693267 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:03.693244    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pj7xr\" (UniqueName: \"kubernetes.io/projected/a1f9ebe4-e7cd-4413-a587-0c86effbd290-kube-api-access-pj7xr\") pod \"insights-runtime-extractor-nk8jb\" (UID: \"a1f9ebe4-e7cd-4413-a587-0c86effbd290\") " pod="openshift-insights/insights-runtime-extractor-nk8jb"
Jul 08 16:35:03.741640 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:03.741573    2565 generic.go:356] "Generic (PLEG): container finished" podID="682207f0-d9fc-46ac-a563-e0eb62eb3019" containerID="6ec0678882b0de0d8ca5db520d25273243f5751960590b8772e4e70c20c2c448" exitCode=0
Jul 08 16:35:03.741752 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:03.741680    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6xpv2" event={"ID":"682207f0-d9fc-46ac-a563-e0eb62eb3019","Type":"ContainerDied","Data":"6ec0678882b0de0d8ca5db520d25273243f5751960590b8772e4e70c20c2c448"}
Jul 08 16:35:03.743153 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:03.743089    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bcc5n" event={"ID":"f1c0f82a-fa63-47b7-a3fc-5443f44a07ac","Type":"ContainerStarted","Data":"e16b47b74928614102ae36262dc5369f6b2fe77f9b22461c06d30f6b8a2887f3"}
Jul 08 16:35:03.744390 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:03.744365    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-gv9xz" event={"ID":"f3323fe9-140a-4c0a-aefd-260318e9364c","Type":"ContainerStarted","Data":"2d67b7a5f65429ec96d9eb251581eabd12584fbf58a74cf9c04a55cb92a710d6"}
Jul 08 16:35:04.080152 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:04.080080    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-fvv6h"]
Jul 08 16:35:04.082015 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:04.081993    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-fvv6h"
Jul 08 16:35:04.084790 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:04.084768    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 08 16:35:04.085159 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:04.085141    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-crtxt\""
Jul 08 16:35:04.085597 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:04.085413    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 08 16:35:04.100148 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:04.100121    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-fvv6h"]
Jul 08 16:35:04.185650 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:04.185616    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a1f9ebe4-e7cd-4413-a587-0c86effbd290-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nk8jb\" (UID: \"a1f9ebe4-e7cd-4413-a587-0c86effbd290\") " pod="openshift-insights/insights-runtime-extractor-nk8jb"
Jul 08 16:35:04.185797 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:04.185744    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22gjh\" (UniqueName: \"kubernetes.io/projected/c7a8c765-396a-4ee6-b13c-bdd8634bcfb6-kube-api-access-22gjh\") pod \"migrator-d57d58cc9-fvv6h\" (UID: \"c7a8c765-396a-4ee6-b13c-bdd8634bcfb6\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-fvv6h"
Jul 08 16:35:04.185797 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:04.185782    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a1f9ebe4-e7cd-4413-a587-0c86effbd290-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nk8jb\" (UID: \"a1f9ebe4-e7cd-4413-a587-0c86effbd290\") " pod="openshift-insights/insights-runtime-extractor-nk8jb"
Jul 08 16:35:04.185950 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:35:04.185923    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 16:35:04.185990 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:35:04.185984    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1f9ebe4-e7cd-4413-a587-0c86effbd290-insights-runtime-extractor-tls podName:a1f9ebe4-e7cd-4413-a587-0c86effbd290 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:05.185966957 +0000 UTC m=+39.286581535 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a1f9ebe4-e7cd-4413-a587-0c86effbd290-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nk8jb" (UID: "a1f9ebe4-e7cd-4413-a587-0c86effbd290") : secret "insights-runtime-extractor-tls" not found
Jul 08 16:35:04.186477 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:35:04.186383    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 16:35:04.186477 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:35:04.186436    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a1f9ebe4-e7cd-4413-a587-0c86effbd290-kube-rbac-proxy-cm podName:a1f9ebe4-e7cd-4413-a587-0c86effbd290 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:05.186419198 +0000 UTC m=+39.287033748 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a1f9ebe4-e7cd-4413-a587-0c86effbd290-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nk8jb" (UID: "a1f9ebe4-e7cd-4413-a587-0c86effbd290") : configmap "kube-rbac-proxy" not found
Jul 08 16:35:04.286917 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:04.286875    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22gjh\" (UniqueName: \"kubernetes.io/projected/c7a8c765-396a-4ee6-b13c-bdd8634bcfb6-kube-api-access-22gjh\") pod \"migrator-d57d58cc9-fvv6h\" (UID: \"c7a8c765-396a-4ee6-b13c-bdd8634bcfb6\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-fvv6h"
Jul 08 16:35:04.303148 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:04.299861    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22gjh\" (UniqueName: \"kubernetes.io/projected/c7a8c765-396a-4ee6-b13c-bdd8634bcfb6-kube-api-access-22gjh\") pod \"migrator-d57d58cc9-fvv6h\" (UID: \"c7a8c765-396a-4ee6-b13c-bdd8634bcfb6\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-fvv6h"
Jul 08 16:35:04.394452 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:04.394382    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-fvv6h"
Jul 08 16:35:04.533916 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:04.533882    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-fvv6h"]
Jul 08 16:35:04.539146 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:35:04.539118    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7a8c765_396a_4ee6_b13c_bdd8634bcfb6.slice/crio-969805d40cf04499725826e7ab9b1ef5f4205a8d79382c5393f0cb9262f0b2c5 WatchSource:0}: Error finding container 969805d40cf04499725826e7ab9b1ef5f4205a8d79382c5393f0cb9262f0b2c5: Status 404 returned error can't find the container with id 969805d40cf04499725826e7ab9b1ef5f4205a8d79382c5393f0cb9262f0b2c5
Jul 08 16:35:04.748720 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:04.748688    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-fvv6h" event={"ID":"c7a8c765-396a-4ee6-b13c-bdd8634bcfb6","Type":"ContainerStarted","Data":"969805d40cf04499725826e7ab9b1ef5f4205a8d79382c5393f0cb9262f0b2c5"}
Jul 08 16:35:04.752574 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:04.752504    2565 generic.go:356] "Generic (PLEG): container finished" podID="682207f0-d9fc-46ac-a563-e0eb62eb3019" containerID="272ac51aac38e99baf9509ac1b5124cc6ffa8785cda35bc4a1fafc3a52feeddc" exitCode=0
Jul 08 16:35:04.752574 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:04.752534    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6xpv2" event={"ID":"682207f0-d9fc-46ac-a563-e0eb62eb3019","Type":"ContainerDied","Data":"272ac51aac38e99baf9509ac1b5124cc6ffa8785cda35bc4a1fafc3a52feeddc"}
Jul 08 16:35:04.994587 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:04.994344    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/482c6fe9-2188-43e0-ba22-d1589eda4e39-metrics-tls\") pod \"dns-default-n8m9r\" (UID: \"482c6fe9-2188-43e0-ba22-d1589eda4e39\") " pod="openshift-dns/dns-default-n8m9r"
Jul 08 16:35:04.994765 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:35:04.994522    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 16:35:04.994765 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:35:04.994691    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/482c6fe9-2188-43e0-ba22-d1589eda4e39-metrics-tls podName:482c6fe9-2188-43e0-ba22-d1589eda4e39 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:08.994670125 +0000 UTC m=+43.095284680 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/482c6fe9-2188-43e0-ba22-d1589eda4e39-metrics-tls") pod "dns-default-n8m9r" (UID: "482c6fe9-2188-43e0-ba22-d1589eda4e39") : secret "dns-default-metrics-tls" not found
Jul 08 16:35:05.196410 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:05.196360    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a1f9ebe4-e7cd-4413-a587-0c86effbd290-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nk8jb\" (UID: \"a1f9ebe4-e7cd-4413-a587-0c86effbd290\") " pod="openshift-insights/insights-runtime-extractor-nk8jb"
Jul 08 16:35:05.196577 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:05.196450    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a1f9ebe4-e7cd-4413-a587-0c86effbd290-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nk8jb\" (UID: \"a1f9ebe4-e7cd-4413-a587-0c86effbd290\") " pod="openshift-insights/insights-runtime-extractor-nk8jb"
Jul 08 16:35:05.196577 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:35:05.196524    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 16:35:05.196657 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:35:05.196588    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1f9ebe4-e7cd-4413-a587-0c86effbd290-insights-runtime-extractor-tls podName:a1f9ebe4-e7cd-4413-a587-0c86effbd290 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:07.196571943 +0000 UTC m=+41.297186507 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a1f9ebe4-e7cd-4413-a587-0c86effbd290-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nk8jb" (UID: "a1f9ebe4-e7cd-4413-a587-0c86effbd290") : secret "insights-runtime-extractor-tls" not found
Jul 08 16:35:05.196768 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:35:05.196607    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 16:35:05.196830 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:35:05.196819    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a1f9ebe4-e7cd-4413-a587-0c86effbd290-kube-rbac-proxy-cm podName:a1f9ebe4-e7cd-4413-a587-0c86effbd290 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:07.196798892 +0000 UTC m=+41.297413443 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a1f9ebe4-e7cd-4413-a587-0c86effbd290-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nk8jb" (UID: "a1f9ebe4-e7cd-4413-a587-0c86effbd290") : configmap "kube-rbac-proxy" not found
Jul 08 16:35:05.659321 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:05.659281    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jzrk9_decd5d3d-7bca-4b32-bf8f-1d060e617e56/dns-node-resolver/0.log"
Jul 08 16:35:06.659576 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:06.659551    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-t8k5z_455653e2-cc9e-4e39-a2b6-013b392b9d47/node-ca/0.log"
Jul 08 16:35:07.213780 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:07.213750    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a1f9ebe4-e7cd-4413-a587-0c86effbd290-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nk8jb\" (UID: \"a1f9ebe4-e7cd-4413-a587-0c86effbd290\") " pod="openshift-insights/insights-runtime-extractor-nk8jb"
Jul 08 16:35:07.213946 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:07.213813    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a1f9ebe4-e7cd-4413-a587-0c86effbd290-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nk8jb\" (UID: \"a1f9ebe4-e7cd-4413-a587-0c86effbd290\") " pod="openshift-insights/insights-runtime-extractor-nk8jb"
Jul 08 16:35:07.213946 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:35:07.213902    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 16:35:07.214050 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:35:07.213956    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1f9ebe4-e7cd-4413-a587-0c86effbd290-insights-runtime-extractor-tls podName:a1f9ebe4-e7cd-4413-a587-0c86effbd290 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:11.213943035 +0000 UTC m=+45.314557583 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a1f9ebe4-e7cd-4413-a587-0c86effbd290-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nk8jb" (UID: "a1f9ebe4-e7cd-4413-a587-0c86effbd290") : secret "insights-runtime-extractor-tls" not found
Jul 08 16:35:07.214050 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:35:07.213955    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 16:35:07.214150 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:35:07.214107    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a1f9ebe4-e7cd-4413-a587-0c86effbd290-kube-rbac-proxy-cm podName:a1f9ebe4-e7cd-4413-a587-0c86effbd290 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:11.214080125 +0000 UTC m=+45.314694673 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a1f9ebe4-e7cd-4413-a587-0c86effbd290-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nk8jb" (UID: "a1f9ebe4-e7cd-4413-a587-0c86effbd290") : configmap "kube-rbac-proxy" not found
Jul 08 16:35:07.762235 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:07.762149    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bcc5n" event={"ID":"f1c0f82a-fa63-47b7-a3fc-5443f44a07ac","Type":"ContainerStarted","Data":"e093fa380e4738f6014a9cb22f16a092f9050e369a5b582fdbde427bb2f4858f"}
Jul 08 16:35:07.763665 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:07.763643    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-gv9xz" event={"ID":"f3323fe9-140a-4c0a-aefd-260318e9364c","Type":"ContainerStarted","Data":"e89d4133c5edb60dcc402197a00ad6601dcd5aecb371cc98b021121f3a8c9c6a"}
Jul 08 16:35:07.765459 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:07.765429    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-fvv6h" event={"ID":"c7a8c765-396a-4ee6-b13c-bdd8634bcfb6","Type":"ContainerStarted","Data":"c32b8630a58a4ea55afef2e83adc19372ff39152a7d05cab5efcd6e4ea4b8901"}
Jul 08 16:35:07.765551 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:07.765478    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-fvv6h" event={"ID":"c7a8c765-396a-4ee6-b13c-bdd8634bcfb6","Type":"ContainerStarted","Data":"87e4a0784837bc8b9aa8dbb6b61fc24fef0595396aaf6486e03eb7766aa38cd0"}
Jul 08 16:35:07.768785 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:07.768767    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6xpv2" event={"ID":"682207f0-d9fc-46ac-a563-e0eb62eb3019","Type":"ContainerStarted","Data":"02ed1d791882d1ecb5efe2681d7c46b50426d65455b9849bdc347ce2b35d3018"}
Jul 08 16:35:07.784792 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:07.784757    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-bcc5n" podStartSLOduration=2.565633783 podStartE2EDuration="6.784744688s" totalImagesPullingTime="4.219110905s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:35:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:07.78312693 +0000 UTC m=+41.883741500" watchObservedRunningTime="2026-07-08 16:35:07.784744688 +0000 UTC m=+41.885359258"
Jul 08 16:35:07.803962 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:07.803908    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-gv9xz" podStartSLOduration=2.576695976 podStartE2EDuration="6.803896712s" totalImagesPullingTime="4.227200736s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:35:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:07.802954097 +0000 UTC m=+41.903568671" watchObservedRunningTime="2026-07-08 16:35:07.803896712 +0000 UTC m=+41.904511285"
Jul 08 16:35:07.832991 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:07.832949    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-6xpv2" podStartSLOduration=12.490083742 podStartE2EDuration="41.832937854s" totalImagesPullingTime="29.342854112s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:34:26 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:07.832483272 +0000 UTC m=+41.933097834" watchObservedRunningTime="2026-07-08 16:35:07.832937854 +0000 UTC m=+41.933552424"
Jul 08 16:35:07.855403 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:07.855370    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-fvv6h" podStartSLOduration=0.936560729 podStartE2EDuration="3.85535738s" totalImagesPullingTime="2.918796651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:35:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:07.85465525 +0000 UTC m=+41.955269819" watchObservedRunningTime="2026-07-08 16:35:07.85535738 +0000 UTC m=+41.955971934"
Jul 08 16:35:09.027494 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:09.027463    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/482c6fe9-2188-43e0-ba22-d1589eda4e39-metrics-tls\") pod \"dns-default-n8m9r\" (UID: \"482c6fe9-2188-43e0-ba22-d1589eda4e39\") " pod="openshift-dns/dns-default-n8m9r"
Jul 08 16:35:09.027837 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:35:09.027570    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 16:35:09.027837 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:35:09.027617    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/482c6fe9-2188-43e0-ba22-d1589eda4e39-metrics-tls podName:482c6fe9-2188-43e0-ba22-d1589eda4e39 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:17.027605256 +0000 UTC m=+51.128219803 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/482c6fe9-2188-43e0-ba22-d1589eda4e39-metrics-tls") pod "dns-default-n8m9r" (UID: "482c6fe9-2188-43e0-ba22-d1589eda4e39") : secret "dns-default-metrics-tls" not found
Jul 08 16:35:11.242754 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:11.242717    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a1f9ebe4-e7cd-4413-a587-0c86effbd290-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nk8jb\" (UID: \"a1f9ebe4-e7cd-4413-a587-0c86effbd290\") " pod="openshift-insights/insights-runtime-extractor-nk8jb"
Jul 08 16:35:11.243118 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:11.242784    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a1f9ebe4-e7cd-4413-a587-0c86effbd290-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nk8jb\" (UID: \"a1f9ebe4-e7cd-4413-a587-0c86effbd290\") " pod="openshift-insights/insights-runtime-extractor-nk8jb"
Jul 08 16:35:11.243118 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:35:11.242845    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 16:35:11.243118 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:35:11.242884    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 16:35:11.243118 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:35:11.242920    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a1f9ebe4-e7cd-4413-a587-0c86effbd290-kube-rbac-proxy-cm podName:a1f9ebe4-e7cd-4413-a587-0c86effbd290 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:19.242902546 +0000 UTC m=+53.343517097 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a1f9ebe4-e7cd-4413-a587-0c86effbd290-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nk8jb" (UID: "a1f9ebe4-e7cd-4413-a587-0c86effbd290") : configmap "kube-rbac-proxy" not found
Jul 08 16:35:11.243118 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:35:11.242935    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1f9ebe4-e7cd-4413-a587-0c86effbd290-insights-runtime-extractor-tls podName:a1f9ebe4-e7cd-4413-a587-0c86effbd290 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:19.242928447 +0000 UTC m=+53.343542995 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a1f9ebe4-e7cd-4413-a587-0c86effbd290-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nk8jb" (UID: "a1f9ebe4-e7cd-4413-a587-0c86effbd290") : secret "insights-runtime-extractor-tls" not found
Jul 08 16:35:17.083962 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:17.083930    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/482c6fe9-2188-43e0-ba22-d1589eda4e39-metrics-tls\") pod \"dns-default-n8m9r\" (UID: \"482c6fe9-2188-43e0-ba22-d1589eda4e39\") " pod="openshift-dns/dns-default-n8m9r"
Jul 08 16:35:17.086725 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:17.086697    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/482c6fe9-2188-43e0-ba22-d1589eda4e39-metrics-tls\") pod \"dns-default-n8m9r\" (UID: \"482c6fe9-2188-43e0-ba22-d1589eda4e39\") " pod="openshift-dns/dns-default-n8m9r"
Jul 08 16:35:17.124828 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:17.124807    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n8m9r"
Jul 08 16:35:17.265617 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:17.265595    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-n8m9r"]
Jul 08 16:35:17.267729 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:35:17.267704    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod482c6fe9_2188_43e0_ba22_d1589eda4e39.slice/crio-2730c44cdfbe649f080b368180b388aecf9bd501b558f04d122622d42476291e WatchSource:0}: Error finding container 2730c44cdfbe649f080b368180b388aecf9bd501b558f04d122622d42476291e: Status 404 returned error can't find the container with id 2730c44cdfbe649f080b368180b388aecf9bd501b558f04d122622d42476291e
Jul 08 16:35:17.792893 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:17.792851    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n8m9r" event={"ID":"482c6fe9-2188-43e0-ba22-d1589eda4e39","Type":"ContainerStarted","Data":"2730c44cdfbe649f080b368180b388aecf9bd501b558f04d122622d42476291e"}
Jul 08 16:35:19.300878 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:19.300850    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a1f9ebe4-e7cd-4413-a587-0c86effbd290-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nk8jb\" (UID: \"a1f9ebe4-e7cd-4413-a587-0c86effbd290\") " pod="openshift-insights/insights-runtime-extractor-nk8jb"
Jul 08 16:35:19.301131 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:19.300923    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a1f9ebe4-e7cd-4413-a587-0c86effbd290-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nk8jb\" (UID: \"a1f9ebe4-e7cd-4413-a587-0c86effbd290\") " pod="openshift-insights/insights-runtime-extractor-nk8jb"
Jul 08 16:35:19.301131 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:35:19.301008    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 16:35:19.301131 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:35:19.301053    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1f9ebe4-e7cd-4413-a587-0c86effbd290-insights-runtime-extractor-tls podName:a1f9ebe4-e7cd-4413-a587-0c86effbd290 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:35.301041096 +0000 UTC m=+69.401655643 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a1f9ebe4-e7cd-4413-a587-0c86effbd290-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nk8jb" (UID: "a1f9ebe4-e7cd-4413-a587-0c86effbd290") : secret "insights-runtime-extractor-tls" not found
Jul 08 16:35:19.301383 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:19.301366    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a1f9ebe4-e7cd-4413-a587-0c86effbd290-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nk8jb\" (UID: \"a1f9ebe4-e7cd-4413-a587-0c86effbd290\") " pod="openshift-insights/insights-runtime-extractor-nk8jb"
Jul 08 16:35:19.799897 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:19.799818    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n8m9r" event={"ID":"482c6fe9-2188-43e0-ba22-d1589eda4e39","Type":"ContainerStarted","Data":"76f896b80a53846b89155dffe3db78340b9bcd448e9361af2064f906da24ea00"}
Jul 08 16:35:19.799897 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:19.799867    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n8m9r" event={"ID":"482c6fe9-2188-43e0-ba22-d1589eda4e39","Type":"ContainerStarted","Data":"f409e564b01af2fa7091edd0574e409f987af9d247a5348328482f1728e9e798"}
Jul 08 16:35:19.800081 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:19.799965    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-n8m9r"
Jul 08 16:35:19.834018 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:19.833974    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-n8m9r" podStartSLOduration=16.92272473 podStartE2EDuration="18.833957837s" totalImagesPullingTime="1.911233107s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:35:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:19.833598203 +0000 UTC m=+53.934212783" watchObservedRunningTime="2026-07-08 16:35:19.833957837 +0000 UTC m=+53.934572405"
Jul 08 16:35:27.735845 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:27.735820    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jxfhc"
Jul 08 16:35:29.807137 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:29.806603    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-n8m9r"
Jul 08 16:35:30.551337 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:30.551308    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f948c56d9-tfqgr"]
Jul 08 16:35:30.554233 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:30.554201    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f948c56d9-tfqgr"
Jul 08 16:35:30.557307 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:30.557285    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 08 16:35:30.557307 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:30.557303    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 08 16:35:30.557796 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:30.557781    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 08 16:35:30.558327 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:30.558311    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 08 16:35:30.560524 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:30.560502    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 08 16:35:30.560974 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:30.560961    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 08 16:35:30.561266 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:30.561248    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 08 16:35:30.574398 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:30.574378    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f948c56d9-tfqgr"]
Jul 08 16:35:30.659689 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:30.659669    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-57d76c5ff7-cp4cq"]
Jul 08 16:35:30.661582 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:30.661567    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57d76c5ff7-cp4cq"
Jul 08 16:35:30.664171 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:30.664157    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 08 16:35:30.664479 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:30.664464    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-r7vmb\""
Jul 08 16:35:30.664562 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:30.664528    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 08 16:35:30.665503 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:30.665486    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 08 16:35:30.669781 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:30.669766    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 08 16:35:30.677577 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:30.677560    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f9f1b69b-ff6f-4124-ba65-d62017274056-hub\") pod \"cluster-proxy-proxy-agent-f948c56d9-tfqgr\" (UID: \"f9f1b69b-ff6f-4124-ba65-d62017274056\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f948c56d9-tfqgr"
Jul 08 16:35:30.677651 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:30.677587    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f9f1b69b-ff6f-4124-ba65-d62017274056-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-f948c56d9-tfqgr\" (UID: \"f9f1b69b-ff6f-4124-ba65-d62017274056\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f948c56d9-tfqgr"
Jul 08 16:35:30.677651 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:30.677631    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9f1b69b-ff6f-4124-ba65-d62017274056-additional-service-ca\") pod \"cluster-proxy-proxy-agent-f948c56d9-tfqgr\" (UID: \"f9f1b69b-ff6f-4124-ba65-d62017274056\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f948c56d9-tfqgr"
Jul 08 16:35:30.677718 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:30.677675    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f9f1b69b-ff6f-4124-ba65-d62017274056-ca\") pod \"cluster-proxy-proxy-agent-f948c56d9-tfqgr\" (UID: \"f9f1b69b-ff6f-4124-ba65-d62017274056\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f948c56d9-tfqgr"
Jul 08 16:35:30.677718 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:30.677693    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqls7\" (UniqueName: \"kubernetes.io/projected/f9f1b69b-ff6f-4124-ba65-d62017274056-kube-api-access-lqls7\") pod \"cluster-proxy-proxy-agent-f948c56d9-tfqgr\" (UID: \"f9f1b69b-ff6f-4124-ba65-d62017274056\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f948c56d9-tfqgr"
Jul 08 16:35:30.677776 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:30.677738    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f9f1b69b-ff6f-4124-ba65-d62017274056-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-f948c56d9-tfqgr\" (UID: \"f9f1b69b-ff6f-4124-ba65-d62017274056\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f948c56d9-tfqgr"
Jul 08 16:35:30.681354 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:30.681331    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57d76c5ff7-cp4cq"]
Jul 08 16:35:30.778913 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:30.778886    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dfb432e6-c846-433e-a711-d12445351d36-bound-sa-token\") pod \"image-registry-57d76c5ff7-cp4cq\" (UID: \"dfb432e6-c846-433e-a711-d12445351d36\") " pod="openshift-image-registry/image-registry-57d76c5ff7-cp4cq"
Jul 08 16:35:30.779027 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:30.778967    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dfb432e6-c846-433e-a711-d12445351d36-ca-trust-extracted\") pod \"image-registry-57d76c5ff7-cp4cq\" (UID: \"dfb432e6-c846-433e-a711-d12445351d36\") " pod="openshift-image-registry/image-registry-57d76c5ff7-cp4cq"
Jul 08 16:35:30.779027 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:30.778986    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxvbd\" (UniqueName: \"kubernetes.io/projected/dfb432e6-c846-433e-a711-d12445351d36-kube-api-access-rxvbd\") pod \"image-registry-57d76c5ff7-cp4cq\" (UID: \"dfb432e6-c846-433e-a711-d12445351d36\") " pod="openshift-image-registry/image-registry-57d76c5ff7-cp4cq"
Jul 08 16:35:30.779027 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:30.779013    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9f1b69b-ff6f-4124-ba65-d62017274056-additional-service-ca\") pod \"cluster-proxy-proxy-agent-f948c56d9-tfqgr\" (UID: \"f9f1b69b-ff6f-4124-ba65-d62017274056\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f948c56d9-tfqgr"
Jul 08 16:35:30.779153 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:30.779036    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f9f1b69b-ff6f-4124-ba65-d62017274056-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-f948c56d9-tfqgr\" (UID: \"f9f1b69b-ff6f-4124-ba65-d62017274056\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f948c56d9-tfqgr"
Jul 08 16:35:30.779153 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:30.779056    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dfb432e6-c846-433e-a711-d12445351d36-registry-tls\") pod \"image-registry-57d76c5ff7-cp4cq\" (UID: \"dfb432e6-c846-433e-a711-d12445351d36\") " pod="openshift-image-registry/image-registry-57d76c5ff7-cp4cq"
Jul 08 16:35:30.779153 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:30.779073    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dfb432e6-c846-433e-a711-d12445351d36-installation-pull-secrets\") pod \"image-registry-57d76c5ff7-cp4cq\" (UID: \"dfb432e6-c846-433e-a711-d12445351d36\") " pod="openshift-image-registry/image-registry-57d76c5ff7-cp4cq"
Jul 08 16:35:30.779153 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:30.779108    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dfb432e6-c846-433e-a711-d12445351d36-registry-certificates\") pod \"image-registry-57d76c5ff7-cp4cq\" (UID: \"dfb432e6-c846-433e-a711-d12445351d36\") " pod="openshift-image-registry/image-registry-57d76c5ff7-cp4cq"
Jul 08 16:35:30.779364 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:30.779154    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f9f1b69b-ff6f-4124-ba65-d62017274056-ca\") pod \"cluster-proxy-proxy-agent-f948c56d9-tfqgr\" (UID: \"f9f1b69b-ff6f-4124-ba65-d62017274056\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f948c56d9-tfqgr"
Jul 08 16:35:30.779364 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:30.779192    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqls7\" (UniqueName: \"kubernetes.io/projected/f9f1b69b-ff6f-4124-ba65-d62017274056-kube-api-access-lqls7\") pod \"cluster-proxy-proxy-agent-f948c56d9-tfqgr\" (UID: \"f9f1b69b-ff6f-4124-ba65-d62017274056\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f948c56d9-tfqgr"
Jul 08 16:35:30.779364 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:30.779258    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dfb432e6-c846-433e-a711-d12445351d36-image-registry-private-configuration\") pod \"image-registry-57d76c5ff7-cp4cq\" (UID: \"dfb432e6-c846-433e-a711-d12445351d36\") " pod="openshift-image-registry/image-registry-57d76c5ff7-cp4cq"
Jul 08 16:35:30.779498 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:30.779384    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f9f1b69b-ff6f-4124-ba65-d62017274056-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-f948c56d9-tfqgr\" (UID: \"f9f1b69b-ff6f-4124-ba65-d62017274056\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f948c56d9-tfqgr"
Jul 08 16:35:30.779498 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:30.779419    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f9f1b69b-ff6f-4124-ba65-d62017274056-hub\") pod \"cluster-proxy-proxy-agent-f948c56d9-tfqgr\" (UID: \"f9f1b69b-ff6f-4124-ba65-d62017274056\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f948c56d9-tfqgr"
Jul 08 16:35:30.779498 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:30.779475    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dfb432e6-c846-433e-a711-d12445351d36-trusted-ca\") pod \"image-registry-57d76c5ff7-cp4cq\" (UID: \"dfb432e6-c846-433e-a711-d12445351d36\") " pod="openshift-image-registry/image-registry-57d76c5ff7-cp4cq"
Jul 08 16:35:30.779769 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:30.779671    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9f1b69b-ff6f-4124-ba65-d62017274056-additional-service-ca\") pod \"cluster-proxy-proxy-agent-f948c56d9-tfqgr\" (UID: \"f9f1b69b-ff6f-4124-ba65-d62017274056\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f948c56d9-tfqgr"
Jul 08 16:35:30.781529 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:30.781506    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f9f1b69b-ff6f-4124-ba65-d62017274056-ca\") pod \"cluster-proxy-proxy-agent-f948c56d9-tfqgr\" (UID: \"f9f1b69b-ff6f-4124-ba65-d62017274056\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f948c56d9-tfqgr"
Jul 08 16:35:30.781717 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:30.781699    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f9f1b69b-ff6f-4124-ba65-d62017274056-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-f948c56d9-tfqgr\" (UID: \"f9f1b69b-ff6f-4124-ba65-d62017274056\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f948c56d9-tfqgr"
Jul 08 16:35:30.781781 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:30.781702    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f9f1b69b-ff6f-4124-ba65-d62017274056-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-f948c56d9-tfqgr\" (UID: \"f9f1b69b-ff6f-4124-ba65-d62017274056\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f948c56d9-tfqgr"
Jul 08 16:35:30.781920 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:30.781903    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f9f1b69b-ff6f-4124-ba65-d62017274056-hub\") pod \"cluster-proxy-proxy-agent-f948c56d9-tfqgr\" (UID: \"f9f1b69b-ff6f-4124-ba65-d62017274056\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f948c56d9-tfqgr"
Jul 08 16:35:30.794232 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:30.794192    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqls7\" (UniqueName: \"kubernetes.io/projected/f9f1b69b-ff6f-4124-ba65-d62017274056-kube-api-access-lqls7\") pod \"cluster-proxy-proxy-agent-f948c56d9-tfqgr\" (UID: \"f9f1b69b-ff6f-4124-ba65-d62017274056\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f948c56d9-tfqgr"
Jul 08 16:35:30.878033 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:30.877981    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f948c56d9-tfqgr"
Jul 08 16:35:30.879806 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:30.879787    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dfb432e6-c846-433e-a711-d12445351d36-bound-sa-token\") pod \"image-registry-57d76c5ff7-cp4cq\" (UID: \"dfb432e6-c846-433e-a711-d12445351d36\") " pod="openshift-image-registry/image-registry-57d76c5ff7-cp4cq"
Jul 08 16:35:30.879896 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:30.879845    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dfb432e6-c846-433e-a711-d12445351d36-ca-trust-extracted\") pod \"image-registry-57d76c5ff7-cp4cq\" (UID: \"dfb432e6-c846-433e-a711-d12445351d36\") " pod="openshift-image-registry/image-registry-57d76c5ff7-cp4cq"
Jul 08 16:35:30.879896 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:30.879879    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxvbd\" (UniqueName: \"kubernetes.io/projected/dfb432e6-c846-433e-a711-d12445351d36-kube-api-access-rxvbd\") pod \"image-registry-57d76c5ff7-cp4cq\" (UID: \"dfb432e6-c846-433e-a711-d12445351d36\") " pod="openshift-image-registry/image-registry-57d76c5ff7-cp4cq"
Jul 08 16:35:30.880005 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:30.879911    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dfb432e6-c846-433e-a711-d12445351d36-registry-tls\") pod \"image-registry-57d76c5ff7-cp4cq\" (UID: \"dfb432e6-c846-433e-a711-d12445351d36\") " pod="openshift-image-registry/image-registry-57d76c5ff7-cp4cq"
Jul 08 16:35:30.880005 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:30.879939    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dfb432e6-c846-433e-a711-d12445351d36-installation-pull-secrets\") pod \"image-registry-57d76c5ff7-cp4cq\" (UID: \"dfb432e6-c846-433e-a711-d12445351d36\") " pod="openshift-image-registry/image-registry-57d76c5ff7-cp4cq"
Jul 08 16:35:30.880005 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:30.879982    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dfb432e6-c846-433e-a711-d12445351d36-registry-certificates\") pod \"image-registry-57d76c5ff7-cp4cq\" (UID: \"dfb432e6-c846-433e-a711-d12445351d36\") " pod="openshift-image-registry/image-registry-57d76c5ff7-cp4cq"
Jul 08 16:35:30.880555 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:30.880018    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dfb432e6-c846-433e-a711-d12445351d36-image-registry-private-configuration\") pod \"image-registry-57d76c5ff7-cp4cq\" (UID: \"dfb432e6-c846-433e-a711-d12445351d36\") " pod="openshift-image-registry/image-registry-57d76c5ff7-cp4cq"
Jul 08 16:35:30.880555 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:30.880067    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dfb432e6-c846-433e-a711-d12445351d36-trusted-ca\") pod \"image-registry-57d76c5ff7-cp4cq\" (UID: \"dfb432e6-c846-433e-a711-d12445351d36\") " pod="openshift-image-registry/image-registry-57d76c5ff7-cp4cq"
Jul 08 16:35:30.880555 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:30.880148    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dfb432e6-c846-433e-a711-d12445351d36-ca-trust-extracted\") pod \"image-registry-57d76c5ff7-cp4cq\" (UID: \"dfb432e6-c846-433e-a711-d12445351d36\") " pod="openshift-image-registry/image-registry-57d76c5ff7-cp4cq"
Jul 08 16:35:30.880956 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:30.880937    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dfb432e6-c846-433e-a711-d12445351d36-trusted-ca\") pod \"image-registry-57d76c5ff7-cp4cq\" (UID: \"dfb432e6-c846-433e-a711-d12445351d36\") " pod="openshift-image-registry/image-registry-57d76c5ff7-cp4cq"
Jul 08 16:35:30.881024 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:30.880997    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dfb432e6-c846-433e-a711-d12445351d36-registry-certificates\") pod \"image-registry-57d76c5ff7-cp4cq\" (UID: \"dfb432e6-c846-433e-a711-d12445351d36\") " pod="openshift-image-registry/image-registry-57d76c5ff7-cp4cq"
Jul 08 16:35:30.882364 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:30.882344    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dfb432e6-c846-433e-a711-d12445351d36-registry-tls\") pod \"image-registry-57d76c5ff7-cp4cq\" (UID: \"dfb432e6-c846-433e-a711-d12445351d36\") " pod="openshift-image-registry/image-registry-57d76c5ff7-cp4cq"
Jul 08 16:35:30.882464 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:30.882445    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dfb432e6-c846-433e-a711-d12445351d36-installation-pull-secrets\") pod \"image-registry-57d76c5ff7-cp4cq\" (UID: \"dfb432e6-c846-433e-a711-d12445351d36\") " pod="openshift-image-registry/image-registry-57d76c5ff7-cp4cq"
Jul 08 16:35:30.882706 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:30.882685    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dfb432e6-c846-433e-a711-d12445351d36-image-registry-private-configuration\") pod \"image-registry-57d76c5ff7-cp4cq\" (UID: \"dfb432e6-c846-433e-a711-d12445351d36\") " pod="openshift-image-registry/image-registry-57d76c5ff7-cp4cq"
Jul 08 16:35:30.898727 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:30.898705    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxvbd\" (UniqueName: \"kubernetes.io/projected/dfb432e6-c846-433e-a711-d12445351d36-kube-api-access-rxvbd\") pod \"image-registry-57d76c5ff7-cp4cq\" (UID: \"dfb432e6-c846-433e-a711-d12445351d36\") " pod="openshift-image-registry/image-registry-57d76c5ff7-cp4cq"
Jul 08 16:35:30.898815 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:30.898726    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dfb432e6-c846-433e-a711-d12445351d36-bound-sa-token\") pod \"image-registry-57d76c5ff7-cp4cq\" (UID: \"dfb432e6-c846-433e-a711-d12445351d36\") " pod="openshift-image-registry/image-registry-57d76c5ff7-cp4cq"
Jul 08 16:35:30.970542 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:30.970517    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57d76c5ff7-cp4cq"
Jul 08 16:35:31.004843 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:31.004811    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f948c56d9-tfqgr"]
Jul 08 16:35:31.008824 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:35:31.008778    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf9f1b69b_ff6f_4124_ba65_d62017274056.slice/crio-fc323f31a3fb68f235b8cabd3c8554af2c4fd2b0af9c3916164f30d9a89d6318 WatchSource:0}: Error finding container fc323f31a3fb68f235b8cabd3c8554af2c4fd2b0af9c3916164f30d9a89d6318: Status 404 returned error can't find the container with id fc323f31a3fb68f235b8cabd3c8554af2c4fd2b0af9c3916164f30d9a89d6318
Jul 08 16:35:31.104571 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:31.104540    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57d76c5ff7-cp4cq"]
Jul 08 16:35:31.107293 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:35:31.107253    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfb432e6_c846_433e_a711_d12445351d36.slice/crio-dfa78c2d8714eff4a7f7b91f5f5d5ec875bc69aa864cc207fb7f24e44e6c6154 WatchSource:0}: Error finding container dfa78c2d8714eff4a7f7b91f5f5d5ec875bc69aa864cc207fb7f24e44e6c6154: Status 404 returned error can't find the container with id dfa78c2d8714eff4a7f7b91f5f5d5ec875bc69aa864cc207fb7f24e44e6c6154
Jul 08 16:35:31.837918 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:31.837879    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57d76c5ff7-cp4cq" event={"ID":"dfb432e6-c846-433e-a711-d12445351d36","Type":"ContainerStarted","Data":"55de940ff04be8b8bbf60cb13606f53f1cde7f139be15d38007b0eb1bcd61907"}
Jul 08 16:35:31.838075 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:31.837986    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57d76c5ff7-cp4cq" event={"ID":"dfb432e6-c846-433e-a711-d12445351d36","Type":"ContainerStarted","Data":"dfa78c2d8714eff4a7f7b91f5f5d5ec875bc69aa864cc207fb7f24e44e6c6154"}
Jul 08 16:35:31.838075 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:31.838025    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-57d76c5ff7-cp4cq"
Jul 08 16:35:31.839175 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:31.839144    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f948c56d9-tfqgr" event={"ID":"f9f1b69b-ff6f-4124-ba65-d62017274056","Type":"ContainerStarted","Data":"fc323f31a3fb68f235b8cabd3c8554af2c4fd2b0af9c3916164f30d9a89d6318"}
Jul 08 16:35:31.867386 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:31.866534    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-57d76c5ff7-cp4cq" podStartSLOduration=1.8665141520000001 podStartE2EDuration="1.866514152s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:35:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:31.865902924 +0000 UTC m=+65.966517493" watchObservedRunningTime="2026-07-08 16:35:31.866514152 +0000 UTC m=+65.967128723"
Jul 08 16:35:33.099215 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:33.099164    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4606c816-49c0-450f-a21f-7594bf0aaa89-original-pull-secret\") pod \"global-pull-secret-syncer-6gvmb\" (UID: \"4606c816-49c0-450f-a21f-7594bf0aaa89\") " pod="kube-system/global-pull-secret-syncer-6gvmb"
Jul 08 16:35:33.101922 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:33.101889    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 08 16:35:33.112796 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:33.112768    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4606c816-49c0-450f-a21f-7594bf0aaa89-original-pull-secret\") pod \"global-pull-secret-syncer-6gvmb\" (UID: \"4606c816-49c0-450f-a21f-7594bf0aaa89\") " pod="kube-system/global-pull-secret-syncer-6gvmb"
Jul 08 16:35:33.200323 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:33.200284    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8eb4f440-8261-4651-a10a-1ccd5cb14f60-metrics-certs\") pod \"network-metrics-daemon-psbhw\" (UID: \"8eb4f440-8261-4651-a10a-1ccd5cb14f60\") " pod="openshift-multus/network-metrics-daemon-psbhw"
Jul 08 16:35:33.200611 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:33.200355    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfnkm\" (UniqueName: \"kubernetes.io/projected/24e40bdc-44ee-4c05-8e65-bd4a3842a5cd-kube-api-access-zfnkm\") pod \"network-check-target-fftjw\" (UID: \"24e40bdc-44ee-4c05-8e65-bd4a3842a5cd\") " pod="openshift-network-diagnostics/network-check-target-fftjw"
Jul 08 16:35:33.203332 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:33.203303    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 08 16:35:33.203442 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:33.203334    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfnkm\" (UniqueName: \"kubernetes.io/projected/24e40bdc-44ee-4c05-8e65-bd4a3842a5cd-kube-api-access-zfnkm\") pod \"network-check-target-fftjw\" (UID: \"24e40bdc-44ee-4c05-8e65-bd4a3842a5cd\") " pod="openshift-network-diagnostics/network-check-target-fftjw"
Jul 08 16:35:33.213743 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:33.213719    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8eb4f440-8261-4651-a10a-1ccd5cb14f60-metrics-certs\") pod \"network-metrics-daemon-psbhw\" (UID: \"8eb4f440-8261-4651-a10a-1ccd5cb14f60\") " pod="openshift-multus/network-metrics-daemon-psbhw"
Jul 08 16:35:33.297000 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:33.296970    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-g78k4\""
Jul 08 16:35:33.305445 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:33.305416    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-psbhw"
Jul 08 16:35:33.398508 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:33.398446    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zs6bx\""
Jul 08 16:35:33.400544 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:33.400514    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gvmb"
Jul 08 16:35:33.406680 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:33.406661    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fftjw"
Jul 08 16:35:34.561710 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:34.561688    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fftjw"]
Jul 08 16:35:34.564122 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:35:34.564095    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24e40bdc_44ee_4c05_8e65_bd4a3842a5cd.slice/crio-6ac3d020096c79ab8e0b615788a95b68a87e0b0f9c6aaadac89ef5fe7e438023 WatchSource:0}: Error finding container 6ac3d020096c79ab8e0b615788a95b68a87e0b0f9c6aaadac89ef5fe7e438023: Status 404 returned error can't find the container with id 6ac3d020096c79ab8e0b615788a95b68a87e0b0f9c6aaadac89ef5fe7e438023
Jul 08 16:35:34.782776 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:34.782743    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-psbhw"]
Jul 08 16:35:34.783834 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:34.783815    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6gvmb"]
Jul 08 16:35:34.810429 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:35:34.810404    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8eb4f440_8261_4651_a10a_1ccd5cb14f60.slice/crio-d50177d8226ce4fe51b5724e19ae63d2b2f7c35ac7cce4fdd1cadea7bd3ddbd8 WatchSource:0}: Error finding container d50177d8226ce4fe51b5724e19ae63d2b2f7c35ac7cce4fdd1cadea7bd3ddbd8: Status 404 returned error can't find the container with id d50177d8226ce4fe51b5724e19ae63d2b2f7c35ac7cce4fdd1cadea7bd3ddbd8
Jul 08 16:35:34.810933 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:35:34.810908    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4606c816_49c0_450f_a21f_7594bf0aaa89.slice/crio-dbfc0845417c5fcd82f31f188e13b0a0fbf21af39312f19931f8abf0ebfe3ed5 WatchSource:0}: Error finding container dbfc0845417c5fcd82f31f188e13b0a0fbf21af39312f19931f8abf0ebfe3ed5: Status 404 returned error can't find the container with id dbfc0845417c5fcd82f31f188e13b0a0fbf21af39312f19931f8abf0ebfe3ed5
Jul 08 16:35:34.850044 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:34.850010    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-psbhw" event={"ID":"8eb4f440-8261-4651-a10a-1ccd5cb14f60","Type":"ContainerStarted","Data":"d50177d8226ce4fe51b5724e19ae63d2b2f7c35ac7cce4fdd1cadea7bd3ddbd8"}
Jul 08 16:35:34.851205 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:34.851175    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6gvmb" event={"ID":"4606c816-49c0-450f-a21f-7594bf0aaa89","Type":"ContainerStarted","Data":"dbfc0845417c5fcd82f31f188e13b0a0fbf21af39312f19931f8abf0ebfe3ed5"}
Jul 08 16:35:34.852656 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:34.852632    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fftjw" event={"ID":"24e40bdc-44ee-4c05-8e65-bd4a3842a5cd","Type":"ContainerStarted","Data":"a860ce94ea0b02af230a1680fc66a27b7e7f5a731c8f0d5cab2c4775aae5da51"}
Jul 08 16:35:34.852738 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:34.852678    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fftjw" event={"ID":"24e40bdc-44ee-4c05-8e65-bd4a3842a5cd","Type":"ContainerStarted","Data":"6ac3d020096c79ab8e0b615788a95b68a87e0b0f9c6aaadac89ef5fe7e438023"}
Jul 08 16:35:34.852809 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:34.852747    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-fftjw"
Jul 08 16:35:34.871283 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:34.871246    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-fftjw" podStartSLOduration=68.871214393 podStartE2EDuration="1m8.871214393s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:34:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:34.870827666 +0000 UTC m=+68.971442235" watchObservedRunningTime="2026-07-08 16:35:34.871214393 +0000 UTC m=+68.971828954"
Jul 08 16:35:35.315370 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:35.315207    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a1f9ebe4-e7cd-4413-a587-0c86effbd290-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nk8jb\" (UID: \"a1f9ebe4-e7cd-4413-a587-0c86effbd290\") " pod="openshift-insights/insights-runtime-extractor-nk8jb"
Jul 08 16:35:35.318197 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:35.318161    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a1f9ebe4-e7cd-4413-a587-0c86effbd290-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nk8jb\" (UID: \"a1f9ebe4-e7cd-4413-a587-0c86effbd290\") " pod="openshift-insights/insights-runtime-extractor-nk8jb"
Jul 08 16:35:35.577380 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:35.577300    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-cshmv\""
Jul 08 16:35:35.585526 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:35.585493    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nk8jb"
Jul 08 16:35:35.750946 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:35.750911    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nk8jb"]
Jul 08 16:35:35.860621 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:35.860472    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f948c56d9-tfqgr" event={"ID":"f9f1b69b-ff6f-4124-ba65-d62017274056","Type":"ContainerStarted","Data":"c36dd3cb4ab58c2f6ca03d85e92997529b4a4fa63a685f19cff56dab2fb75397"}
Jul 08 16:35:35.860621 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:35.860590    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f948c56d9-tfqgr" event={"ID":"f9f1b69b-ff6f-4124-ba65-d62017274056","Type":"ContainerStarted","Data":"aec95f2b224d1110a579f2383bd4cc399f50a77e61d99e1d4631988b19c73cca"}
Jul 08 16:35:35.861006 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:35.860978    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f948c56d9-tfqgr" event={"ID":"f9f1b69b-ff6f-4124-ba65-d62017274056","Type":"ContainerStarted","Data":"7bc9c0428cbd2f991d313f1aa253faca42607ac1568c7eca2112f727b12178ff"}
Jul 08 16:35:35.884804 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:35.883781    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f948c56d9-tfqgr" podStartSLOduration=2.036256766 podStartE2EDuration="5.883762355s" totalImagesPullingTime="3.847505589s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:35:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:35.883264387 +0000 UTC m=+69.983878957" watchObservedRunningTime="2026-07-08 16:35:35.883762355 +0000 UTC m=+69.984376927"
Jul 08 16:35:36.042942 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:35:36.042907    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1f9ebe4_e7cd_4413_a587_0c86effbd290.slice/crio-b4d07f98d5d75ea62bcb6393bb9f6666530d7c71f8856ea83a7cf04bd5194ec6 WatchSource:0}: Error finding container b4d07f98d5d75ea62bcb6393bb9f6666530d7c71f8856ea83a7cf04bd5194ec6: Status 404 returned error can't find the container with id b4d07f98d5d75ea62bcb6393bb9f6666530d7c71f8856ea83a7cf04bd5194ec6
Jul 08 16:35:36.866577 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:36.866491    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-psbhw" event={"ID":"8eb4f440-8261-4651-a10a-1ccd5cb14f60","Type":"ContainerStarted","Data":"a0212c6d36044df60b692f50232f14dd33fcfc3022f03b20fdd5950bd37dbaa2"}
Jul 08 16:35:36.866577 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:36.866555    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-psbhw" event={"ID":"8eb4f440-8261-4651-a10a-1ccd5cb14f60","Type":"ContainerStarted","Data":"2952a37b5ed5181de20f0a87d766a7a20494b58dca07a0433b3d819c03143b0d"}
Jul 08 16:35:36.868504 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:36.868464    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nk8jb" event={"ID":"a1f9ebe4-e7cd-4413-a587-0c86effbd290","Type":"ContainerStarted","Data":"b4d07f98d5d75ea62bcb6393bb9f6666530d7c71f8856ea83a7cf04bd5194ec6"}
Jul 08 16:35:36.895065 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:36.894954    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-psbhw" podStartSLOduration=69.399912987 podStartE2EDuration="1m10.894935881s" totalImagesPullingTime="1.495022894s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:34:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:36.894413158 +0000 UTC m=+70.995027727" watchObservedRunningTime="2026-07-08 16:35:36.894935881 +0000 UTC m=+70.995550453"
Jul 08 16:35:41.888725 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:41.888683    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6gvmb" event={"ID":"4606c816-49c0-450f-a21f-7594bf0aaa89","Type":"ContainerStarted","Data":"4a3f138294b9461b572b7852ceacaba418ea0876bdd1a50520b4379691ef5916"}
Jul 08 16:35:41.890075 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:41.890053    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nk8jb" event={"ID":"a1f9ebe4-e7cd-4413-a587-0c86effbd290","Type":"ContainerStarted","Data":"2e8ee014178f3dd6b4eab50952b21901b57fbc09ed630e0191d926932978322a"}
Jul 08 16:35:41.908172 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:41.908114    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6gvmb" podStartSLOduration=69.366642442 podStartE2EDuration="1m15.908100498s" totalImagesPullingTime="6.541458056s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:34:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:41.907304886 +0000 UTC m=+76.007919456" watchObservedRunningTime="2026-07-08 16:35:41.908100498 +0000 UTC m=+76.008715068"
Jul 08 16:35:42.896188 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:42.896143    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nk8jb" event={"ID":"a1f9ebe4-e7cd-4413-a587-0c86effbd290","Type":"ContainerStarted","Data":"1952a171d130d21fcf840a46f2adb97f88d898df063fcc965339a32b8471b789"}
Jul 08 16:35:43.329535 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:43.329493    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8fbnv"]
Jul 08 16:35:43.331823 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:43.331798    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8fbnv"
Jul 08 16:35:43.334526 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:43.334497    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 08 16:35:43.334649 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:43.334501    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dzgdb\""
Jul 08 16:35:43.334863 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:43.334791    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 08 16:35:43.335355 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:43.335331    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 08 16:35:43.335468 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:43.335401    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 08 16:35:43.335468 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:43.335433    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 08 16:35:43.335468 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:43.335450    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 08 16:35:43.381727 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:43.381694    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clz6g\" (UniqueName: \"kubernetes.io/projected/a16873bb-b3ad-4609-9007-0b2745e7bb83-kube-api-access-clz6g\") pod \"node-exporter-8fbnv\" (UID: \"a16873bb-b3ad-4609-9007-0b2745e7bb83\") " pod="openshift-monitoring/node-exporter-8fbnv"
Jul 08 16:35:43.381904 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:43.381733    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a16873bb-b3ad-4609-9007-0b2745e7bb83-node-exporter-textfile\") pod \"node-exporter-8fbnv\" (UID: \"a16873bb-b3ad-4609-9007-0b2745e7bb83\") " pod="openshift-monitoring/node-exporter-8fbnv"
Jul 08 16:35:43.381904 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:43.381758    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a16873bb-b3ad-4609-9007-0b2745e7bb83-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8fbnv\" (UID: \"a16873bb-b3ad-4609-9007-0b2745e7bb83\") " pod="openshift-monitoring/node-exporter-8fbnv"
Jul 08 16:35:43.381904 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:43.381777    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a16873bb-b3ad-4609-9007-0b2745e7bb83-node-exporter-accelerators-collector-config\") pod \"node-exporter-8fbnv\" (UID: \"a16873bb-b3ad-4609-9007-0b2745e7bb83\") " pod="openshift-monitoring/node-exporter-8fbnv"
Jul 08 16:35:43.381904 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:43.381851    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a16873bb-b3ad-4609-9007-0b2745e7bb83-root\") pod \"node-exporter-8fbnv\" (UID: \"a16873bb-b3ad-4609-9007-0b2745e7bb83\") " pod="openshift-monitoring/node-exporter-8fbnv"
Jul 08 16:35:43.381904 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:43.381876    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a16873bb-b3ad-4609-9007-0b2745e7bb83-node-exporter-wtmp\") pod \"node-exporter-8fbnv\" (UID: \"a16873bb-b3ad-4609-9007-0b2745e7bb83\") " pod="openshift-monitoring/node-exporter-8fbnv"
Jul 08 16:35:43.381904 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:43.381905    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a16873bb-b3ad-4609-9007-0b2745e7bb83-node-exporter-tls\") pod \"node-exporter-8fbnv\" (UID: \"a16873bb-b3ad-4609-9007-0b2745e7bb83\") " pod="openshift-monitoring/node-exporter-8fbnv"
Jul 08 16:35:43.382123 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:43.381923    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a16873bb-b3ad-4609-9007-0b2745e7bb83-sys\") pod \"node-exporter-8fbnv\" (UID: \"a16873bb-b3ad-4609-9007-0b2745e7bb83\") " pod="openshift-monitoring/node-exporter-8fbnv"
Jul 08 16:35:43.382123 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:43.381948    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a16873bb-b3ad-4609-9007-0b2745e7bb83-metrics-client-ca\") pod \"node-exporter-8fbnv\" (UID: \"a16873bb-b3ad-4609-9007-0b2745e7bb83\") " pod="openshift-monitoring/node-exporter-8fbnv"
Jul 08 16:35:43.482849 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:43.482813    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a16873bb-b3ad-4609-9007-0b2745e7bb83-sys\") pod \"node-exporter-8fbnv\" (UID: \"a16873bb-b3ad-4609-9007-0b2745e7bb83\") " pod="openshift-monitoring/node-exporter-8fbnv"
Jul 08 16:35:43.482849 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:43.482857    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a16873bb-b3ad-4609-9007-0b2745e7bb83-metrics-client-ca\") pod \"node-exporter-8fbnv\" (UID: \"a16873bb-b3ad-4609-9007-0b2745e7bb83\") " pod="openshift-monitoring/node-exporter-8fbnv"
Jul 08 16:35:43.483095 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:43.482886    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clz6g\" (UniqueName: \"kubernetes.io/projected/a16873bb-b3ad-4609-9007-0b2745e7bb83-kube-api-access-clz6g\") pod \"node-exporter-8fbnv\" (UID: \"a16873bb-b3ad-4609-9007-0b2745e7bb83\") " pod="openshift-monitoring/node-exporter-8fbnv"
Jul 08 16:35:43.483095 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:43.482924    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a16873bb-b3ad-4609-9007-0b2745e7bb83-node-exporter-textfile\") pod \"node-exporter-8fbnv\" (UID: \"a16873bb-b3ad-4609-9007-0b2745e7bb83\") " pod="openshift-monitoring/node-exporter-8fbnv"
Jul 08 16:35:43.483095 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:43.482932    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a16873bb-b3ad-4609-9007-0b2745e7bb83-sys\") pod \"node-exporter-8fbnv\" (UID: \"a16873bb-b3ad-4609-9007-0b2745e7bb83\") " pod="openshift-monitoring/node-exporter-8fbnv"
Jul 08 16:35:43.483095 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:43.482947    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a16873bb-b3ad-4609-9007-0b2745e7bb83-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8fbnv\" (UID: \"a16873bb-b3ad-4609-9007-0b2745e7bb83\") " pod="openshift-monitoring/node-exporter-8fbnv"
Jul 08 16:35:43.483095 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:43.482971    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a16873bb-b3ad-4609-9007-0b2745e7bb83-node-exporter-accelerators-collector-config\") pod \"node-exporter-8fbnv\" (UID: \"a16873bb-b3ad-4609-9007-0b2745e7bb83\") " pod="openshift-monitoring/node-exporter-8fbnv"
Jul 08 16:35:43.483369 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:43.483102    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a16873bb-b3ad-4609-9007-0b2745e7bb83-root\") pod \"node-exporter-8fbnv\" (UID: \"a16873bb-b3ad-4609-9007-0b2745e7bb83\") " pod="openshift-monitoring/node-exporter-8fbnv"
Jul 08 16:35:43.483369 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:43.483144    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a16873bb-b3ad-4609-9007-0b2745e7bb83-node-exporter-wtmp\") pod \"node-exporter-8fbnv\" (UID: \"a16873bb-b3ad-4609-9007-0b2745e7bb83\") " pod="openshift-monitoring/node-exporter-8fbnv"
Jul 08 16:35:43.483369 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:43.483191    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a16873bb-b3ad-4609-9007-0b2745e7bb83-node-exporter-tls\") pod \"node-exporter-8fbnv\" (UID: \"a16873bb-b3ad-4609-9007-0b2745e7bb83\") " pod="openshift-monitoring/node-exporter-8fbnv"
Jul 08 16:35:43.483369 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:43.483289    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a16873bb-b3ad-4609-9007-0b2745e7bb83-node-exporter-textfile\") pod \"node-exporter-8fbnv\" (UID: \"a16873bb-b3ad-4609-9007-0b2745e7bb83\") " pod="openshift-monitoring/node-exporter-8fbnv"
Jul 08 16:35:43.483369 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:35:43.483347    2565 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 08 16:35:43.483369 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:43.483362    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a16873bb-b3ad-4609-9007-0b2745e7bb83-node-exporter-wtmp\") pod \"node-exporter-8fbnv\" (UID: \"a16873bb-b3ad-4609-9007-0b2745e7bb83\") " pod="openshift-monitoring/node-exporter-8fbnv"
Jul 08 16:35:43.483634 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:43.483363    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a16873bb-b3ad-4609-9007-0b2745e7bb83-root\") pod \"node-exporter-8fbnv\" (UID: \"a16873bb-b3ad-4609-9007-0b2745e7bb83\") " pod="openshift-monitoring/node-exporter-8fbnv"
Jul 08 16:35:43.483634 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:35:43.483408    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a16873bb-b3ad-4609-9007-0b2745e7bb83-node-exporter-tls podName:a16873bb-b3ad-4609-9007-0b2745e7bb83 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:43.983390053 +0000 UTC m=+78.084004601 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/a16873bb-b3ad-4609-9007-0b2745e7bb83-node-exporter-tls") pod "node-exporter-8fbnv" (UID: "a16873bb-b3ad-4609-9007-0b2745e7bb83") : secret "node-exporter-tls" not found
Jul 08 16:35:43.483634 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:43.483569    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a16873bb-b3ad-4609-9007-0b2745e7bb83-node-exporter-accelerators-collector-config\") pod \"node-exporter-8fbnv\" (UID: \"a16873bb-b3ad-4609-9007-0b2745e7bb83\") " pod="openshift-monitoring/node-exporter-8fbnv"
Jul 08 16:35:43.483634 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:43.483591    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a16873bb-b3ad-4609-9007-0b2745e7bb83-metrics-client-ca\") pod \"node-exporter-8fbnv\" (UID: \"a16873bb-b3ad-4609-9007-0b2745e7bb83\") " pod="openshift-monitoring/node-exporter-8fbnv"
Jul 08 16:35:43.485542 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:43.485516    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a16873bb-b3ad-4609-9007-0b2745e7bb83-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8fbnv\" (UID: \"a16873bb-b3ad-4609-9007-0b2745e7bb83\") " pod="openshift-monitoring/node-exporter-8fbnv"
Jul 08 16:35:43.500816 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:43.500791    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clz6g\" (UniqueName: \"kubernetes.io/projected/a16873bb-b3ad-4609-9007-0b2745e7bb83-kube-api-access-clz6g\") pod \"node-exporter-8fbnv\" (UID: \"a16873bb-b3ad-4609-9007-0b2745e7bb83\") " pod="openshift-monitoring/node-exporter-8fbnv"
Jul 08 16:35:43.987084 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:43.987038    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a16873bb-b3ad-4609-9007-0b2745e7bb83-node-exporter-tls\") pod \"node-exporter-8fbnv\" (UID: \"a16873bb-b3ad-4609-9007-0b2745e7bb83\") " pod="openshift-monitoring/node-exporter-8fbnv"
Jul 08 16:35:43.989809 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:43.989780    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a16873bb-b3ad-4609-9007-0b2745e7bb83-node-exporter-tls\") pod \"node-exporter-8fbnv\" (UID: \"a16873bb-b3ad-4609-9007-0b2745e7bb83\") " pod="openshift-monitoring/node-exporter-8fbnv"
Jul 08 16:35:44.243394 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:44.243299    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8fbnv"
Jul 08 16:35:44.541155 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:35:44.541120    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda16873bb_b3ad_4609_9007_0b2745e7bb83.slice/crio-6b040e3f72f0fceca078da741673bf7cecb3a4d1f07e31228ce91050bad77481 WatchSource:0}: Error finding container 6b040e3f72f0fceca078da741673bf7cecb3a4d1f07e31228ce91050bad77481: Status 404 returned error can't find the container with id 6b040e3f72f0fceca078da741673bf7cecb3a4d1f07e31228ce91050bad77481
Jul 08 16:35:44.905315 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:44.905201    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nk8jb" event={"ID":"a1f9ebe4-e7cd-4413-a587-0c86effbd290","Type":"ContainerStarted","Data":"bf077ebc16dcf48c3f957f88bb32c7f6b2d20891aad536aadfb7d7f1307ba369"}
Jul 08 16:35:44.906549 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:44.906523    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8fbnv" event={"ID":"a16873bb-b3ad-4609-9007-0b2745e7bb83","Type":"ContainerStarted","Data":"6b040e3f72f0fceca078da741673bf7cecb3a4d1f07e31228ce91050bad77481"}
Jul 08 16:35:44.928719 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:44.928669    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-nk8jb" podStartSLOduration=33.518236265 podStartE2EDuration="41.92865442s" totalImagesPullingTime="8.410418155s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:35:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:44.927708473 +0000 UTC m=+79.028323044" watchObservedRunningTime="2026-07-08 16:35:44.92865442 +0000 UTC m=+79.029268990"
Jul 08 16:35:45.912091 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:45.911991    2565 generic.go:356] "Generic (PLEG): container finished" podID="a16873bb-b3ad-4609-9007-0b2745e7bb83" containerID="e4a024fd525362535afa3952c77ab118b065977ac34966a0bce5eef0b8fa9f67" exitCode=0
Jul 08 16:35:45.912503 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:45.912101    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8fbnv" event={"ID":"a16873bb-b3ad-4609-9007-0b2745e7bb83","Type":"ContainerDied","Data":"e4a024fd525362535afa3952c77ab118b065977ac34966a0bce5eef0b8fa9f67"}
Jul 08 16:35:46.918214 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:46.918077    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8fbnv" event={"ID":"a16873bb-b3ad-4609-9007-0b2745e7bb83","Type":"ContainerStarted","Data":"1a663ec35b13e86f71b3fd71f5e87bf16bfadb36e66f8eeb4bfa763e57428daa"}
Jul 08 16:35:46.918214 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:46.918137    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8fbnv" event={"ID":"a16873bb-b3ad-4609-9007-0b2745e7bb83","Type":"ContainerStarted","Data":"150c75e09889e37a21978728e09c894cad5f72bdb19d2cc6c28b90fe003b815c"}
Jul 08 16:35:46.945984 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:46.942641    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8fbnv" podStartSLOduration=2.9658857039999997 podStartE2EDuration="3.942616405s" totalImagesPullingTime="904.107869ms" totalInitContainerRuntime="72.622832ms" isStatefulPod=true podCreationTimestamp="2026-07-08 16:35:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:46.941559367 +0000 UTC m=+81.042173938" watchObservedRunningTime="2026-07-08 16:35:46.942616405 +0000 UTC m=+81.043230974"
Jul 08 16:35:47.892310 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:47.892279    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-85696fc556-mtdtp"]
Jul 08 16:35:47.894755 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:47.894740    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-85696fc556-mtdtp"
Jul 08 16:35:47.897728 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:47.897705    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 08 16:35:47.898467 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:47.898451    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 08 16:35:47.898770 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:47.898755    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 08 16:35:47.898816 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:47.898782    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 08 16:35:47.898991 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:47.898977    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-z2cvl\""
Jul 08 16:35:47.900066 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:47.900050    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-1hco6ees8hjaa\""
Jul 08 16:35:47.911435 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:47.911407    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-85696fc556-mtdtp"]
Jul 08 16:35:48.018483 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:48.018441    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05cab2a7-b107-4f76-98ae-0ddba230eb64-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-85696fc556-mtdtp\" (UID: \"05cab2a7-b107-4f76-98ae-0ddba230eb64\") " pod="openshift-monitoring/metrics-server-85696fc556-mtdtp"
Jul 08 16:35:48.018977 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:48.018501    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xd7bq\" (UniqueName: \"kubernetes.io/projected/05cab2a7-b107-4f76-98ae-0ddba230eb64-kube-api-access-xd7bq\") pod \"metrics-server-85696fc556-mtdtp\" (UID: \"05cab2a7-b107-4f76-98ae-0ddba230eb64\") " pod="openshift-monitoring/metrics-server-85696fc556-mtdtp"
Jul 08 16:35:48.018977 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:48.018524    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/05cab2a7-b107-4f76-98ae-0ddba230eb64-secret-metrics-server-client-certs\") pod \"metrics-server-85696fc556-mtdtp\" (UID: \"05cab2a7-b107-4f76-98ae-0ddba230eb64\") " pod="openshift-monitoring/metrics-server-85696fc556-mtdtp"
Jul 08 16:35:48.018977 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:48.018610    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/05cab2a7-b107-4f76-98ae-0ddba230eb64-audit-log\") pod \"metrics-server-85696fc556-mtdtp\" (UID: \"05cab2a7-b107-4f76-98ae-0ddba230eb64\") " pod="openshift-monitoring/metrics-server-85696fc556-mtdtp"
Jul 08 16:35:48.018977 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:48.018684    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/05cab2a7-b107-4f76-98ae-0ddba230eb64-metrics-server-audit-profiles\") pod \"metrics-server-85696fc556-mtdtp\" (UID: \"05cab2a7-b107-4f76-98ae-0ddba230eb64\") " pod="openshift-monitoring/metrics-server-85696fc556-mtdtp"
Jul 08 16:35:48.018977 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:48.018772    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/05cab2a7-b107-4f76-98ae-0ddba230eb64-client-ca-bundle\") pod \"metrics-server-85696fc556-mtdtp\" (UID: \"05cab2a7-b107-4f76-98ae-0ddba230eb64\") " pod="openshift-monitoring/metrics-server-85696fc556-mtdtp"
Jul 08 16:35:48.018977 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:48.018916    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/05cab2a7-b107-4f76-98ae-0ddba230eb64-secret-metrics-server-tls\") pod \"metrics-server-85696fc556-mtdtp\" (UID: \"05cab2a7-b107-4f76-98ae-0ddba230eb64\") " pod="openshift-monitoring/metrics-server-85696fc556-mtdtp"
Jul 08 16:35:48.120087 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:48.120052    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/05cab2a7-b107-4f76-98ae-0ddba230eb64-audit-log\") pod \"metrics-server-85696fc556-mtdtp\" (UID: \"05cab2a7-b107-4f76-98ae-0ddba230eb64\") " pod="openshift-monitoring/metrics-server-85696fc556-mtdtp"
Jul 08 16:35:48.120303 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:48.120097    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/05cab2a7-b107-4f76-98ae-0ddba230eb64-metrics-server-audit-profiles\") pod \"metrics-server-85696fc556-mtdtp\" (UID: \"05cab2a7-b107-4f76-98ae-0ddba230eb64\") " pod="openshift-monitoring/metrics-server-85696fc556-mtdtp"
Jul 08 16:35:48.120303 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:48.120126    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/05cab2a7-b107-4f76-98ae-0ddba230eb64-client-ca-bundle\") pod \"metrics-server-85696fc556-mtdtp\" (UID: \"05cab2a7-b107-4f76-98ae-0ddba230eb64\") " pod="openshift-monitoring/metrics-server-85696fc556-mtdtp"
Jul 08 16:35:48.120303 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:48.120145    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/05cab2a7-b107-4f76-98ae-0ddba230eb64-secret-metrics-server-tls\") pod \"metrics-server-85696fc556-mtdtp\" (UID: \"05cab2a7-b107-4f76-98ae-0ddba230eb64\") " pod="openshift-monitoring/metrics-server-85696fc556-mtdtp"
Jul 08 16:35:48.120303 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:48.120164    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05cab2a7-b107-4f76-98ae-0ddba230eb64-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-85696fc556-mtdtp\" (UID: \"05cab2a7-b107-4f76-98ae-0ddba230eb64\") " pod="openshift-monitoring/metrics-server-85696fc556-mtdtp"
Jul 08 16:35:48.120303 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:48.120181    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xd7bq\" (UniqueName: \"kubernetes.io/projected/05cab2a7-b107-4f76-98ae-0ddba230eb64-kube-api-access-xd7bq\") pod \"metrics-server-85696fc556-mtdtp\" (UID: \"05cab2a7-b107-4f76-98ae-0ddba230eb64\") " pod="openshift-monitoring/metrics-server-85696fc556-mtdtp"
Jul 08 16:35:48.120303 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:48.120199    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/05cab2a7-b107-4f76-98ae-0ddba230eb64-secret-metrics-server-client-certs\") pod \"metrics-server-85696fc556-mtdtp\" (UID: \"05cab2a7-b107-4f76-98ae-0ddba230eb64\") " pod="openshift-monitoring/metrics-server-85696fc556-mtdtp"
Jul 08 16:35:48.120676 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:48.120537    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/05cab2a7-b107-4f76-98ae-0ddba230eb64-audit-log\") pod \"metrics-server-85696fc556-mtdtp\" (UID: \"05cab2a7-b107-4f76-98ae-0ddba230eb64\") " pod="openshift-monitoring/metrics-server-85696fc556-mtdtp"
Jul 08 16:35:48.121007 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:48.120976    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05cab2a7-b107-4f76-98ae-0ddba230eb64-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-85696fc556-mtdtp\" (UID: \"05cab2a7-b107-4f76-98ae-0ddba230eb64\") " pod="openshift-monitoring/metrics-server-85696fc556-mtdtp"
Jul 08 16:35:48.121400 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:48.121378    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/05cab2a7-b107-4f76-98ae-0ddba230eb64-metrics-server-audit-profiles\") pod \"metrics-server-85696fc556-mtdtp\" (UID: \"05cab2a7-b107-4f76-98ae-0ddba230eb64\") " pod="openshift-monitoring/metrics-server-85696fc556-mtdtp"
Jul 08 16:35:48.123074 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:48.123050    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/05cab2a7-b107-4f76-98ae-0ddba230eb64-secret-metrics-server-tls\") pod \"metrics-server-85696fc556-mtdtp\" (UID: \"05cab2a7-b107-4f76-98ae-0ddba230eb64\") " pod="openshift-monitoring/metrics-server-85696fc556-mtdtp"
Jul 08 16:35:48.123168 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:48.123151    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/05cab2a7-b107-4f76-98ae-0ddba230eb64-client-ca-bundle\") pod \"metrics-server-85696fc556-mtdtp\" (UID: \"05cab2a7-b107-4f76-98ae-0ddba230eb64\") " pod="openshift-monitoring/metrics-server-85696fc556-mtdtp"
Jul 08 16:35:48.123237 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:48.123195    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/05cab2a7-b107-4f76-98ae-0ddba230eb64-secret-metrics-server-client-certs\") pod \"metrics-server-85696fc556-mtdtp\" (UID: \"05cab2a7-b107-4f76-98ae-0ddba230eb64\") " pod="openshift-monitoring/metrics-server-85696fc556-mtdtp"
Jul 08 16:35:48.129770 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:48.129750    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xd7bq\" (UniqueName: \"kubernetes.io/projected/05cab2a7-b107-4f76-98ae-0ddba230eb64-kube-api-access-xd7bq\") pod \"metrics-server-85696fc556-mtdtp\" (UID: \"05cab2a7-b107-4f76-98ae-0ddba230eb64\") " pod="openshift-monitoring/metrics-server-85696fc556-mtdtp"
Jul 08 16:35:48.204324 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:48.204292    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-85696fc556-mtdtp"
Jul 08 16:35:48.349531 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:48.349399    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-85696fc556-mtdtp"]
Jul 08 16:35:48.353210 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:35:48.353174    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05cab2a7_b107_4f76_98ae_0ddba230eb64.slice/crio-ea57f50d7d7f528cdc68043e173705776b9154c1cb9e3b5939f48fc7fecad356 WatchSource:0}: Error finding container ea57f50d7d7f528cdc68043e173705776b9154c1cb9e3b5939f48fc7fecad356: Status 404 returned error can't find the container with id ea57f50d7d7f528cdc68043e173705776b9154c1cb9e3b5939f48fc7fecad356
Jul 08 16:35:48.926882 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:48.926848    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-85696fc556-mtdtp" event={"ID":"05cab2a7-b107-4f76-98ae-0ddba230eb64","Type":"ContainerStarted","Data":"ea57f50d7d7f528cdc68043e173705776b9154c1cb9e3b5939f48fc7fecad356"}
Jul 08 16:35:49.806395 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:49.806361    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 16:35:49.811339 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:49.811317    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:35:49.815410 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:49.815386    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 08 16:35:49.817678 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:49.817655    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 08 16:35:49.819953 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:49.819932    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 08 16:35:49.821024 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:49.821003    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 08 16:35:49.821123 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:49.821061    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-5gnngssjfsl4o\""
Jul 08 16:35:49.821123 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:49.821010    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 08 16:35:49.821259 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:49.821017    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 08 16:35:49.821335 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:49.821315    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-mqw42\""
Jul 08 16:35:49.821928 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:49.821720    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 08 16:35:49.821928 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:49.821784    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 08 16:35:49.823689 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:49.823653    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 08 16:35:49.824024 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:49.824004    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 08 16:35:49.824301 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:49.824277    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 08 16:35:49.824403 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:49.824279    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 08 16:35:49.825022 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:49.825001    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 08 16:35:49.831327 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:49.831296    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 08 16:35:49.846544 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:49.846516    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 16:35:49.934009 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:49.933980    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/302e3ff9-cc52-4edc-bf97-f9d108f4173a-web-config\") pod \"prometheus-k8s-0\" (UID: \"302e3ff9-cc52-4edc-bf97-f9d108f4173a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:35:49.934120 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:49.934030    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/302e3ff9-cc52-4edc-bf97-f9d108f4173a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"302e3ff9-cc52-4edc-bf97-f9d108f4173a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:35:49.934184 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:49.934112    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/302e3ff9-cc52-4edc-bf97-f9d108f4173a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"302e3ff9-cc52-4edc-bf97-f9d108f4173a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:35:49.934184 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:49.934172    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/302e3ff9-cc52-4edc-bf97-f9d108f4173a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"302e3ff9-cc52-4edc-bf97-f9d108f4173a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:35:49.934321 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:49.934261    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/302e3ff9-cc52-4edc-bf97-f9d108f4173a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"302e3ff9-cc52-4edc-bf97-f9d108f4173a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:35:49.934321 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:49.934287    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/302e3ff9-cc52-4edc-bf97-f9d108f4173a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"302e3ff9-cc52-4edc-bf97-f9d108f4173a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:35:49.934321 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:49.934311    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/302e3ff9-cc52-4edc-bf97-f9d108f4173a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"302e3ff9-cc52-4edc-bf97-f9d108f4173a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:35:49.934535 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:49.934351    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/302e3ff9-cc52-4edc-bf97-f9d108f4173a-config\") pod \"prometheus-k8s-0\" (UID: \"302e3ff9-cc52-4edc-bf97-f9d108f4173a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:35:49.934535 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:49.934418    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/302e3ff9-cc52-4edc-bf97-f9d108f4173a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"302e3ff9-cc52-4edc-bf97-f9d108f4173a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:35:49.934535 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:49.934455    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/302e3ff9-cc52-4edc-bf97-f9d108f4173a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"302e3ff9-cc52-4edc-bf97-f9d108f4173a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:35:49.934535 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:49.934491    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/302e3ff9-cc52-4edc-bf97-f9d108f4173a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"302e3ff9-cc52-4edc-bf97-f9d108f4173a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:35:49.934535 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:49.934513    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/302e3ff9-cc52-4edc-bf97-f9d108f4173a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"302e3ff9-cc52-4edc-bf97-f9d108f4173a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:35:49.934535 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:49.934532    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/302e3ff9-cc52-4edc-bf97-f9d108f4173a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"302e3ff9-cc52-4edc-bf97-f9d108f4173a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:35:49.934838 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:49.934546    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/302e3ff9-cc52-4edc-bf97-f9d108f4173a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"302e3ff9-cc52-4edc-bf97-f9d108f4173a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:35:49.934838 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:49.934569    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gq2s\" (UniqueName: \"kubernetes.io/projected/302e3ff9-cc52-4edc-bf97-f9d108f4173a-kube-api-access-8gq2s\") pod \"prometheus-k8s-0\" (UID: \"302e3ff9-cc52-4edc-bf97-f9d108f4173a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:35:49.934838 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:49.934587    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/302e3ff9-cc52-4edc-bf97-f9d108f4173a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"302e3ff9-cc52-4edc-bf97-f9d108f4173a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:35:49.934838 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:49.934603    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/302e3ff9-cc52-4edc-bf97-f9d108f4173a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"302e3ff9-cc52-4edc-bf97-f9d108f4173a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:35:49.934838 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:49.934639    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/302e3ff9-cc52-4edc-bf97-f9d108f4173a-config-out\") pod \"prometheus-k8s-0\" (UID: \"302e3ff9-cc52-4edc-bf97-f9d108f4173a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:35:49.934838 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:49.934672    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/302e3ff9-cc52-4edc-bf97-f9d108f4173a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"302e3ff9-cc52-4edc-bf97-f9d108f4173a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:35:49.934838 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:49.934696    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/302e3ff9-cc52-4edc-bf97-f9d108f4173a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"302e3ff9-cc52-4edc-bf97-f9d108f4173a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:35:50.035432 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:50.035393    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/302e3ff9-cc52-4edc-bf97-f9d108f4173a-web-config\") pod \"prometheus-k8s-0\" (UID: \"302e3ff9-cc52-4edc-bf97-f9d108f4173a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:35:50.035610 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:50.035443    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/302e3ff9-cc52-4edc-bf97-f9d108f4173a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"302e3ff9-cc52-4edc-bf97-f9d108f4173a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:35:50.035610 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:50.035580    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/302e3ff9-cc52-4edc-bf97-f9d108f4173a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"302e3ff9-cc52-4edc-bf97-f9d108f4173a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:35:50.035727 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:50.035616    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/302e3ff9-cc52-4edc-bf97-f9d108f4173a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"302e3ff9-cc52-4edc-bf97-f9d108f4173a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:35:50.035727 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:50.035646    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/302e3ff9-cc52-4edc-bf97-f9d108f4173a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"302e3ff9-cc52-4edc-bf97-f9d108f4173a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:35:50.035727 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:50.035672    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/302e3ff9-cc52-4edc-bf97-f9d108f4173a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"302e3ff9-cc52-4edc-bf97-f9d108f4173a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:35:50.035727 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:50.035698    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/302e3ff9-cc52-4edc-bf97-f9d108f4173a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"302e3ff9-cc52-4edc-bf97-f9d108f4173a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:35:50.035727 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:50.035728    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/302e3ff9-cc52-4edc-bf97-f9d108f4173a-config\") pod \"prometheus-k8s-0\" (UID: \"302e3ff9-cc52-4edc-bf97-f9d108f4173a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:35:50.035977 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:50.035756    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/302e3ff9-cc52-4edc-bf97-f9d108f4173a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"302e3ff9-cc52-4edc-bf97-f9d108f4173a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:35:50.035977 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:50.035786    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/302e3ff9-cc52-4edc-bf97-f9d108f4173a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"302e3ff9-cc52-4edc-bf97-f9d108f4173a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:35:50.035977 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:50.035833    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/302e3ff9-cc52-4edc-bf97-f9d108f4173a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"302e3ff9-cc52-4edc-bf97-f9d108f4173a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:35:50.035977 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:50.035872    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/302e3ff9-cc52-4edc-bf97-f9d108f4173a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"302e3ff9-cc52-4edc-bf97-f9d108f4173a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:35:50.035977 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:50.035906    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/302e3ff9-cc52-4edc-bf97-f9d108f4173a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"302e3ff9-cc52-4edc-bf97-f9d108f4173a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:35:50.035977 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:50.035929    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/302e3ff9-cc52-4edc-bf97-f9d108f4173a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"302e3ff9-cc52-4edc-bf97-f9d108f4173a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:35:50.035977 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:50.035951    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gq2s\" (UniqueName: \"kubernetes.io/projected/302e3ff9-cc52-4edc-bf97-f9d108f4173a-kube-api-access-8gq2s\") pod \"prometheus-k8s-0\" (UID: \"302e3ff9-cc52-4edc-bf97-f9d108f4173a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:35:50.035977 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:50.035978    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/302e3ff9-cc52-4edc-bf97-f9d108f4173a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"302e3ff9-cc52-4edc-bf97-f9d108f4173a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:35:50.036547 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:50.036009    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/302e3ff9-cc52-4edc-bf97-f9d108f4173a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"302e3ff9-cc52-4edc-bf97-f9d108f4173a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:35:50.036856 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:50.036829    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/302e3ff9-cc52-4edc-bf97-f9d108f4173a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"302e3ff9-cc52-4edc-bf97-f9d108f4173a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:35:50.037157 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:50.037129    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/302e3ff9-cc52-4edc-bf97-f9d108f4173a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"302e3ff9-cc52-4edc-bf97-f9d108f4173a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:35:50.037604 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:50.037574    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/302e3ff9-cc52-4edc-bf97-f9d108f4173a-config-out\") pod \"prometheus-k8s-0\" (UID: \"302e3ff9-cc52-4edc-bf97-f9d108f4173a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:35:50.037694 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:50.037651    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/302e3ff9-cc52-4edc-bf97-f9d108f4173a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"302e3ff9-cc52-4edc-bf97-f9d108f4173a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:35:50.037694 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:50.037681    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/302e3ff9-cc52-4edc-bf97-f9d108f4173a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"302e3ff9-cc52-4edc-bf97-f9d108f4173a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:35:50.038027 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:50.037998    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/302e3ff9-cc52-4edc-bf97-f9d108f4173a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"302e3ff9-cc52-4edc-bf97-f9d108f4173a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:35:50.038318 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:50.038293    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/302e3ff9-cc52-4edc-bf97-f9d108f4173a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"302e3ff9-cc52-4edc-bf97-f9d108f4173a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:35:50.038401 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:50.038339    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/302e3ff9-cc52-4edc-bf97-f9d108f4173a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"302e3ff9-cc52-4edc-bf97-f9d108f4173a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:35:50.039018 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:50.038992    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/302e3ff9-cc52-4edc-bf97-f9d108f4173a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"302e3ff9-cc52-4edc-bf97-f9d108f4173a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:35:50.039848 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:50.039824    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/302e3ff9-cc52-4edc-bf97-f9d108f4173a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"302e3ff9-cc52-4edc-bf97-f9d108f4173a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:35:50.040691 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:50.040662    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/302e3ff9-cc52-4edc-bf97-f9d108f4173a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"302e3ff9-cc52-4edc-bf97-f9d108f4173a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:35:50.040966 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:50.040942    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/302e3ff9-cc52-4edc-bf97-f9d108f4173a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"302e3ff9-cc52-4edc-bf97-f9d108f4173a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:35:50.041095 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:50.041072    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/302e3ff9-cc52-4edc-bf97-f9d108f4173a-web-config\") pod \"prometheus-k8s-0\" (UID: \"302e3ff9-cc52-4edc-bf97-f9d108f4173a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:35:50.041310 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:50.041274    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/302e3ff9-cc52-4edc-bf97-f9d108f4173a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"302e3ff9-cc52-4edc-bf97-f9d108f4173a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:35:50.041608 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:50.041551    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/302e3ff9-cc52-4edc-bf97-f9d108f4173a-config-out\") pod \"prometheus-k8s-0\" (UID: \"302e3ff9-cc52-4edc-bf97-f9d108f4173a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:35:50.041689 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:50.041653    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/302e3ff9-cc52-4edc-bf97-f9d108f4173a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"302e3ff9-cc52-4edc-bf97-f9d108f4173a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:35:50.042632 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:50.042610    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/302e3ff9-cc52-4edc-bf97-f9d108f4173a-config\") pod \"prometheus-k8s-0\" (UID: \"302e3ff9-cc52-4edc-bf97-f9d108f4173a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:35:50.042752 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:50.042718    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/302e3ff9-cc52-4edc-bf97-f9d108f4173a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"302e3ff9-cc52-4edc-bf97-f9d108f4173a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:35:50.043324 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:50.043295    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/302e3ff9-cc52-4edc-bf97-f9d108f4173a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"302e3ff9-cc52-4edc-bf97-f9d108f4173a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:35:50.043405 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:50.043329    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/302e3ff9-cc52-4edc-bf97-f9d108f4173a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"302e3ff9-cc52-4edc-bf97-f9d108f4173a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:35:50.043465 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:50.043402    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/302e3ff9-cc52-4edc-bf97-f9d108f4173a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"302e3ff9-cc52-4edc-bf97-f9d108f4173a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:35:50.043606 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:50.043588    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/302e3ff9-cc52-4edc-bf97-f9d108f4173a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"302e3ff9-cc52-4edc-bf97-f9d108f4173a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:35:50.060799 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:50.060748    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gq2s\" (UniqueName: \"kubernetes.io/projected/302e3ff9-cc52-4edc-bf97-f9d108f4173a-kube-api-access-8gq2s\") pod \"prometheus-k8s-0\" (UID: \"302e3ff9-cc52-4edc-bf97-f9d108f4173a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:35:50.122836 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:50.122805    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:35:50.278721 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:50.278651    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 16:35:50.280150 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:35:50.280120    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod302e3ff9_cc52_4edc_bf97_f9d108f4173a.slice/crio-26fb3464b5657ef0115ad24052def94089594b44a3ea241e8a6a20a8d85438a9 WatchSource:0}: Error finding container 26fb3464b5657ef0115ad24052def94089594b44a3ea241e8a6a20a8d85438a9: Status 404 returned error can't find the container with id 26fb3464b5657ef0115ad24052def94089594b44a3ea241e8a6a20a8d85438a9
Jul 08 16:35:50.937380 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:50.937344    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-85696fc556-mtdtp" event={"ID":"05cab2a7-b107-4f76-98ae-0ddba230eb64","Type":"ContainerStarted","Data":"af774d19650e0d1c97ac9198473e4caa90b9d5f7ce81388657370516f2a99f7b"}
Jul 08 16:35:50.938897 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:50.938870    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"302e3ff9-cc52-4edc-bf97-f9d108f4173a","Type":"ContainerStarted","Data":"26fb3464b5657ef0115ad24052def94089594b44a3ea241e8a6a20a8d85438a9"}
Jul 08 16:35:50.970210 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:50.970152    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-85696fc556-mtdtp" podStartSLOduration=2.408934527 podStartE2EDuration="3.970132316s" totalImagesPullingTime="1.561197789s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:35:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:50.969945754 +0000 UTC m=+85.070560324" watchObservedRunningTime="2026-07-08 16:35:50.970132316 +0000 UTC m=+85.070746888"
Jul 08 16:35:51.943287 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:51.943249    2565 generic.go:356] "Generic (PLEG): container finished" podID="302e3ff9-cc52-4edc-bf97-f9d108f4173a" containerID="6313a326d5e2f6990b30c92cb31bd719dd1c7ae2d84e08e9f6bec94a759dd387" exitCode=0
Jul 08 16:35:51.943678 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:51.943333    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"302e3ff9-cc52-4edc-bf97-f9d108f4173a","Type":"ContainerDied","Data":"6313a326d5e2f6990b30c92cb31bd719dd1c7ae2d84e08e9f6bec94a759dd387"}
Jul 08 16:35:52.848541 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:52.848506    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-57d76c5ff7-cp4cq"
Jul 08 16:35:56.966604 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:56.966567    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"302e3ff9-cc52-4edc-bf97-f9d108f4173a","Type":"ContainerStarted","Data":"776f82afdf7c76ff9a995d761cb112bbb4a7747c56001b4f484d521eaabc0627"}
Jul 08 16:35:56.967077 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:56.966636    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"302e3ff9-cc52-4edc-bf97-f9d108f4173a","Type":"ContainerStarted","Data":"93577884603c0a451b0a6383b6be377ddc03a34aae10e93ff7a3646a3bce0d35"}
Jul 08 16:35:57.973534 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:57.973507    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"302e3ff9-cc52-4edc-bf97-f9d108f4173a","Type":"ContainerStarted","Data":"97ece3c2470103e72bb763fddbdd6b26e602d4dd37f4e96e84995843eebbafd8"}
Jul 08 16:35:57.973890 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:57.973576    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"302e3ff9-cc52-4edc-bf97-f9d108f4173a","Type":"ContainerStarted","Data":"ab6fec00cff113fb3114bbb7add7702a57c9a0bc7684567c9715eb6cc17bdedd"}
Jul 08 16:35:57.973890 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:57.973605    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"302e3ff9-cc52-4edc-bf97-f9d108f4173a","Type":"ContainerStarted","Data":"44ce5c6b250ea881d7ffe9f59366eb7b9e109d9206585db6a63e73a595ca3279"}
Jul 08 16:35:58.980471 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:58.980433    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"302e3ff9-cc52-4edc-bf97-f9d108f4173a","Type":"ContainerStarted","Data":"954a70e56b489524738476f0334b1cb1a2bed7098030a0949afdf5335e2231b3"}
Jul 08 16:35:59.024820 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:35:59.024762    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.295742091 podStartE2EDuration="10.024743383s" totalImagesPullingTime="6.70496558s" totalInitContainerRuntime="24.035712ms" isStatefulPod=false podCreationTimestamp="2026-07-08 16:35:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:59.023305011 +0000 UTC m=+93.123919580" watchObservedRunningTime="2026-07-08 16:35:59.024743383 +0000 UTC m=+93.125357953"
Jul 08 16:36:00.122995 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:36:00.122966    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:36:05.862839 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:36:05.862812    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-fftjw"
Jul 08 16:36:08.204601 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:36:08.204564    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-85696fc556-mtdtp"
Jul 08 16:36:08.204992 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:36:08.204627    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-85696fc556-mtdtp"
Jul 08 16:36:28.209983 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:36:28.209953    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-85696fc556-mtdtp"
Jul 08 16:36:28.213633 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:36:28.213613    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-85696fc556-mtdtp"
Jul 08 16:36:50.123504 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:36:50.123464    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:36:50.145729 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:36:50.145695    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:36:50.174146 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:36:50.174120    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 16:39:26.287890 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:39:26.287863    2565 kubelet.go:1648] "Image garbage collection succeeded"
Jul 08 16:41:29.948799 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:41:29.948768    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-58g4c"]
Jul 08 16:41:29.951896 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:41:29.951877    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-58g4c"
Jul 08 16:41:29.957921 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:41:29.957890    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 08 16:41:29.958400 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:41:29.958056    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-845ks\""
Jul 08 16:41:29.960639 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:41:29.960624    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 08 16:41:30.049046 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:41:30.049022    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76pnv\" (UniqueName: \"kubernetes.io/projected/7ee380a3-c2e0-410b-9c9c-07eb5172f694-kube-api-access-76pnv\") pod \"openshift-lws-operator-fd8ccff4c-58g4c\" (UID: \"7ee380a3-c2e0-410b-9c9c-07eb5172f694\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-58g4c"
Jul 08 16:41:30.049154 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:41:30.049072    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ee380a3-c2e0-410b-9c9c-07eb5172f694-tmp\") pod \"openshift-lws-operator-fd8ccff4c-58g4c\" (UID: \"7ee380a3-c2e0-410b-9c9c-07eb5172f694\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-58g4c"
Jul 08 16:41:30.068778 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:41:30.068751    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-58g4c"]
Jul 08 16:41:30.149672 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:41:30.149648    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76pnv\" (UniqueName: \"kubernetes.io/projected/7ee380a3-c2e0-410b-9c9c-07eb5172f694-kube-api-access-76pnv\") pod \"openshift-lws-operator-fd8ccff4c-58g4c\" (UID: \"7ee380a3-c2e0-410b-9c9c-07eb5172f694\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-58g4c"
Jul 08 16:41:30.149795 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:41:30.149694    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ee380a3-c2e0-410b-9c9c-07eb5172f694-tmp\") pod \"openshift-lws-operator-fd8ccff4c-58g4c\" (UID: \"7ee380a3-c2e0-410b-9c9c-07eb5172f694\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-58g4c"
Jul 08 16:41:30.149989 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:41:30.149973    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ee380a3-c2e0-410b-9c9c-07eb5172f694-tmp\") pod \"openshift-lws-operator-fd8ccff4c-58g4c\" (UID: \"7ee380a3-c2e0-410b-9c9c-07eb5172f694\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-58g4c"
Jul 08 16:41:30.162492 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:41:30.162473    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76pnv\" (UniqueName: \"kubernetes.io/projected/7ee380a3-c2e0-410b-9c9c-07eb5172f694-kube-api-access-76pnv\") pod \"openshift-lws-operator-fd8ccff4c-58g4c\" (UID: \"7ee380a3-c2e0-410b-9c9c-07eb5172f694\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-58g4c"
Jul 08 16:41:30.260756 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:41:30.260689    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-58g4c"
Jul 08 16:41:30.394441 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:41:30.394409    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-58g4c"]
Jul 08 16:41:30.397843 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:41:30.397814    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7ee380a3_c2e0_410b_9c9c_07eb5172f694.slice/crio-5351dc6a642f822118995b2780443fd1649299a47525ba29089108fd3a758f92 WatchSource:0}: Error finding container 5351dc6a642f822118995b2780443fd1649299a47525ba29089108fd3a758f92: Status 404 returned error can't find the container with id 5351dc6a642f822118995b2780443fd1649299a47525ba29089108fd3a758f92
Jul 08 16:41:30.399279 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:41:30.399261    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 16:41:31.113735 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:41:31.113676    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-58g4c" event={"ID":"7ee380a3-c2e0-410b-9c9c-07eb5172f694","Type":"ContainerStarted","Data":"5351dc6a642f822118995b2780443fd1649299a47525ba29089108fd3a758f92"}
Jul 08 16:41:33.122481 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:41:33.122447    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-58g4c" event={"ID":"7ee380a3-c2e0-410b-9c9c-07eb5172f694","Type":"ContainerStarted","Data":"4ce14fd6e90485bb4b243a642872d5b4c5aecf6e49b28af2503964f3525b32ef"}
Jul 08 16:41:33.145480 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:41:33.145431    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-58g4c" podStartSLOduration=1.856905861 podStartE2EDuration="4.145411902s" totalImagesPullingTime="2.288506041s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:41:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:41:33.14482845 +0000 UTC m=+427.245443020" watchObservedRunningTime="2026-07-08 16:41:33.145411902 +0000 UTC m=+427.246026473"
Jul 08 16:42:00.443129 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:42:00.443097    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6744679755-75qfd"]
Jul 08 16:42:00.446693 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:42:00.446676    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6744679755-75qfd"
Jul 08 16:42:00.454661 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:42:00.454633    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-wmwxd\""
Jul 08 16:42:00.454787 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:42:00.454670    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 08 16:42:00.454787 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:42:00.454709    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 08 16:42:00.454905 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:42:00.454791    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 08 16:42:00.482427 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:42:00.482404    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6744679755-75qfd"]
Jul 08 16:42:00.596190 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:42:00.596164    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzr8g\" (UniqueName: \"kubernetes.io/projected/4d68d98a-812d-45bf-8074-9d0a941779c4-kube-api-access-wzr8g\") pod \"lws-controller-manager-6744679755-75qfd\" (UID: \"4d68d98a-812d-45bf-8074-9d0a941779c4\") " pod="openshift-lws-operator/lws-controller-manager-6744679755-75qfd"
Jul 08 16:42:00.596381 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:42:00.596243    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4d68d98a-812d-45bf-8074-9d0a941779c4-manager-config\") pod \"lws-controller-manager-6744679755-75qfd\" (UID: \"4d68d98a-812d-45bf-8074-9d0a941779c4\") " pod="openshift-lws-operator/lws-controller-manager-6744679755-75qfd"
Jul 08 16:42:00.596381 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:42:00.596278    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4d68d98a-812d-45bf-8074-9d0a941779c4-metrics-cert\") pod \"lws-controller-manager-6744679755-75qfd\" (UID: \"4d68d98a-812d-45bf-8074-9d0a941779c4\") " pod="openshift-lws-operator/lws-controller-manager-6744679755-75qfd"
Jul 08 16:42:00.596381 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:42:00.596320    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4d68d98a-812d-45bf-8074-9d0a941779c4-cert\") pod \"lws-controller-manager-6744679755-75qfd\" (UID: \"4d68d98a-812d-45bf-8074-9d0a941779c4\") " pod="openshift-lws-operator/lws-controller-manager-6744679755-75qfd"
Jul 08 16:42:00.697194 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:42:00.697121    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4d68d98a-812d-45bf-8074-9d0a941779c4-cert\") pod \"lws-controller-manager-6744679755-75qfd\" (UID: \"4d68d98a-812d-45bf-8074-9d0a941779c4\") " pod="openshift-lws-operator/lws-controller-manager-6744679755-75qfd"
Jul 08 16:42:00.697194 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:42:00.697179    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzr8g\" (UniqueName: \"kubernetes.io/projected/4d68d98a-812d-45bf-8074-9d0a941779c4-kube-api-access-wzr8g\") pod \"lws-controller-manager-6744679755-75qfd\" (UID: \"4d68d98a-812d-45bf-8074-9d0a941779c4\") " pod="openshift-lws-operator/lws-controller-manager-6744679755-75qfd"
Jul 08 16:42:00.697386 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:42:00.697237    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4d68d98a-812d-45bf-8074-9d0a941779c4-manager-config\") pod \"lws-controller-manager-6744679755-75qfd\" (UID: \"4d68d98a-812d-45bf-8074-9d0a941779c4\") " pod="openshift-lws-operator/lws-controller-manager-6744679755-75qfd"
Jul 08 16:42:00.697386 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:42:00.697259    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4d68d98a-812d-45bf-8074-9d0a941779c4-metrics-cert\") pod \"lws-controller-manager-6744679755-75qfd\" (UID: \"4d68d98a-812d-45bf-8074-9d0a941779c4\") " pod="openshift-lws-operator/lws-controller-manager-6744679755-75qfd"
Jul 08 16:42:00.697897 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:42:00.697833    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4d68d98a-812d-45bf-8074-9d0a941779c4-manager-config\") pod \"lws-controller-manager-6744679755-75qfd\" (UID: \"4d68d98a-812d-45bf-8074-9d0a941779c4\") " pod="openshift-lws-operator/lws-controller-manager-6744679755-75qfd"
Jul 08 16:42:00.699675 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:42:00.699652    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4d68d98a-812d-45bf-8074-9d0a941779c4-metrics-cert\") pod \"lws-controller-manager-6744679755-75qfd\" (UID: \"4d68d98a-812d-45bf-8074-9d0a941779c4\") " pod="openshift-lws-operator/lws-controller-manager-6744679755-75qfd"
Jul 08 16:42:00.699675 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:42:00.699667    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4d68d98a-812d-45bf-8074-9d0a941779c4-cert\") pod \"lws-controller-manager-6744679755-75qfd\" (UID: \"4d68d98a-812d-45bf-8074-9d0a941779c4\") " pod="openshift-lws-operator/lws-controller-manager-6744679755-75qfd"
Jul 08 16:42:00.707311 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:42:00.707284    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzr8g\" (UniqueName: \"kubernetes.io/projected/4d68d98a-812d-45bf-8074-9d0a941779c4-kube-api-access-wzr8g\") pod \"lws-controller-manager-6744679755-75qfd\" (UID: \"4d68d98a-812d-45bf-8074-9d0a941779c4\") " pod="openshift-lws-operator/lws-controller-manager-6744679755-75qfd"
Jul 08 16:42:00.755513 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:42:00.755487    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6744679755-75qfd"
Jul 08 16:42:00.888328 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:42:00.888296    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6744679755-75qfd"]
Jul 08 16:42:00.890795 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:42:00.890768    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d68d98a_812d_45bf_8074_9d0a941779c4.slice/crio-6677a3301ec5ac11fe4191bd7196385792e65a3827e6f1879e3d1dd24b7dc763 WatchSource:0}: Error finding container 6677a3301ec5ac11fe4191bd7196385792e65a3827e6f1879e3d1dd24b7dc763: Status 404 returned error can't find the container with id 6677a3301ec5ac11fe4191bd7196385792e65a3827e6f1879e3d1dd24b7dc763
Jul 08 16:42:01.225463 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:42:01.225430    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6744679755-75qfd" event={"ID":"4d68d98a-812d-45bf-8074-9d0a941779c4","Type":"ContainerStarted","Data":"6677a3301ec5ac11fe4191bd7196385792e65a3827e6f1879e3d1dd24b7dc763"}
Jul 08 16:42:03.233839 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:42:03.233800    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6744679755-75qfd" event={"ID":"4d68d98a-812d-45bf-8074-9d0a941779c4","Type":"ContainerStarted","Data":"c1297df319996e808a1bf519f463b383f511484b158536eae60d2efe4b371a78"}
Jul 08 16:42:03.234265 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:42:03.233873    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6744679755-75qfd"
Jul 08 16:42:03.254709 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:42:03.254665    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6744679755-75qfd" podStartSLOduration=1.701281955 podStartE2EDuration="3.254646414s" totalImagesPullingTime="1.553364459s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:42:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:42:03.254285588 +0000 UTC m=+457.354900157" watchObservedRunningTime="2026-07-08 16:42:03.254646414 +0000 UTC m=+457.355260984"
Jul 08 16:42:14.239749 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:42:14.239710    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6744679755-75qfd"
Jul 08 16:42:24.214819 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:42:24.214786    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6f9f468797-kh4pg"]
Jul 08 16:42:24.217832 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:42:24.217810    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6f9f468797-kh4pg"
Jul 08 16:42:24.223400 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:42:24.223371    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 08 16:42:24.223499 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:42:24.223485    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-65jdr\""
Jul 08 16:42:24.224326 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:42:24.224307    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 08 16:42:24.244060 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:42:24.244040    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6f9f468797-kh4pg"]
Jul 08 16:42:24.379760 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:42:24.379733    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vlhj\" (UniqueName: \"kubernetes.io/projected/95c1eafb-084e-4510-8912-44b1c63bc4cf-kube-api-access-7vlhj\") pod \"limitador-operator-controller-manager-6f9f468797-kh4pg\" (UID: \"95c1eafb-084e-4510-8912-44b1c63bc4cf\") " pod="kuadrant-system/limitador-operator-controller-manager-6f9f468797-kh4pg"
Jul 08 16:42:24.481074 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:42:24.481001    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vlhj\" (UniqueName: \"kubernetes.io/projected/95c1eafb-084e-4510-8912-44b1c63bc4cf-kube-api-access-7vlhj\") pod \"limitador-operator-controller-manager-6f9f468797-kh4pg\" (UID: \"95c1eafb-084e-4510-8912-44b1c63bc4cf\") " pod="kuadrant-system/limitador-operator-controller-manager-6f9f468797-kh4pg"
Jul 08 16:42:24.501467 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:42:24.501437    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vlhj\" (UniqueName: \"kubernetes.io/projected/95c1eafb-084e-4510-8912-44b1c63bc4cf-kube-api-access-7vlhj\") pod \"limitador-operator-controller-manager-6f9f468797-kh4pg\" (UID: \"95c1eafb-084e-4510-8912-44b1c63bc4cf\") " pod="kuadrant-system/limitador-operator-controller-manager-6f9f468797-kh4pg"
Jul 08 16:42:24.527156 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:42:24.527130    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6f9f468797-kh4pg"
Jul 08 16:42:24.665555 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:42:24.665516    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6f9f468797-kh4pg"]
Jul 08 16:42:24.668572 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:42:24.668539    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95c1eafb_084e_4510_8912_44b1c63bc4cf.slice/crio-754580e3f0750b974453b0c0325be28a5ff86503d722af84f35e61dae0e569c0 WatchSource:0}: Error finding container 754580e3f0750b974453b0c0325be28a5ff86503d722af84f35e61dae0e569c0: Status 404 returned error can't find the container with id 754580e3f0750b974453b0c0325be28a5ff86503d722af84f35e61dae0e569c0
Jul 08 16:42:25.315598 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:42:25.315565    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6f9f468797-kh4pg" event={"ID":"95c1eafb-084e-4510-8912-44b1c63bc4cf","Type":"ContainerStarted","Data":"754580e3f0750b974453b0c0325be28a5ff86503d722af84f35e61dae0e569c0"}
Jul 08 16:42:27.323870 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:42:27.323835    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6f9f468797-kh4pg" event={"ID":"95c1eafb-084e-4510-8912-44b1c63bc4cf","Type":"ContainerStarted","Data":"1a43e329c4c742a44809269740733b61ee7715e32d76903987d299313b3c6820"}
Jul 08 16:42:27.324376 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:42:27.323948    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6f9f468797-kh4pg"
Jul 08 16:42:27.352522 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:42:27.352478    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6f9f468797-kh4pg" podStartSLOduration=1.236960256 podStartE2EDuration="3.352459246s" totalImagesPullingTime="2.11549899s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:42:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:42:27.351196637 +0000 UTC m=+481.451811222" watchObservedRunningTime="2026-07-08 16:42:27.352459246 +0000 UTC m=+481.453073862"
Jul 08 16:42:38.330075 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:42:38.330032    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6f9f468797-kh4pg"
Jul 08 16:43:10.845126 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:43:10.845090    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-gxr6q"]
Jul 08 16:43:10.849455 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:43:10.849422    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-69574b596d-gxr6q"
Jul 08 16:43:10.852310 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:43:10.852288    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 08 16:43:10.852427 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:43:10.852365    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-sthpr\""
Jul 08 16:43:10.858270 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:43:10.858249    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-gxr6q"]
Jul 08 16:43:10.892891 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:43:10.892873    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-gxr6q"]
Jul 08 16:43:10.938853 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:43:10.938827    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tlkf\" (UniqueName: \"kubernetes.io/projected/0df0bbdc-0eb7-45c7-a5c5-5bdd0cd08445-kube-api-access-7tlkf\") pod \"limitador-limitador-69574b596d-gxr6q\" (UID: \"0df0bbdc-0eb7-45c7-a5c5-5bdd0cd08445\") " pod="kuadrant-system/limitador-limitador-69574b596d-gxr6q"
Jul 08 16:43:10.938947 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:43:10.938886    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0df0bbdc-0eb7-45c7-a5c5-5bdd0cd08445-config-file\") pod \"limitador-limitador-69574b596d-gxr6q\" (UID: \"0df0bbdc-0eb7-45c7-a5c5-5bdd0cd08445\") " pod="kuadrant-system/limitador-limitador-69574b596d-gxr6q"
Jul 08 16:43:11.039590 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:43:11.039566    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0df0bbdc-0eb7-45c7-a5c5-5bdd0cd08445-config-file\") pod \"limitador-limitador-69574b596d-gxr6q\" (UID: \"0df0bbdc-0eb7-45c7-a5c5-5bdd0cd08445\") " pod="kuadrant-system/limitador-limitador-69574b596d-gxr6q"
Jul 08 16:43:11.039675 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:43:11.039608    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tlkf\" (UniqueName: \"kubernetes.io/projected/0df0bbdc-0eb7-45c7-a5c5-5bdd0cd08445-kube-api-access-7tlkf\") pod \"limitador-limitador-69574b596d-gxr6q\" (UID: \"0df0bbdc-0eb7-45c7-a5c5-5bdd0cd08445\") " pod="kuadrant-system/limitador-limitador-69574b596d-gxr6q"
Jul 08 16:43:11.040111 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:43:11.040094    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0df0bbdc-0eb7-45c7-a5c5-5bdd0cd08445-config-file\") pod \"limitador-limitador-69574b596d-gxr6q\" (UID: \"0df0bbdc-0eb7-45c7-a5c5-5bdd0cd08445\") " pod="kuadrant-system/limitador-limitador-69574b596d-gxr6q"
Jul 08 16:43:11.049843 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:43:11.049817    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tlkf\" (UniqueName: \"kubernetes.io/projected/0df0bbdc-0eb7-45c7-a5c5-5bdd0cd08445-kube-api-access-7tlkf\") pod \"limitador-limitador-69574b596d-gxr6q\" (UID: \"0df0bbdc-0eb7-45c7-a5c5-5bdd0cd08445\") " pod="kuadrant-system/limitador-limitador-69574b596d-gxr6q"
Jul 08 16:43:11.161159 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:43:11.161097    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-69574b596d-gxr6q"
Jul 08 16:43:11.288967 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:43:11.288886    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-69574b596d-gxr6q"]
Jul 08 16:43:11.291083 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:43:11.291047    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0df0bbdc_0eb7_45c7_a5c5_5bdd0cd08445.slice/crio-67eb59effe0bbc0959b08a0a2b88ead180f94c46a536d922ef326a003226878a WatchSource:0}: Error finding container 67eb59effe0bbc0959b08a0a2b88ead180f94c46a536d922ef326a003226878a: Status 404 returned error can't find the container with id 67eb59effe0bbc0959b08a0a2b88ead180f94c46a536d922ef326a003226878a
Jul 08 16:43:11.483025 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:43:11.482992    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-69574b596d-gxr6q" event={"ID":"0df0bbdc-0eb7-45c7-a5c5-5bdd0cd08445","Type":"ContainerStarted","Data":"67eb59effe0bbc0959b08a0a2b88ead180f94c46a536d922ef326a003226878a"}
Jul 08 16:43:15.500722 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:43:15.500687    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-69574b596d-gxr6q" event={"ID":"0df0bbdc-0eb7-45c7-a5c5-5bdd0cd08445","Type":"ContainerStarted","Data":"bff37b0dd37345d259e00e76b06c86ebf55541bf9d1f467bbed84561ea549598"}
Jul 08 16:43:15.501096 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:43:15.500787    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-69574b596d-gxr6q"
Jul 08 16:43:26.505487 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:43:26.505417    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-69574b596d-gxr6q"
Jul 08 16:43:26.526061 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:43:26.526008    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-69574b596d-gxr6q" podStartSLOduration=13.030654256 podStartE2EDuration="16.525994191s" totalImagesPullingTime="3.495339935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:43:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:43:15.536870778 +0000 UTC m=+529.637485348" watchObservedRunningTime="2026-07-08 16:43:26.525994191 +0000 UTC m=+540.626608760"
Jul 08 16:46:52.687619 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:46:52.687582    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bwm7dq"]
Jul 08 16:46:52.689864 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:46:52.689848    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bwm7dq"
Jul 08 16:46:52.692400 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:46:52.692380    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 08 16:46:52.693438 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:46:52.693419    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 08 16:46:52.693529 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:46:52.693457    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-8qxdr\""
Jul 08 16:46:52.693529 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:46:52.693474    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs\""
Jul 08 16:46:52.700050 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:46:52.700031    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bwm7dq"]
Jul 08 16:46:52.858908 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:46:52.858880    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b7f2d79-2738-4428-addf-b3ef7112571d-dshm\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bwm7dq\" (UID: \"9b7f2d79-2738-4428-addf-b3ef7112571d\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bwm7dq"
Jul 08 16:46:52.858908 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:46:52.858910    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b7f2d79-2738-4428-addf-b3ef7112571d-model-cache\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bwm7dq\" (UID: \"9b7f2d79-2738-4428-addf-b3ef7112571d\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bwm7dq"
Jul 08 16:46:52.859069 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:46:52.858942    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b7f2d79-2738-4428-addf-b3ef7112571d-tmp-dir\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bwm7dq\" (UID: \"9b7f2d79-2738-4428-addf-b3ef7112571d\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bwm7dq"
Jul 08 16:46:52.859069 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:46:52.858965    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b7f2d79-2738-4428-addf-b3ef7112571d-tls-certs\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bwm7dq\" (UID: \"9b7f2d79-2738-4428-addf-b3ef7112571d\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bwm7dq"
Jul 08 16:46:52.859069 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:46:52.859002    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b7f2d79-2738-4428-addf-b3ef7112571d-home\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bwm7dq\" (UID: \"9b7f2d79-2738-4428-addf-b3ef7112571d\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bwm7dq"
Jul 08 16:46:52.859069 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:46:52.859026    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjgqt\" (UniqueName: \"kubernetes.io/projected/9b7f2d79-2738-4428-addf-b3ef7112571d-kube-api-access-qjgqt\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bwm7dq\" (UID: \"9b7f2d79-2738-4428-addf-b3ef7112571d\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bwm7dq"
Jul 08 16:46:52.960140 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:46:52.960116    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b7f2d79-2738-4428-addf-b3ef7112571d-dshm\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bwm7dq\" (UID: \"9b7f2d79-2738-4428-addf-b3ef7112571d\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bwm7dq"
Jul 08 16:46:52.960273 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:46:52.960144    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b7f2d79-2738-4428-addf-b3ef7112571d-model-cache\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bwm7dq\" (UID: \"9b7f2d79-2738-4428-addf-b3ef7112571d\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bwm7dq"
Jul 08 16:46:52.960273 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:46:52.960176    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b7f2d79-2738-4428-addf-b3ef7112571d-tmp-dir\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bwm7dq\" (UID: \"9b7f2d79-2738-4428-addf-b3ef7112571d\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bwm7dq"
Jul 08 16:46:52.960273 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:46:52.960195    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b7f2d79-2738-4428-addf-b3ef7112571d-tls-certs\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bwm7dq\" (UID: \"9b7f2d79-2738-4428-addf-b3ef7112571d\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bwm7dq"
Jul 08 16:46:52.960273 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:46:52.960251    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b7f2d79-2738-4428-addf-b3ef7112571d-home\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bwm7dq\" (UID: \"9b7f2d79-2738-4428-addf-b3ef7112571d\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bwm7dq"
Jul 08 16:46:52.960449 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:46:52.960281    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjgqt\" (UniqueName: \"kubernetes.io/projected/9b7f2d79-2738-4428-addf-b3ef7112571d-kube-api-access-qjgqt\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bwm7dq\" (UID: \"9b7f2d79-2738-4428-addf-b3ef7112571d\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bwm7dq"
Jul 08 16:46:52.960637 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:46:52.960609    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b7f2d79-2738-4428-addf-b3ef7112571d-model-cache\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bwm7dq\" (UID: \"9b7f2d79-2738-4428-addf-b3ef7112571d\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bwm7dq"
Jul 08 16:46:52.960637 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:46:52.960624    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b7f2d79-2738-4428-addf-b3ef7112571d-tmp-dir\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bwm7dq\" (UID: \"9b7f2d79-2738-4428-addf-b3ef7112571d\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bwm7dq"
Jul 08 16:46:52.960761 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:46:52.960660    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b7f2d79-2738-4428-addf-b3ef7112571d-home\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bwm7dq\" (UID: \"9b7f2d79-2738-4428-addf-b3ef7112571d\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bwm7dq"
Jul 08 16:46:52.962411 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:46:52.962390    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b7f2d79-2738-4428-addf-b3ef7112571d-dshm\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bwm7dq\" (UID: \"9b7f2d79-2738-4428-addf-b3ef7112571d\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bwm7dq"
Jul 08 16:46:52.962752 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:46:52.962733    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b7f2d79-2738-4428-addf-b3ef7112571d-tls-certs\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bwm7dq\" (UID: \"9b7f2d79-2738-4428-addf-b3ef7112571d\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bwm7dq"
Jul 08 16:46:52.970578 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:46:52.970557    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjgqt\" (UniqueName: \"kubernetes.io/projected/9b7f2d79-2738-4428-addf-b3ef7112571d-kube-api-access-qjgqt\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bwm7dq\" (UID: \"9b7f2d79-2738-4428-addf-b3ef7112571d\") " pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bwm7dq"
Jul 08 16:46:52.999439 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:46:52.999419    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bwm7dq"
Jul 08 16:46:53.127136 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:46:53.127112    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bwm7dq"]
Jul 08 16:46:53.129499 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:46:53.129476    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b7f2d79_2738_4428_addf_b3ef7112571d.slice/crio-0f2faeabc71d8d5fb904a00ba3fec0dde0b973c35e8cb923adc693bcb8833849 WatchSource:0}: Error finding container 0f2faeabc71d8d5fb904a00ba3fec0dde0b973c35e8cb923adc693bcb8833849: Status 404 returned error can't find the container with id 0f2faeabc71d8d5fb904a00ba3fec0dde0b973c35e8cb923adc693bcb8833849
Jul 08 16:46:53.131403 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:46:53.131387    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 16:46:53.293067 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:46:53.292996    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bwm7dq" event={"ID":"9b7f2d79-2738-4428-addf-b3ef7112571d","Type":"ContainerStarted","Data":"0f2faeabc71d8d5fb904a00ba3fec0dde0b973c35e8cb923adc693bcb8833849"}
Jul 08 16:46:54.299257 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:46:54.299202    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bwm7dq" event={"ID":"9b7f2d79-2738-4428-addf-b3ef7112571d","Type":"ContainerStarted","Data":"cdbf8e1182ea45bdf88042b71ee450fd82c8ef7f642ecdf87f4ff7434da7cf53"}
Jul 08 16:46:54.320807 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:46:54.320764    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bwm7dq" podStartSLOduration=1.303158234 podStartE2EDuration="2.320747883s" totalImagesPullingTime="1.017589649s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:46:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:46:54.318766059 +0000 UTC m=+748.419380629" watchObservedRunningTime="2026-07-08 16:46:54.320747883 +0000 UTC m=+748.421362452"
Jul 08 16:46:54.999579 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:46:54.999539    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bwm7dq"
Jul 08 16:47:02.999638 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:47:02.999597    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bwm7dq"
Jul 08 16:47:03.011794 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:47:03.011766    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bwm7dq"
Jul 08 16:47:03.341953 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:47:03.341873    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bwm7dq"
Jul 08 16:47:07.232705 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:47:07.232675    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bwm7dq"]
Jul 08 16:47:22.252733 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:47:22.252690    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bwm7dq" podUID="9b7f2d79-2738-4428-addf-b3ef7112571d" containerName="main" containerID="cri-o://cdbf8e1182ea45bdf88042b71ee450fd82c8ef7f642ecdf87f4ff7434da7cf53" gracePeriod=45
Jul 08 16:47:22.330998 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:47:22.330957    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bwm7dq" podUID="9b7f2d79-2738-4428-addf-b3ef7112571d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.19:8000/health\": dial tcp 10.134.0.19:8000: connect: connection refused"
Jul 08 16:47:22.409432 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:47:22.409400    2565 generic.go:356] "Generic (PLEG): container finished" podID="9b7f2d79-2738-4428-addf-b3ef7112571d" containerID="cdbf8e1182ea45bdf88042b71ee450fd82c8ef7f642ecdf87f4ff7434da7cf53" exitCode=0
Jul 08 16:47:22.409579 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:47:22.409478    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bwm7dq" event={"ID":"9b7f2d79-2738-4428-addf-b3ef7112571d","Type":"ContainerDied","Data":"cdbf8e1182ea45bdf88042b71ee450fd82c8ef7f642ecdf87f4ff7434da7cf53"}
Jul 08 16:47:22.493299 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:47:22.493275    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bwm7dq"
Jul 08 16:47:22.612266 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:47:22.612170    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b7f2d79-2738-4428-addf-b3ef7112571d-model-cache\") pod \"9b7f2d79-2738-4428-addf-b3ef7112571d\" (UID: \"9b7f2d79-2738-4428-addf-b3ef7112571d\") "
Jul 08 16:47:22.612266 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:47:22.612212    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b7f2d79-2738-4428-addf-b3ef7112571d-dshm\") pod \"9b7f2d79-2738-4428-addf-b3ef7112571d\" (UID: \"9b7f2d79-2738-4428-addf-b3ef7112571d\") "
Jul 08 16:47:22.612266 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:47:22.612261    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b7f2d79-2738-4428-addf-b3ef7112571d-tmp-dir\") pod \"9b7f2d79-2738-4428-addf-b3ef7112571d\" (UID: \"9b7f2d79-2738-4428-addf-b3ef7112571d\") "
Jul 08 16:47:22.612531 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:47:22.612303    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qjgqt\" (UniqueName: \"kubernetes.io/projected/9b7f2d79-2738-4428-addf-b3ef7112571d-kube-api-access-qjgqt\") pod \"9b7f2d79-2738-4428-addf-b3ef7112571d\" (UID: \"9b7f2d79-2738-4428-addf-b3ef7112571d\") "
Jul 08 16:47:22.612531 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:47:22.612358    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b7f2d79-2738-4428-addf-b3ef7112571d-home\") pod \"9b7f2d79-2738-4428-addf-b3ef7112571d\" (UID: \"9b7f2d79-2738-4428-addf-b3ef7112571d\") "
Jul 08 16:47:22.612531 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:47:22.612394    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b7f2d79-2738-4428-addf-b3ef7112571d-tls-certs\") pod \"9b7f2d79-2738-4428-addf-b3ef7112571d\" (UID: \"9b7f2d79-2738-4428-addf-b3ef7112571d\") "
Jul 08 16:47:22.612531 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:47:22.612425    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b7f2d79-2738-4428-addf-b3ef7112571d-model-cache" (OuterVolumeSpecName: "model-cache") pod "9b7f2d79-2738-4428-addf-b3ef7112571d" (UID: "9b7f2d79-2738-4428-addf-b3ef7112571d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:47:22.612703 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:47:22.612534    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b7f2d79-2738-4428-addf-b3ef7112571d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9b7f2d79-2738-4428-addf-b3ef7112571d" (UID: "9b7f2d79-2738-4428-addf-b3ef7112571d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:47:22.612703 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:47:22.612637    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9b7f2d79-2738-4428-addf-b3ef7112571d-model-cache\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 16:47:22.612703 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:47:22.612648    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9b7f2d79-2738-4428-addf-b3ef7112571d-tmp-dir\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 16:47:22.612703 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:47:22.612641    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b7f2d79-2738-4428-addf-b3ef7112571d-home" (OuterVolumeSpecName: "home") pod "9b7f2d79-2738-4428-addf-b3ef7112571d" (UID: "9b7f2d79-2738-4428-addf-b3ef7112571d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:47:22.614627 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:47:22.614595    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b7f2d79-2738-4428-addf-b3ef7112571d-dshm" (OuterVolumeSpecName: "dshm") pod "9b7f2d79-2738-4428-addf-b3ef7112571d" (UID: "9b7f2d79-2738-4428-addf-b3ef7112571d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:47:22.614735 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:47:22.614624    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b7f2d79-2738-4428-addf-b3ef7112571d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9b7f2d79-2738-4428-addf-b3ef7112571d" (UID: "9b7f2d79-2738-4428-addf-b3ef7112571d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 16:47:22.614735 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:47:22.614629    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b7f2d79-2738-4428-addf-b3ef7112571d-kube-api-access-qjgqt" (OuterVolumeSpecName: "kube-api-access-qjgqt") pod "9b7f2d79-2738-4428-addf-b3ef7112571d" (UID: "9b7f2d79-2738-4428-addf-b3ef7112571d"). InnerVolumeSpecName "kube-api-access-qjgqt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:47:22.713237 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:47:22.713199    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qjgqt\" (UniqueName: \"kubernetes.io/projected/9b7f2d79-2738-4428-addf-b3ef7112571d-kube-api-access-qjgqt\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 16:47:22.713237 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:47:22.713239    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9b7f2d79-2738-4428-addf-b3ef7112571d-home\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 16:47:22.713410 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:47:22.713249    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b7f2d79-2738-4428-addf-b3ef7112571d-tls-certs\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 16:47:22.713410 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:47:22.713258    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9b7f2d79-2738-4428-addf-b3ef7112571d-dshm\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 16:47:23.413990 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:47:23.413954    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bwm7dq" event={"ID":"9b7f2d79-2738-4428-addf-b3ef7112571d","Type":"ContainerDied","Data":"0f2faeabc71d8d5fb904a00ba3fec0dde0b973c35e8cb923adc693bcb8833849"}
Jul 08 16:47:23.414485 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:47:23.414015    2565 scope.go:117] "RemoveContainer" containerID="cdbf8e1182ea45bdf88042b71ee450fd82c8ef7f642ecdf87f4ff7434da7cf53"
Jul 08 16:47:23.414485 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:47:23.413972    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bwm7dq"
Jul 08 16:47:23.439718 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:47:23.439690    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bwm7dq"]
Jul 08 16:47:23.444962 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:47:23.444941    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bwm7dq"]
Jul 08 16:47:24.488597 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:47:24.488567    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b7f2d79-2738-4428-addf-b3ef7112571d" path="/var/lib/kubelet/pods/9b7f2d79-2738-4428-addf-b3ef7112571d/volumes"
Jul 08 16:48:28.762137 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:48:28.762104    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schex2hpd"]
Jul 08 16:48:28.762558 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:48:28.762402    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b7f2d79-2738-4428-addf-b3ef7112571d" containerName="main"
Jul 08 16:48:28.762558 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:48:28.762413    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b7f2d79-2738-4428-addf-b3ef7112571d" containerName="main"
Jul 08 16:48:28.762558 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:48:28.762471    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b7f2d79-2738-4428-addf-b3ef7112571d" containerName="main"
Jul 08 16:48:28.765211 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:48:28.765195    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schex2hpd"
Jul 08 16:48:28.769000 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:48:28.768976    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisvc-router-managed-test-llm-e45d1f79-epp-sa-dockercfg-kjhlx\""
Jul 08 16:48:28.769150 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:48:28.769012    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisv5c7e67b6c51568d1d6d13829a9337f2a-kserve-self-signed-certs\""
Jul 08 16:48:28.769150 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:48:28.769089    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 08 16:48:28.769295 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:48:28.769168    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-8qxdr\""
Jul 08 16:48:28.769295 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:48:28.769234    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 08 16:48:28.779437 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:48:28.779416    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schex2hpd"]
Jul 08 16:48:28.844952 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:48:28.844928    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ccae8b25-5be4-402d-b12b-aa33ab2bbfb0-tls-certs\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schex2hpd\" (UID: \"ccae8b25-5be4-402d-b12b-aa33ab2bbfb0\") " pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schex2hpd"
Jul 08 16:48:28.845088 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:48:28.844982    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/ccae8b25-5be4-402d-b12b-aa33ab2bbfb0-tokenizer-uds\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schex2hpd\" (UID: \"ccae8b25-5be4-402d-b12b-aa33ab2bbfb0\") " pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schex2hpd"
Jul 08 16:48:28.845088 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:48:28.845004    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mn96\" (UniqueName: \"kubernetes.io/projected/ccae8b25-5be4-402d-b12b-aa33ab2bbfb0-kube-api-access-2mn96\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schex2hpd\" (UID: \"ccae8b25-5be4-402d-b12b-aa33ab2bbfb0\") " pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schex2hpd"
Jul 08 16:48:28.945468 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:48:28.945434    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ccae8b25-5be4-402d-b12b-aa33ab2bbfb0-tls-certs\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schex2hpd\" (UID: \"ccae8b25-5be4-402d-b12b-aa33ab2bbfb0\") " pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schex2hpd"
Jul 08 16:48:28.945630 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:48:28.945504    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/ccae8b25-5be4-402d-b12b-aa33ab2bbfb0-tokenizer-uds\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schex2hpd\" (UID: \"ccae8b25-5be4-402d-b12b-aa33ab2bbfb0\") " pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schex2hpd"
Jul 08 16:48:28.945630 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:48:28.945528    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mn96\" (UniqueName: \"kubernetes.io/projected/ccae8b25-5be4-402d-b12b-aa33ab2bbfb0-kube-api-access-2mn96\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schex2hpd\" (UID: \"ccae8b25-5be4-402d-b12b-aa33ab2bbfb0\") " pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schex2hpd"
Jul 08 16:48:28.945949 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:48:28.945925    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/ccae8b25-5be4-402d-b12b-aa33ab2bbfb0-tokenizer-uds\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schex2hpd\" (UID: \"ccae8b25-5be4-402d-b12b-aa33ab2bbfb0\") " pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schex2hpd"
Jul 08 16:48:28.948107 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:48:28.948085    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ccae8b25-5be4-402d-b12b-aa33ab2bbfb0-tls-certs\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schex2hpd\" (UID: \"ccae8b25-5be4-402d-b12b-aa33ab2bbfb0\") " pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schex2hpd"
Jul 08 16:48:28.954952 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:48:28.954929    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mn96\" (UniqueName: \"kubernetes.io/projected/ccae8b25-5be4-402d-b12b-aa33ab2bbfb0-kube-api-access-2mn96\") pod \"llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schex2hpd\" (UID: \"ccae8b25-5be4-402d-b12b-aa33ab2bbfb0\") " pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schex2hpd"
Jul 08 16:48:29.073993 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:48:29.073906    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schex2hpd"
Jul 08 16:48:29.207632 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:48:29.207601    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schex2hpd"]
Jul 08 16:48:29.210019 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:48:29.209992    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccae8b25_5be4_402d_b12b_aa33ab2bbfb0.slice/crio-2e0bf4109b8476dc83872f6efda2e70cac38072254803700142865f8379ea573 WatchSource:0}: Error finding container 2e0bf4109b8476dc83872f6efda2e70cac38072254803700142865f8379ea573: Status 404 returned error can't find the container with id 2e0bf4109b8476dc83872f6efda2e70cac38072254803700142865f8379ea573
Jul 08 16:48:29.665948 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:48:29.665914    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schex2hpd" event={"ID":"ccae8b25-5be4-402d-b12b-aa33ab2bbfb0","Type":"ContainerStarted","Data":"2e0bf4109b8476dc83872f6efda2e70cac38072254803700142865f8379ea573"}
Jul 08 16:48:31.675725 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:48:31.675686    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schex2hpd" event={"ID":"ccae8b25-5be4-402d-b12b-aa33ab2bbfb0","Type":"ContainerStarted","Data":"6c845b5e6c2500817f03442cd2c1ee34922e392064055dc852f853db2a634c56"}
Jul 08 16:48:31.676105 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:48:31.675813    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schex2hpd"
Jul 08 16:48:31.697421 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:48:31.697357    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schex2hpd" podStartSLOduration=2.136816604 podStartE2EDuration="3.69734355s" totalImagesPullingTime="1.560526946s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:48:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:48:31.69616997 +0000 UTC m=+845.796784542" watchObservedRunningTime="2026-07-08 16:48:31.69734355 +0000 UTC m=+845.797958120"
Jul 08 16:49:02.681037 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:49:02.681007    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schex2hpd"
Jul 08 16:49:04.390969 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:49:04.390941    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schex2hpd"]
Jul 08 16:49:04.400024 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:49:04.399981    2565 log.go:32] "ExecSync cmd from runtime service failed" err=<
Jul 08 16:49:04.400024 ip-10-0-142-172 kubenswrapper[2565]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 08 16:49:04.400024 ip-10-0-142-172 kubenswrapper[2565]:         , stdout: , stderr: , exit code -1
Jul 08 16:49:04.400024 ip-10-0-142-172 kubenswrapper[2565]:  > containerID="6c845b5e6c2500817f03442cd2c1ee34922e392064055dc852f853db2a634c56" cmd=["/bin/sleep","15"]
Jul 08 16:49:04.400333 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:49:04.400048    2565 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schex2hpd" message="" err=<
Jul 08 16:49:04.400333 ip-10-0-142-172 kubenswrapper[2565]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 08 16:49:04.400333 ip-10-0-142-172 kubenswrapper[2565]:         , stdout: , stderr: , exit code -1
Jul 08 16:49:04.400333 ip-10-0-142-172 kubenswrapper[2565]:  >
Jul 08 16:49:04.400333 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:49:04.400064    2565 kuberuntime_container.go:754] "PreStop hook failed" err=<
Jul 08 16:49:04.400333 ip-10-0-142-172 kubenswrapper[2565]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 08 16:49:04.400333 ip-10-0-142-172 kubenswrapper[2565]:         , stdout: , stderr: , exit code -1
Jul 08 16:49:04.400333 ip-10-0-142-172 kubenswrapper[2565]:  > pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schex2hpd" podUID="ccae8b25-5be4-402d-b12b-aa33ab2bbfb0" containerName="main" containerID="cri-o://6c845b5e6c2500817f03442cd2c1ee34922e392064055dc852f853db2a634c56"
Jul 08 16:49:04.400333 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:49:04.400133    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schex2hpd" podUID="ccae8b25-5be4-402d-b12b-aa33ab2bbfb0" containerName="main" containerID="cri-o://6c845b5e6c2500817f03442cd2c1ee34922e392064055dc852f853db2a634c56" gracePeriod=60
Jul 08 16:49:04.643871 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:49:04.643818    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schex2hpd"
Jul 08 16:49:04.713180 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:49:04.713143    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/ccae8b25-5be4-402d-b12b-aa33ab2bbfb0-tokenizer-uds\") pod \"ccae8b25-5be4-402d-b12b-aa33ab2bbfb0\" (UID: \"ccae8b25-5be4-402d-b12b-aa33ab2bbfb0\") "
Jul 08 16:49:04.713392 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:49:04.713180    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2mn96\" (UniqueName: \"kubernetes.io/projected/ccae8b25-5be4-402d-b12b-aa33ab2bbfb0-kube-api-access-2mn96\") pod \"ccae8b25-5be4-402d-b12b-aa33ab2bbfb0\" (UID: \"ccae8b25-5be4-402d-b12b-aa33ab2bbfb0\") "
Jul 08 16:49:04.713392 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:49:04.713318    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ccae8b25-5be4-402d-b12b-aa33ab2bbfb0-tls-certs\") pod \"ccae8b25-5be4-402d-b12b-aa33ab2bbfb0\" (UID: \"ccae8b25-5be4-402d-b12b-aa33ab2bbfb0\") "
Jul 08 16:49:04.713514 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:49:04.713460    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ccae8b25-5be4-402d-b12b-aa33ab2bbfb0-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "ccae8b25-5be4-402d-b12b-aa33ab2bbfb0" (UID: "ccae8b25-5be4-402d-b12b-aa33ab2bbfb0"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:49:04.715482 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:49:04.715449    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ccae8b25-5be4-402d-b12b-aa33ab2bbfb0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ccae8b25-5be4-402d-b12b-aa33ab2bbfb0" (UID: "ccae8b25-5be4-402d-b12b-aa33ab2bbfb0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 16:49:04.715592 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:49:04.715454    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ccae8b25-5be4-402d-b12b-aa33ab2bbfb0-kube-api-access-2mn96" (OuterVolumeSpecName: "kube-api-access-2mn96") pod "ccae8b25-5be4-402d-b12b-aa33ab2bbfb0" (UID: "ccae8b25-5be4-402d-b12b-aa33ab2bbfb0"). InnerVolumeSpecName "kube-api-access-2mn96". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:49:04.798917 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:49:04.798885    2565 generic.go:356] "Generic (PLEG): container finished" podID="ccae8b25-5be4-402d-b12b-aa33ab2bbfb0" containerID="6c845b5e6c2500817f03442cd2c1ee34922e392064055dc852f853db2a634c56" exitCode=0
Jul 08 16:49:04.798917 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:49:04.798920    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schex2hpd" event={"ID":"ccae8b25-5be4-402d-b12b-aa33ab2bbfb0","Type":"ContainerDied","Data":"6c845b5e6c2500817f03442cd2c1ee34922e392064055dc852f853db2a634c56"}
Jul 08 16:49:04.799109 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:49:04.798933    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schex2hpd"
Jul 08 16:49:04.799109 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:49:04.798955    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schex2hpd" event={"ID":"ccae8b25-5be4-402d-b12b-aa33ab2bbfb0","Type":"ContainerDied","Data":"2e0bf4109b8476dc83872f6efda2e70cac38072254803700142865f8379ea573"}
Jul 08 16:49:04.799109 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:49:04.798976    2565 scope.go:117] "RemoveContainer" containerID="6c845b5e6c2500817f03442cd2c1ee34922e392064055dc852f853db2a634c56"
Jul 08 16:49:04.807667 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:49:04.807653    2565 scope.go:117] "RemoveContainer" containerID="6c845b5e6c2500817f03442cd2c1ee34922e392064055dc852f853db2a634c56"
Jul 08 16:49:04.807912 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:49:04.807894    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c845b5e6c2500817f03442cd2c1ee34922e392064055dc852f853db2a634c56\": container with ID starting with 6c845b5e6c2500817f03442cd2c1ee34922e392064055dc852f853db2a634c56 not found: ID does not exist" containerID="6c845b5e6c2500817f03442cd2c1ee34922e392064055dc852f853db2a634c56"
Jul 08 16:49:04.807981 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:49:04.807923    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c845b5e6c2500817f03442cd2c1ee34922e392064055dc852f853db2a634c56"} err="failed to get container status \"6c845b5e6c2500817f03442cd2c1ee34922e392064055dc852f853db2a634c56\": rpc error: code = NotFound desc = could not find container \"6c845b5e6c2500817f03442cd2c1ee34922e392064055dc852f853db2a634c56\": container with ID starting with 6c845b5e6c2500817f03442cd2c1ee34922e392064055dc852f853db2a634c56 not found: ID does not exist"
Jul 08 16:49:04.813917 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:49:04.813901    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ccae8b25-5be4-402d-b12b-aa33ab2bbfb0-tls-certs\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 16:49:04.813917 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:49:04.813918    2565 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/ccae8b25-5be4-402d-b12b-aa33ab2bbfb0-tokenizer-uds\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 16:49:04.814030 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:49:04.813926    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2mn96\" (UniqueName: \"kubernetes.io/projected/ccae8b25-5be4-402d-b12b-aa33ab2bbfb0-kube-api-access-2mn96\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 16:49:04.821350 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:49:04.821331    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schex2hpd"]
Jul 08 16:49:04.828026 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:49:04.828007    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schex2hpd"]
Jul 08 16:49:06.488951 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:49:06.488918    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ccae8b25-5be4-402d-b12b-aa33ab2bbfb0" path="/var/lib/kubelet/pods/ccae8b25-5be4-402d-b12b-aa33ab2bbfb0/volumes"
Jul 08 16:50:41.882536 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:50:41.882503    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddk5j4w"]
Jul 08 16:50:41.883001 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:50:41.882779    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ccae8b25-5be4-402d-b12b-aa33ab2bbfb0" containerName="main"
Jul 08 16:50:41.883001 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:50:41.882790    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccae8b25-5be4-402d-b12b-aa33ab2bbfb0" containerName="main"
Jul 08 16:50:41.883001 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:50:41.882841    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ccae8b25-5be4-402d-b12b-aa33ab2bbfb0" containerName="main"
Jul 08 16:50:41.885328 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:50:41.885312    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddk5j4w"
Jul 08 16:50:41.888576 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:50:41.888555    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-8qxdr\""
Jul 08 16:50:41.888693 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:50:41.888674    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisvb11a9c9832b99b016bc8f8e0ea095712-kserve-self-signed-certs\""
Jul 08 16:50:41.888768 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:50:41.888754    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 08 16:50:41.888829 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:50:41.888780    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 08 16:50:41.895270 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:50:41.895249    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddk5j4w"]
Jul 08 16:50:41.957424 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:50:41.957391    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/204f569b-a681-4a9a-9d39-9c79c3882c86-model-cache\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddk5j4w\" (UID: \"204f569b-a681-4a9a-9d39-9c79c3882c86\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddk5j4w"
Jul 08 16:50:41.957591 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:50:41.957433    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6gj5\" (UniqueName: \"kubernetes.io/projected/204f569b-a681-4a9a-9d39-9c79c3882c86-kube-api-access-d6gj5\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddk5j4w\" (UID: \"204f569b-a681-4a9a-9d39-9c79c3882c86\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddk5j4w"
Jul 08 16:50:41.957591 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:50:41.957458    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/204f569b-a681-4a9a-9d39-9c79c3882c86-tls-certs\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddk5j4w\" (UID: \"204f569b-a681-4a9a-9d39-9c79c3882c86\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddk5j4w"
Jul 08 16:50:41.957591 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:50:41.957493    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/204f569b-a681-4a9a-9d39-9c79c3882c86-tmp-dir\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddk5j4w\" (UID: \"204f569b-a681-4a9a-9d39-9c79c3882c86\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddk5j4w"
Jul 08 16:50:41.957591 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:50:41.957573    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/204f569b-a681-4a9a-9d39-9c79c3882c86-dshm\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddk5j4w\" (UID: \"204f569b-a681-4a9a-9d39-9c79c3882c86\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddk5j4w"
Jul 08 16:50:41.957764 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:50:41.957613    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/204f569b-a681-4a9a-9d39-9c79c3882c86-home\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddk5j4w\" (UID: \"204f569b-a681-4a9a-9d39-9c79c3882c86\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddk5j4w"
Jul 08 16:50:42.058357 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:50:42.058316    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/204f569b-a681-4a9a-9d39-9c79c3882c86-model-cache\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddk5j4w\" (UID: \"204f569b-a681-4a9a-9d39-9c79c3882c86\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddk5j4w"
Jul 08 16:50:42.058525 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:50:42.058372    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6gj5\" (UniqueName: \"kubernetes.io/projected/204f569b-a681-4a9a-9d39-9c79c3882c86-kube-api-access-d6gj5\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddk5j4w\" (UID: \"204f569b-a681-4a9a-9d39-9c79c3882c86\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddk5j4w"
Jul 08 16:50:42.058525 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:50:42.058405    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/204f569b-a681-4a9a-9d39-9c79c3882c86-tls-certs\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddk5j4w\" (UID: \"204f569b-a681-4a9a-9d39-9c79c3882c86\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddk5j4w"
Jul 08 16:50:42.058525 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:50:42.058431    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/204f569b-a681-4a9a-9d39-9c79c3882c86-tmp-dir\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddk5j4w\" (UID: \"204f569b-a681-4a9a-9d39-9c79c3882c86\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddk5j4w"
Jul 08 16:50:42.058677 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:50:42.058568    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/204f569b-a681-4a9a-9d39-9c79c3882c86-dshm\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddk5j4w\" (UID: \"204f569b-a681-4a9a-9d39-9c79c3882c86\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddk5j4w"
Jul 08 16:50:42.058677 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:50:42.058615    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/204f569b-a681-4a9a-9d39-9c79c3882c86-home\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddk5j4w\" (UID: \"204f569b-a681-4a9a-9d39-9c79c3882c86\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddk5j4w"
Jul 08 16:50:42.058763 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:50:42.058749    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/204f569b-a681-4a9a-9d39-9c79c3882c86-model-cache\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddk5j4w\" (UID: \"204f569b-a681-4a9a-9d39-9c79c3882c86\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddk5j4w"
Jul 08 16:50:42.058811 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:50:42.058785    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/204f569b-a681-4a9a-9d39-9c79c3882c86-tmp-dir\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddk5j4w\" (UID: \"204f569b-a681-4a9a-9d39-9c79c3882c86\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddk5j4w"
Jul 08 16:50:42.058969 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:50:42.058941    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/204f569b-a681-4a9a-9d39-9c79c3882c86-home\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddk5j4w\" (UID: \"204f569b-a681-4a9a-9d39-9c79c3882c86\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddk5j4w"
Jul 08 16:50:42.060789 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:50:42.060765    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/204f569b-a681-4a9a-9d39-9c79c3882c86-dshm\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddk5j4w\" (UID: \"204f569b-a681-4a9a-9d39-9c79c3882c86\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddk5j4w"
Jul 08 16:50:42.061030 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:50:42.061014    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/204f569b-a681-4a9a-9d39-9c79c3882c86-tls-certs\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddk5j4w\" (UID: \"204f569b-a681-4a9a-9d39-9c79c3882c86\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddk5j4w"
Jul 08 16:50:42.068635 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:50:42.068606    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6gj5\" (UniqueName: \"kubernetes.io/projected/204f569b-a681-4a9a-9d39-9c79c3882c86-kube-api-access-d6gj5\") pod \"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddk5j4w\" (UID: \"204f569b-a681-4a9a-9d39-9c79c3882c86\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddk5j4w"
Jul 08 16:50:42.195718 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:50:42.195689    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddk5j4w"
Jul 08 16:50:42.325358 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:50:42.325199    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddk5j4w"]
Jul 08 16:50:42.327837 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:50:42.327799    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod204f569b_a681_4a9a_9d39_9c79c3882c86.slice/crio-b9c77f87663c3656f765127ba7045c6f26e22e96461740b01421c8b20c97eb48 WatchSource:0}: Error finding container b9c77f87663c3656f765127ba7045c6f26e22e96461740b01421c8b20c97eb48: Status 404 returned error can't find the container with id b9c77f87663c3656f765127ba7045c6f26e22e96461740b01421c8b20c97eb48
Jul 08 16:50:43.153857 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:50:43.153825    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddk5j4w" event={"ID":"204f569b-a681-4a9a-9d39-9c79c3882c86","Type":"ContainerStarted","Data":"bcf347385da0d7c7800b130360e501c02bc106ede8ad26c9c64bccf2d4e174df"}
Jul 08 16:50:43.154266 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:50:43.153875    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddk5j4w" event={"ID":"204f569b-a681-4a9a-9d39-9c79c3882c86","Type":"ContainerStarted","Data":"b9c77f87663c3656f765127ba7045c6f26e22e96461740b01421c8b20c97eb48"}
Jul 08 16:50:43.175445 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:50:43.175395    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddk5j4w" podStartSLOduration=2.175370657 podStartE2EDuration="2.175370657s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:50:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:50:43.173121029 +0000 UTC m=+977.273735597" watchObservedRunningTime="2026-07-08 16:50:43.175370657 +0000 UTC m=+977.275985216"
Jul 08 16:50:43.196081 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:50:43.196042    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddk5j4w"
Jul 08 16:50:52.196328 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:50:52.196242    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddk5j4w"
Jul 08 16:50:52.208389 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:50:52.208363    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddk5j4w"
Jul 08 16:50:53.201846 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:50:53.201820    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddk5j4w"
Jul 08 16:51:33.393459 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:51:33.393430    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddk5j4w"]
Jul 08 16:51:48.412593 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:51:48.412537    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddk5j4w" podUID="204f569b-a681-4a9a-9d39-9c79c3882c86" containerName="main" containerID="cri-o://bcf347385da0d7c7800b130360e501c02bc106ede8ad26c9c64bccf2d4e174df" gracePeriod=45
Jul 08 16:51:48.654166 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:51:48.654128    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddk5j4w"
Jul 08 16:51:48.788241 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:51:48.788197    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/204f569b-a681-4a9a-9d39-9c79c3882c86-model-cache\") pod \"204f569b-a681-4a9a-9d39-9c79c3882c86\" (UID: \"204f569b-a681-4a9a-9d39-9c79c3882c86\") "
Jul 08 16:51:48.788416 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:51:48.788280    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/204f569b-a681-4a9a-9d39-9c79c3882c86-tmp-dir\") pod \"204f569b-a681-4a9a-9d39-9c79c3882c86\" (UID: \"204f569b-a681-4a9a-9d39-9c79c3882c86\") "
Jul 08 16:51:48.788416 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:51:48.788333    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/204f569b-a681-4a9a-9d39-9c79c3882c86-tls-certs\") pod \"204f569b-a681-4a9a-9d39-9c79c3882c86\" (UID: \"204f569b-a681-4a9a-9d39-9c79c3882c86\") "
Jul 08 16:51:48.788416 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:51:48.788364    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/204f569b-a681-4a9a-9d39-9c79c3882c86-home\") pod \"204f569b-a681-4a9a-9d39-9c79c3882c86\" (UID: \"204f569b-a681-4a9a-9d39-9c79c3882c86\") "
Jul 08 16:51:48.788554 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:51:48.788423    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d6gj5\" (UniqueName: \"kubernetes.io/projected/204f569b-a681-4a9a-9d39-9c79c3882c86-kube-api-access-d6gj5\") pod \"204f569b-a681-4a9a-9d39-9c79c3882c86\" (UID: \"204f569b-a681-4a9a-9d39-9c79c3882c86\") "
Jul 08 16:51:48.788554 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:51:48.788428    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/204f569b-a681-4a9a-9d39-9c79c3882c86-model-cache" (OuterVolumeSpecName: "model-cache") pod "204f569b-a681-4a9a-9d39-9c79c3882c86" (UID: "204f569b-a681-4a9a-9d39-9c79c3882c86"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:51:48.788635 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:51:48.788540    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/204f569b-a681-4a9a-9d39-9c79c3882c86-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "204f569b-a681-4a9a-9d39-9c79c3882c86" (UID: "204f569b-a681-4a9a-9d39-9c79c3882c86"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:51:48.788635 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:51:48.788620    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/204f569b-a681-4a9a-9d39-9c79c3882c86-dshm\") pod \"204f569b-a681-4a9a-9d39-9c79c3882c86\" (UID: \"204f569b-a681-4a9a-9d39-9c79c3882c86\") "
Jul 08 16:51:48.788635 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:51:48.788629    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/204f569b-a681-4a9a-9d39-9c79c3882c86-home" (OuterVolumeSpecName: "home") pod "204f569b-a681-4a9a-9d39-9c79c3882c86" (UID: "204f569b-a681-4a9a-9d39-9c79c3882c86"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:51:48.788926 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:51:48.788896    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/204f569b-a681-4a9a-9d39-9c79c3882c86-model-cache\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 16:51:48.788926 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:51:48.788919    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/204f569b-a681-4a9a-9d39-9c79c3882c86-tmp-dir\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 16:51:48.789087 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:51:48.788931    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/204f569b-a681-4a9a-9d39-9c79c3882c86-home\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 16:51:48.790643 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:51:48.790616    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/204f569b-a681-4a9a-9d39-9c79c3882c86-kube-api-access-d6gj5" (OuterVolumeSpecName: "kube-api-access-d6gj5") pod "204f569b-a681-4a9a-9d39-9c79c3882c86" (UID: "204f569b-a681-4a9a-9d39-9c79c3882c86"). InnerVolumeSpecName "kube-api-access-d6gj5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:51:48.790872 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:51:48.790854    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/204f569b-a681-4a9a-9d39-9c79c3882c86-dshm" (OuterVolumeSpecName: "dshm") pod "204f569b-a681-4a9a-9d39-9c79c3882c86" (UID: "204f569b-a681-4a9a-9d39-9c79c3882c86"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:51:48.791053 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:51:48.791031    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/204f569b-a681-4a9a-9d39-9c79c3882c86-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "204f569b-a681-4a9a-9d39-9c79c3882c86" (UID: "204f569b-a681-4a9a-9d39-9c79c3882c86"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 16:51:48.890185 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:51:48.890164    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d6gj5\" (UniqueName: \"kubernetes.io/projected/204f569b-a681-4a9a-9d39-9c79c3882c86-kube-api-access-d6gj5\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 16:51:48.890185 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:51:48.890183    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/204f569b-a681-4a9a-9d39-9c79c3882c86-dshm\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 16:51:48.890331 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:51:48.890193    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/204f569b-a681-4a9a-9d39-9c79c3882c86-tls-certs\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 16:51:49.398303 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:51:49.398275    2565 generic.go:356] "Generic (PLEG): container finished" podID="204f569b-a681-4a9a-9d39-9c79c3882c86" containerID="bcf347385da0d7c7800b130360e501c02bc106ede8ad26c9c64bccf2d4e174df" exitCode=0
Jul 08 16:51:49.398303 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:51:49.398312    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddk5j4w" event={"ID":"204f569b-a681-4a9a-9d39-9c79c3882c86","Type":"ContainerDied","Data":"bcf347385da0d7c7800b130360e501c02bc106ede8ad26c9c64bccf2d4e174df"}
Jul 08 16:51:49.398529 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:51:49.398319    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddk5j4w"
Jul 08 16:51:49.398529 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:51:49.398348    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddk5j4w" event={"ID":"204f569b-a681-4a9a-9d39-9c79c3882c86","Type":"ContainerDied","Data":"b9c77f87663c3656f765127ba7045c6f26e22e96461740b01421c8b20c97eb48"}
Jul 08 16:51:49.398529 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:51:49.398369    2565 scope.go:117] "RemoveContainer" containerID="bcf347385da0d7c7800b130360e501c02bc106ede8ad26c9c64bccf2d4e174df"
Jul 08 16:51:49.406660 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:51:49.406642    2565 scope.go:117] "RemoveContainer" containerID="bcf347385da0d7c7800b130360e501c02bc106ede8ad26c9c64bccf2d4e174df"
Jul 08 16:51:49.406869 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:51:49.406852    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bcf347385da0d7c7800b130360e501c02bc106ede8ad26c9c64bccf2d4e174df\": container with ID starting with bcf347385da0d7c7800b130360e501c02bc106ede8ad26c9c64bccf2d4e174df not found: ID does not exist" containerID="bcf347385da0d7c7800b130360e501c02bc106ede8ad26c9c64bccf2d4e174df"
Jul 08 16:51:49.406918 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:51:49.406876    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcf347385da0d7c7800b130360e501c02bc106ede8ad26c9c64bccf2d4e174df"} err="failed to get container status \"bcf347385da0d7c7800b130360e501c02bc106ede8ad26c9c64bccf2d4e174df\": rpc error: code = NotFound desc = could not find container \"bcf347385da0d7c7800b130360e501c02bc106ede8ad26c9c64bccf2d4e174df\": container with ID starting with bcf347385da0d7c7800b130360e501c02bc106ede8ad26c9c64bccf2d4e174df not found: ID does not exist"
Jul 08 16:51:49.421877 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:51:49.421856    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddk5j4w"]
Jul 08 16:51:49.427563 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:51:49.427539    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddk5j4w"]
Jul 08 16:51:50.487953 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:51:50.487920    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="204f569b-a681-4a9a-9d39-9c79c3882c86" path="/var/lib/kubelet/pods/204f569b-a681-4a9a-9d39-9c79c3882c86/volumes"
Jul 08 16:54:01.912553 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:01.912475    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmxwss"]
Jul 08 16:54:01.913004 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:01.912762    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="204f569b-a681-4a9a-9d39-9c79c3882c86" containerName="main"
Jul 08 16:54:01.913004 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:01.912773    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="204f569b-a681-4a9a-9d39-9c79c3882c86" containerName="main"
Jul 08 16:54:01.913004 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:01.912818    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="204f569b-a681-4a9a-9d39-9c79c3882c86" containerName="main"
Jul 08 16:54:01.915537 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:01.915522    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmxwss"
Jul 08 16:54:01.919408 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:01.919386    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 08 16:54:01.920193 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:01.920175    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 08 16:54:01.920319 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:01.920194    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisv08544b88a8d963ffd553cc1f3ed82d16-kserve-self-signed-certs\""
Jul 08 16:54:01.920319 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:01.920255    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-8qxdr\""
Jul 08 16:54:01.930979 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:01.930957    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmxwss"]
Jul 08 16:54:02.031443 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:02.031407    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f6b7f9b-5e8e-461f-8f90-8a136fa78a65-tmp-dir\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmxwss\" (UID: \"6f6b7f9b-5e8e-461f-8f90-8a136fa78a65\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmxwss"
Jul 08 16:54:02.031599 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:02.031493    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f6b7f9b-5e8e-461f-8f90-8a136fa78a65-dshm\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmxwss\" (UID: \"6f6b7f9b-5e8e-461f-8f90-8a136fa78a65\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmxwss"
Jul 08 16:54:02.031599 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:02.031527    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-428xs\" (UniqueName: \"kubernetes.io/projected/6f6b7f9b-5e8e-461f-8f90-8a136fa78a65-kube-api-access-428xs\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmxwss\" (UID: \"6f6b7f9b-5e8e-461f-8f90-8a136fa78a65\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmxwss"
Jul 08 16:54:02.031599 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:02.031563    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f6b7f9b-5e8e-461f-8f90-8a136fa78a65-model-cache\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmxwss\" (UID: \"6f6b7f9b-5e8e-461f-8f90-8a136fa78a65\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmxwss"
Jul 08 16:54:02.031599 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:02.031593    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f6b7f9b-5e8e-461f-8f90-8a136fa78a65-home\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmxwss\" (UID: \"6f6b7f9b-5e8e-461f-8f90-8a136fa78a65\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmxwss"
Jul 08 16:54:02.031764 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:02.031656    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f6b7f9b-5e8e-461f-8f90-8a136fa78a65-tls-certs\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmxwss\" (UID: \"6f6b7f9b-5e8e-461f-8f90-8a136fa78a65\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmxwss"
Jul 08 16:54:02.132650 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:02.132622    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f6b7f9b-5e8e-461f-8f90-8a136fa78a65-dshm\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmxwss\" (UID: \"6f6b7f9b-5e8e-461f-8f90-8a136fa78a65\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmxwss"
Jul 08 16:54:02.132795 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:02.132654    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-428xs\" (UniqueName: \"kubernetes.io/projected/6f6b7f9b-5e8e-461f-8f90-8a136fa78a65-kube-api-access-428xs\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmxwss\" (UID: \"6f6b7f9b-5e8e-461f-8f90-8a136fa78a65\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmxwss"
Jul 08 16:54:02.132795 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:02.132676    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f6b7f9b-5e8e-461f-8f90-8a136fa78a65-model-cache\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmxwss\" (UID: \"6f6b7f9b-5e8e-461f-8f90-8a136fa78a65\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmxwss"
Jul 08 16:54:02.132795 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:02.132697    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f6b7f9b-5e8e-461f-8f90-8a136fa78a65-home\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmxwss\" (UID: \"6f6b7f9b-5e8e-461f-8f90-8a136fa78a65\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmxwss"
Jul 08 16:54:02.132795 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:02.132720    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f6b7f9b-5e8e-461f-8f90-8a136fa78a65-tls-certs\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmxwss\" (UID: \"6f6b7f9b-5e8e-461f-8f90-8a136fa78a65\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmxwss"
Jul 08 16:54:02.132795 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:02.132767    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f6b7f9b-5e8e-461f-8f90-8a136fa78a65-tmp-dir\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmxwss\" (UID: \"6f6b7f9b-5e8e-461f-8f90-8a136fa78a65\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmxwss"
Jul 08 16:54:02.133099 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:02.133082    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f6b7f9b-5e8e-461f-8f90-8a136fa78a65-model-cache\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmxwss\" (UID: \"6f6b7f9b-5e8e-461f-8f90-8a136fa78a65\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmxwss"
Jul 08 16:54:02.133174 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:02.133114    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f6b7f9b-5e8e-461f-8f90-8a136fa78a65-home\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmxwss\" (UID: \"6f6b7f9b-5e8e-461f-8f90-8a136fa78a65\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmxwss"
Jul 08 16:54:02.133174 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:02.133163    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f6b7f9b-5e8e-461f-8f90-8a136fa78a65-tmp-dir\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmxwss\" (UID: \"6f6b7f9b-5e8e-461f-8f90-8a136fa78a65\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmxwss"
Jul 08 16:54:02.134888 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:02.134865    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f6b7f9b-5e8e-461f-8f90-8a136fa78a65-dshm\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmxwss\" (UID: \"6f6b7f9b-5e8e-461f-8f90-8a136fa78a65\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmxwss"
Jul 08 16:54:02.135290 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:02.135271    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f6b7f9b-5e8e-461f-8f90-8a136fa78a65-tls-certs\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmxwss\" (UID: \"6f6b7f9b-5e8e-461f-8f90-8a136fa78a65\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmxwss"
Jul 08 16:54:02.146939 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:02.146914    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-428xs\" (UniqueName: \"kubernetes.io/projected/6f6b7f9b-5e8e-461f-8f90-8a136fa78a65-kube-api-access-428xs\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmxwss\" (UID: \"6f6b7f9b-5e8e-461f-8f90-8a136fa78a65\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmxwss"
Jul 08 16:54:02.225931 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:02.225909    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmxwss"
Jul 08 16:54:02.365601 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:02.365576    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmxwss"]
Jul 08 16:54:02.368265 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:54:02.368234    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f6b7f9b_5e8e_461f_8f90_8a136fa78a65.slice/crio-aac12cdd9611d2939492b6fa46c4c5600f8be077700b4e13bfb9f539b9ea7ed6 WatchSource:0}: Error finding container aac12cdd9611d2939492b6fa46c4c5600f8be077700b4e13bfb9f539b9ea7ed6: Status 404 returned error can't find the container with id aac12cdd9611d2939492b6fa46c4c5600f8be077700b4e13bfb9f539b9ea7ed6
Jul 08 16:54:02.422285 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:02.422262    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekdmw4"]
Jul 08 16:54:02.427433 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:02.427418    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekdmw4"
Jul 08 16:54:02.430130 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:02.429942    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-epp-sa-dockercfg-cprjj\""
Jul 08 16:54:02.438847 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:02.438825    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekdmw4"]
Jul 08 16:54:02.535332 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:02.535253    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bclqp\" (UniqueName: \"kubernetes.io/projected/97ea5f29-4b05-43fe-b616-993d0a2d8d50-kube-api-access-bclqp\") pod \"llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekdmw4\" (UID: \"97ea5f29-4b05-43fe-b616-993d0a2d8d50\") " pod="kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekdmw4"
Jul 08 16:54:02.535332 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:02.535312    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/97ea5f29-4b05-43fe-b616-993d0a2d8d50-tokenizer-uds\") pod \"llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekdmw4\" (UID: \"97ea5f29-4b05-43fe-b616-993d0a2d8d50\") " pod="kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekdmw4"
Jul 08 16:54:02.535503 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:02.535352    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97ea5f29-4b05-43fe-b616-993d0a2d8d50-tls-certs\") pod \"llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekdmw4\" (UID: \"97ea5f29-4b05-43fe-b616-993d0a2d8d50\") " pod="kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekdmw4"
Jul 08 16:54:02.635950 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:02.635926    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/97ea5f29-4b05-43fe-b616-993d0a2d8d50-tokenizer-uds\") pod \"llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekdmw4\" (UID: \"97ea5f29-4b05-43fe-b616-993d0a2d8d50\") " pod="kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekdmw4"
Jul 08 16:54:02.636086 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:02.635964    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97ea5f29-4b05-43fe-b616-993d0a2d8d50-tls-certs\") pod \"llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekdmw4\" (UID: \"97ea5f29-4b05-43fe-b616-993d0a2d8d50\") " pod="kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekdmw4"
Jul 08 16:54:02.636086 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:02.636024    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bclqp\" (UniqueName: \"kubernetes.io/projected/97ea5f29-4b05-43fe-b616-993d0a2d8d50-kube-api-access-bclqp\") pod \"llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekdmw4\" (UID: \"97ea5f29-4b05-43fe-b616-993d0a2d8d50\") " pod="kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekdmw4"
Jul 08 16:54:02.636379 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:02.636361    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/97ea5f29-4b05-43fe-b616-993d0a2d8d50-tokenizer-uds\") pod \"llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekdmw4\" (UID: \"97ea5f29-4b05-43fe-b616-993d0a2d8d50\") " pod="kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekdmw4"
Jul 08 16:54:02.638468 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:02.638449    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97ea5f29-4b05-43fe-b616-993d0a2d8d50-tls-certs\") pod \"llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekdmw4\" (UID: \"97ea5f29-4b05-43fe-b616-993d0a2d8d50\") " pod="kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekdmw4"
Jul 08 16:54:02.647394 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:02.647378    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bclqp\" (UniqueName: \"kubernetes.io/projected/97ea5f29-4b05-43fe-b616-993d0a2d8d50-kube-api-access-bclqp\") pod \"llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekdmw4\" (UID: \"97ea5f29-4b05-43fe-b616-993d0a2d8d50\") " pod="kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekdmw4"
Jul 08 16:54:02.738084 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:02.738063    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekdmw4"
Jul 08 16:54:02.884527 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:02.884498    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmxwss" event={"ID":"6f6b7f9b-5e8e-461f-8f90-8a136fa78a65","Type":"ContainerStarted","Data":"f0c66d794228b92b3f60e4fa927b5d51336a72992476561f41872410408ff727"}
Jul 08 16:54:02.884647 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:02.884552    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmxwss" event={"ID":"6f6b7f9b-5e8e-461f-8f90-8a136fa78a65","Type":"ContainerStarted","Data":"aac12cdd9611d2939492b6fa46c4c5600f8be077700b4e13bfb9f539b9ea7ed6"}
Jul 08 16:54:02.885016 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:02.884998    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekdmw4"]
Jul 08 16:54:02.886899 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:54:02.886871    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97ea5f29_4b05_43fe_b616_993d0a2d8d50.slice/crio-990e8a761aa3ed83748073fccfd7fb67310b12a1e5495e3ec5293daf23228171 WatchSource:0}: Error finding container 990e8a761aa3ed83748073fccfd7fb67310b12a1e5495e3ec5293daf23228171: Status 404 returned error can't find the container with id 990e8a761aa3ed83748073fccfd7fb67310b12a1e5495e3ec5293daf23228171
Jul 08 16:54:02.920862 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:02.920794    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmxwss" podStartSLOduration=1.9207736560000002 podStartE2EDuration="1.920773656s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:54:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:54:02.919788713 +0000 UTC m=+1177.020403283" watchObservedRunningTime="2026-07-08 16:54:02.920773656 +0000 UTC m=+1177.021388254"
Jul 08 16:54:03.226190 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:03.226160    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmxwss"
Jul 08 16:54:03.889842 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:03.889803    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekdmw4" event={"ID":"97ea5f29-4b05-43fe-b616-993d0a2d8d50","Type":"ContainerStarted","Data":"a4eb9a7b884ee227dd61a4326f5c552929c20815963d3f23b28fb0ad53cf7f27"}
Jul 08 16:54:03.890102 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:03.890075    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekdmw4"
Jul 08 16:54:03.890158 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:03.890122    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekdmw4" event={"ID":"97ea5f29-4b05-43fe-b616-993d0a2d8d50","Type":"ContainerStarted","Data":"990e8a761aa3ed83748073fccfd7fb67310b12a1e5495e3ec5293daf23228171"}
Jul 08 16:54:03.913287 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:03.913001    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekdmw4" podStartSLOduration=1.912982302 podStartE2EDuration="1.912982302s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:54:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:54:03.912379088 +0000 UTC m=+1178.012993659" watchObservedRunningTime="2026-07-08 16:54:03.912982302 +0000 UTC m=+1178.013596874"
Jul 08 16:54:12.227034 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:12.226993    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmxwss"
Jul 08 16:54:12.239171 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:12.239149    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmxwss"
Jul 08 16:54:12.936823 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:12.936791    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmxwss"
Jul 08 16:54:35.898346 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:35.898318    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekdmw4"
Jul 08 16:54:37.256190 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:37.256120    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekdmw4"]
Jul 08 16:54:37.264892 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:54:37.264852    2565 log.go:32] "ExecSync cmd from runtime service failed" err=<
Jul 08 16:54:37.264892 ip-10-0-142-172 kubenswrapper[2565]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 08 16:54:37.264892 ip-10-0-142-172 kubenswrapper[2565]:         , stdout: , stderr: , exit code -1
Jul 08 16:54:37.264892 ip-10-0-142-172 kubenswrapper[2565]:  > containerID="a4eb9a7b884ee227dd61a4326f5c552929c20815963d3f23b28fb0ad53cf7f27" cmd=["/bin/sleep","15"]
Jul 08 16:54:37.265097 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:37.264916    2565 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekdmw4" message="" err=<
Jul 08 16:54:37.265097 ip-10-0-142-172 kubenswrapper[2565]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 08 16:54:37.265097 ip-10-0-142-172 kubenswrapper[2565]:         , stdout: , stderr: , exit code -1
Jul 08 16:54:37.265097 ip-10-0-142-172 kubenswrapper[2565]:  >
Jul 08 16:54:37.265097 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:54:37.264935    2565 kuberuntime_container.go:754] "PreStop hook failed" err=<
Jul 08 16:54:37.265097 ip-10-0-142-172 kubenswrapper[2565]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 08 16:54:37.265097 ip-10-0-142-172 kubenswrapper[2565]:         , stdout: , stderr: , exit code -1
Jul 08 16:54:37.265097 ip-10-0-142-172 kubenswrapper[2565]:  > pod="kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekdmw4" podUID="97ea5f29-4b05-43fe-b616-993d0a2d8d50" containerName="main" containerID="cri-o://a4eb9a7b884ee227dd61a4326f5c552929c20815963d3f23b28fb0ad53cf7f27"
Jul 08 16:54:37.265097 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:37.264989    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekdmw4" podUID="97ea5f29-4b05-43fe-b616-993d0a2d8d50" containerName="main" containerID="cri-o://a4eb9a7b884ee227dd61a4326f5c552929c20815963d3f23b28fb0ad53cf7f27" gracePeriod=60
Jul 08 16:54:37.271655 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:37.271630    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmxwss"]
Jul 08 16:54:37.510265 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:37.510193    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekdmw4"
Jul 08 16:54:37.618869 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:37.618844    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97ea5f29-4b05-43fe-b616-993d0a2d8d50-tls-certs\") pod \"97ea5f29-4b05-43fe-b616-993d0a2d8d50\" (UID: \"97ea5f29-4b05-43fe-b616-993d0a2d8d50\") "
Jul 08 16:54:37.619030 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:37.618907    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bclqp\" (UniqueName: \"kubernetes.io/projected/97ea5f29-4b05-43fe-b616-993d0a2d8d50-kube-api-access-bclqp\") pod \"97ea5f29-4b05-43fe-b616-993d0a2d8d50\" (UID: \"97ea5f29-4b05-43fe-b616-993d0a2d8d50\") "
Jul 08 16:54:37.619030 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:37.618941    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/97ea5f29-4b05-43fe-b616-993d0a2d8d50-tokenizer-uds\") pod \"97ea5f29-4b05-43fe-b616-993d0a2d8d50\" (UID: \"97ea5f29-4b05-43fe-b616-993d0a2d8d50\") "
Jul 08 16:54:37.619282 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:37.619257    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97ea5f29-4b05-43fe-b616-993d0a2d8d50-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "97ea5f29-4b05-43fe-b616-993d0a2d8d50" (UID: "97ea5f29-4b05-43fe-b616-993d0a2d8d50"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:54:37.621116 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:37.621087    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97ea5f29-4b05-43fe-b616-993d0a2d8d50-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "97ea5f29-4b05-43fe-b616-993d0a2d8d50" (UID: "97ea5f29-4b05-43fe-b616-993d0a2d8d50"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 16:54:37.621116 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:37.621104    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97ea5f29-4b05-43fe-b616-993d0a2d8d50-kube-api-access-bclqp" (OuterVolumeSpecName: "kube-api-access-bclqp") pod "97ea5f29-4b05-43fe-b616-993d0a2d8d50" (UID: "97ea5f29-4b05-43fe-b616-993d0a2d8d50"). InnerVolumeSpecName "kube-api-access-bclqp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:54:37.719767 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:37.719741    2565 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/97ea5f29-4b05-43fe-b616-993d0a2d8d50-tokenizer-uds\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 16:54:37.719767 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:37.719763    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97ea5f29-4b05-43fe-b616-993d0a2d8d50-tls-certs\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 16:54:37.719893 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:37.719772    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bclqp\" (UniqueName: \"kubernetes.io/projected/97ea5f29-4b05-43fe-b616-993d0a2d8d50-kube-api-access-bclqp\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 16:54:38.024003 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:38.023955    2565 generic.go:356] "Generic (PLEG): container finished" podID="97ea5f29-4b05-43fe-b616-993d0a2d8d50" containerID="a4eb9a7b884ee227dd61a4326f5c552929c20815963d3f23b28fb0ad53cf7f27" exitCode=0
Jul 08 16:54:38.024183 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:38.024009    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekdmw4"
Jul 08 16:54:38.024183 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:38.024009    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekdmw4" event={"ID":"97ea5f29-4b05-43fe-b616-993d0a2d8d50","Type":"ContainerDied","Data":"a4eb9a7b884ee227dd61a4326f5c552929c20815963d3f23b28fb0ad53cf7f27"}
Jul 08 16:54:38.024183 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:38.024130    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekdmw4" event={"ID":"97ea5f29-4b05-43fe-b616-993d0a2d8d50","Type":"ContainerDied","Data":"990e8a761aa3ed83748073fccfd7fb67310b12a1e5495e3ec5293daf23228171"}
Jul 08 16:54:38.024183 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:38.024167    2565 scope.go:117] "RemoveContainer" containerID="a4eb9a7b884ee227dd61a4326f5c552929c20815963d3f23b28fb0ad53cf7f27"
Jul 08 16:54:38.033479 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:38.033461    2565 scope.go:117] "RemoveContainer" containerID="a4eb9a7b884ee227dd61a4326f5c552929c20815963d3f23b28fb0ad53cf7f27"
Jul 08 16:54:38.033748 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:54:38.033726    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4eb9a7b884ee227dd61a4326f5c552929c20815963d3f23b28fb0ad53cf7f27\": container with ID starting with a4eb9a7b884ee227dd61a4326f5c552929c20815963d3f23b28fb0ad53cf7f27 not found: ID does not exist" containerID="a4eb9a7b884ee227dd61a4326f5c552929c20815963d3f23b28fb0ad53cf7f27"
Jul 08 16:54:38.033812 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:38.033757    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4eb9a7b884ee227dd61a4326f5c552929c20815963d3f23b28fb0ad53cf7f27"} err="failed to get container status \"a4eb9a7b884ee227dd61a4326f5c552929c20815963d3f23b28fb0ad53cf7f27\": rpc error: code = NotFound desc = could not find container \"a4eb9a7b884ee227dd61a4326f5c552929c20815963d3f23b28fb0ad53cf7f27\": container with ID starting with a4eb9a7b884ee227dd61a4326f5c552929c20815963d3f23b28fb0ad53cf7f27 not found: ID does not exist"
Jul 08 16:54:38.055671 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:38.055650    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekdmw4"]
Jul 08 16:54:38.068803 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:38.068784    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekdmw4"]
Jul 08 16:54:38.488574 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:38.488533    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97ea5f29-4b05-43fe-b616-993d0a2d8d50" path="/var/lib/kubelet/pods/97ea5f29-4b05-43fe-b616-993d0a2d8d50/volumes"
Jul 08 16:54:52.292869 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:52.292802    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmxwss" podUID="6f6b7f9b-5e8e-461f-8f90-8a136fa78a65" containerName="main" containerID="cri-o://f0c66d794228b92b3f60e4fa927b5d51336a72992476561f41872410408ff727" gracePeriod=45
Jul 08 16:54:52.538464 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:52.538439    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmxwss"
Jul 08 16:54:52.635440 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:52.635366    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f6b7f9b-5e8e-461f-8f90-8a136fa78a65-tmp-dir\") pod \"6f6b7f9b-5e8e-461f-8f90-8a136fa78a65\" (UID: \"6f6b7f9b-5e8e-461f-8f90-8a136fa78a65\") "
Jul 08 16:54:52.635440 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:52.635402    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f6b7f9b-5e8e-461f-8f90-8a136fa78a65-model-cache\") pod \"6f6b7f9b-5e8e-461f-8f90-8a136fa78a65\" (UID: \"6f6b7f9b-5e8e-461f-8f90-8a136fa78a65\") "
Jul 08 16:54:52.635624 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:52.635447    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-428xs\" (UniqueName: \"kubernetes.io/projected/6f6b7f9b-5e8e-461f-8f90-8a136fa78a65-kube-api-access-428xs\") pod \"6f6b7f9b-5e8e-461f-8f90-8a136fa78a65\" (UID: \"6f6b7f9b-5e8e-461f-8f90-8a136fa78a65\") "
Jul 08 16:54:52.635624 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:52.635493    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f6b7f9b-5e8e-461f-8f90-8a136fa78a65-tls-certs\") pod \"6f6b7f9b-5e8e-461f-8f90-8a136fa78a65\" (UID: \"6f6b7f9b-5e8e-461f-8f90-8a136fa78a65\") "
Jul 08 16:54:52.635624 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:52.635556    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f6b7f9b-5e8e-461f-8f90-8a136fa78a65-dshm\") pod \"6f6b7f9b-5e8e-461f-8f90-8a136fa78a65\" (UID: \"6f6b7f9b-5e8e-461f-8f90-8a136fa78a65\") "
Jul 08 16:54:52.635624 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:52.635593    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f6b7f9b-5e8e-461f-8f90-8a136fa78a65-home\") pod \"6f6b7f9b-5e8e-461f-8f90-8a136fa78a65\" (UID: \"6f6b7f9b-5e8e-461f-8f90-8a136fa78a65\") "
Jul 08 16:54:52.635624 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:52.635588    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f6b7f9b-5e8e-461f-8f90-8a136fa78a65-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6f6b7f9b-5e8e-461f-8f90-8a136fa78a65" (UID: "6f6b7f9b-5e8e-461f-8f90-8a136fa78a65"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:54:52.635852 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:52.635627    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f6b7f9b-5e8e-461f-8f90-8a136fa78a65-model-cache" (OuterVolumeSpecName: "model-cache") pod "6f6b7f9b-5e8e-461f-8f90-8a136fa78a65" (UID: "6f6b7f9b-5e8e-461f-8f90-8a136fa78a65"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:54:52.635900 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:52.635861    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f6b7f9b-5e8e-461f-8f90-8a136fa78a65-tmp-dir\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 16:54:52.635900 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:52.635873    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f6b7f9b-5e8e-461f-8f90-8a136fa78a65-home" (OuterVolumeSpecName: "home") pod "6f6b7f9b-5e8e-461f-8f90-8a136fa78a65" (UID: "6f6b7f9b-5e8e-461f-8f90-8a136fa78a65"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:54:52.635900 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:52.635881    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f6b7f9b-5e8e-461f-8f90-8a136fa78a65-model-cache\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 16:54:52.637672 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:52.637645    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f6b7f9b-5e8e-461f-8f90-8a136fa78a65-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6f6b7f9b-5e8e-461f-8f90-8a136fa78a65" (UID: "6f6b7f9b-5e8e-461f-8f90-8a136fa78a65"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 16:54:52.637749 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:52.637699    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f6b7f9b-5e8e-461f-8f90-8a136fa78a65-kube-api-access-428xs" (OuterVolumeSpecName: "kube-api-access-428xs") pod "6f6b7f9b-5e8e-461f-8f90-8a136fa78a65" (UID: "6f6b7f9b-5e8e-461f-8f90-8a136fa78a65"). InnerVolumeSpecName "kube-api-access-428xs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:54:52.637749 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:52.637710    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f6b7f9b-5e8e-461f-8f90-8a136fa78a65-dshm" (OuterVolumeSpecName: "dshm") pod "6f6b7f9b-5e8e-461f-8f90-8a136fa78a65" (UID: "6f6b7f9b-5e8e-461f-8f90-8a136fa78a65"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:54:52.737180 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:52.737152    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f6b7f9b-5e8e-461f-8f90-8a136fa78a65-dshm\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 16:54:52.737180 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:52.737177    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f6b7f9b-5e8e-461f-8f90-8a136fa78a65-home\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 16:54:52.737180 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:52.737186    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-428xs\" (UniqueName: \"kubernetes.io/projected/6f6b7f9b-5e8e-461f-8f90-8a136fa78a65-kube-api-access-428xs\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 16:54:52.737399 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:52.737196    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f6b7f9b-5e8e-461f-8f90-8a136fa78a65-tls-certs\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 16:54:53.085357 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:53.085327    2565 generic.go:356] "Generic (PLEG): container finished" podID="6f6b7f9b-5e8e-461f-8f90-8a136fa78a65" containerID="f0c66d794228b92b3f60e4fa927b5d51336a72992476561f41872410408ff727" exitCode=0
Jul 08 16:54:53.085509 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:53.085370    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmxwss"
Jul 08 16:54:53.085509 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:53.085381    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmxwss" event={"ID":"6f6b7f9b-5e8e-461f-8f90-8a136fa78a65","Type":"ContainerDied","Data":"f0c66d794228b92b3f60e4fa927b5d51336a72992476561f41872410408ff727"}
Jul 08 16:54:53.085509 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:53.085424    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmxwss" event={"ID":"6f6b7f9b-5e8e-461f-8f90-8a136fa78a65","Type":"ContainerDied","Data":"aac12cdd9611d2939492b6fa46c4c5600f8be077700b4e13bfb9f539b9ea7ed6"}
Jul 08 16:54:53.085509 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:53.085448    2565 scope.go:117] "RemoveContainer" containerID="f0c66d794228b92b3f60e4fa927b5d51336a72992476561f41872410408ff727"
Jul 08 16:54:53.093860 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:53.093844    2565 scope.go:117] "RemoveContainer" containerID="f0c66d794228b92b3f60e4fa927b5d51336a72992476561f41872410408ff727"
Jul 08 16:54:53.094139 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:54:53.094121    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0c66d794228b92b3f60e4fa927b5d51336a72992476561f41872410408ff727\": container with ID starting with f0c66d794228b92b3f60e4fa927b5d51336a72992476561f41872410408ff727 not found: ID does not exist" containerID="f0c66d794228b92b3f60e4fa927b5d51336a72992476561f41872410408ff727"
Jul 08 16:54:53.094185 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:53.094147    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0c66d794228b92b3f60e4fa927b5d51336a72992476561f41872410408ff727"} err="failed to get container status \"f0c66d794228b92b3f60e4fa927b5d51336a72992476561f41872410408ff727\": rpc error: code = NotFound desc = could not find container \"f0c66d794228b92b3f60e4fa927b5d51336a72992476561f41872410408ff727\": container with ID starting with f0c66d794228b92b3f60e4fa927b5d51336a72992476561f41872410408ff727 not found: ID does not exist"
Jul 08 16:54:53.107953 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:53.107931    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmxwss"]
Jul 08 16:54:53.114026 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:53.114005    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmxwss"]
Jul 08 16:54:54.490783 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:54:54.490751    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f6b7f9b-5e8e-461f-8f90-8a136fa78a65" path="/var/lib/kubelet/pods/6f6b7f9b-5e8e-461f-8f90-8a136fa78a65/volumes"
Jul 08 16:56:06.945387 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:06.945352    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-44gcv"]
Jul 08 16:56:06.945813 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:06.945625    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97ea5f29-4b05-43fe-b616-993d0a2d8d50" containerName="main"
Jul 08 16:56:06.945813 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:06.945637    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="97ea5f29-4b05-43fe-b616-993d0a2d8d50" containerName="main"
Jul 08 16:56:06.945813 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:06.945648    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f6b7f9b-5e8e-461f-8f90-8a136fa78a65" containerName="main"
Jul 08 16:56:06.945813 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:06.945653    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f6b7f9b-5e8e-461f-8f90-8a136fa78a65" containerName="main"
Jul 08 16:56:06.945813 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:06.945724    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f6b7f9b-5e8e-461f-8f90-8a136fa78a65" containerName="main"
Jul 08 16:56:06.945813 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:06.945730    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="97ea5f29-4b05-43fe-b616-993d0a2d8d50" containerName="main"
Jul 08 16:56:06.948514 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:06.948497    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-44gcv"
Jul 08 16:56:06.953426 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:06.953405    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 08 16:56:06.953574 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:06.953562    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-gw-ca-root-cert\""
Jul 08 16:56:06.953648 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:06.953604    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"router-gateway-1-openshift-default-dockercfg-dc4rb\""
Jul 08 16:56:06.954558 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:06.954538    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 08 16:56:06.961514 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:06.961491    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-44gcv"]
Jul 08 16:56:07.120313 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:07.120280    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a423d25-2629-41b7-aff2-91f886f4b3b0-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-799f46c59b-44gcv\" (UID: \"4a423d25-2629-41b7-aff2-91f886f4b3b0\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-44gcv"
Jul 08 16:56:07.120313 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:07.120318    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a423d25-2629-41b7-aff2-91f886f4b3b0-workload-certs\") pod \"router-gateway-1-openshift-default-799f46c59b-44gcv\" (UID: \"4a423d25-2629-41b7-aff2-91f886f4b3b0\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-44gcv"
Jul 08 16:56:07.120511 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:07.120386    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fk2mf\" (UniqueName: \"kubernetes.io/projected/4a423d25-2629-41b7-aff2-91f886f4b3b0-kube-api-access-fk2mf\") pod \"router-gateway-1-openshift-default-799f46c59b-44gcv\" (UID: \"4a423d25-2629-41b7-aff2-91f886f4b3b0\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-44gcv"
Jul 08 16:56:07.120511 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:07.120421    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a423d25-2629-41b7-aff2-91f886f4b3b0-istio-token\") pod \"router-gateway-1-openshift-default-799f46c59b-44gcv\" (UID: \"4a423d25-2629-41b7-aff2-91f886f4b3b0\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-44gcv"
Jul 08 16:56:07.120511 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:07.120442    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a423d25-2629-41b7-aff2-91f886f4b3b0-istio-envoy\") pod \"router-gateway-1-openshift-default-799f46c59b-44gcv\" (UID: \"4a423d25-2629-41b7-aff2-91f886f4b3b0\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-44gcv"
Jul 08 16:56:07.120511 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:07.120468    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a423d25-2629-41b7-aff2-91f886f4b3b0-workload-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-44gcv\" (UID: \"4a423d25-2629-41b7-aff2-91f886f4b3b0\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-44gcv"
Jul 08 16:56:07.120511 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:07.120490    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a423d25-2629-41b7-aff2-91f886f4b3b0-credential-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-44gcv\" (UID: \"4a423d25-2629-41b7-aff2-91f886f4b3b0\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-44gcv"
Jul 08 16:56:07.120672 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:07.120538    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a423d25-2629-41b7-aff2-91f886f4b3b0-istio-data\") pod \"router-gateway-1-openshift-default-799f46c59b-44gcv\" (UID: \"4a423d25-2629-41b7-aff2-91f886f4b3b0\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-44gcv"
Jul 08 16:56:07.120672 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:07.120558    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a423d25-2629-41b7-aff2-91f886f4b3b0-istio-podinfo\") pod \"router-gateway-1-openshift-default-799f46c59b-44gcv\" (UID: \"4a423d25-2629-41b7-aff2-91f886f4b3b0\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-44gcv"
Jul 08 16:56:07.221019 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:07.220929    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a423d25-2629-41b7-aff2-91f886f4b3b0-istio-data\") pod \"router-gateway-1-openshift-default-799f46c59b-44gcv\" (UID: \"4a423d25-2629-41b7-aff2-91f886f4b3b0\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-44gcv"
Jul 08 16:56:07.221019 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:07.220969    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a423d25-2629-41b7-aff2-91f886f4b3b0-istio-podinfo\") pod \"router-gateway-1-openshift-default-799f46c59b-44gcv\" (UID: \"4a423d25-2629-41b7-aff2-91f886f4b3b0\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-44gcv"
Jul 08 16:56:07.221019 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:07.221000    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a423d25-2629-41b7-aff2-91f886f4b3b0-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-799f46c59b-44gcv\" (UID: \"4a423d25-2629-41b7-aff2-91f886f4b3b0\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-44gcv"
Jul 08 16:56:07.221019 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:07.221017    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a423d25-2629-41b7-aff2-91f886f4b3b0-workload-certs\") pod \"router-gateway-1-openshift-default-799f46c59b-44gcv\" (UID: \"4a423d25-2629-41b7-aff2-91f886f4b3b0\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-44gcv"
Jul 08 16:56:07.221430 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:07.221047    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fk2mf\" (UniqueName: \"kubernetes.io/projected/4a423d25-2629-41b7-aff2-91f886f4b3b0-kube-api-access-fk2mf\") pod \"router-gateway-1-openshift-default-799f46c59b-44gcv\" (UID: \"4a423d25-2629-41b7-aff2-91f886f4b3b0\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-44gcv"
Jul 08 16:56:07.221430 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:07.221063    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a423d25-2629-41b7-aff2-91f886f4b3b0-istio-token\") pod \"router-gateway-1-openshift-default-799f46c59b-44gcv\" (UID: \"4a423d25-2629-41b7-aff2-91f886f4b3b0\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-44gcv"
Jul 08 16:56:07.221430 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:07.221081    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a423d25-2629-41b7-aff2-91f886f4b3b0-istio-envoy\") pod \"router-gateway-1-openshift-default-799f46c59b-44gcv\" (UID: \"4a423d25-2629-41b7-aff2-91f886f4b3b0\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-44gcv"
Jul 08 16:56:07.221430 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:07.221107    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a423d25-2629-41b7-aff2-91f886f4b3b0-workload-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-44gcv\" (UID: \"4a423d25-2629-41b7-aff2-91f886f4b3b0\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-44gcv"
Jul 08 16:56:07.221430 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:07.221123    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a423d25-2629-41b7-aff2-91f886f4b3b0-credential-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-44gcv\" (UID: \"4a423d25-2629-41b7-aff2-91f886f4b3b0\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-44gcv"
Jul 08 16:56:07.221676 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:07.221484    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a423d25-2629-41b7-aff2-91f886f4b3b0-workload-certs\") pod \"router-gateway-1-openshift-default-799f46c59b-44gcv\" (UID: \"4a423d25-2629-41b7-aff2-91f886f4b3b0\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-44gcv"
Jul 08 16:56:07.221676 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:07.221540    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a423d25-2629-41b7-aff2-91f886f4b3b0-credential-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-44gcv\" (UID: \"4a423d25-2629-41b7-aff2-91f886f4b3b0\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-44gcv"
Jul 08 16:56:07.221676 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:07.221599    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a423d25-2629-41b7-aff2-91f886f4b3b0-istio-data\") pod \"router-gateway-1-openshift-default-799f46c59b-44gcv\" (UID: \"4a423d25-2629-41b7-aff2-91f886f4b3b0\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-44gcv"
Jul 08 16:56:07.221676 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:07.221618    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a423d25-2629-41b7-aff2-91f886f4b3b0-workload-socket\") pod \"router-gateway-1-openshift-default-799f46c59b-44gcv\" (UID: \"4a423d25-2629-41b7-aff2-91f886f4b3b0\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-44gcv"
Jul 08 16:56:07.221824 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:07.221712    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a423d25-2629-41b7-aff2-91f886f4b3b0-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-799f46c59b-44gcv\" (UID: \"4a423d25-2629-41b7-aff2-91f886f4b3b0\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-44gcv"
Jul 08 16:56:07.223626 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:07.223604    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a423d25-2629-41b7-aff2-91f886f4b3b0-istio-envoy\") pod \"router-gateway-1-openshift-default-799f46c59b-44gcv\" (UID: \"4a423d25-2629-41b7-aff2-91f886f4b3b0\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-44gcv"
Jul 08 16:56:07.223900 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:07.223876    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a423d25-2629-41b7-aff2-91f886f4b3b0-istio-podinfo\") pod \"router-gateway-1-openshift-default-799f46c59b-44gcv\" (UID: \"4a423d25-2629-41b7-aff2-91f886f4b3b0\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-44gcv"
Jul 08 16:56:07.232364 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:07.232340    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a423d25-2629-41b7-aff2-91f886f4b3b0-istio-token\") pod \"router-gateway-1-openshift-default-799f46c59b-44gcv\" (UID: \"4a423d25-2629-41b7-aff2-91f886f4b3b0\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-44gcv"
Jul 08 16:56:07.232948 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:07.232931    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fk2mf\" (UniqueName: \"kubernetes.io/projected/4a423d25-2629-41b7-aff2-91f886f4b3b0-kube-api-access-fk2mf\") pod \"router-gateway-1-openshift-default-799f46c59b-44gcv\" (UID: \"4a423d25-2629-41b7-aff2-91f886f4b3b0\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-44gcv"
Jul 08 16:56:07.259021 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:07.258989    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-44gcv"
Jul 08 16:56:07.391897 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:07.391874    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-44gcv"]
Jul 08 16:56:07.393639 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:56:07.393617    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a423d25_2629_41b7_aff2_91f886f4b3b0.slice/crio-2361aa5984458547b7a50d237b298d6b11c55414ef86f489054f9fe4eab1b135 WatchSource:0}: Error finding container 2361aa5984458547b7a50d237b298d6b11c55414ef86f489054f9fe4eab1b135: Status 404 returned error can't find the container with id 2361aa5984458547b7a50d237b298d6b11c55414ef86f489054f9fe4eab1b135
Jul 08 16:56:07.395545 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:07.395530    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 16:56:07.671905 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:07.671821    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-44gcv"]
Jul 08 16:56:08.372827 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:08.372785    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-44gcv" event={"ID":"4a423d25-2629-41b7-aff2-91f886f4b3b0","Type":"ContainerStarted","Data":"2361aa5984458547b7a50d237b298d6b11c55414ef86f489054f9fe4eab1b135"}
Jul 08 16:56:10.081136 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:10.081098    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 08 16:56:10.081429 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:10.081170    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 08 16:56:10.081429 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:10.081201    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 08 16:56:10.386193 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:10.386117    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-44gcv" event={"ID":"4a423d25-2629-41b7-aff2-91f886f4b3b0","Type":"ContainerStarted","Data":"9b8029e61cf4a293ec8fea328fed581446dde4f3b324a0b63261d6dc5d3af899"}
Jul 08 16:56:10.386351 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:10.386242    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-44gcv" podUID="4a423d25-2629-41b7-aff2-91f886f4b3b0" containerName="istio-proxy" containerID="cri-o://9b8029e61cf4a293ec8fea328fed581446dde4f3b324a0b63261d6dc5d3af899" gracePeriod=30
Jul 08 16:56:10.416478 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:10.416432    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-44gcv" podStartSLOduration=1.731217445 podStartE2EDuration="4.416417744s" totalImagesPullingTime="2.685200299s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:56:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:56:10.415354042 +0000 UTC m=+1304.515968614" watchObservedRunningTime="2026-07-08 16:56:10.416417744 +0000 UTC m=+1304.517032314"
Jul 08 16:56:15.360091 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:15.360058    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4wjhf9"]
Jul 08 16:56:15.363330 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:15.363311    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4wjhf9"
Jul 08 16:56:15.366711 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:15.366682    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-8qxdr\""
Jul 08 16:56:15.367599 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:15.367583    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisv122f03714c5bdf915a2917fdf1262b98-kserve-self-signed-certs\""
Jul 08 16:56:15.380346 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:15.380316    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4wjhf9"]
Jul 08 16:56:15.488671 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:15.488643    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27793b02-9be7-42ac-8be9-f7cfa8a54dd8-dshm\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4wjhf9\" (UID: \"27793b02-9be7-42ac-8be9-f7cfa8a54dd8\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4wjhf9"
Jul 08 16:56:15.488814 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:15.488702    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flxrh\" (UniqueName: \"kubernetes.io/projected/27793b02-9be7-42ac-8be9-f7cfa8a54dd8-kube-api-access-flxrh\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4wjhf9\" (UID: \"27793b02-9be7-42ac-8be9-f7cfa8a54dd8\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4wjhf9"
Jul 08 16:56:15.488814 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:15.488770    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27793b02-9be7-42ac-8be9-f7cfa8a54dd8-tmp-dir\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4wjhf9\" (UID: \"27793b02-9be7-42ac-8be9-f7cfa8a54dd8\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4wjhf9"
Jul 08 16:56:15.488814 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:15.488801    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27793b02-9be7-42ac-8be9-f7cfa8a54dd8-tls-certs\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4wjhf9\" (UID: \"27793b02-9be7-42ac-8be9-f7cfa8a54dd8\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4wjhf9"
Jul 08 16:56:15.488915 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:15.488831    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27793b02-9be7-42ac-8be9-f7cfa8a54dd8-home\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4wjhf9\" (UID: \"27793b02-9be7-42ac-8be9-f7cfa8a54dd8\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4wjhf9"
Jul 08 16:56:15.488915 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:15.488870    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27793b02-9be7-42ac-8be9-f7cfa8a54dd8-model-cache\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4wjhf9\" (UID: \"27793b02-9be7-42ac-8be9-f7cfa8a54dd8\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4wjhf9"
Jul 08 16:56:15.590293 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:15.590264    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27793b02-9be7-42ac-8be9-f7cfa8a54dd8-dshm\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4wjhf9\" (UID: \"27793b02-9be7-42ac-8be9-f7cfa8a54dd8\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4wjhf9"
Jul 08 16:56:15.590448 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:15.590339    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flxrh\" (UniqueName: \"kubernetes.io/projected/27793b02-9be7-42ac-8be9-f7cfa8a54dd8-kube-api-access-flxrh\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4wjhf9\" (UID: \"27793b02-9be7-42ac-8be9-f7cfa8a54dd8\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4wjhf9"
Jul 08 16:56:15.590448 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:15.590384    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27793b02-9be7-42ac-8be9-f7cfa8a54dd8-tmp-dir\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4wjhf9\" (UID: \"27793b02-9be7-42ac-8be9-f7cfa8a54dd8\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4wjhf9"
Jul 08 16:56:15.590448 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:15.590413    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27793b02-9be7-42ac-8be9-f7cfa8a54dd8-tls-certs\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4wjhf9\" (UID: \"27793b02-9be7-42ac-8be9-f7cfa8a54dd8\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4wjhf9"
Jul 08 16:56:15.590610 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:15.590453    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27793b02-9be7-42ac-8be9-f7cfa8a54dd8-home\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4wjhf9\" (UID: \"27793b02-9be7-42ac-8be9-f7cfa8a54dd8\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4wjhf9"
Jul 08 16:56:15.590610 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:15.590483    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27793b02-9be7-42ac-8be9-f7cfa8a54dd8-model-cache\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4wjhf9\" (UID: \"27793b02-9be7-42ac-8be9-f7cfa8a54dd8\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4wjhf9"
Jul 08 16:56:15.590868 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:15.590844    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27793b02-9be7-42ac-8be9-f7cfa8a54dd8-model-cache\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4wjhf9\" (UID: \"27793b02-9be7-42ac-8be9-f7cfa8a54dd8\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4wjhf9"
Jul 08 16:56:15.590989 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:15.590968    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27793b02-9be7-42ac-8be9-f7cfa8a54dd8-home\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4wjhf9\" (UID: \"27793b02-9be7-42ac-8be9-f7cfa8a54dd8\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4wjhf9"
Jul 08 16:56:15.591373 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:15.591350    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27793b02-9be7-42ac-8be9-f7cfa8a54dd8-tmp-dir\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4wjhf9\" (UID: \"27793b02-9be7-42ac-8be9-f7cfa8a54dd8\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4wjhf9"
Jul 08 16:56:15.592616 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:15.592592    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27793b02-9be7-42ac-8be9-f7cfa8a54dd8-dshm\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4wjhf9\" (UID: \"27793b02-9be7-42ac-8be9-f7cfa8a54dd8\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4wjhf9"
Jul 08 16:56:15.593196 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:15.593180    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27793b02-9be7-42ac-8be9-f7cfa8a54dd8-tls-certs\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4wjhf9\" (UID: \"27793b02-9be7-42ac-8be9-f7cfa8a54dd8\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4wjhf9"
Jul 08 16:56:15.601369 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:15.601346    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-flxrh\" (UniqueName: \"kubernetes.io/projected/27793b02-9be7-42ac-8be9-f7cfa8a54dd8-kube-api-access-flxrh\") pod \"llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4wjhf9\" (UID: \"27793b02-9be7-42ac-8be9-f7cfa8a54dd8\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4wjhf9"
Jul 08 16:56:15.633598 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:15.633580    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-44gcv"
Jul 08 16:56:15.673791 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:15.673769    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4wjhf9"
Jul 08 16:56:15.792405 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:15.792377    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a423d25-2629-41b7-aff2-91f886f4b3b0-istio-envoy\") pod \"4a423d25-2629-41b7-aff2-91f886f4b3b0\" (UID: \"4a423d25-2629-41b7-aff2-91f886f4b3b0\") "
Jul 08 16:56:15.792554 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:15.792411    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a423d25-2629-41b7-aff2-91f886f4b3b0-istio-data\") pod \"4a423d25-2629-41b7-aff2-91f886f4b3b0\" (UID: \"4a423d25-2629-41b7-aff2-91f886f4b3b0\") "
Jul 08 16:56:15.792554 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:15.792471    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a423d25-2629-41b7-aff2-91f886f4b3b0-istiod-ca-cert\") pod \"4a423d25-2629-41b7-aff2-91f886f4b3b0\" (UID: \"4a423d25-2629-41b7-aff2-91f886f4b3b0\") "
Jul 08 16:56:15.792554 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:15.792495    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a423d25-2629-41b7-aff2-91f886f4b3b0-workload-socket\") pod \"4a423d25-2629-41b7-aff2-91f886f4b3b0\" (UID: \"4a423d25-2629-41b7-aff2-91f886f4b3b0\") "
Jul 08 16:56:15.792554 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:15.792522    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a423d25-2629-41b7-aff2-91f886f4b3b0-credential-socket\") pod \"4a423d25-2629-41b7-aff2-91f886f4b3b0\" (UID: \"4a423d25-2629-41b7-aff2-91f886f4b3b0\") "
Jul 08 16:56:15.792554 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:15.792547    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a423d25-2629-41b7-aff2-91f886f4b3b0-istio-token\") pod \"4a423d25-2629-41b7-aff2-91f886f4b3b0\" (UID: \"4a423d25-2629-41b7-aff2-91f886f4b3b0\") "
Jul 08 16:56:15.792810 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:15.792588    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a423d25-2629-41b7-aff2-91f886f4b3b0-istio-podinfo\") pod \"4a423d25-2629-41b7-aff2-91f886f4b3b0\" (UID: \"4a423d25-2629-41b7-aff2-91f886f4b3b0\") "
Jul 08 16:56:15.792810 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:15.792617    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a423d25-2629-41b7-aff2-91f886f4b3b0-workload-certs\") pod \"4a423d25-2629-41b7-aff2-91f886f4b3b0\" (UID: \"4a423d25-2629-41b7-aff2-91f886f4b3b0\") "
Jul 08 16:56:15.792810 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:15.792684    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fk2mf\" (UniqueName: \"kubernetes.io/projected/4a423d25-2629-41b7-aff2-91f886f4b3b0-kube-api-access-fk2mf\") pod \"4a423d25-2629-41b7-aff2-91f886f4b3b0\" (UID: \"4a423d25-2629-41b7-aff2-91f886f4b3b0\") "
Jul 08 16:56:15.792810 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:15.792772    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a423d25-2629-41b7-aff2-91f886f4b3b0-istio-data" (OuterVolumeSpecName: "istio-data") pod "4a423d25-2629-41b7-aff2-91f886f4b3b0" (UID: "4a423d25-2629-41b7-aff2-91f886f4b3b0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:56:15.792810 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:15.792786    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a423d25-2629-41b7-aff2-91f886f4b3b0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4a423d25-2629-41b7-aff2-91f886f4b3b0" (UID: "4a423d25-2629-41b7-aff2-91f886f4b3b0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:56:15.793056 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:15.792840    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a423d25-2629-41b7-aff2-91f886f4b3b0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4a423d25-2629-41b7-aff2-91f886f4b3b0" (UID: "4a423d25-2629-41b7-aff2-91f886f4b3b0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 16:56:15.793056 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:15.792971    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a423d25-2629-41b7-aff2-91f886f4b3b0-istio-data\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 16:56:15.793056 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:15.792976    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a423d25-2629-41b7-aff2-91f886f4b3b0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4a423d25-2629-41b7-aff2-91f886f4b3b0" (UID: "4a423d25-2629-41b7-aff2-91f886f4b3b0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:56:15.793056 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:15.792990    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a423d25-2629-41b7-aff2-91f886f4b3b0-istiod-ca-cert\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 16:56:15.793056 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:15.793004    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a423d25-2629-41b7-aff2-91f886f4b3b0-workload-socket\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 16:56:15.793611 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:15.793409    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a423d25-2629-41b7-aff2-91f886f4b3b0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4a423d25-2629-41b7-aff2-91f886f4b3b0" (UID: "4a423d25-2629-41b7-aff2-91f886f4b3b0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:56:15.794774 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:15.794744    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a423d25-2629-41b7-aff2-91f886f4b3b0-istio-token" (OuterVolumeSpecName: "istio-token") pod "4a423d25-2629-41b7-aff2-91f886f4b3b0" (UID: "4a423d25-2629-41b7-aff2-91f886f4b3b0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:56:15.794873 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:15.794772    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a423d25-2629-41b7-aff2-91f886f4b3b0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4a423d25-2629-41b7-aff2-91f886f4b3b0" (UID: "4a423d25-2629-41b7-aff2-91f886f4b3b0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:56:15.794873 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:15.794791    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4a423d25-2629-41b7-aff2-91f886f4b3b0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4a423d25-2629-41b7-aff2-91f886f4b3b0" (UID: "4a423d25-2629-41b7-aff2-91f886f4b3b0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 16:56:15.794952 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:15.794920    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a423d25-2629-41b7-aff2-91f886f4b3b0-kube-api-access-fk2mf" (OuterVolumeSpecName: "kube-api-access-fk2mf") pod "4a423d25-2629-41b7-aff2-91f886f4b3b0" (UID: "4a423d25-2629-41b7-aff2-91f886f4b3b0"). InnerVolumeSpecName "kube-api-access-fk2mf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:56:15.803731 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:15.803712    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4wjhf9"]
Jul 08 16:56:15.806160 ip-10-0-142-172 kubenswrapper[2565]: W0708 16:56:15.806140    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27793b02_9be7_42ac_8be9_f7cfa8a54dd8.slice/crio-66d1782a079ae0651d3fc8cd7a39177948188bd1dcc0c86a8db062997e29cf8f WatchSource:0}: Error finding container 66d1782a079ae0651d3fc8cd7a39177948188bd1dcc0c86a8db062997e29cf8f: Status 404 returned error can't find the container with id 66d1782a079ae0651d3fc8cd7a39177948188bd1dcc0c86a8db062997e29cf8f
Jul 08 16:56:15.893954 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:15.893894    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a423d25-2629-41b7-aff2-91f886f4b3b0-credential-socket\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 16:56:15.893954 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:15.893915    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a423d25-2629-41b7-aff2-91f886f4b3b0-istio-token\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 16:56:15.893954 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:15.893926    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a423d25-2629-41b7-aff2-91f886f4b3b0-istio-podinfo\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 16:56:15.893954 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:15.893934    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a423d25-2629-41b7-aff2-91f886f4b3b0-workload-certs\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 16:56:15.893954 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:15.893944    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fk2mf\" (UniqueName: \"kubernetes.io/projected/4a423d25-2629-41b7-aff2-91f886f4b3b0-kube-api-access-fk2mf\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 16:56:15.893954 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:15.893954    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a423d25-2629-41b7-aff2-91f886f4b3b0-istio-envoy\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 16:56:16.409279 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:16.409252    2565 generic.go:356] "Generic (PLEG): container finished" podID="4a423d25-2629-41b7-aff2-91f886f4b3b0" containerID="9b8029e61cf4a293ec8fea328fed581446dde4f3b324a0b63261d6dc5d3af899" exitCode=0
Jul 08 16:56:16.409615 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:16.409296    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-44gcv"
Jul 08 16:56:16.409615 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:16.409330    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-44gcv" event={"ID":"4a423d25-2629-41b7-aff2-91f886f4b3b0","Type":"ContainerDied","Data":"9b8029e61cf4a293ec8fea328fed581446dde4f3b324a0b63261d6dc5d3af899"}
Jul 08 16:56:16.409615 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:16.409378    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-44gcv" event={"ID":"4a423d25-2629-41b7-aff2-91f886f4b3b0","Type":"ContainerDied","Data":"2361aa5984458547b7a50d237b298d6b11c55414ef86f489054f9fe4eab1b135"}
Jul 08 16:56:16.409615 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:16.409400    2565 scope.go:117] "RemoveContainer" containerID="9b8029e61cf4a293ec8fea328fed581446dde4f3b324a0b63261d6dc5d3af899"
Jul 08 16:56:16.411037 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:16.411011    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4wjhf9" event={"ID":"27793b02-9be7-42ac-8be9-f7cfa8a54dd8","Type":"ContainerStarted","Data":"c1bc424b862092adcb483680f32b9ca0ab8c7fa53a71931b39b4bb5ce0a3e0f7"}
Jul 08 16:56:16.411154 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:16.411064    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4wjhf9" event={"ID":"27793b02-9be7-42ac-8be9-f7cfa8a54dd8","Type":"ContainerStarted","Data":"66d1782a079ae0651d3fc8cd7a39177948188bd1dcc0c86a8db062997e29cf8f"}
Jul 08 16:56:16.417834 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:16.417819    2565 scope.go:117] "RemoveContainer" containerID="9b8029e61cf4a293ec8fea328fed581446dde4f3b324a0b63261d6dc5d3af899"
Jul 08 16:56:16.418068 ip-10-0-142-172 kubenswrapper[2565]: E0708 16:56:16.418051    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b8029e61cf4a293ec8fea328fed581446dde4f3b324a0b63261d6dc5d3af899\": container with ID starting with 9b8029e61cf4a293ec8fea328fed581446dde4f3b324a0b63261d6dc5d3af899 not found: ID does not exist" containerID="9b8029e61cf4a293ec8fea328fed581446dde4f3b324a0b63261d6dc5d3af899"
Jul 08 16:56:16.418135 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:16.418080    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b8029e61cf4a293ec8fea328fed581446dde4f3b324a0b63261d6dc5d3af899"} err="failed to get container status \"9b8029e61cf4a293ec8fea328fed581446dde4f3b324a0b63261d6dc5d3af899\": rpc error: code = NotFound desc = could not find container \"9b8029e61cf4a293ec8fea328fed581446dde4f3b324a0b63261d6dc5d3af899\": container with ID starting with 9b8029e61cf4a293ec8fea328fed581446dde4f3b324a0b63261d6dc5d3af899 not found: ID does not exist"
Jul 08 16:56:16.475155 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:16.475117    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4wjhf9" podStartSLOduration=1.47510433 podStartE2EDuration="1.47510433s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:56:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:56:16.455509645 +0000 UTC m=+1310.556124216" watchObservedRunningTime="2026-07-08 16:56:16.47510433 +0000 UTC m=+1310.575718900"
Jul 08 16:56:16.475643 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:16.475630    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-44gcv"]
Jul 08 16:56:16.480297 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:16.480279    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-44gcv"]
Jul 08 16:56:16.489732 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:16.489712    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a423d25-2629-41b7-aff2-91f886f4b3b0" path="/var/lib/kubelet/pods/4a423d25-2629-41b7-aff2-91f886f4b3b0/volumes"
Jul 08 16:56:16.674711 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:16.674640    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4wjhf9"
Jul 08 16:56:25.673996 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:25.673962    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4wjhf9"
Jul 08 16:56:25.686375 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:25.686353    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4wjhf9"
Jul 08 16:56:26.462572 ip-10-0-142-172 kubenswrapper[2565]: I0708 16:56:26.462540    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4wjhf9"
Jul 08 17:02:28.226035 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:02:28.226004    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4wjhf9"]
Jul 08 17:02:43.245677 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:02:43.245615    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4wjhf9" podUID="27793b02-9be7-42ac-8be9-f7cfa8a54dd8" containerName="main" containerID="cri-o://c1bc424b862092adcb483680f32b9ca0ab8c7fa53a71931b39b4bb5ce0a3e0f7" gracePeriod=45
Jul 08 17:02:43.493261 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:02:43.493236    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4wjhf9"
Jul 08 17:02:43.649081 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:02:43.648991    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27793b02-9be7-42ac-8be9-f7cfa8a54dd8-tls-certs\") pod \"27793b02-9be7-42ac-8be9-f7cfa8a54dd8\" (UID: \"27793b02-9be7-42ac-8be9-f7cfa8a54dd8\") "
Jul 08 17:02:43.649081 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:02:43.649045    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-flxrh\" (UniqueName: \"kubernetes.io/projected/27793b02-9be7-42ac-8be9-f7cfa8a54dd8-kube-api-access-flxrh\") pod \"27793b02-9be7-42ac-8be9-f7cfa8a54dd8\" (UID: \"27793b02-9be7-42ac-8be9-f7cfa8a54dd8\") "
Jul 08 17:02:43.649336 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:02:43.649097    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27793b02-9be7-42ac-8be9-f7cfa8a54dd8-model-cache\") pod \"27793b02-9be7-42ac-8be9-f7cfa8a54dd8\" (UID: \"27793b02-9be7-42ac-8be9-f7cfa8a54dd8\") "
Jul 08 17:02:43.649336 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:02:43.649113    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27793b02-9be7-42ac-8be9-f7cfa8a54dd8-dshm\") pod \"27793b02-9be7-42ac-8be9-f7cfa8a54dd8\" (UID: \"27793b02-9be7-42ac-8be9-f7cfa8a54dd8\") "
Jul 08 17:02:43.649336 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:02:43.649147    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27793b02-9be7-42ac-8be9-f7cfa8a54dd8-home\") pod \"27793b02-9be7-42ac-8be9-f7cfa8a54dd8\" (UID: \"27793b02-9be7-42ac-8be9-f7cfa8a54dd8\") "
Jul 08 17:02:43.649336 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:02:43.649185    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27793b02-9be7-42ac-8be9-f7cfa8a54dd8-tmp-dir\") pod \"27793b02-9be7-42ac-8be9-f7cfa8a54dd8\" (UID: \"27793b02-9be7-42ac-8be9-f7cfa8a54dd8\") "
Jul 08 17:02:43.649536 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:02:43.649441    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27793b02-9be7-42ac-8be9-f7cfa8a54dd8-model-cache" (OuterVolumeSpecName: "model-cache") pod "27793b02-9be7-42ac-8be9-f7cfa8a54dd8" (UID: "27793b02-9be7-42ac-8be9-f7cfa8a54dd8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 17:02:43.649536 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:02:43.649461    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27793b02-9be7-42ac-8be9-f7cfa8a54dd8-home" (OuterVolumeSpecName: "home") pod "27793b02-9be7-42ac-8be9-f7cfa8a54dd8" (UID: "27793b02-9be7-42ac-8be9-f7cfa8a54dd8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 17:02:43.649536 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:02:43.649480    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27793b02-9be7-42ac-8be9-f7cfa8a54dd8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "27793b02-9be7-42ac-8be9-f7cfa8a54dd8" (UID: "27793b02-9be7-42ac-8be9-f7cfa8a54dd8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 17:02:43.651343 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:02:43.651308    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27793b02-9be7-42ac-8be9-f7cfa8a54dd8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "27793b02-9be7-42ac-8be9-f7cfa8a54dd8" (UID: "27793b02-9be7-42ac-8be9-f7cfa8a54dd8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 17:02:43.651450 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:02:43.651399    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27793b02-9be7-42ac-8be9-f7cfa8a54dd8-dshm" (OuterVolumeSpecName: "dshm") pod "27793b02-9be7-42ac-8be9-f7cfa8a54dd8" (UID: "27793b02-9be7-42ac-8be9-f7cfa8a54dd8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 17:02:43.651492 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:02:43.651446    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27793b02-9be7-42ac-8be9-f7cfa8a54dd8-kube-api-access-flxrh" (OuterVolumeSpecName: "kube-api-access-flxrh") pod "27793b02-9be7-42ac-8be9-f7cfa8a54dd8" (UID: "27793b02-9be7-42ac-8be9-f7cfa8a54dd8"). InnerVolumeSpecName "kube-api-access-flxrh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 17:02:43.750036 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:02:43.750004    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27793b02-9be7-42ac-8be9-f7cfa8a54dd8-model-cache\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 17:02:43.750036 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:02:43.750033    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27793b02-9be7-42ac-8be9-f7cfa8a54dd8-dshm\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 17:02:43.750036 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:02:43.750041    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27793b02-9be7-42ac-8be9-f7cfa8a54dd8-home\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 17:02:43.750036 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:02:43.750049    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27793b02-9be7-42ac-8be9-f7cfa8a54dd8-tmp-dir\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 17:02:43.750343 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:02:43.750056    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27793b02-9be7-42ac-8be9-f7cfa8a54dd8-tls-certs\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 17:02:43.750343 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:02:43.750066    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-flxrh\" (UniqueName: \"kubernetes.io/projected/27793b02-9be7-42ac-8be9-f7cfa8a54dd8-kube-api-access-flxrh\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 17:02:43.878800 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:02:43.878767    2565 generic.go:356] "Generic (PLEG): container finished" podID="27793b02-9be7-42ac-8be9-f7cfa8a54dd8" containerID="c1bc424b862092adcb483680f32b9ca0ab8c7fa53a71931b39b4bb5ce0a3e0f7" exitCode=0
Jul 08 17:02:43.878800 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:02:43.878803    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4wjhf9" event={"ID":"27793b02-9be7-42ac-8be9-f7cfa8a54dd8","Type":"ContainerDied","Data":"c1bc424b862092adcb483680f32b9ca0ab8c7fa53a71931b39b4bb5ce0a3e0f7"}
Jul 08 17:02:43.879053 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:02:43.878810    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4wjhf9"
Jul 08 17:02:43.879053 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:02:43.878846    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4wjhf9" event={"ID":"27793b02-9be7-42ac-8be9-f7cfa8a54dd8","Type":"ContainerDied","Data":"66d1782a079ae0651d3fc8cd7a39177948188bd1dcc0c86a8db062997e29cf8f"}
Jul 08 17:02:43.879053 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:02:43.878869    2565 scope.go:117] "RemoveContainer" containerID="c1bc424b862092adcb483680f32b9ca0ab8c7fa53a71931b39b4bb5ce0a3e0f7"
Jul 08 17:02:43.887465 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:02:43.887446    2565 scope.go:117] "RemoveContainer" containerID="c1bc424b862092adcb483680f32b9ca0ab8c7fa53a71931b39b4bb5ce0a3e0f7"
Jul 08 17:02:43.887713 ip-10-0-142-172 kubenswrapper[2565]: E0708 17:02:43.887692    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1bc424b862092adcb483680f32b9ca0ab8c7fa53a71931b39b4bb5ce0a3e0f7\": container with ID starting with c1bc424b862092adcb483680f32b9ca0ab8c7fa53a71931b39b4bb5ce0a3e0f7 not found: ID does not exist" containerID="c1bc424b862092adcb483680f32b9ca0ab8c7fa53a71931b39b4bb5ce0a3e0f7"
Jul 08 17:02:43.887779 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:02:43.887721    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1bc424b862092adcb483680f32b9ca0ab8c7fa53a71931b39b4bb5ce0a3e0f7"} err="failed to get container status \"c1bc424b862092adcb483680f32b9ca0ab8c7fa53a71931b39b4bb5ce0a3e0f7\": rpc error: code = NotFound desc = could not find container \"c1bc424b862092adcb483680f32b9ca0ab8c7fa53a71931b39b4bb5ce0a3e0f7\": container with ID starting with c1bc424b862092adcb483680f32b9ca0ab8c7fa53a71931b39b4bb5ce0a3e0f7 not found: ID does not exist"
Jul 08 17:02:43.905756 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:02:43.905699    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4wjhf9"]
Jul 08 17:02:43.908600 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:02:43.908579    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4wjhf9"]
Jul 08 17:02:44.451852 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:02:44.451807    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4wjhf9" podUID="27793b02-9be7-42ac-8be9-f7cfa8a54dd8" containerName="main" probeResult="failure" output="Get \"https://10.134.0.25:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Jul 08 17:02:44.488211 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:02:44.488181    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27793b02-9be7-42ac-8be9-f7cfa8a54dd8" path="/var/lib/kubelet/pods/27793b02-9be7-42ac-8be9-f7cfa8a54dd8/volumes"
Jul 08 17:03:10.554165 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:03:10.554133    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schegd925"]
Jul 08 17:03:10.554608 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:03:10.554564    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a423d25-2629-41b7-aff2-91f886f4b3b0" containerName="istio-proxy"
Jul 08 17:03:10.554608 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:03:10.554579    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a423d25-2629-41b7-aff2-91f886f4b3b0" containerName="istio-proxy"
Jul 08 17:03:10.554608 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:03:10.554597    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27793b02-9be7-42ac-8be9-f7cfa8a54dd8" containerName="main"
Jul 08 17:03:10.554608 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:03:10.554605    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="27793b02-9be7-42ac-8be9-f7cfa8a54dd8" containerName="main"
Jul 08 17:03:10.554744 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:03:10.554675    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a423d25-2629-41b7-aff2-91f886f4b3b0" containerName="istio-proxy"
Jul 08 17:03:10.554744 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:03:10.554686    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="27793b02-9be7-42ac-8be9-f7cfa8a54dd8" containerName="main"
Jul 08 17:03:10.557325 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:03:10.557306    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schegd925"
Jul 08 17:03:10.560636 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:03:10.560608    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisvc-model-pvc-router-manage-e8706282-epp-sa-dockercfg-kq2r7\""
Jul 08 17:03:10.562009 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:03:10.561988    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 08 17:03:10.562106 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:03:10.562019    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisvb19f98874e050eec8ca94d49676113f0-kserve-self-signed-certs\""
Jul 08 17:03:10.562106 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:03:10.562019    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-8qxdr\""
Jul 08 17:03:10.562260 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:03:10.562118    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 08 17:03:10.571127 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:03:10.571105    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schegd925"]
Jul 08 17:03:10.658615 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:03:10.658588    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ea6997e-350a-4275-893f-554f95fb27b7-tls-certs\") pod \"llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schegd925\" (UID: \"1ea6997e-350a-4275-893f-554f95fb27b7\") " pod="kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schegd925"
Jul 08 17:03:10.658615 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:03:10.658618    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxcx6\" (UniqueName: \"kubernetes.io/projected/1ea6997e-350a-4275-893f-554f95fb27b7-kube-api-access-gxcx6\") pod \"llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schegd925\" (UID: \"1ea6997e-350a-4275-893f-554f95fb27b7\") " pod="kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schegd925"
Jul 08 17:03:10.658796 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:03:10.658649    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/1ea6997e-350a-4275-893f-554f95fb27b7-tokenizer-uds\") pod \"llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schegd925\" (UID: \"1ea6997e-350a-4275-893f-554f95fb27b7\") " pod="kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schegd925"
Jul 08 17:03:10.759673 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:03:10.759632    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ea6997e-350a-4275-893f-554f95fb27b7-tls-certs\") pod \"llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schegd925\" (UID: \"1ea6997e-350a-4275-893f-554f95fb27b7\") " pod="kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schegd925"
Jul 08 17:03:10.759673 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:03:10.759677    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxcx6\" (UniqueName: \"kubernetes.io/projected/1ea6997e-350a-4275-893f-554f95fb27b7-kube-api-access-gxcx6\") pod \"llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schegd925\" (UID: \"1ea6997e-350a-4275-893f-554f95fb27b7\") " pod="kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schegd925"
Jul 08 17:03:10.759880 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:03:10.759706    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/1ea6997e-350a-4275-893f-554f95fb27b7-tokenizer-uds\") pod \"llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schegd925\" (UID: \"1ea6997e-350a-4275-893f-554f95fb27b7\") " pod="kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schegd925"
Jul 08 17:03:10.760073 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:03:10.760045    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/1ea6997e-350a-4275-893f-554f95fb27b7-tokenizer-uds\") pod \"llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schegd925\" (UID: \"1ea6997e-350a-4275-893f-554f95fb27b7\") " pod="kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schegd925"
Jul 08 17:03:10.762181 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:03:10.762163    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ea6997e-350a-4275-893f-554f95fb27b7-tls-certs\") pod \"llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schegd925\" (UID: \"1ea6997e-350a-4275-893f-554f95fb27b7\") " pod="kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schegd925"
Jul 08 17:03:10.776733 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:03:10.776702    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxcx6\" (UniqueName: \"kubernetes.io/projected/1ea6997e-350a-4275-893f-554f95fb27b7-kube-api-access-gxcx6\") pod \"llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schegd925\" (UID: \"1ea6997e-350a-4275-893f-554f95fb27b7\") " pod="kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schegd925"
Jul 08 17:03:10.866854 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:03:10.866781    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schegd925"
Jul 08 17:03:11.002942 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:03:11.002920    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schegd925"]
Jul 08 17:03:11.004654 ip-10-0-142-172 kubenswrapper[2565]: W0708 17:03:11.004628    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ea6997e_350a_4275_893f_554f95fb27b7.slice/crio-f7724f5eb997bfd6e7f0bc8652785b8302d82d78724e64d773fe106611902a56 WatchSource:0}: Error finding container f7724f5eb997bfd6e7f0bc8652785b8302d82d78724e64d773fe106611902a56: Status 404 returned error can't find the container with id f7724f5eb997bfd6e7f0bc8652785b8302d82d78724e64d773fe106611902a56
Jul 08 17:03:11.989708 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:03:11.989676    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schegd925" event={"ID":"1ea6997e-350a-4275-893f-554f95fb27b7","Type":"ContainerStarted","Data":"69f4fdc74c8692762554db454279dd4d97b18be38194774086987df3754482df"}
Jul 08 17:03:11.990094 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:03:11.989725    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schegd925" event={"ID":"1ea6997e-350a-4275-893f-554f95fb27b7","Type":"ContainerStarted","Data":"f7724f5eb997bfd6e7f0bc8652785b8302d82d78724e64d773fe106611902a56"}
Jul 08 17:03:11.990094 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:03:11.989782    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schegd925"
Jul 08 17:03:12.012982 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:03:12.012931    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schegd925" podStartSLOduration=2.012913864 podStartE2EDuration="2.012913864s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:03:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:03:12.01234137 +0000 UTC m=+1726.112955941" watchObservedRunningTime="2026-07-08 17:03:12.012913864 +0000 UTC m=+1726.113528434"
Jul 08 17:03:42.995190 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:03:42.995158    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schegd925"
Jul 08 17:06:34.978150 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:06:34.978105    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schegd925"]
Jul 08 17:06:34.987498 ip-10-0-142-172 kubenswrapper[2565]: E0708 17:06:34.987457    2565 log.go:32] "ExecSync cmd from runtime service failed" err=<
Jul 08 17:06:34.987498 ip-10-0-142-172 kubenswrapper[2565]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 08 17:06:34.987498 ip-10-0-142-172 kubenswrapper[2565]:         , stdout: , stderr: , exit code -1
Jul 08 17:06:34.987498 ip-10-0-142-172 kubenswrapper[2565]:  > containerID="69f4fdc74c8692762554db454279dd4d97b18be38194774086987df3754482df" cmd=["/bin/sleep","15"]
Jul 08 17:06:34.987883 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:06:34.987512    2565 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schegd925" message="" err=<
Jul 08 17:06:34.987883 ip-10-0-142-172 kubenswrapper[2565]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 08 17:06:34.987883 ip-10-0-142-172 kubenswrapper[2565]:         , stdout: , stderr: , exit code -1
Jul 08 17:06:34.987883 ip-10-0-142-172 kubenswrapper[2565]:  >
Jul 08 17:06:34.987883 ip-10-0-142-172 kubenswrapper[2565]: E0708 17:06:34.987528    2565 kuberuntime_container.go:754] "PreStop hook failed" err=<
Jul 08 17:06:34.987883 ip-10-0-142-172 kubenswrapper[2565]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 08 17:06:34.987883 ip-10-0-142-172 kubenswrapper[2565]:         , stdout: , stderr: , exit code -1
Jul 08 17:06:34.987883 ip-10-0-142-172 kubenswrapper[2565]:  > pod="kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schegd925" podUID="1ea6997e-350a-4275-893f-554f95fb27b7" containerName="main" containerID="cri-o://69f4fdc74c8692762554db454279dd4d97b18be38194774086987df3754482df"
Jul 08 17:06:34.987883 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:06:34.987566    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schegd925" podUID="1ea6997e-350a-4275-893f-554f95fb27b7" containerName="main" containerID="cri-o://69f4fdc74c8692762554db454279dd4d97b18be38194774086987df3754482df" gracePeriod=60
Jul 08 17:06:35.247911 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:06:35.247881    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schegd925"
Jul 08 17:06:35.303145 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:06:35.303109    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ea6997e-350a-4275-893f-554f95fb27b7-tls-certs\") pod \"1ea6997e-350a-4275-893f-554f95fb27b7\" (UID: \"1ea6997e-350a-4275-893f-554f95fb27b7\") "
Jul 08 17:06:35.303372 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:06:35.303178    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/1ea6997e-350a-4275-893f-554f95fb27b7-tokenizer-uds\") pod \"1ea6997e-350a-4275-893f-554f95fb27b7\" (UID: \"1ea6997e-350a-4275-893f-554f95fb27b7\") "
Jul 08 17:06:35.303372 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:06:35.303208    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gxcx6\" (UniqueName: \"kubernetes.io/projected/1ea6997e-350a-4275-893f-554f95fb27b7-kube-api-access-gxcx6\") pod \"1ea6997e-350a-4275-893f-554f95fb27b7\" (UID: \"1ea6997e-350a-4275-893f-554f95fb27b7\") "
Jul 08 17:06:35.303520 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:06:35.303493    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ea6997e-350a-4275-893f-554f95fb27b7-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "1ea6997e-350a-4275-893f-554f95fb27b7" (UID: "1ea6997e-350a-4275-893f-554f95fb27b7"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 17:06:35.305469 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:06:35.305442    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ea6997e-350a-4275-893f-554f95fb27b7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1ea6997e-350a-4275-893f-554f95fb27b7" (UID: "1ea6997e-350a-4275-893f-554f95fb27b7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 17:06:35.305546 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:06:35.305485    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ea6997e-350a-4275-893f-554f95fb27b7-kube-api-access-gxcx6" (OuterVolumeSpecName: "kube-api-access-gxcx6") pod "1ea6997e-350a-4275-893f-554f95fb27b7" (UID: "1ea6997e-350a-4275-893f-554f95fb27b7"). InnerVolumeSpecName "kube-api-access-gxcx6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 17:06:35.403675 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:06:35.403632    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gxcx6\" (UniqueName: \"kubernetes.io/projected/1ea6997e-350a-4275-893f-554f95fb27b7-kube-api-access-gxcx6\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 17:06:35.403675 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:06:35.403665    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ea6997e-350a-4275-893f-554f95fb27b7-tls-certs\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 17:06:35.403675 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:06:35.403675    2565 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/1ea6997e-350a-4275-893f-554f95fb27b7-tokenizer-uds\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 17:06:35.781182 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:06:35.781140    2565 generic.go:356] "Generic (PLEG): container finished" podID="1ea6997e-350a-4275-893f-554f95fb27b7" containerID="69f4fdc74c8692762554db454279dd4d97b18be38194774086987df3754482df" exitCode=0
Jul 08 17:06:35.781435 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:06:35.781197    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schegd925"
Jul 08 17:06:35.781435 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:06:35.781242    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schegd925" event={"ID":"1ea6997e-350a-4275-893f-554f95fb27b7","Type":"ContainerDied","Data":"69f4fdc74c8692762554db454279dd4d97b18be38194774086987df3754482df"}
Jul 08 17:06:35.781435 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:06:35.781336    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schegd925" event={"ID":"1ea6997e-350a-4275-893f-554f95fb27b7","Type":"ContainerDied","Data":"f7724f5eb997bfd6e7f0bc8652785b8302d82d78724e64d773fe106611902a56"}
Jul 08 17:06:35.781435 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:06:35.781366    2565 scope.go:117] "RemoveContainer" containerID="69f4fdc74c8692762554db454279dd4d97b18be38194774086987df3754482df"
Jul 08 17:06:35.791263 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:06:35.791207    2565 scope.go:117] "RemoveContainer" containerID="69f4fdc74c8692762554db454279dd4d97b18be38194774086987df3754482df"
Jul 08 17:06:35.791580 ip-10-0-142-172 kubenswrapper[2565]: E0708 17:06:35.791561    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69f4fdc74c8692762554db454279dd4d97b18be38194774086987df3754482df\": container with ID starting with 69f4fdc74c8692762554db454279dd4d97b18be38194774086987df3754482df not found: ID does not exist" containerID="69f4fdc74c8692762554db454279dd4d97b18be38194774086987df3754482df"
Jul 08 17:06:35.791634 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:06:35.791590    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69f4fdc74c8692762554db454279dd4d97b18be38194774086987df3754482df"} err="failed to get container status \"69f4fdc74c8692762554db454279dd4d97b18be38194774086987df3754482df\": rpc error: code = NotFound desc = could not find container \"69f4fdc74c8692762554db454279dd4d97b18be38194774086987df3754482df\": container with ID starting with 69f4fdc74c8692762554db454279dd4d97b18be38194774086987df3754482df not found: ID does not exist"
Jul 08 17:06:35.806230 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:06:35.806177    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schegd925"]
Jul 08 17:06:35.812654 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:06:35.812621    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schegd925"]
Jul 08 17:06:36.490022 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:06:36.489982    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ea6997e-350a-4275-893f-554f95fb27b7" path="/var/lib/kubelet/pods/1ea6997e-350a-4275-893f-554f95fb27b7/volumes"
Jul 08 17:07:00.368239 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:07:00.368186    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schezjgtq"]
Jul 08 17:07:00.368733 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:07:00.368712    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ea6997e-350a-4275-893f-554f95fb27b7" containerName="main"
Jul 08 17:07:00.368790 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:07:00.368740    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ea6997e-350a-4275-893f-554f95fb27b7" containerName="main"
Jul 08 17:07:00.368851 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:07:00.368838    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ea6997e-350a-4275-893f-554f95fb27b7" containerName="main"
Jul 08 17:07:00.372026 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:07:00.372002    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schezjgtq"
Jul 08 17:07:00.376039 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:07:00.376008    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 08 17:07:00.376155 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:07:00.376044    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisv1dc4269d1ada5f2d28562215d180c57f-kserve-self-signed-certs\""
Jul 08 17:07:00.376155 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:07:00.376117    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-8qxdr\""
Jul 08 17:07:00.376382 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:07:00.376368    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 08 17:07:00.376517 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:07:00.376497    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisvc-model-pvc-router-manage-2577e794-epp-sa-dockercfg-xbm4l\""
Jul 08 17:07:00.383664 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:07:00.383641    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schezjgtq"]
Jul 08 17:07:00.492576 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:07:00.492545    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/3bbd35c3-f2e4-4c89-955a-e2573a7f581d-tokenizer-uds\") pod \"llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schezjgtq\" (UID: \"3bbd35c3-f2e4-4c89-955a-e2573a7f581d\") " pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schezjgtq"
Jul 08 17:07:00.492769 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:07:00.492612    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3bbd35c3-f2e4-4c89-955a-e2573a7f581d-tls-certs\") pod \"llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schezjgtq\" (UID: \"3bbd35c3-f2e4-4c89-955a-e2573a7f581d\") " pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schezjgtq"
Jul 08 17:07:00.492769 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:07:00.492633    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4z2zk\" (UniqueName: \"kubernetes.io/projected/3bbd35c3-f2e4-4c89-955a-e2573a7f581d-kube-api-access-4z2zk\") pod \"llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schezjgtq\" (UID: \"3bbd35c3-f2e4-4c89-955a-e2573a7f581d\") " pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schezjgtq"
Jul 08 17:07:00.593149 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:07:00.593115    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3bbd35c3-f2e4-4c89-955a-e2573a7f581d-tls-certs\") pod \"llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schezjgtq\" (UID: \"3bbd35c3-f2e4-4c89-955a-e2573a7f581d\") " pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schezjgtq"
Jul 08 17:07:00.593149 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:07:00.593149    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4z2zk\" (UniqueName: \"kubernetes.io/projected/3bbd35c3-f2e4-4c89-955a-e2573a7f581d-kube-api-access-4z2zk\") pod \"llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schezjgtq\" (UID: \"3bbd35c3-f2e4-4c89-955a-e2573a7f581d\") " pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schezjgtq"
Jul 08 17:07:00.593389 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:07:00.593203    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/3bbd35c3-f2e4-4c89-955a-e2573a7f581d-tokenizer-uds\") pod \"llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schezjgtq\" (UID: \"3bbd35c3-f2e4-4c89-955a-e2573a7f581d\") " pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schezjgtq"
Jul 08 17:07:00.593687 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:07:00.593666    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/3bbd35c3-f2e4-4c89-955a-e2573a7f581d-tokenizer-uds\") pod \"llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schezjgtq\" (UID: \"3bbd35c3-f2e4-4c89-955a-e2573a7f581d\") " pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schezjgtq"
Jul 08 17:07:00.595814 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:07:00.595795    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3bbd35c3-f2e4-4c89-955a-e2573a7f581d-tls-certs\") pod \"llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schezjgtq\" (UID: \"3bbd35c3-f2e4-4c89-955a-e2573a7f581d\") " pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schezjgtq"
Jul 08 17:07:00.603565 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:07:00.603541    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4z2zk\" (UniqueName: \"kubernetes.io/projected/3bbd35c3-f2e4-4c89-955a-e2573a7f581d-kube-api-access-4z2zk\") pod \"llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schezjgtq\" (UID: \"3bbd35c3-f2e4-4c89-955a-e2573a7f581d\") " pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schezjgtq"
Jul 08 17:07:00.682397 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:07:00.682301    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schezjgtq"
Jul 08 17:07:00.827258 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:07:00.824940    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schezjgtq"]
Jul 08 17:07:00.831598 ip-10-0-142-172 kubenswrapper[2565]: W0708 17:07:00.831569    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bbd35c3_f2e4_4c89_955a_e2573a7f581d.slice/crio-ebb31b87fe9e184930f9fc043cd25abf80947dccd004acbfc0d03a6af7eb3b55 WatchSource:0}: Error finding container ebb31b87fe9e184930f9fc043cd25abf80947dccd004acbfc0d03a6af7eb3b55: Status 404 returned error can't find the container with id ebb31b87fe9e184930f9fc043cd25abf80947dccd004acbfc0d03a6af7eb3b55
Jul 08 17:07:00.877046 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:07:00.877015    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schezjgtq" event={"ID":"3bbd35c3-f2e4-4c89-955a-e2573a7f581d","Type":"ContainerStarted","Data":"ebb31b87fe9e184930f9fc043cd25abf80947dccd004acbfc0d03a6af7eb3b55"}
Jul 08 17:07:01.881861 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:07:01.881821    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schezjgtq" event={"ID":"3bbd35c3-f2e4-4c89-955a-e2573a7f581d","Type":"ContainerStarted","Data":"8668dffb55bd061b9fff4bc3aa47f56546fdaf011de93c5141c9627beb5e8d1d"}
Jul 08 17:07:01.882285 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:07:01.881928    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schezjgtq"
Jul 08 17:07:01.906048 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:07:01.905991    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schezjgtq" podStartSLOduration=1.9059740010000001 podStartE2EDuration="1.905974001s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:07:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:07:01.90441675 +0000 UTC m=+1956.005031331" watchObservedRunningTime="2026-07-08 17:07:01.905974001 +0000 UTC m=+1956.006588571"
Jul 08 17:07:32.887073 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:07:32.887044    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schezjgtq"
Jul 08 17:12:33.922410 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:12:33.922367    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schezjgtq"]
Jul 08 17:12:33.932112 ip-10-0-142-172 kubenswrapper[2565]: E0708 17:12:33.932070    2565 log.go:32] "ExecSync cmd from runtime service failed" err=<
Jul 08 17:12:33.932112 ip-10-0-142-172 kubenswrapper[2565]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 08 17:12:33.932112 ip-10-0-142-172 kubenswrapper[2565]:         , stdout: , stderr: , exit code -1
Jul 08 17:12:33.932112 ip-10-0-142-172 kubenswrapper[2565]:  > containerID="8668dffb55bd061b9fff4bc3aa47f56546fdaf011de93c5141c9627beb5e8d1d" cmd=["/bin/sleep","15"]
Jul 08 17:12:33.932402 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:12:33.932125    2565 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schezjgtq" message="" err=<
Jul 08 17:12:33.932402 ip-10-0-142-172 kubenswrapper[2565]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 08 17:12:33.932402 ip-10-0-142-172 kubenswrapper[2565]:         , stdout: , stderr: , exit code -1
Jul 08 17:12:33.932402 ip-10-0-142-172 kubenswrapper[2565]:  >
Jul 08 17:12:33.932402 ip-10-0-142-172 kubenswrapper[2565]: E0708 17:12:33.932144    2565 kuberuntime_container.go:754] "PreStop hook failed" err=<
Jul 08 17:12:33.932402 ip-10-0-142-172 kubenswrapper[2565]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 08 17:12:33.932402 ip-10-0-142-172 kubenswrapper[2565]:         , stdout: , stderr: , exit code -1
Jul 08 17:12:33.932402 ip-10-0-142-172 kubenswrapper[2565]:  > pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schezjgtq" podUID="3bbd35c3-f2e4-4c89-955a-e2573a7f581d" containerName="main" containerID="cri-o://8668dffb55bd061b9fff4bc3aa47f56546fdaf011de93c5141c9627beb5e8d1d"
Jul 08 17:12:33.932402 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:12:33.932185    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schezjgtq" podUID="3bbd35c3-f2e4-4c89-955a-e2573a7f581d" containerName="main" containerID="cri-o://8668dffb55bd061b9fff4bc3aa47f56546fdaf011de93c5141c9627beb5e8d1d" gracePeriod=60
Jul 08 17:12:34.157390 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:12:34.157354    2565 generic.go:356] "Generic (PLEG): container finished" podID="3bbd35c3-f2e4-4c89-955a-e2573a7f581d" containerID="8668dffb55bd061b9fff4bc3aa47f56546fdaf011de93c5141c9627beb5e8d1d" exitCode=0
Jul 08 17:12:34.157560 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:12:34.157411    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schezjgtq" event={"ID":"3bbd35c3-f2e4-4c89-955a-e2573a7f581d","Type":"ContainerDied","Data":"8668dffb55bd061b9fff4bc3aa47f56546fdaf011de93c5141c9627beb5e8d1d"}
Jul 08 17:12:34.194644 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:12:34.194618    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schezjgtq"
Jul 08 17:12:34.339821 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:12:34.339788    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/3bbd35c3-f2e4-4c89-955a-e2573a7f581d-tokenizer-uds\") pod \"3bbd35c3-f2e4-4c89-955a-e2573a7f581d\" (UID: \"3bbd35c3-f2e4-4c89-955a-e2573a7f581d\") "
Jul 08 17:12:34.340014 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:12:34.339844    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3bbd35c3-f2e4-4c89-955a-e2573a7f581d-tls-certs\") pod \"3bbd35c3-f2e4-4c89-955a-e2573a7f581d\" (UID: \"3bbd35c3-f2e4-4c89-955a-e2573a7f581d\") "
Jul 08 17:12:34.340014 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:12:34.339964    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4z2zk\" (UniqueName: \"kubernetes.io/projected/3bbd35c3-f2e4-4c89-955a-e2573a7f581d-kube-api-access-4z2zk\") pod \"3bbd35c3-f2e4-4c89-955a-e2573a7f581d\" (UID: \"3bbd35c3-f2e4-4c89-955a-e2573a7f581d\") "
Jul 08 17:12:34.340139 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:12:34.340116    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bbd35c3-f2e4-4c89-955a-e2573a7f581d-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "3bbd35c3-f2e4-4c89-955a-e2573a7f581d" (UID: "3bbd35c3-f2e4-4c89-955a-e2573a7f581d"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 17:12:34.340281 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:12:34.340267    2565 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/3bbd35c3-f2e4-4c89-955a-e2573a7f581d-tokenizer-uds\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 17:12:34.342199 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:12:34.342164    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3bbd35c3-f2e4-4c89-955a-e2573a7f581d-kube-api-access-4z2zk" (OuterVolumeSpecName: "kube-api-access-4z2zk") pod "3bbd35c3-f2e4-4c89-955a-e2573a7f581d" (UID: "3bbd35c3-f2e4-4c89-955a-e2573a7f581d"). InnerVolumeSpecName "kube-api-access-4z2zk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 17:12:34.342299 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:12:34.342194    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3bbd35c3-f2e4-4c89-955a-e2573a7f581d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3bbd35c3-f2e4-4c89-955a-e2573a7f581d" (UID: "3bbd35c3-f2e4-4c89-955a-e2573a7f581d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 17:12:34.440763 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:12:34.440665    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4z2zk\" (UniqueName: \"kubernetes.io/projected/3bbd35c3-f2e4-4c89-955a-e2573a7f581d-kube-api-access-4z2zk\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 17:12:34.440763 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:12:34.440697    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3bbd35c3-f2e4-4c89-955a-e2573a7f581d-tls-certs\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 17:12:35.167927 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:12:35.167882    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schezjgtq" event={"ID":"3bbd35c3-f2e4-4c89-955a-e2573a7f581d","Type":"ContainerDied","Data":"ebb31b87fe9e184930f9fc043cd25abf80947dccd004acbfc0d03a6af7eb3b55"}
Jul 08 17:12:35.167927 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:12:35.167926    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schezjgtq"
Jul 08 17:12:35.168696 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:12:35.167999    2565 scope.go:117] "RemoveContainer" containerID="8668dffb55bd061b9fff4bc3aa47f56546fdaf011de93c5141c9627beb5e8d1d"
Jul 08 17:12:35.188642 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:12:35.188602    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schezjgtq"]
Jul 08 17:12:35.190435 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:12:35.190408    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schezjgtq"]
Jul 08 17:12:36.489495 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:12:36.489463    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3bbd35c3-f2e4-4c89-955a-e2573a7f581d" path="/var/lib/kubelet/pods/3bbd35c3-f2e4-4c89-955a-e2573a7f581d/volumes"
Jul 08 17:20:20.148529 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:20.148499    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-tppn4"]
Jul 08 17:20:20.149044 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:20.148897    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bbd35c3-f2e4-4c89-955a-e2573a7f581d" containerName="main"
Jul 08 17:20:20.149044 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:20.148914    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bbd35c3-f2e4-4c89-955a-e2573a7f581d" containerName="main"
Jul 08 17:20:20.149044 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:20.149023    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3bbd35c3-f2e4-4c89-955a-e2573a7f581d" containerName="main"
Jul 08 17:20:20.152018 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:20.151996    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-tppn4"
Jul 08 17:20:20.154779 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:20.154746    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"router-gateway-2-openshift-default-dockercfg-kvqnt\""
Jul 08 17:20:20.154903 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:20.154822    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-gw-ca-root-cert\""
Jul 08 17:20:20.155178 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:20.155132    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 08 17:20:20.155310 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:20.155278    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 08 17:20:20.165730 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:20.165699    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-tppn4"]
Jul 08 17:20:20.257148 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:20.257104    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828-istio-envoy\") pod \"router-gateway-2-openshift-default-54c789bdc6-tppn4\" (UID: \"c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-tppn4"
Jul 08 17:20:20.257148 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:20.257144    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828-istio-podinfo\") pod \"router-gateway-2-openshift-default-54c789bdc6-tppn4\" (UID: \"c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-tppn4"
Jul 08 17:20:20.257434 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:20.257163    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828-credential-socket\") pod \"router-gateway-2-openshift-default-54c789bdc6-tppn4\" (UID: \"c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-tppn4"
Jul 08 17:20:20.257434 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:20.257204    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828-istiod-ca-cert\") pod \"router-gateway-2-openshift-default-54c789bdc6-tppn4\" (UID: \"c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-tppn4"
Jul 08 17:20:20.257434 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:20.257274    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828-istio-data\") pod \"router-gateway-2-openshift-default-54c789bdc6-tppn4\" (UID: \"c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-tppn4"
Jul 08 17:20:20.257434 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:20.257326    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828-workload-socket\") pod \"router-gateway-2-openshift-default-54c789bdc6-tppn4\" (UID: \"c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-tppn4"
Jul 08 17:20:20.257434 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:20.257350    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828-workload-certs\") pod \"router-gateway-2-openshift-default-54c789bdc6-tppn4\" (UID: \"c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-tppn4"
Jul 08 17:20:20.257434 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:20.257385    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828-istio-token\") pod \"router-gateway-2-openshift-default-54c789bdc6-tppn4\" (UID: \"c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-tppn4"
Jul 08 17:20:20.257434 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:20.257432    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gl2rm\" (UniqueName: \"kubernetes.io/projected/c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828-kube-api-access-gl2rm\") pod \"router-gateway-2-openshift-default-54c789bdc6-tppn4\" (UID: \"c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-tppn4"
Jul 08 17:20:20.358548 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:20.358510    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828-workload-socket\") pod \"router-gateway-2-openshift-default-54c789bdc6-tppn4\" (UID: \"c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-tppn4"
Jul 08 17:20:20.358548 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:20.358552    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828-workload-certs\") pod \"router-gateway-2-openshift-default-54c789bdc6-tppn4\" (UID: \"c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-tppn4"
Jul 08 17:20:20.358795 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:20.358573    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828-istio-token\") pod \"router-gateway-2-openshift-default-54c789bdc6-tppn4\" (UID: \"c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-tppn4"
Jul 08 17:20:20.358795 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:20.358592    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gl2rm\" (UniqueName: \"kubernetes.io/projected/c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828-kube-api-access-gl2rm\") pod \"router-gateway-2-openshift-default-54c789bdc6-tppn4\" (UID: \"c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-tppn4"
Jul 08 17:20:20.358795 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:20.358627    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828-istio-envoy\") pod \"router-gateway-2-openshift-default-54c789bdc6-tppn4\" (UID: \"c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-tppn4"
Jul 08 17:20:20.358795 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:20.358652    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828-istio-podinfo\") pod \"router-gateway-2-openshift-default-54c789bdc6-tppn4\" (UID: \"c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-tppn4"
Jul 08 17:20:20.358795 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:20.358679    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828-credential-socket\") pod \"router-gateway-2-openshift-default-54c789bdc6-tppn4\" (UID: \"c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-tppn4"
Jul 08 17:20:20.358795 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:20.358702    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828-istiod-ca-cert\") pod \"router-gateway-2-openshift-default-54c789bdc6-tppn4\" (UID: \"c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-tppn4"
Jul 08 17:20:20.358795 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:20.358744    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828-istio-data\") pod \"router-gateway-2-openshift-default-54c789bdc6-tppn4\" (UID: \"c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-tppn4"
Jul 08 17:20:20.359127 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:20.358959    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828-workload-socket\") pod \"router-gateway-2-openshift-default-54c789bdc6-tppn4\" (UID: \"c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-tppn4"
Jul 08 17:20:20.359187 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:20.359163    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828-istio-data\") pod \"router-gateway-2-openshift-default-54c789bdc6-tppn4\" (UID: \"c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-tppn4"
Jul 08 17:20:20.359262 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:20.359199    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828-workload-certs\") pod \"router-gateway-2-openshift-default-54c789bdc6-tppn4\" (UID: \"c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-tppn4"
Jul 08 17:20:20.359316 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:20.359294    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828-credential-socket\") pod \"router-gateway-2-openshift-default-54c789bdc6-tppn4\" (UID: \"c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-tppn4"
Jul 08 17:20:20.359752 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:20.359730    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828-istiod-ca-cert\") pod \"router-gateway-2-openshift-default-54c789bdc6-tppn4\" (UID: \"c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-tppn4"
Jul 08 17:20:20.361083 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:20.361055    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828-istio-envoy\") pod \"router-gateway-2-openshift-default-54c789bdc6-tppn4\" (UID: \"c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-tppn4"
Jul 08 17:20:20.361201 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:20.361184    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828-istio-podinfo\") pod \"router-gateway-2-openshift-default-54c789bdc6-tppn4\" (UID: \"c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-tppn4"
Jul 08 17:20:20.368294 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:20.368266    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gl2rm\" (UniqueName: \"kubernetes.io/projected/c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828-kube-api-access-gl2rm\") pod \"router-gateway-2-openshift-default-54c789bdc6-tppn4\" (UID: \"c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-tppn4"
Jul 08 17:20:20.368409 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:20.368370    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828-istio-token\") pod \"router-gateway-2-openshift-default-54c789bdc6-tppn4\" (UID: \"c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828\") " pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-tppn4"
Jul 08 17:20:20.463525 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:20.463493    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-tppn4"
Jul 08 17:20:20.611242 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:20.611056    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-tppn4"]
Jul 08 17:20:20.613976 ip-10-0-142-172 kubenswrapper[2565]: W0708 17:20:20.613947    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3d8062b_3e99_4b59_ad6a_ab5c6c7e5828.slice/crio-ae04a893696daa6d82c8fc28cf44e58fd7e332fe3dc10767a1d9aa5258758a7f WatchSource:0}: Error finding container ae04a893696daa6d82c8fc28cf44e58fd7e332fe3dc10767a1d9aa5258758a7f: Status 404 returned error can't find the container with id ae04a893696daa6d82c8fc28cf44e58fd7e332fe3dc10767a1d9aa5258758a7f
Jul 08 17:20:20.616282 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:20.616252    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 08 17:20:20.616376 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:20.616321    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 08 17:20:20.616376 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:20.616352    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 08 17:20:20.923136 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:20.922919    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-tppn4" event={"ID":"c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828","Type":"ContainerStarted","Data":"99d2bb4654df13bb30c476679805eb066bfa4352bc1083d9012fdc6fd1c10312"}
Jul 08 17:20:20.923136 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:20.923126    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-tppn4" event={"ID":"c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828","Type":"ContainerStarted","Data":"ae04a893696daa6d82c8fc28cf44e58fd7e332fe3dc10767a1d9aa5258758a7f"}
Jul 08 17:20:20.947828 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:20.947767    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-tppn4" podStartSLOduration=0.947746802 podStartE2EDuration="947.746802ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:20:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:20:20.94690178 +0000 UTC m=+2755.047516377" watchObservedRunningTime="2026-07-08 17:20:20.947746802 +0000 UTC m=+2755.048361373"
Jul 08 17:20:21.463952 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:21.463903    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-tppn4"
Jul 08 17:20:21.469041 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:21.469006    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-tppn4"
Jul 08 17:20:21.927437 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:21.927342    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-tppn4"
Jul 08 17:20:21.928405 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:21.928385    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-tppn4"
Jul 08 17:20:22.731575 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:22.731539    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-tppn4"]
Jul 08 17:20:23.934770 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:23.934728    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-tppn4" podUID="c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828" containerName="istio-proxy" containerID="cri-o://99d2bb4654df13bb30c476679805eb066bfa4352bc1083d9012fdc6fd1c10312" gracePeriod=30
Jul 08 17:20:29.191819 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:29.191792    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-tppn4"
Jul 08 17:20:29.237544 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:29.237452    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828-workload-socket\") pod \"c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828\" (UID: \"c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828\") "
Jul 08 17:20:29.237544 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:29.237510    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gl2rm\" (UniqueName: \"kubernetes.io/projected/c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828-kube-api-access-gl2rm\") pod \"c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828\" (UID: \"c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828\") "
Jul 08 17:20:29.237544 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:29.237531    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828-istio-token\") pod \"c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828\" (UID: \"c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828\") "
Jul 08 17:20:29.237788 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:29.237564    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828-workload-certs\") pod \"c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828\" (UID: \"c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828\") "
Jul 08 17:20:29.237788 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:29.237602    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828-istio-podinfo\") pod \"c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828\" (UID: \"c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828\") "
Jul 08 17:20:29.237788 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:29.237654    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828-istio-data\") pod \"c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828\" (UID: \"c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828\") "
Jul 08 17:20:29.237788 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:29.237690    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828-istio-envoy\") pod \"c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828\" (UID: \"c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828\") "
Jul 08 17:20:29.237788 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:29.237713    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828-istiod-ca-cert\") pod \"c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828\" (UID: \"c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828\") "
Jul 08 17:20:29.237788 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:29.237754    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828-credential-socket\") pod \"c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828\" (UID: \"c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828\") "
Jul 08 17:20:29.239433 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:29.239390    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828" (UID: "c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 17:20:29.239600 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:29.239534    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828" (UID: "c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 17:20:29.239600 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:29.239559    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828-istio-data" (OuterVolumeSpecName: "istio-data") pod "c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828" (UID: "c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 17:20:29.239729 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:29.239662    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828" (UID: "c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 17:20:29.239956 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:29.239923    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828" (UID: "c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 17:20:29.241482 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:29.241452    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828-kube-api-access-gl2rm" (OuterVolumeSpecName: "kube-api-access-gl2rm") pod "c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828" (UID: "c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828"). InnerVolumeSpecName "kube-api-access-gl2rm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 17:20:29.241807 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:29.241786    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828" (UID: "c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 17:20:29.241999 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:29.241984    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828-istio-token" (OuterVolumeSpecName: "istio-token") pod "c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828" (UID: "c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 17:20:29.242041 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:29.241991    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828" (UID: "c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 17:20:29.338761 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:29.338725    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828-istio-data\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 17:20:29.338761 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:29.338758    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828-istio-envoy\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 17:20:29.338761 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:29.338772    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828-istiod-ca-cert\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 17:20:29.339036 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:29.338783    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828-credential-socket\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 17:20:29.339036 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:29.338794    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828-workload-socket\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 17:20:29.339036 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:29.338803    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gl2rm\" (UniqueName: \"kubernetes.io/projected/c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828-kube-api-access-gl2rm\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 17:20:29.339036 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:29.338811    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828-istio-token\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 17:20:29.339036 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:29.338818    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828-workload-certs\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 17:20:29.339036 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:29.338825    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828-istio-podinfo\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 17:20:29.958032 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:29.957986    2565 generic.go:356] "Generic (PLEG): container finished" podID="c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828" containerID="99d2bb4654df13bb30c476679805eb066bfa4352bc1083d9012fdc6fd1c10312" exitCode=0
Jul 08 17:20:29.958032 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:29.958036    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-tppn4"
Jul 08 17:20:29.958300 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:29.958062    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-tppn4" event={"ID":"c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828","Type":"ContainerDied","Data":"99d2bb4654df13bb30c476679805eb066bfa4352bc1083d9012fdc6fd1c10312"}
Jul 08 17:20:29.958300 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:29.958116    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-tppn4" event={"ID":"c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828","Type":"ContainerDied","Data":"ae04a893696daa6d82c8fc28cf44e58fd7e332fe3dc10767a1d9aa5258758a7f"}
Jul 08 17:20:29.958300 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:29.958137    2565 scope.go:117] "RemoveContainer" containerID="99d2bb4654df13bb30c476679805eb066bfa4352bc1083d9012fdc6fd1c10312"
Jul 08 17:20:29.966864 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:29.966844    2565 scope.go:117] "RemoveContainer" containerID="99d2bb4654df13bb30c476679805eb066bfa4352bc1083d9012fdc6fd1c10312"
Jul 08 17:20:29.967159 ip-10-0-142-172 kubenswrapper[2565]: E0708 17:20:29.967139    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99d2bb4654df13bb30c476679805eb066bfa4352bc1083d9012fdc6fd1c10312\": container with ID starting with 99d2bb4654df13bb30c476679805eb066bfa4352bc1083d9012fdc6fd1c10312 not found: ID does not exist" containerID="99d2bb4654df13bb30c476679805eb066bfa4352bc1083d9012fdc6fd1c10312"
Jul 08 17:20:29.967242 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:29.967173    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99d2bb4654df13bb30c476679805eb066bfa4352bc1083d9012fdc6fd1c10312"} err="failed to get container status \"99d2bb4654df13bb30c476679805eb066bfa4352bc1083d9012fdc6fd1c10312\": rpc error: code = NotFound desc = could not find container \"99d2bb4654df13bb30c476679805eb066bfa4352bc1083d9012fdc6fd1c10312\": container with ID starting with 99d2bb4654df13bb30c476679805eb066bfa4352bc1083d9012fdc6fd1c10312 not found: ID does not exist"
Jul 08 17:20:29.982539 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:29.982508    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-tppn4"]
Jul 08 17:20:29.989655 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:29.989626    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-tppn4"]
Jul 08 17:20:30.488883 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:20:30.488847    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828" path="/var/lib/kubelet/pods/c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828/volumes"
Jul 08 17:30:25.675106 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:30:25.675072    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-rclxb"]
Jul 08 17:30:25.675631 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:30:25.675384    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828" containerName="istio-proxy"
Jul 08 17:30:25.675631 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:30:25.675397    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828" containerName="istio-proxy"
Jul 08 17:30:25.675631 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:30:25.675457    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3d8062b-3e99-4b59-ad6a-ab5c6c7e5828" containerName="istio-proxy"
Jul 08 17:30:25.678351 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:30:25.678333    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-rclxb"
Jul 08 17:30:25.680761 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:30:25.680740    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 08 17:30:25.681697 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:30:25.681670    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-8qxdr\""
Jul 08 17:30:25.681808 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:30:25.681718    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-inline-config-test-kserve-self-signed-certs\""
Jul 08 17:30:25.681808 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:30:25.681766    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 08 17:30:25.692429 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:30:25.692399    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-rclxb"]
Jul 08 17:30:25.799971 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:30:25.799923    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c2bbf51-f295-4adf-8106-e9b98ec1ebb0-home\") pod \"scheduler-inline-config-test-kserve-7c6c58cc96-rclxb\" (UID: \"6c2bbf51-f295-4adf-8106-e9b98ec1ebb0\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-rclxb"
Jul 08 17:30:25.799971 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:30:25.799965    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtbk7\" (UniqueName: \"kubernetes.io/projected/6c2bbf51-f295-4adf-8106-e9b98ec1ebb0-kube-api-access-vtbk7\") pod \"scheduler-inline-config-test-kserve-7c6c58cc96-rclxb\" (UID: \"6c2bbf51-f295-4adf-8106-e9b98ec1ebb0\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-rclxb"
Jul 08 17:30:25.800211 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:30:25.799993    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c2bbf51-f295-4adf-8106-e9b98ec1ebb0-dshm\") pod \"scheduler-inline-config-test-kserve-7c6c58cc96-rclxb\" (UID: \"6c2bbf51-f295-4adf-8106-e9b98ec1ebb0\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-rclxb"
Jul 08 17:30:25.800211 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:30:25.800023    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c2bbf51-f295-4adf-8106-e9b98ec1ebb0-tmp-dir\") pod \"scheduler-inline-config-test-kserve-7c6c58cc96-rclxb\" (UID: \"6c2bbf51-f295-4adf-8106-e9b98ec1ebb0\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-rclxb"
Jul 08 17:30:25.800211 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:30:25.800103    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c2bbf51-f295-4adf-8106-e9b98ec1ebb0-tls-certs\") pod \"scheduler-inline-config-test-kserve-7c6c58cc96-rclxb\" (UID: \"6c2bbf51-f295-4adf-8106-e9b98ec1ebb0\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-rclxb"
Jul 08 17:30:25.800211 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:30:25.800123    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c2bbf51-f295-4adf-8106-e9b98ec1ebb0-model-cache\") pod \"scheduler-inline-config-test-kserve-7c6c58cc96-rclxb\" (UID: \"6c2bbf51-f295-4adf-8106-e9b98ec1ebb0\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-rclxb"
Jul 08 17:30:25.901099 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:30:25.901059    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c2bbf51-f295-4adf-8106-e9b98ec1ebb0-model-cache\") pod \"scheduler-inline-config-test-kserve-7c6c58cc96-rclxb\" (UID: \"6c2bbf51-f295-4adf-8106-e9b98ec1ebb0\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-rclxb"
Jul 08 17:30:25.901099 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:30:25.901105    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c2bbf51-f295-4adf-8106-e9b98ec1ebb0-home\") pod \"scheduler-inline-config-test-kserve-7c6c58cc96-rclxb\" (UID: \"6c2bbf51-f295-4adf-8106-e9b98ec1ebb0\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-rclxb"
Jul 08 17:30:25.901411 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:30:25.901127    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtbk7\" (UniqueName: \"kubernetes.io/projected/6c2bbf51-f295-4adf-8106-e9b98ec1ebb0-kube-api-access-vtbk7\") pod \"scheduler-inline-config-test-kserve-7c6c58cc96-rclxb\" (UID: \"6c2bbf51-f295-4adf-8106-e9b98ec1ebb0\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-rclxb"
Jul 08 17:30:25.901411 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:30:25.901144    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c2bbf51-f295-4adf-8106-e9b98ec1ebb0-dshm\") pod \"scheduler-inline-config-test-kserve-7c6c58cc96-rclxb\" (UID: \"6c2bbf51-f295-4adf-8106-e9b98ec1ebb0\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-rclxb"
Jul 08 17:30:25.901411 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:30:25.901165    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c2bbf51-f295-4adf-8106-e9b98ec1ebb0-tmp-dir\") pod \"scheduler-inline-config-test-kserve-7c6c58cc96-rclxb\" (UID: \"6c2bbf51-f295-4adf-8106-e9b98ec1ebb0\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-rclxb"
Jul 08 17:30:25.901411 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:30:25.901267    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c2bbf51-f295-4adf-8106-e9b98ec1ebb0-tls-certs\") pod \"scheduler-inline-config-test-kserve-7c6c58cc96-rclxb\" (UID: \"6c2bbf51-f295-4adf-8106-e9b98ec1ebb0\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-rclxb"
Jul 08 17:30:25.901616 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:30:25.901559    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c2bbf51-f295-4adf-8106-e9b98ec1ebb0-model-cache\") pod \"scheduler-inline-config-test-kserve-7c6c58cc96-rclxb\" (UID: \"6c2bbf51-f295-4adf-8106-e9b98ec1ebb0\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-rclxb"
Jul 08 17:30:25.901616 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:30:25.901584    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c2bbf51-f295-4adf-8106-e9b98ec1ebb0-home\") pod \"scheduler-inline-config-test-kserve-7c6c58cc96-rclxb\" (UID: \"6c2bbf51-f295-4adf-8106-e9b98ec1ebb0\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-rclxb"
Jul 08 17:30:25.901687 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:30:25.901642    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c2bbf51-f295-4adf-8106-e9b98ec1ebb0-tmp-dir\") pod \"scheduler-inline-config-test-kserve-7c6c58cc96-rclxb\" (UID: \"6c2bbf51-f295-4adf-8106-e9b98ec1ebb0\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-rclxb"
Jul 08 17:30:25.903646 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:30:25.903619    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c2bbf51-f295-4adf-8106-e9b98ec1ebb0-dshm\") pod \"scheduler-inline-config-test-kserve-7c6c58cc96-rclxb\" (UID: \"6c2bbf51-f295-4adf-8106-e9b98ec1ebb0\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-rclxb"
Jul 08 17:30:25.903870 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:30:25.903851    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c2bbf51-f295-4adf-8106-e9b98ec1ebb0-tls-certs\") pod \"scheduler-inline-config-test-kserve-7c6c58cc96-rclxb\" (UID: \"6c2bbf51-f295-4adf-8106-e9b98ec1ebb0\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-rclxb"
Jul 08 17:30:25.913210 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:30:25.913186    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtbk7\" (UniqueName: \"kubernetes.io/projected/6c2bbf51-f295-4adf-8106-e9b98ec1ebb0-kube-api-access-vtbk7\") pod \"scheduler-inline-config-test-kserve-7c6c58cc96-rclxb\" (UID: \"6c2bbf51-f295-4adf-8106-e9b98ec1ebb0\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-rclxb"
Jul 08 17:30:25.988902 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:30:25.988863    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-rclxb"
Jul 08 17:30:26.128184 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:30:26.128153    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-rclxb"]
Jul 08 17:30:26.131212 ip-10-0-142-172 kubenswrapper[2565]: W0708 17:30:26.131186    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c2bbf51_f295_4adf_8106_e9b98ec1ebb0.slice/crio-8ab151789e3a0d87fe173c825a18e346ab946382b2728c8f6b4d3c5f92116665 WatchSource:0}: Error finding container 8ab151789e3a0d87fe173c825a18e346ab946382b2728c8f6b4d3c5f92116665: Status 404 returned error can't find the container with id 8ab151789e3a0d87fe173c825a18e346ab946382b2728c8f6b4d3c5f92116665
Jul 08 17:30:26.238176 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:30:26.238126    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-rclxb" event={"ID":"6c2bbf51-f295-4adf-8106-e9b98ec1ebb0","Type":"ContainerStarted","Data":"716e0fac074ed44a884802ea417676a369446a9daae6a41111f95a0bcf89d69e"}
Jul 08 17:30:26.238536 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:30:26.238205    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-rclxb" event={"ID":"6c2bbf51-f295-4adf-8106-e9b98ec1ebb0","Type":"ContainerStarted","Data":"8ab151789e3a0d87fe173c825a18e346ab946382b2728c8f6b4d3c5f92116665"}
Jul 08 17:30:26.257711 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:30:26.257614    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-rclxb" podStartSLOduration=1.257595455 podStartE2EDuration="1.257595455s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:30:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:30:26.256513983 +0000 UTC m=+3360.357128553" watchObservedRunningTime="2026-07-08 17:30:26.257595455 +0000 UTC m=+3360.358210102"
Jul 08 17:30:26.989175 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:30:26.989124    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-rclxb"
Jul 08 17:30:35.989959 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:30:35.989913    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-rclxb"
Jul 08 17:30:36.002920 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:30:36.002890    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-rclxb"
Jul 08 17:30:36.289406 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:30:36.289315    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-rclxb"
Jul 08 17:30:59.307965 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:30:59.307924    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-rclxb"]
Jul 08 17:31:14.329138 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:14.329094    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-rclxb" podUID="6c2bbf51-f295-4adf-8106-e9b98ec1ebb0" containerName="main" containerID="cri-o://716e0fac074ed44a884802ea417676a369446a9daae6a41111f95a0bcf89d69e" gracePeriod=45
Jul 08 17:31:14.571275 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:14.571250    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-rclxb"
Jul 08 17:31:14.706496 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:14.706467    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vtbk7\" (UniqueName: \"kubernetes.io/projected/6c2bbf51-f295-4adf-8106-e9b98ec1ebb0-kube-api-access-vtbk7\") pod \"6c2bbf51-f295-4adf-8106-e9b98ec1ebb0\" (UID: \"6c2bbf51-f295-4adf-8106-e9b98ec1ebb0\") "
Jul 08 17:31:14.706680 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:14.706505    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c2bbf51-f295-4adf-8106-e9b98ec1ebb0-home\") pod \"6c2bbf51-f295-4adf-8106-e9b98ec1ebb0\" (UID: \"6c2bbf51-f295-4adf-8106-e9b98ec1ebb0\") "
Jul 08 17:31:14.706680 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:14.706537    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c2bbf51-f295-4adf-8106-e9b98ec1ebb0-tls-certs\") pod \"6c2bbf51-f295-4adf-8106-e9b98ec1ebb0\" (UID: \"6c2bbf51-f295-4adf-8106-e9b98ec1ebb0\") "
Jul 08 17:31:14.706680 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:14.706563    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c2bbf51-f295-4adf-8106-e9b98ec1ebb0-dshm\") pod \"6c2bbf51-f295-4adf-8106-e9b98ec1ebb0\" (UID: \"6c2bbf51-f295-4adf-8106-e9b98ec1ebb0\") "
Jul 08 17:31:14.706680 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:14.706609    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c2bbf51-f295-4adf-8106-e9b98ec1ebb0-model-cache\") pod \"6c2bbf51-f295-4adf-8106-e9b98ec1ebb0\" (UID: \"6c2bbf51-f295-4adf-8106-e9b98ec1ebb0\") "
Jul 08 17:31:14.706680 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:14.706642    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c2bbf51-f295-4adf-8106-e9b98ec1ebb0-tmp-dir\") pod \"6c2bbf51-f295-4adf-8106-e9b98ec1ebb0\" (UID: \"6c2bbf51-f295-4adf-8106-e9b98ec1ebb0\") "
Jul 08 17:31:14.706935 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:14.706817    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c2bbf51-f295-4adf-8106-e9b98ec1ebb0-home" (OuterVolumeSpecName: "home") pod "6c2bbf51-f295-4adf-8106-e9b98ec1ebb0" (UID: "6c2bbf51-f295-4adf-8106-e9b98ec1ebb0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 17:31:14.706935 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:14.706908    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c2bbf51-f295-4adf-8106-e9b98ec1ebb0-model-cache" (OuterVolumeSpecName: "model-cache") pod "6c2bbf51-f295-4adf-8106-e9b98ec1ebb0" (UID: "6c2bbf51-f295-4adf-8106-e9b98ec1ebb0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 17:31:14.707106 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:14.706985    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c2bbf51-f295-4adf-8106-e9b98ec1ebb0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6c2bbf51-f295-4adf-8106-e9b98ec1ebb0" (UID: "6c2bbf51-f295-4adf-8106-e9b98ec1ebb0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 17:31:14.708902 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:14.708871    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c2bbf51-f295-4adf-8106-e9b98ec1ebb0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6c2bbf51-f295-4adf-8106-e9b98ec1ebb0" (UID: "6c2bbf51-f295-4adf-8106-e9b98ec1ebb0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 17:31:14.708902 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:14.708875    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c2bbf51-f295-4adf-8106-e9b98ec1ebb0-dshm" (OuterVolumeSpecName: "dshm") pod "6c2bbf51-f295-4adf-8106-e9b98ec1ebb0" (UID: "6c2bbf51-f295-4adf-8106-e9b98ec1ebb0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 17:31:14.709045 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:14.708908    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c2bbf51-f295-4adf-8106-e9b98ec1ebb0-kube-api-access-vtbk7" (OuterVolumeSpecName: "kube-api-access-vtbk7") pod "6c2bbf51-f295-4adf-8106-e9b98ec1ebb0" (UID: "6c2bbf51-f295-4adf-8106-e9b98ec1ebb0"). InnerVolumeSpecName "kube-api-access-vtbk7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 17:31:14.807180 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:14.807150    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c2bbf51-f295-4adf-8106-e9b98ec1ebb0-tls-certs\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 17:31:14.807180 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:14.807174    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c2bbf51-f295-4adf-8106-e9b98ec1ebb0-dshm\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 17:31:14.807180 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:14.807182    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c2bbf51-f295-4adf-8106-e9b98ec1ebb0-model-cache\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 17:31:14.807180 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:14.807190    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c2bbf51-f295-4adf-8106-e9b98ec1ebb0-tmp-dir\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 17:31:14.807471 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:14.807198    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vtbk7\" (UniqueName: \"kubernetes.io/projected/6c2bbf51-f295-4adf-8106-e9b98ec1ebb0-kube-api-access-vtbk7\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 17:31:14.807471 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:14.807213    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c2bbf51-f295-4adf-8106-e9b98ec1ebb0-home\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 17:31:15.428987 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:15.428953    2565 generic.go:356] "Generic (PLEG): container finished" podID="6c2bbf51-f295-4adf-8106-e9b98ec1ebb0" containerID="716e0fac074ed44a884802ea417676a369446a9daae6a41111f95a0bcf89d69e" exitCode=0
Jul 08 17:31:15.429455 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:15.429004    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-rclxb"
Jul 08 17:31:15.429455 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:15.429016    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-rclxb" event={"ID":"6c2bbf51-f295-4adf-8106-e9b98ec1ebb0","Type":"ContainerDied","Data":"716e0fac074ed44a884802ea417676a369446a9daae6a41111f95a0bcf89d69e"}
Jul 08 17:31:15.429455 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:15.429061    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-rclxb" event={"ID":"6c2bbf51-f295-4adf-8106-e9b98ec1ebb0","Type":"ContainerDied","Data":"8ab151789e3a0d87fe173c825a18e346ab946382b2728c8f6b4d3c5f92116665"}
Jul 08 17:31:15.429455 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:15.429084    2565 scope.go:117] "RemoveContainer" containerID="716e0fac074ed44a884802ea417676a369446a9daae6a41111f95a0bcf89d69e"
Jul 08 17:31:15.437777 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:15.437757    2565 scope.go:117] "RemoveContainer" containerID="716e0fac074ed44a884802ea417676a369446a9daae6a41111f95a0bcf89d69e"
Jul 08 17:31:15.438098 ip-10-0-142-172 kubenswrapper[2565]: E0708 17:31:15.438078    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"716e0fac074ed44a884802ea417676a369446a9daae6a41111f95a0bcf89d69e\": container with ID starting with 716e0fac074ed44a884802ea417676a369446a9daae6a41111f95a0bcf89d69e not found: ID does not exist" containerID="716e0fac074ed44a884802ea417676a369446a9daae6a41111f95a0bcf89d69e"
Jul 08 17:31:15.438189 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:15.438108    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"716e0fac074ed44a884802ea417676a369446a9daae6a41111f95a0bcf89d69e"} err="failed to get container status \"716e0fac074ed44a884802ea417676a369446a9daae6a41111f95a0bcf89d69e\": rpc error: code = NotFound desc = could not find container \"716e0fac074ed44a884802ea417676a369446a9daae6a41111f95a0bcf89d69e\": container with ID starting with 716e0fac074ed44a884802ea417676a369446a9daae6a41111f95a0bcf89d69e not found: ID does not exist"
Jul 08 17:31:15.452035 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:15.452006    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-rclxb"]
Jul 08 17:31:15.457450 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:15.457421    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-rclxb"]
Jul 08 17:31:16.488576 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:16.488545    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c2bbf51-f295-4adf-8106-e9b98ec1ebb0" path="/var/lib/kubelet/pods/6c2bbf51-f295-4adf-8106-e9b98ec1ebb0/volumes"
Jul 08 17:31:37.075741 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:37.075708    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4w2k6k"]
Jul 08 17:31:37.076190 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:37.075997    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c2bbf51-f295-4adf-8106-e9b98ec1ebb0" containerName="main"
Jul 08 17:31:37.076190 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:37.076008    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c2bbf51-f295-4adf-8106-e9b98ec1ebb0" containerName="main"
Jul 08 17:31:37.076190 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:37.076057    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c2bbf51-f295-4adf-8106-e9b98ec1ebb0" containerName="main"
Jul 08 17:31:37.080343 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:37.080319    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4w2k6k"
Jul 08 17:31:37.083748 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:37.083722    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-8qxdr\""
Jul 08 17:31:37.083748 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:37.083737    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 08 17:31:37.083929 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:37.083786    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisv431d7e30f13554296364403a5b6365f5-kserve-self-signed-certs\""
Jul 08 17:31:37.083929 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:37.083726    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 08 17:31:37.088698 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:37.088675    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4w2k6k"]
Jul 08 17:31:37.201008 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:37.200955    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9ee622a-002e-4406-90d7-7d8e9ecfca80-tls-certs\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4w2k6k\" (UID: \"c9ee622a-002e-4406-90d7-7d8e9ecfca80\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4w2k6k"
Jul 08 17:31:37.201008 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:37.201016    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdt8g\" (UniqueName: \"kubernetes.io/projected/c9ee622a-002e-4406-90d7-7d8e9ecfca80-kube-api-access-rdt8g\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4w2k6k\" (UID: \"c9ee622a-002e-4406-90d7-7d8e9ecfca80\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4w2k6k"
Jul 08 17:31:37.201331 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:37.201119    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c9ee622a-002e-4406-90d7-7d8e9ecfca80-home\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4w2k6k\" (UID: \"c9ee622a-002e-4406-90d7-7d8e9ecfca80\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4w2k6k"
Jul 08 17:31:37.201331 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:37.201151    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c9ee622a-002e-4406-90d7-7d8e9ecfca80-dshm\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4w2k6k\" (UID: \"c9ee622a-002e-4406-90d7-7d8e9ecfca80\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4w2k6k"
Jul 08 17:31:37.201331 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:37.201178    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9ee622a-002e-4406-90d7-7d8e9ecfca80-tmp-dir\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4w2k6k\" (UID: \"c9ee622a-002e-4406-90d7-7d8e9ecfca80\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4w2k6k"
Jul 08 17:31:37.201331 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:37.201254    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c9ee622a-002e-4406-90d7-7d8e9ecfca80-model-cache\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4w2k6k\" (UID: \"c9ee622a-002e-4406-90d7-7d8e9ecfca80\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4w2k6k"
Jul 08 17:31:37.302833 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:37.302794    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9ee622a-002e-4406-90d7-7d8e9ecfca80-tls-certs\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4w2k6k\" (UID: \"c9ee622a-002e-4406-90d7-7d8e9ecfca80\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4w2k6k"
Jul 08 17:31:37.303018 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:37.302846    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdt8g\" (UniqueName: \"kubernetes.io/projected/c9ee622a-002e-4406-90d7-7d8e9ecfca80-kube-api-access-rdt8g\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4w2k6k\" (UID: \"c9ee622a-002e-4406-90d7-7d8e9ecfca80\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4w2k6k"
Jul 08 17:31:37.303018 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:37.302898    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c9ee622a-002e-4406-90d7-7d8e9ecfca80-home\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4w2k6k\" (UID: \"c9ee622a-002e-4406-90d7-7d8e9ecfca80\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4w2k6k"
Jul 08 17:31:37.303018 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:37.302923    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c9ee622a-002e-4406-90d7-7d8e9ecfca80-dshm\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4w2k6k\" (UID: \"c9ee622a-002e-4406-90d7-7d8e9ecfca80\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4w2k6k"
Jul 08 17:31:37.303018 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:37.302951    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9ee622a-002e-4406-90d7-7d8e9ecfca80-tmp-dir\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4w2k6k\" (UID: \"c9ee622a-002e-4406-90d7-7d8e9ecfca80\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4w2k6k"
Jul 08 17:31:37.303018 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:37.302988    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c9ee622a-002e-4406-90d7-7d8e9ecfca80-model-cache\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4w2k6k\" (UID: \"c9ee622a-002e-4406-90d7-7d8e9ecfca80\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4w2k6k"
Jul 08 17:31:37.303372 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:37.303340    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c9ee622a-002e-4406-90d7-7d8e9ecfca80-home\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4w2k6k\" (UID: \"c9ee622a-002e-4406-90d7-7d8e9ecfca80\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4w2k6k"
Jul 08 17:31:37.303490 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:37.303395    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c9ee622a-002e-4406-90d7-7d8e9ecfca80-model-cache\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4w2k6k\" (UID: \"c9ee622a-002e-4406-90d7-7d8e9ecfca80\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4w2k6k"
Jul 08 17:31:37.303490 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:37.303420    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9ee622a-002e-4406-90d7-7d8e9ecfca80-tmp-dir\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4w2k6k\" (UID: \"c9ee622a-002e-4406-90d7-7d8e9ecfca80\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4w2k6k"
Jul 08 17:31:37.305517 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:37.305493    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c9ee622a-002e-4406-90d7-7d8e9ecfca80-dshm\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4w2k6k\" (UID: \"c9ee622a-002e-4406-90d7-7d8e9ecfca80\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4w2k6k"
Jul 08 17:31:37.305660 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:37.305608    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9ee622a-002e-4406-90d7-7d8e9ecfca80-tls-certs\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4w2k6k\" (UID: \"c9ee622a-002e-4406-90d7-7d8e9ecfca80\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4w2k6k"
Jul 08 17:31:37.313363 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:37.313341    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdt8g\" (UniqueName: \"kubernetes.io/projected/c9ee622a-002e-4406-90d7-7d8e9ecfca80-kube-api-access-rdt8g\") pod \"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4w2k6k\" (UID: \"c9ee622a-002e-4406-90d7-7d8e9ecfca80\") " pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4w2k6k"
Jul 08 17:31:37.391825 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:37.391720    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4w2k6k"
Jul 08 17:31:37.538183 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:37.538114    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4w2k6k"]
Jul 08 17:31:37.540864 ip-10-0-142-172 kubenswrapper[2565]: W0708 17:31:37.540834    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9ee622a_002e_4406_90d7_7d8e9ecfca80.slice/crio-2b5b74db1b38f230ea9eff896332d46adfe24b8428fa722b72109ff62ee9f74f WatchSource:0}: Error finding container 2b5b74db1b38f230ea9eff896332d46adfe24b8428fa722b72109ff62ee9f74f: Status 404 returned error can't find the container with id 2b5b74db1b38f230ea9eff896332d46adfe24b8428fa722b72109ff62ee9f74f
Jul 08 17:31:38.519274 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:38.519239    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4w2k6k" event={"ID":"c9ee622a-002e-4406-90d7-7d8e9ecfca80","Type":"ContainerStarted","Data":"a7b93a90b16aadc7b80139d51a1c98103a698eeec70774810dd46b9ee91e83d9"}
Jul 08 17:31:38.519675 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:38.519292    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4w2k6k" event={"ID":"c9ee622a-002e-4406-90d7-7d8e9ecfca80","Type":"ContainerStarted","Data":"2b5b74db1b38f230ea9eff896332d46adfe24b8428fa722b72109ff62ee9f74f"}
Jul 08 17:31:38.544574 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:38.544517    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4w2k6k" podStartSLOduration=1.5444964909999999 podStartE2EDuration="1.544496491s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:31:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:31:38.544498343 +0000 UTC m=+3432.645112926" watchObservedRunningTime="2026-07-08 17:31:38.544496491 +0000 UTC m=+3432.645111061"
Jul 08 17:31:39.392663 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:39.392617    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4w2k6k"
Jul 08 17:31:47.392439 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:47.392393    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4w2k6k"
Jul 08 17:31:47.405835 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:47.405808    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4w2k6k"
Jul 08 17:31:47.564748 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:31:47.564713    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4w2k6k"
Jul 08 17:32:10.609693 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:10.609660    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4w2k6k"]
Jul 08 17:32:25.630383 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:25.630314    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4w2k6k" podUID="c9ee622a-002e-4406-90d7-7d8e9ecfca80" containerName="main" containerID="cri-o://a7b93a90b16aadc7b80139d51a1c98103a698eeec70774810dd46b9ee91e83d9" gracePeriod=45
Jul 08 17:32:25.888749 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:25.888676    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4w2k6k"
Jul 08 17:32:26.015912 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:26.015866    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9ee622a-002e-4406-90d7-7d8e9ecfca80-tmp-dir\") pod \"c9ee622a-002e-4406-90d7-7d8e9ecfca80\" (UID: \"c9ee622a-002e-4406-90d7-7d8e9ecfca80\") "
Jul 08 17:32:26.015912 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:26.015913    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c9ee622a-002e-4406-90d7-7d8e9ecfca80-home\") pod \"c9ee622a-002e-4406-90d7-7d8e9ecfca80\" (UID: \"c9ee622a-002e-4406-90d7-7d8e9ecfca80\") "
Jul 08 17:32:26.016168 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:26.015938    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c9ee622a-002e-4406-90d7-7d8e9ecfca80-model-cache\") pod \"c9ee622a-002e-4406-90d7-7d8e9ecfca80\" (UID: \"c9ee622a-002e-4406-90d7-7d8e9ecfca80\") "
Jul 08 17:32:26.016168 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:26.016005    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rdt8g\" (UniqueName: \"kubernetes.io/projected/c9ee622a-002e-4406-90d7-7d8e9ecfca80-kube-api-access-rdt8g\") pod \"c9ee622a-002e-4406-90d7-7d8e9ecfca80\" (UID: \"c9ee622a-002e-4406-90d7-7d8e9ecfca80\") "
Jul 08 17:32:26.016168 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:26.016032    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9ee622a-002e-4406-90d7-7d8e9ecfca80-tls-certs\") pod \"c9ee622a-002e-4406-90d7-7d8e9ecfca80\" (UID: \"c9ee622a-002e-4406-90d7-7d8e9ecfca80\") "
Jul 08 17:32:26.016168 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:26.016066    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c9ee622a-002e-4406-90d7-7d8e9ecfca80-dshm\") pod \"c9ee622a-002e-4406-90d7-7d8e9ecfca80\" (UID: \"c9ee622a-002e-4406-90d7-7d8e9ecfca80\") "
Jul 08 17:32:26.016373 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:26.016184    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9ee622a-002e-4406-90d7-7d8e9ecfca80-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c9ee622a-002e-4406-90d7-7d8e9ecfca80" (UID: "c9ee622a-002e-4406-90d7-7d8e9ecfca80"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 17:32:26.016373 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:26.016201    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9ee622a-002e-4406-90d7-7d8e9ecfca80-home" (OuterVolumeSpecName: "home") pod "c9ee622a-002e-4406-90d7-7d8e9ecfca80" (UID: "c9ee622a-002e-4406-90d7-7d8e9ecfca80"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 17:32:26.016373 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:26.016294    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9ee622a-002e-4406-90d7-7d8e9ecfca80-model-cache" (OuterVolumeSpecName: "model-cache") pod "c9ee622a-002e-4406-90d7-7d8e9ecfca80" (UID: "c9ee622a-002e-4406-90d7-7d8e9ecfca80"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 17:32:26.016497 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:26.016393    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9ee622a-002e-4406-90d7-7d8e9ecfca80-tmp-dir\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 17:32:26.016497 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:26.016407    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c9ee622a-002e-4406-90d7-7d8e9ecfca80-home\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 17:32:26.016497 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:26.016415    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c9ee622a-002e-4406-90d7-7d8e9ecfca80-model-cache\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 17:32:26.018533 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:26.018501    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9ee622a-002e-4406-90d7-7d8e9ecfca80-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c9ee622a-002e-4406-90d7-7d8e9ecfca80" (UID: "c9ee622a-002e-4406-90d7-7d8e9ecfca80"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 17:32:26.018533 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:26.018512    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9ee622a-002e-4406-90d7-7d8e9ecfca80-dshm" (OuterVolumeSpecName: "dshm") pod "c9ee622a-002e-4406-90d7-7d8e9ecfca80" (UID: "c9ee622a-002e-4406-90d7-7d8e9ecfca80"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 17:32:26.018708 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:26.018507    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9ee622a-002e-4406-90d7-7d8e9ecfca80-kube-api-access-rdt8g" (OuterVolumeSpecName: "kube-api-access-rdt8g") pod "c9ee622a-002e-4406-90d7-7d8e9ecfca80" (UID: "c9ee622a-002e-4406-90d7-7d8e9ecfca80"). InnerVolumeSpecName "kube-api-access-rdt8g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 17:32:26.117016 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:26.116974    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rdt8g\" (UniqueName: \"kubernetes.io/projected/c9ee622a-002e-4406-90d7-7d8e9ecfca80-kube-api-access-rdt8g\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 17:32:26.117016 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:26.117012    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9ee622a-002e-4406-90d7-7d8e9ecfca80-tls-certs\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 17:32:26.117016 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:26.117025    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c9ee622a-002e-4406-90d7-7d8e9ecfca80-dshm\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 17:32:26.707329 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:26.707295    2565 generic.go:356] "Generic (PLEG): container finished" podID="c9ee622a-002e-4406-90d7-7d8e9ecfca80" containerID="a7b93a90b16aadc7b80139d51a1c98103a698eeec70774810dd46b9ee91e83d9" exitCode=0
Jul 08 17:32:26.707743 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:26.707351    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4w2k6k"
Jul 08 17:32:26.707743 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:26.707379    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4w2k6k" event={"ID":"c9ee622a-002e-4406-90d7-7d8e9ecfca80","Type":"ContainerDied","Data":"a7b93a90b16aadc7b80139d51a1c98103a698eeec70774810dd46b9ee91e83d9"}
Jul 08 17:32:26.707743 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:26.707434    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4w2k6k" event={"ID":"c9ee622a-002e-4406-90d7-7d8e9ecfca80","Type":"ContainerDied","Data":"2b5b74db1b38f230ea9eff896332d46adfe24b8428fa722b72109ff62ee9f74f"}
Jul 08 17:32:26.707743 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:26.707458    2565 scope.go:117] "RemoveContainer" containerID="a7b93a90b16aadc7b80139d51a1c98103a698eeec70774810dd46b9ee91e83d9"
Jul 08 17:32:26.717919 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:26.717873    2565 scope.go:117] "RemoveContainer" containerID="a7b93a90b16aadc7b80139d51a1c98103a698eeec70774810dd46b9ee91e83d9"
Jul 08 17:32:26.718414 ip-10-0-142-172 kubenswrapper[2565]: E0708 17:32:26.718387    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7b93a90b16aadc7b80139d51a1c98103a698eeec70774810dd46b9ee91e83d9\": container with ID starting with a7b93a90b16aadc7b80139d51a1c98103a698eeec70774810dd46b9ee91e83d9 not found: ID does not exist" containerID="a7b93a90b16aadc7b80139d51a1c98103a698eeec70774810dd46b9ee91e83d9"
Jul 08 17:32:26.718527 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:26.718426    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7b93a90b16aadc7b80139d51a1c98103a698eeec70774810dd46b9ee91e83d9"} err="failed to get container status \"a7b93a90b16aadc7b80139d51a1c98103a698eeec70774810dd46b9ee91e83d9\": rpc error: code = NotFound desc = could not find container \"a7b93a90b16aadc7b80139d51a1c98103a698eeec70774810dd46b9ee91e83d9\": container with ID starting with a7b93a90b16aadc7b80139d51a1c98103a698eeec70774810dd46b9ee91e83d9 not found: ID does not exist"
Jul 08 17:32:26.731682 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:26.731637    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4w2k6k"]
Jul 08 17:32:26.733567 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:26.733534    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4w2k6k"]
Jul 08 17:32:28.489244 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:28.489191    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9ee622a-002e-4406-90d7-7d8e9ecfca80" path="/var/lib/kubelet/pods/c9ee622a-002e-4406-90d7-7d8e9ecfca80/volumes"
Jul 08 17:32:38.580499 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:38.580459    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-g7knk"]
Jul 08 17:32:38.581006 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:38.580771    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9ee622a-002e-4406-90d7-7d8e9ecfca80" containerName="main"
Jul 08 17:32:38.581006 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:38.580784    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9ee622a-002e-4406-90d7-7d8e9ecfca80" containerName="main"
Jul 08 17:32:38.581006 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:38.580858    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9ee622a-002e-4406-90d7-7d8e9ecfca80" containerName="main"
Jul 08 17:32:38.583583 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:38.583561    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-g7knk"
Jul 08 17:32:38.586564 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:38.586537    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 08 17:32:38.586564 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:38.586549    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 08 17:32:38.587704 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:38.587685    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-8qxdr\""
Jul 08 17:32:38.587841 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:38.587690    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-configmap-ref-test-kserve-self-signed-certs\""
Jul 08 17:32:38.599571 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:38.599541    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-g7knk"]
Jul 08 17:32:38.621043 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:38.620999    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7fd92e70-e870-455a-8d07-4affcc7c337c-tls-certs\") pod \"scheduler-configmap-ref-test-kserve-744bf59fbd-g7knk\" (UID: \"7fd92e70-e870-455a-8d07-4affcc7c337c\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-g7knk"
Jul 08 17:32:38.621043 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:38.621040    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhtgf\" (UniqueName: \"kubernetes.io/projected/7fd92e70-e870-455a-8d07-4affcc7c337c-kube-api-access-nhtgf\") pod \"scheduler-configmap-ref-test-kserve-744bf59fbd-g7knk\" (UID: \"7fd92e70-e870-455a-8d07-4affcc7c337c\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-g7knk"
Jul 08 17:32:38.621296 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:38.621075    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7fd92e70-e870-455a-8d07-4affcc7c337c-dshm\") pod \"scheduler-configmap-ref-test-kserve-744bf59fbd-g7knk\" (UID: \"7fd92e70-e870-455a-8d07-4affcc7c337c\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-g7knk"
Jul 08 17:32:38.621296 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:38.621099    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7fd92e70-e870-455a-8d07-4affcc7c337c-model-cache\") pod \"scheduler-configmap-ref-test-kserve-744bf59fbd-g7knk\" (UID: \"7fd92e70-e870-455a-8d07-4affcc7c337c\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-g7knk"
Jul 08 17:32:38.621296 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:38.621121    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7fd92e70-e870-455a-8d07-4affcc7c337c-home\") pod \"scheduler-configmap-ref-test-kserve-744bf59fbd-g7knk\" (UID: \"7fd92e70-e870-455a-8d07-4affcc7c337c\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-g7knk"
Jul 08 17:32:38.621296 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:38.621185    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7fd92e70-e870-455a-8d07-4affcc7c337c-tmp-dir\") pod \"scheduler-configmap-ref-test-kserve-744bf59fbd-g7knk\" (UID: \"7fd92e70-e870-455a-8d07-4affcc7c337c\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-g7knk"
Jul 08 17:32:38.722083 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:38.722041    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7fd92e70-e870-455a-8d07-4affcc7c337c-dshm\") pod \"scheduler-configmap-ref-test-kserve-744bf59fbd-g7knk\" (UID: \"7fd92e70-e870-455a-8d07-4affcc7c337c\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-g7knk"
Jul 08 17:32:38.722083 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:38.722088    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7fd92e70-e870-455a-8d07-4affcc7c337c-model-cache\") pod \"scheduler-configmap-ref-test-kserve-744bf59fbd-g7knk\" (UID: \"7fd92e70-e870-455a-8d07-4affcc7c337c\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-g7knk"
Jul 08 17:32:38.722390 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:38.722114    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7fd92e70-e870-455a-8d07-4affcc7c337c-home\") pod \"scheduler-configmap-ref-test-kserve-744bf59fbd-g7knk\" (UID: \"7fd92e70-e870-455a-8d07-4affcc7c337c\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-g7knk"
Jul 08 17:32:38.722390 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:38.722155    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7fd92e70-e870-455a-8d07-4affcc7c337c-tmp-dir\") pod \"scheduler-configmap-ref-test-kserve-744bf59fbd-g7knk\" (UID: \"7fd92e70-e870-455a-8d07-4affcc7c337c\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-g7knk"
Jul 08 17:32:38.722390 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:38.722214    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7fd92e70-e870-455a-8d07-4affcc7c337c-tls-certs\") pod \"scheduler-configmap-ref-test-kserve-744bf59fbd-g7knk\" (UID: \"7fd92e70-e870-455a-8d07-4affcc7c337c\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-g7knk"
Jul 08 17:32:38.722390 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:38.722269    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhtgf\" (UniqueName: \"kubernetes.io/projected/7fd92e70-e870-455a-8d07-4affcc7c337c-kube-api-access-nhtgf\") pod \"scheduler-configmap-ref-test-kserve-744bf59fbd-g7knk\" (UID: \"7fd92e70-e870-455a-8d07-4affcc7c337c\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-g7knk"
Jul 08 17:32:38.722627 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:38.722600    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7fd92e70-e870-455a-8d07-4affcc7c337c-model-cache\") pod \"scheduler-configmap-ref-test-kserve-744bf59fbd-g7knk\" (UID: \"7fd92e70-e870-455a-8d07-4affcc7c337c\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-g7knk"
Jul 08 17:32:38.722687 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:38.722629    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7fd92e70-e870-455a-8d07-4affcc7c337c-tmp-dir\") pod \"scheduler-configmap-ref-test-kserve-744bf59fbd-g7knk\" (UID: \"7fd92e70-e870-455a-8d07-4affcc7c337c\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-g7knk"
Jul 08 17:32:38.722687 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:38.722641    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7fd92e70-e870-455a-8d07-4affcc7c337c-home\") pod \"scheduler-configmap-ref-test-kserve-744bf59fbd-g7knk\" (UID: \"7fd92e70-e870-455a-8d07-4affcc7c337c\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-g7knk"
Jul 08 17:32:38.724638 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:38.724605    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7fd92e70-e870-455a-8d07-4affcc7c337c-dshm\") pod \"scheduler-configmap-ref-test-kserve-744bf59fbd-g7knk\" (UID: \"7fd92e70-e870-455a-8d07-4affcc7c337c\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-g7knk"
Jul 08 17:32:38.724806 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:38.724789    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7fd92e70-e870-455a-8d07-4affcc7c337c-tls-certs\") pod \"scheduler-configmap-ref-test-kserve-744bf59fbd-g7knk\" (UID: \"7fd92e70-e870-455a-8d07-4affcc7c337c\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-g7knk"
Jul 08 17:32:38.736096 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:38.736067    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhtgf\" (UniqueName: \"kubernetes.io/projected/7fd92e70-e870-455a-8d07-4affcc7c337c-kube-api-access-nhtgf\") pod \"scheduler-configmap-ref-test-kserve-744bf59fbd-g7knk\" (UID: \"7fd92e70-e870-455a-8d07-4affcc7c337c\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-g7knk"
Jul 08 17:32:38.893964 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:38.893874    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-g7knk"
Jul 08 17:32:39.044349 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:39.044309    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-g7knk"]
Jul 08 17:32:39.049106 ip-10-0-142-172 kubenswrapper[2565]: W0708 17:32:39.049077    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fd92e70_e870_455a_8d07_4affcc7c337c.slice/crio-efb77931dab8fe9212baa065fede83bc4cdca93dd18f5e35f2a56b098c38b623 WatchSource:0}: Error finding container efb77931dab8fe9212baa065fede83bc4cdca93dd18f5e35f2a56b098c38b623: Status 404 returned error can't find the container with id efb77931dab8fe9212baa065fede83bc4cdca93dd18f5e35f2a56b098c38b623
Jul 08 17:32:39.759477 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:39.759438    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-g7knk" event={"ID":"7fd92e70-e870-455a-8d07-4affcc7c337c","Type":"ContainerStarted","Data":"12b78fe0d77ef3adea6671cae3ed9118e6fba8074503f8974e4dbe8f91bd4cbe"}
Jul 08 17:32:39.759899 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:39.759498    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-g7knk" event={"ID":"7fd92e70-e870-455a-8d07-4affcc7c337c","Type":"ContainerStarted","Data":"efb77931dab8fe9212baa065fede83bc4cdca93dd18f5e35f2a56b098c38b623"}
Jul 08 17:32:39.784937 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:39.784872    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-g7knk" podStartSLOduration=1.784852104 podStartE2EDuration="1.784852104s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:32:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:32:39.783210706 +0000 UTC m=+3493.883825276" watchObservedRunningTime="2026-07-08 17:32:39.784852104 +0000 UTC m=+3493.885466674"
Jul 08 17:32:39.894952 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:39.894901    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-g7knk"
Jul 08 17:32:48.895180 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:48.895093    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-g7knk"
Jul 08 17:32:48.907752 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:48.907724    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-g7knk"
Jul 08 17:32:49.808677 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:32:49.808647    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-g7knk"
Jul 08 17:33:12.454342 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:33:12.454302    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-g7knk"]
Jul 08 17:33:27.474748 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:33:27.474681    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-g7knk" podUID="7fd92e70-e870-455a-8d07-4affcc7c337c" containerName="main" containerID="cri-o://12b78fe0d77ef3adea6671cae3ed9118e6fba8074503f8974e4dbe8f91bd4cbe" gracePeriod=45
Jul 08 17:33:27.729100 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:33:27.729023    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-g7knk"
Jul 08 17:33:27.842187 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:33:27.842130    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7fd92e70-e870-455a-8d07-4affcc7c337c-tls-certs\") pod \"7fd92e70-e870-455a-8d07-4affcc7c337c\" (UID: \"7fd92e70-e870-455a-8d07-4affcc7c337c\") "
Jul 08 17:33:27.842187 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:33:27.842201    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7fd92e70-e870-455a-8d07-4affcc7c337c-model-cache\") pod \"7fd92e70-e870-455a-8d07-4affcc7c337c\" (UID: \"7fd92e70-e870-455a-8d07-4affcc7c337c\") "
Jul 08 17:33:27.842441 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:33:27.842263    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nhtgf\" (UniqueName: \"kubernetes.io/projected/7fd92e70-e870-455a-8d07-4affcc7c337c-kube-api-access-nhtgf\") pod \"7fd92e70-e870-455a-8d07-4affcc7c337c\" (UID: \"7fd92e70-e870-455a-8d07-4affcc7c337c\") "
Jul 08 17:33:27.842441 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:33:27.842280    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7fd92e70-e870-455a-8d07-4affcc7c337c-tmp-dir\") pod \"7fd92e70-e870-455a-8d07-4affcc7c337c\" (UID: \"7fd92e70-e870-455a-8d07-4affcc7c337c\") "
Jul 08 17:33:27.842441 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:33:27.842304    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7fd92e70-e870-455a-8d07-4affcc7c337c-home\") pod \"7fd92e70-e870-455a-8d07-4affcc7c337c\" (UID: \"7fd92e70-e870-455a-8d07-4affcc7c337c\") "
Jul 08 17:33:27.842441 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:33:27.842351    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7fd92e70-e870-455a-8d07-4affcc7c337c-dshm\") pod \"7fd92e70-e870-455a-8d07-4affcc7c337c\" (UID: \"7fd92e70-e870-455a-8d07-4affcc7c337c\") "
Jul 08 17:33:27.842636 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:33:27.842526    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fd92e70-e870-455a-8d07-4affcc7c337c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7fd92e70-e870-455a-8d07-4affcc7c337c" (UID: "7fd92e70-e870-455a-8d07-4affcc7c337c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 17:33:27.842636 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:33:27.842555    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fd92e70-e870-455a-8d07-4affcc7c337c-model-cache" (OuterVolumeSpecName: "model-cache") pod "7fd92e70-e870-455a-8d07-4affcc7c337c" (UID: "7fd92e70-e870-455a-8d07-4affcc7c337c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 17:33:27.842636 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:33:27.842594    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fd92e70-e870-455a-8d07-4affcc7c337c-home" (OuterVolumeSpecName: "home") pod "7fd92e70-e870-455a-8d07-4affcc7c337c" (UID: "7fd92e70-e870-455a-8d07-4affcc7c337c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 17:33:27.844513 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:33:27.844482    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fd92e70-e870-455a-8d07-4affcc7c337c-dshm" (OuterVolumeSpecName: "dshm") pod "7fd92e70-e870-455a-8d07-4affcc7c337c" (UID: "7fd92e70-e870-455a-8d07-4affcc7c337c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 17:33:27.844591 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:33:27.844536    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7fd92e70-e870-455a-8d07-4affcc7c337c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7fd92e70-e870-455a-8d07-4affcc7c337c" (UID: "7fd92e70-e870-455a-8d07-4affcc7c337c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 17:33:27.844591 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:33:27.844563    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fd92e70-e870-455a-8d07-4affcc7c337c-kube-api-access-nhtgf" (OuterVolumeSpecName: "kube-api-access-nhtgf") pod "7fd92e70-e870-455a-8d07-4affcc7c337c" (UID: "7fd92e70-e870-455a-8d07-4affcc7c337c"). InnerVolumeSpecName "kube-api-access-nhtgf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 17:33:27.943402 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:33:27.943352    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7fd92e70-e870-455a-8d07-4affcc7c337c-model-cache\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 17:33:27.943402 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:33:27.943397    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nhtgf\" (UniqueName: \"kubernetes.io/projected/7fd92e70-e870-455a-8d07-4affcc7c337c-kube-api-access-nhtgf\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 17:33:27.943623 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:33:27.943429    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7fd92e70-e870-455a-8d07-4affcc7c337c-tmp-dir\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 17:33:27.943623 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:33:27.943442    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7fd92e70-e870-455a-8d07-4affcc7c337c-home\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 17:33:27.943623 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:33:27.943449    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7fd92e70-e870-455a-8d07-4affcc7c337c-dshm\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 17:33:27.943623 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:33:27.943456    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7fd92e70-e870-455a-8d07-4affcc7c337c-tls-certs\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 17:33:27.950665 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:33:27.950637    2565 generic.go:356] "Generic (PLEG): container finished" podID="7fd92e70-e870-455a-8d07-4affcc7c337c" containerID="12b78fe0d77ef3adea6671cae3ed9118e6fba8074503f8974e4dbe8f91bd4cbe" exitCode=0
Jul 08 17:33:27.950822 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:33:27.950686    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-g7knk"
Jul 08 17:33:27.950822 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:33:27.950706    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-g7knk" event={"ID":"7fd92e70-e870-455a-8d07-4affcc7c337c","Type":"ContainerDied","Data":"12b78fe0d77ef3adea6671cae3ed9118e6fba8074503f8974e4dbe8f91bd4cbe"}
Jul 08 17:33:27.950822 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:33:27.950751    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-g7knk" event={"ID":"7fd92e70-e870-455a-8d07-4affcc7c337c","Type":"ContainerDied","Data":"efb77931dab8fe9212baa065fede83bc4cdca93dd18f5e35f2a56b098c38b623"}
Jul 08 17:33:27.950822 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:33:27.950774    2565 scope.go:117] "RemoveContainer" containerID="12b78fe0d77ef3adea6671cae3ed9118e6fba8074503f8974e4dbe8f91bd4cbe"
Jul 08 17:33:27.959698 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:33:27.959672    2565 scope.go:117] "RemoveContainer" containerID="12b78fe0d77ef3adea6671cae3ed9118e6fba8074503f8974e4dbe8f91bd4cbe"
Jul 08 17:33:27.960005 ip-10-0-142-172 kubenswrapper[2565]: E0708 17:33:27.959986    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12b78fe0d77ef3adea6671cae3ed9118e6fba8074503f8974e4dbe8f91bd4cbe\": container with ID starting with 12b78fe0d77ef3adea6671cae3ed9118e6fba8074503f8974e4dbe8f91bd4cbe not found: ID does not exist" containerID="12b78fe0d77ef3adea6671cae3ed9118e6fba8074503f8974e4dbe8f91bd4cbe"
Jul 08 17:33:27.960065 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:33:27.960016    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12b78fe0d77ef3adea6671cae3ed9118e6fba8074503f8974e4dbe8f91bd4cbe"} err="failed to get container status \"12b78fe0d77ef3adea6671cae3ed9118e6fba8074503f8974e4dbe8f91bd4cbe\": rpc error: code = NotFound desc = could not find container \"12b78fe0d77ef3adea6671cae3ed9118e6fba8074503f8974e4dbe8f91bd4cbe\": container with ID starting with 12b78fe0d77ef3adea6671cae3ed9118e6fba8074503f8974e4dbe8f91bd4cbe not found: ID does not exist"
Jul 08 17:33:27.977583 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:33:27.977551    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-g7knk"]
Jul 08 17:33:27.983736 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:33:27.983675    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-g7knk"]
Jul 08 17:33:28.488580 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:33:28.488549    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7fd92e70-e870-455a-8d07-4affcc7c337c" path="/var/lib/kubelet/pods/7fd92e70-e870-455a-8d07-4affcc7c337c/volumes"
Jul 08 17:33:49.046456 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:33:49.046417    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dkvvq9"]
Jul 08 17:33:49.046942 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:33:49.046691    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fd92e70-e870-455a-8d07-4affcc7c337c" containerName="main"
Jul 08 17:33:49.046942 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:33:49.046703    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fd92e70-e870-455a-8d07-4affcc7c337c" containerName="main"
Jul 08 17:33:49.046942 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:33:49.046777    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7fd92e70-e870-455a-8d07-4affcc7c337c" containerName="main"
Jul 08 17:33:49.049528 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:33:49.049511    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dkvvq9"
Jul 08 17:33:49.053105 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:33:49.053073    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-ha-replicas-test-epp-sa-dockercfg-wrhzr\""
Jul 08 17:33:49.053297 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:33:49.053190    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 08 17:33:49.053297 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:33:49.053195    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-8qxdr\""
Jul 08 17:33:49.053297 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:33:49.053263    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-ha-replicas-test-kserve-self-signed-certs\""
Jul 08 17:33:49.053297 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:33:49.053196    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 08 17:33:49.064381 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:33:49.064352    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dkvvq9"]
Jul 08 17:33:49.128293 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:33:49.128252    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5w8bc\" (UniqueName: \"kubernetes.io/projected/8a1c8d95-d546-4d9f-a5fb-610bbe3ab62d-kube-api-access-5w8bc\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dkvvq9\" (UID: \"8a1c8d95-d546-4d9f-a5fb-610bbe3ab62d\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dkvvq9"
Jul 08 17:33:49.128507 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:33:49.128316    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a1c8d95-d546-4d9f-a5fb-610bbe3ab62d-tls-certs\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dkvvq9\" (UID: \"8a1c8d95-d546-4d9f-a5fb-610bbe3ab62d\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dkvvq9"
Jul 08 17:33:49.128507 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:33:49.128393    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/8a1c8d95-d546-4d9f-a5fb-610bbe3ab62d-tokenizer-uds\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dkvvq9\" (UID: \"8a1c8d95-d546-4d9f-a5fb-610bbe3ab62d\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dkvvq9"
Jul 08 17:33:49.229111 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:33:49.229059    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a1c8d95-d546-4d9f-a5fb-610bbe3ab62d-tls-certs\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dkvvq9\" (UID: \"8a1c8d95-d546-4d9f-a5fb-610bbe3ab62d\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dkvvq9"
Jul 08 17:33:49.229111 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:33:49.229127    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/8a1c8d95-d546-4d9f-a5fb-610bbe3ab62d-tokenizer-uds\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dkvvq9\" (UID: \"8a1c8d95-d546-4d9f-a5fb-610bbe3ab62d\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dkvvq9"
Jul 08 17:33:49.229395 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:33:49.229163    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w8bc\" (UniqueName: \"kubernetes.io/projected/8a1c8d95-d546-4d9f-a5fb-610bbe3ab62d-kube-api-access-5w8bc\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dkvvq9\" (UID: \"8a1c8d95-d546-4d9f-a5fb-610bbe3ab62d\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dkvvq9"
Jul 08 17:33:49.229559 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:33:49.229535    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/8a1c8d95-d546-4d9f-a5fb-610bbe3ab62d-tokenizer-uds\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dkvvq9\" (UID: \"8a1c8d95-d546-4d9f-a5fb-610bbe3ab62d\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dkvvq9"
Jul 08 17:33:49.231763 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:33:49.231740    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a1c8d95-d546-4d9f-a5fb-610bbe3ab62d-tls-certs\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dkvvq9\" (UID: \"8a1c8d95-d546-4d9f-a5fb-610bbe3ab62d\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dkvvq9"
Jul 08 17:33:49.244429 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:33:49.244395    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w8bc\" (UniqueName: \"kubernetes.io/projected/8a1c8d95-d546-4d9f-a5fb-610bbe3ab62d-kube-api-access-5w8bc\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dkvvq9\" (UID: \"8a1c8d95-d546-4d9f-a5fb-610bbe3ab62d\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dkvvq9"
Jul 08 17:33:49.358966 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:33:49.358861    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dkvvq9"
Jul 08 17:33:49.506583 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:33:49.506561    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dkvvq9"]
Jul 08 17:33:49.508966 ip-10-0-142-172 kubenswrapper[2565]: W0708 17:33:49.508935    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a1c8d95_d546_4d9f_a5fb_610bbe3ab62d.slice/crio-6f12526ed9e895573f8a35dda95ae0a4173b3055a1d48bae82088a72f4371d6e WatchSource:0}: Error finding container 6f12526ed9e895573f8a35dda95ae0a4173b3055a1d48bae82088a72f4371d6e: Status 404 returned error can't find the container with id 6f12526ed9e895573f8a35dda95ae0a4173b3055a1d48bae82088a72f4371d6e
Jul 08 17:33:50.041495 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:33:50.041458    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dkvvq9" event={"ID":"8a1c8d95-d546-4d9f-a5fb-610bbe3ab62d","Type":"ContainerStarted","Data":"dddcdec655a5c7cabacb94f4c73ac832df4095bbc4078e88f5d89cfdf337ad8b"}
Jul 08 17:33:50.041691 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:33:50.041531    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dkvvq9" event={"ID":"8a1c8d95-d546-4d9f-a5fb-610bbe3ab62d","Type":"ContainerStarted","Data":"6f12526ed9e895573f8a35dda95ae0a4173b3055a1d48bae82088a72f4371d6e"}
Jul 08 17:33:50.041691 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:33:50.041567    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dkvvq9"
Jul 08 17:34:21.047169 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:34:21.047081    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dkvvq9" podUID="8a1c8d95-d546-4d9f-a5fb-610bbe3ab62d" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Jul 08 17:34:31.046695 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:34:31.046649    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dkvvq9" podUID="8a1c8d95-d546-4d9f-a5fb-610bbe3ab62d" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Jul 08 17:34:41.046961 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:34:41.046916    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dkvvq9" podUID="8a1c8d95-d546-4d9f-a5fb-610bbe3ab62d" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Jul 08 17:34:49.579593 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:34:49.579534    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dkvvq9" podStartSLOduration=60.57951568 podStartE2EDuration="1m0.57951568s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:33:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:33:50.100515107 +0000 UTC m=+3564.201129677" watchObservedRunningTime="2026-07-08 17:34:49.57951568 +0000 UTC m=+3623.680130250"
Jul 08 17:34:49.579992 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:34:49.579936    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dkvvq9"]
Jul 08 17:34:49.581907 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:34:49.581874    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dkvvq9" podUID="8a1c8d95-d546-4d9f-a5fb-610bbe3ab62d" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Jul 08 17:34:49.589157 ip-10-0-142-172 kubenswrapper[2565]: E0708 17:34:49.589122    2565 log.go:32] "ExecSync cmd from runtime service failed" err=<
Jul 08 17:34:49.589157 ip-10-0-142-172 kubenswrapper[2565]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 08 17:34:49.589157 ip-10-0-142-172 kubenswrapper[2565]:         , stdout: , stderr: , exit code -1
Jul 08 17:34:49.589157 ip-10-0-142-172 kubenswrapper[2565]:  > containerID="dddcdec655a5c7cabacb94f4c73ac832df4095bbc4078e88f5d89cfdf337ad8b" cmd=["/bin/sleep","15"]
Jul 08 17:34:49.589412 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:34:49.589171    2565 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dkvvq9" message="" err=<
Jul 08 17:34:49.589412 ip-10-0-142-172 kubenswrapper[2565]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 08 17:34:49.589412 ip-10-0-142-172 kubenswrapper[2565]:         , stdout: , stderr: , exit code -1
Jul 08 17:34:49.589412 ip-10-0-142-172 kubenswrapper[2565]:  >
Jul 08 17:34:49.589412 ip-10-0-142-172 kubenswrapper[2565]: E0708 17:34:49.589183    2565 kuberuntime_container.go:754] "PreStop hook failed" err=<
Jul 08 17:34:49.589412 ip-10-0-142-172 kubenswrapper[2565]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 08 17:34:49.589412 ip-10-0-142-172 kubenswrapper[2565]:         , stdout: , stderr: , exit code -1
Jul 08 17:34:49.589412 ip-10-0-142-172 kubenswrapper[2565]:  > pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dkvvq9" podUID="8a1c8d95-d546-4d9f-a5fb-610bbe3ab62d" containerName="main" containerID="cri-o://dddcdec655a5c7cabacb94f4c73ac832df4095bbc4078e88f5d89cfdf337ad8b"
Jul 08 17:34:49.589412 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:34:49.589250    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dkvvq9" podUID="8a1c8d95-d546-4d9f-a5fb-610bbe3ab62d" containerName="main" containerID="cri-o://dddcdec655a5c7cabacb94f4c73ac832df4095bbc4078e88f5d89cfdf337ad8b" gracePeriod=60
Jul 08 17:34:49.840106 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:34:49.840030    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dkvvq9"
Jul 08 17:34:49.936864 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:34:49.936826    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5w8bc\" (UniqueName: \"kubernetes.io/projected/8a1c8d95-d546-4d9f-a5fb-610bbe3ab62d-kube-api-access-5w8bc\") pod \"8a1c8d95-d546-4d9f-a5fb-610bbe3ab62d\" (UID: \"8a1c8d95-d546-4d9f-a5fb-610bbe3ab62d\") "
Jul 08 17:34:49.936864 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:34:49.936862    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a1c8d95-d546-4d9f-a5fb-610bbe3ab62d-tls-certs\") pod \"8a1c8d95-d546-4d9f-a5fb-610bbe3ab62d\" (UID: \"8a1c8d95-d546-4d9f-a5fb-610bbe3ab62d\") "
Jul 08 17:34:49.937070 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:34:49.936889    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/8a1c8d95-d546-4d9f-a5fb-610bbe3ab62d-tokenizer-uds\") pod \"8a1c8d95-d546-4d9f-a5fb-610bbe3ab62d\" (UID: \"8a1c8d95-d546-4d9f-a5fb-610bbe3ab62d\") "
Jul 08 17:34:49.937198 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:34:49.937168    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a1c8d95-d546-4d9f-a5fb-610bbe3ab62d-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "8a1c8d95-d546-4d9f-a5fb-610bbe3ab62d" (UID: "8a1c8d95-d546-4d9f-a5fb-610bbe3ab62d"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 17:34:49.939212 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:34:49.939190    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a1c8d95-d546-4d9f-a5fb-610bbe3ab62d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8a1c8d95-d546-4d9f-a5fb-610bbe3ab62d" (UID: "8a1c8d95-d546-4d9f-a5fb-610bbe3ab62d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 17:34:49.939306 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:34:49.939273    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a1c8d95-d546-4d9f-a5fb-610bbe3ab62d-kube-api-access-5w8bc" (OuterVolumeSpecName: "kube-api-access-5w8bc") pod "8a1c8d95-d546-4d9f-a5fb-610bbe3ab62d" (UID: "8a1c8d95-d546-4d9f-a5fb-610bbe3ab62d"). InnerVolumeSpecName "kube-api-access-5w8bc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 17:34:50.038009 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:34:50.037966    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5w8bc\" (UniqueName: \"kubernetes.io/projected/8a1c8d95-d546-4d9f-a5fb-610bbe3ab62d-kube-api-access-5w8bc\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 17:34:50.038009 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:34:50.037998    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a1c8d95-d546-4d9f-a5fb-610bbe3ab62d-tls-certs\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 17:34:50.038009 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:34:50.038008    2565 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/8a1c8d95-d546-4d9f-a5fb-610bbe3ab62d-tokenizer-uds\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 17:34:50.270116 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:34:50.270078    2565 generic.go:356] "Generic (PLEG): container finished" podID="8a1c8d95-d546-4d9f-a5fb-610bbe3ab62d" containerID="dddcdec655a5c7cabacb94f4c73ac832df4095bbc4078e88f5d89cfdf337ad8b" exitCode=0
Jul 08 17:34:50.270339 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:34:50.270130    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dkvvq9"
Jul 08 17:34:50.270339 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:34:50.270126    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dkvvq9" event={"ID":"8a1c8d95-d546-4d9f-a5fb-610bbe3ab62d","Type":"ContainerDied","Data":"dddcdec655a5c7cabacb94f4c73ac832df4095bbc4078e88f5d89cfdf337ad8b"}
Jul 08 17:34:50.270339 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:34:50.270292    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dkvvq9" event={"ID":"8a1c8d95-d546-4d9f-a5fb-610bbe3ab62d","Type":"ContainerDied","Data":"6f12526ed9e895573f8a35dda95ae0a4173b3055a1d48bae82088a72f4371d6e"}
Jul 08 17:34:50.270339 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:34:50.270323    2565 scope.go:117] "RemoveContainer" containerID="dddcdec655a5c7cabacb94f4c73ac832df4095bbc4078e88f5d89cfdf337ad8b"
Jul 08 17:34:50.279375 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:34:50.279356    2565 scope.go:117] "RemoveContainer" containerID="dddcdec655a5c7cabacb94f4c73ac832df4095bbc4078e88f5d89cfdf337ad8b"
Jul 08 17:34:50.279692 ip-10-0-142-172 kubenswrapper[2565]: E0708 17:34:50.279670    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dddcdec655a5c7cabacb94f4c73ac832df4095bbc4078e88f5d89cfdf337ad8b\": container with ID starting with dddcdec655a5c7cabacb94f4c73ac832df4095bbc4078e88f5d89cfdf337ad8b not found: ID does not exist" containerID="dddcdec655a5c7cabacb94f4c73ac832df4095bbc4078e88f5d89cfdf337ad8b"
Jul 08 17:34:50.279785 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:34:50.279699    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dddcdec655a5c7cabacb94f4c73ac832df4095bbc4078e88f5d89cfdf337ad8b"} err="failed to get container status \"dddcdec655a5c7cabacb94f4c73ac832df4095bbc4078e88f5d89cfdf337ad8b\": rpc error: code = NotFound desc = could not find container \"dddcdec655a5c7cabacb94f4c73ac832df4095bbc4078e88f5d89cfdf337ad8b\": container with ID starting with dddcdec655a5c7cabacb94f4c73ac832df4095bbc4078e88f5d89cfdf337ad8b not found: ID does not exist"
Jul 08 17:34:50.303965 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:34:50.303933    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dkvvq9"]
Jul 08 17:34:50.309023 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:34:50.308995    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dkvvq9"]
Jul 08 17:34:50.489987 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:34:50.489952    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a1c8d95-d546-4d9f-a5fb-610bbe3ab62d" path="/var/lib/kubelet/pods/8a1c8d95-d546-4d9f-a5fb-610bbe3ab62d/volumes"
Jul 08 17:35:20.027206 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:35:20.027163    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46"]
Jul 08 17:35:20.027773 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:35:20.027559    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a1c8d95-d546-4d9f-a5fb-610bbe3ab62d" containerName="main"
Jul 08 17:35:20.027773 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:35:20.027573    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a1c8d95-d546-4d9f-a5fb-610bbe3ab62d" containerName="main"
Jul 08 17:35:20.027773 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:35:20.027623    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a1c8d95-d546-4d9f-a5fb-610bbe3ab62d" containerName="main"
Jul 08 17:35:20.030489 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:35:20.030464    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46"
Jul 08 17:35:20.033028 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:35:20.032995    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-8qxdr\""
Jul 08 17:35:20.033161 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:35:20.032995    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 08 17:35:20.034029 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:35:20.034009    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 08 17:35:20.034194 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:35:20.034178    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-v06-pd-migration-test-kserve-self-signed-certs\""
Jul 08 17:35:20.046738 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:35:20.046709    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46"]
Jul 08 17:35:20.105196 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:35:20.105151    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m64lb\" (UniqueName: \"kubernetes.io/projected/6964cc10-b630-4b37-9005-73e5a9a47a08-kube-api-access-m64lb\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46\" (UID: \"6964cc10-b630-4b37-9005-73e5a9a47a08\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46"
Jul 08 17:35:20.105196 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:35:20.105194    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6964cc10-b630-4b37-9005-73e5a9a47a08-home\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46\" (UID: \"6964cc10-b630-4b37-9005-73e5a9a47a08\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46"
Jul 08 17:35:20.105447 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:35:20.105251    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6964cc10-b630-4b37-9005-73e5a9a47a08-model-cache\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46\" (UID: \"6964cc10-b630-4b37-9005-73e5a9a47a08\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46"
Jul 08 17:35:20.105447 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:35:20.105285    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6964cc10-b630-4b37-9005-73e5a9a47a08-tls-certs\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46\" (UID: \"6964cc10-b630-4b37-9005-73e5a9a47a08\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46"
Jul 08 17:35:20.105447 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:35:20.105311    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6964cc10-b630-4b37-9005-73e5a9a47a08-dshm\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46\" (UID: \"6964cc10-b630-4b37-9005-73e5a9a47a08\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46"
Jul 08 17:35:20.105447 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:35:20.105380    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6964cc10-b630-4b37-9005-73e5a9a47a08-tmp-dir\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46\" (UID: \"6964cc10-b630-4b37-9005-73e5a9a47a08\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46"
Jul 08 17:35:20.205764 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:35:20.205713    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6964cc10-b630-4b37-9005-73e5a9a47a08-tmp-dir\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46\" (UID: \"6964cc10-b630-4b37-9005-73e5a9a47a08\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46"
Jul 08 17:35:20.205969 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:35:20.205789    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m64lb\" (UniqueName: \"kubernetes.io/projected/6964cc10-b630-4b37-9005-73e5a9a47a08-kube-api-access-m64lb\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46\" (UID: \"6964cc10-b630-4b37-9005-73e5a9a47a08\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46"
Jul 08 17:35:20.205969 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:35:20.205819    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6964cc10-b630-4b37-9005-73e5a9a47a08-home\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46\" (UID: \"6964cc10-b630-4b37-9005-73e5a9a47a08\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46"
Jul 08 17:35:20.205969 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:35:20.205845    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6964cc10-b630-4b37-9005-73e5a9a47a08-model-cache\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46\" (UID: \"6964cc10-b630-4b37-9005-73e5a9a47a08\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46"
Jul 08 17:35:20.205969 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:35:20.205867    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6964cc10-b630-4b37-9005-73e5a9a47a08-tls-certs\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46\" (UID: \"6964cc10-b630-4b37-9005-73e5a9a47a08\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46"
Jul 08 17:35:20.205969 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:35:20.205887    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6964cc10-b630-4b37-9005-73e5a9a47a08-dshm\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46\" (UID: \"6964cc10-b630-4b37-9005-73e5a9a47a08\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46"
Jul 08 17:35:20.206280 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:35:20.206135    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6964cc10-b630-4b37-9005-73e5a9a47a08-tmp-dir\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46\" (UID: \"6964cc10-b630-4b37-9005-73e5a9a47a08\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46"
Jul 08 17:35:20.206280 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:35:20.206263    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6964cc10-b630-4b37-9005-73e5a9a47a08-home\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46\" (UID: \"6964cc10-b630-4b37-9005-73e5a9a47a08\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46"
Jul 08 17:35:20.206400 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:35:20.206377    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6964cc10-b630-4b37-9005-73e5a9a47a08-model-cache\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46\" (UID: \"6964cc10-b630-4b37-9005-73e5a9a47a08\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46"
Jul 08 17:35:20.208465 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:35:20.208441    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6964cc10-b630-4b37-9005-73e5a9a47a08-dshm\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46\" (UID: \"6964cc10-b630-4b37-9005-73e5a9a47a08\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46"
Jul 08 17:35:20.208595 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:35:20.208579    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6964cc10-b630-4b37-9005-73e5a9a47a08-tls-certs\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46\" (UID: \"6964cc10-b630-4b37-9005-73e5a9a47a08\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46"
Jul 08 17:35:20.218546 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:35:20.218522    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m64lb\" (UniqueName: \"kubernetes.io/projected/6964cc10-b630-4b37-9005-73e5a9a47a08-kube-api-access-m64lb\") pod \"scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46\" (UID: \"6964cc10-b630-4b37-9005-73e5a9a47a08\") " pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46"
Jul 08 17:35:20.342282 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:35:20.342171    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46"
Jul 08 17:35:20.487296 ip-10-0-142-172 kubenswrapper[2565]: W0708 17:35:20.487263    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6964cc10_b630_4b37_9005_73e5a9a47a08.slice/crio-3690271f9ba71cb5079a53cb0e83c1e8a637d54f894abe7501bfc46f18fc4e2e WatchSource:0}: Error finding container 3690271f9ba71cb5079a53cb0e83c1e8a637d54f894abe7501bfc46f18fc4e2e: Status 404 returned error can't find the container with id 3690271f9ba71cb5079a53cb0e83c1e8a637d54f894abe7501bfc46f18fc4e2e
Jul 08 17:35:20.489119 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:35:20.489067    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46"]
Jul 08 17:35:21.392617 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:35:21.392579    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46" event={"ID":"6964cc10-b630-4b37-9005-73e5a9a47a08","Type":"ContainerStarted","Data":"f893dce706c0cde7242fd34e768f4829f6706a2f7d49bf7d717a7b245a8154e8"}
Jul 08 17:35:21.393103 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:35:21.392673    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46" event={"ID":"6964cc10-b630-4b37-9005-73e5a9a47a08","Type":"ContainerStarted","Data":"3690271f9ba71cb5079a53cb0e83c1e8a637d54f894abe7501bfc46f18fc4e2e"}
Jul 08 17:35:21.413694 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:35:21.413643    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46" podStartSLOduration=1.41362701 podStartE2EDuration="1.41362701s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:35:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:35:21.413020459 +0000 UTC m=+3655.513635030" watchObservedRunningTime="2026-07-08 17:35:21.41362701 +0000 UTC m=+3655.514241579"
Jul 08 17:35:22.343102 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:35:22.343053    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46"
Jul 08 17:35:30.342428 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:35:30.342391    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46"
Jul 08 17:35:30.354584 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:35:30.354553    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46"
Jul 08 17:35:30.438484 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:35:30.438457    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46"
Jul 08 17:54:17.873117 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:54:17.873085    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46_6964cc10-b630-4b37-9005-73e5a9a47a08/main/0.log"
Jul 08 17:54:25.349459 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:54:25.349426    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-prefill-5fc5n8sgm"]
Jul 08 17:54:25.352855 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:54:25.352830    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-prefill-5fc5n8sgm"
Jul 08 17:54:25.355535 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:54:25.355511    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-v06-threshold-migration-test-kserve-self-signed-certs\""
Jul 08 17:54:25.367133 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:54:25.367100    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-prefill-5fc5n8sgm"]
Jul 08 17:54:25.405651 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:54:25.405600    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0905e52a-beea-4a8d-b230-8b9a15d27082-dshm\") pod \"scheduler-v06-threshold-migration-test-kserve-prefill-5fc5n8sgm\" (UID: \"0905e52a-beea-4a8d-b230-8b9a15d27082\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-prefill-5fc5n8sgm"
Jul 08 17:54:25.405830 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:54:25.405666    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0905e52a-beea-4a8d-b230-8b9a15d27082-tmp-dir\") pod \"scheduler-v06-threshold-migration-test-kserve-prefill-5fc5n8sgm\" (UID: \"0905e52a-beea-4a8d-b230-8b9a15d27082\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-prefill-5fc5n8sgm"
Jul 08 17:54:25.405830 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:54:25.405693    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0905e52a-beea-4a8d-b230-8b9a15d27082-tls-certs\") pod \"scheduler-v06-threshold-migration-test-kserve-prefill-5fc5n8sgm\" (UID: \"0905e52a-beea-4a8d-b230-8b9a15d27082\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-prefill-5fc5n8sgm"
Jul 08 17:54:25.405830 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:54:25.405714    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0905e52a-beea-4a8d-b230-8b9a15d27082-home\") pod \"scheduler-v06-threshold-migration-test-kserve-prefill-5fc5n8sgm\" (UID: \"0905e52a-beea-4a8d-b230-8b9a15d27082\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-prefill-5fc5n8sgm"
Jul 08 17:54:25.405830 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:54:25.405733    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qksg2\" (UniqueName: \"kubernetes.io/projected/0905e52a-beea-4a8d-b230-8b9a15d27082-kube-api-access-qksg2\") pod \"scheduler-v06-threshold-migration-test-kserve-prefill-5fc5n8sgm\" (UID: \"0905e52a-beea-4a8d-b230-8b9a15d27082\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-prefill-5fc5n8sgm"
Jul 08 17:54:25.405830 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:54:25.405769    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0905e52a-beea-4a8d-b230-8b9a15d27082-model-cache\") pod \"scheduler-v06-threshold-migration-test-kserve-prefill-5fc5n8sgm\" (UID: \"0905e52a-beea-4a8d-b230-8b9a15d27082\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-prefill-5fc5n8sgm"
Jul 08 17:54:25.507070 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:54:25.507030    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0905e52a-beea-4a8d-b230-8b9a15d27082-dshm\") pod \"scheduler-v06-threshold-migration-test-kserve-prefill-5fc5n8sgm\" (UID: \"0905e52a-beea-4a8d-b230-8b9a15d27082\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-prefill-5fc5n8sgm"
Jul 08 17:54:25.507070 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:54:25.507080    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0905e52a-beea-4a8d-b230-8b9a15d27082-tmp-dir\") pod \"scheduler-v06-threshold-migration-test-kserve-prefill-5fc5n8sgm\" (UID: \"0905e52a-beea-4a8d-b230-8b9a15d27082\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-prefill-5fc5n8sgm"
Jul 08 17:54:25.507380 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:54:25.507106    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0905e52a-beea-4a8d-b230-8b9a15d27082-tls-certs\") pod \"scheduler-v06-threshold-migration-test-kserve-prefill-5fc5n8sgm\" (UID: \"0905e52a-beea-4a8d-b230-8b9a15d27082\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-prefill-5fc5n8sgm"
Jul 08 17:54:25.507380 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:54:25.507133    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0905e52a-beea-4a8d-b230-8b9a15d27082-home\") pod \"scheduler-v06-threshold-migration-test-kserve-prefill-5fc5n8sgm\" (UID: \"0905e52a-beea-4a8d-b230-8b9a15d27082\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-prefill-5fc5n8sgm"
Jul 08 17:54:25.507380 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:54:25.507160    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qksg2\" (UniqueName: \"kubernetes.io/projected/0905e52a-beea-4a8d-b230-8b9a15d27082-kube-api-access-qksg2\") pod \"scheduler-v06-threshold-migration-test-kserve-prefill-5fc5n8sgm\" (UID: \"0905e52a-beea-4a8d-b230-8b9a15d27082\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-prefill-5fc5n8sgm"
Jul 08 17:54:25.507380 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:54:25.507206    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0905e52a-beea-4a8d-b230-8b9a15d27082-model-cache\") pod \"scheduler-v06-threshold-migration-test-kserve-prefill-5fc5n8sgm\" (UID: \"0905e52a-beea-4a8d-b230-8b9a15d27082\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-prefill-5fc5n8sgm"
Jul 08 17:54:25.507646 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:54:25.507609    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0905e52a-beea-4a8d-b230-8b9a15d27082-home\") pod \"scheduler-v06-threshold-migration-test-kserve-prefill-5fc5n8sgm\" (UID: \"0905e52a-beea-4a8d-b230-8b9a15d27082\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-prefill-5fc5n8sgm"
Jul 08 17:54:25.507646 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:54:25.507631    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0905e52a-beea-4a8d-b230-8b9a15d27082-model-cache\") pod \"scheduler-v06-threshold-migration-test-kserve-prefill-5fc5n8sgm\" (UID: \"0905e52a-beea-4a8d-b230-8b9a15d27082\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-prefill-5fc5n8sgm"
Jul 08 17:54:25.507757 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:54:25.507702    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0905e52a-beea-4a8d-b230-8b9a15d27082-tmp-dir\") pod \"scheduler-v06-threshold-migration-test-kserve-prefill-5fc5n8sgm\" (UID: \"0905e52a-beea-4a8d-b230-8b9a15d27082\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-prefill-5fc5n8sgm"
Jul 08 17:54:25.509539 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:54:25.509509    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0905e52a-beea-4a8d-b230-8b9a15d27082-dshm\") pod \"scheduler-v06-threshold-migration-test-kserve-prefill-5fc5n8sgm\" (UID: \"0905e52a-beea-4a8d-b230-8b9a15d27082\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-prefill-5fc5n8sgm"
Jul 08 17:54:25.509815 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:54:25.509795    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0905e52a-beea-4a8d-b230-8b9a15d27082-tls-certs\") pod \"scheduler-v06-threshold-migration-test-kserve-prefill-5fc5n8sgm\" (UID: \"0905e52a-beea-4a8d-b230-8b9a15d27082\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-prefill-5fc5n8sgm"
Jul 08 17:54:25.518482 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:54:25.518458    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qksg2\" (UniqueName: \"kubernetes.io/projected/0905e52a-beea-4a8d-b230-8b9a15d27082-kube-api-access-qksg2\") pod \"scheduler-v06-threshold-migration-test-kserve-prefill-5fc5n8sgm\" (UID: \"0905e52a-beea-4a8d-b230-8b9a15d27082\") " pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-prefill-5fc5n8sgm"
Jul 08 17:54:25.663846 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:54:25.663748    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-prefill-5fc5n8sgm"
Jul 08 17:54:25.803019 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:54:25.802984    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-prefill-5fc5n8sgm"]
Jul 08 17:54:25.805211 ip-10-0-142-172 kubenswrapper[2565]: W0708 17:54:25.805185    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0905e52a_beea_4a8d_b230_8b9a15d27082.slice/crio-9b110a4279af01e92dd73135d562c7f94f05a2f55c2ef99efa58b4568f89b743 WatchSource:0}: Error finding container 9b110a4279af01e92dd73135d562c7f94f05a2f55c2ef99efa58b4568f89b743: Status 404 returned error can't find the container with id 9b110a4279af01e92dd73135d562c7f94f05a2f55c2ef99efa58b4568f89b743
Jul 08 17:54:26.791952 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:54:26.791916    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-prefill-5fc5n8sgm" event={"ID":"0905e52a-beea-4a8d-b230-8b9a15d27082","Type":"ContainerStarted","Data":"506ca61c6810d49d15b148c8317ddab223029f4ef5bc9179185df8615034010f"}
Jul 08 17:54:26.792389 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:54:26.791974    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-prefill-5fc5n8sgm" event={"ID":"0905e52a-beea-4a8d-b230-8b9a15d27082","Type":"ContainerStarted","Data":"9b110a4279af01e92dd73135d562c7f94f05a2f55c2ef99efa58b4568f89b743"}
Jul 08 17:54:27.664155 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:54:27.664110    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-prefill-5fc5n8sgm"
Jul 08 17:54:35.663975 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:54:35.663864    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-prefill-5fc5n8sgm"
Jul 08 17:54:35.676796 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:54:35.676767    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-prefill-5fc5n8sgm"
Jul 08 17:54:35.699047 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:54:35.698989    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-prefill-5fc5n8sgm" podStartSLOduration=10.698970355 podStartE2EDuration="10.698970355s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:54:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:54:26.82117751 +0000 UTC m=+4800.921792081" watchObservedRunningTime="2026-07-08 17:54:35.698970355 +0000 UTC m=+4809.799584923"
Jul 08 17:54:35.838359 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:54:35.838330    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-prefill-5fc5n8sgm"
Jul 08 17:55:01.256086 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:55:01.256043    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-prefill-5fc5n8sgm"]
Jul 08 17:55:16.277239 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:55:16.277171    2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-prefill-5fc5n8sgm" podUID="0905e52a-beea-4a8d-b230-8b9a15d27082" containerName="main" containerID="cri-o://506ca61c6810d49d15b148c8317ddab223029f4ef5bc9179185df8615034010f" gracePeriod=45
Jul 08 17:55:16.520383 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:55:16.520356    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-prefill-5fc5n8sgm"
Jul 08 17:55:16.645919 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:55:16.645787    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0905e52a-beea-4a8d-b230-8b9a15d27082-home\") pod \"0905e52a-beea-4a8d-b230-8b9a15d27082\" (UID: \"0905e52a-beea-4a8d-b230-8b9a15d27082\") "
Jul 08 17:55:16.645919 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:55:16.645849    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0905e52a-beea-4a8d-b230-8b9a15d27082-model-cache\") pod \"0905e52a-beea-4a8d-b230-8b9a15d27082\" (UID: \"0905e52a-beea-4a8d-b230-8b9a15d27082\") "
Jul 08 17:55:16.645919 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:55:16.645883    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0905e52a-beea-4a8d-b230-8b9a15d27082-tls-certs\") pod \"0905e52a-beea-4a8d-b230-8b9a15d27082\" (UID: \"0905e52a-beea-4a8d-b230-8b9a15d27082\") "
Jul 08 17:55:16.645919 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:55:16.645905    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0905e52a-beea-4a8d-b230-8b9a15d27082-dshm\") pod \"0905e52a-beea-4a8d-b230-8b9a15d27082\" (UID: \"0905e52a-beea-4a8d-b230-8b9a15d27082\") "
Jul 08 17:55:16.646312 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:55:16.645945    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0905e52a-beea-4a8d-b230-8b9a15d27082-tmp-dir\") pod \"0905e52a-beea-4a8d-b230-8b9a15d27082\" (UID: \"0905e52a-beea-4a8d-b230-8b9a15d27082\") "
Jul 08 17:55:16.646312 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:55:16.645974    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qksg2\" (UniqueName: \"kubernetes.io/projected/0905e52a-beea-4a8d-b230-8b9a15d27082-kube-api-access-qksg2\") pod \"0905e52a-beea-4a8d-b230-8b9a15d27082\" (UID: \"0905e52a-beea-4a8d-b230-8b9a15d27082\") "
Jul 08 17:55:16.646312 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:55:16.646078    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0905e52a-beea-4a8d-b230-8b9a15d27082-home" (OuterVolumeSpecName: "home") pod "0905e52a-beea-4a8d-b230-8b9a15d27082" (UID: "0905e52a-beea-4a8d-b230-8b9a15d27082"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 17:55:16.646312 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:55:16.646190    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0905e52a-beea-4a8d-b230-8b9a15d27082-home\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 17:55:16.646312 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:55:16.646188    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0905e52a-beea-4a8d-b230-8b9a15d27082-model-cache" (OuterVolumeSpecName: "model-cache") pod "0905e52a-beea-4a8d-b230-8b9a15d27082" (UID: "0905e52a-beea-4a8d-b230-8b9a15d27082"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 17:55:16.646519 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:55:16.646326    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0905e52a-beea-4a8d-b230-8b9a15d27082-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0905e52a-beea-4a8d-b230-8b9a15d27082" (UID: "0905e52a-beea-4a8d-b230-8b9a15d27082"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 17:55:16.648349 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:55:16.648326    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0905e52a-beea-4a8d-b230-8b9a15d27082-dshm" (OuterVolumeSpecName: "dshm") pod "0905e52a-beea-4a8d-b230-8b9a15d27082" (UID: "0905e52a-beea-4a8d-b230-8b9a15d27082"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 17:55:16.648349 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:55:16.648339    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0905e52a-beea-4a8d-b230-8b9a15d27082-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0905e52a-beea-4a8d-b230-8b9a15d27082" (UID: "0905e52a-beea-4a8d-b230-8b9a15d27082"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 17:55:16.648480 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:55:16.648404    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0905e52a-beea-4a8d-b230-8b9a15d27082-kube-api-access-qksg2" (OuterVolumeSpecName: "kube-api-access-qksg2") pod "0905e52a-beea-4a8d-b230-8b9a15d27082" (UID: "0905e52a-beea-4a8d-b230-8b9a15d27082"). InnerVolumeSpecName "kube-api-access-qksg2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 17:55:16.746765 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:55:16.746721    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0905e52a-beea-4a8d-b230-8b9a15d27082-tmp-dir\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 17:55:16.746765 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:55:16.746755    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qksg2\" (UniqueName: \"kubernetes.io/projected/0905e52a-beea-4a8d-b230-8b9a15d27082-kube-api-access-qksg2\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 17:55:16.746765 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:55:16.746768    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0905e52a-beea-4a8d-b230-8b9a15d27082-model-cache\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 17:55:16.746765 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:55:16.746777    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0905e52a-beea-4a8d-b230-8b9a15d27082-tls-certs\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 17:55:16.747045 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:55:16.746784    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0905e52a-beea-4a8d-b230-8b9a15d27082-dshm\") on node \"ip-10-0-142-172.ec2.internal\" DevicePath \"\""
Jul 08 17:55:16.988376 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:55:16.988343    2565 generic.go:356] "Generic (PLEG): container finished" podID="0905e52a-beea-4a8d-b230-8b9a15d27082" containerID="506ca61c6810d49d15b148c8317ddab223029f4ef5bc9179185df8615034010f" exitCode=0
Jul 08 17:55:16.988575 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:55:16.988391    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-prefill-5fc5n8sgm"
Jul 08 17:55:16.988575 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:55:16.988425    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-prefill-5fc5n8sgm" event={"ID":"0905e52a-beea-4a8d-b230-8b9a15d27082","Type":"ContainerDied","Data":"506ca61c6810d49d15b148c8317ddab223029f4ef5bc9179185df8615034010f"}
Jul 08 17:55:16.988575 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:55:16.988484    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-prefill-5fc5n8sgm" event={"ID":"0905e52a-beea-4a8d-b230-8b9a15d27082","Type":"ContainerDied","Data":"9b110a4279af01e92dd73135d562c7f94f05a2f55c2ef99efa58b4568f89b743"}
Jul 08 17:55:16.988575 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:55:16.988507    2565 scope.go:117] "RemoveContainer" containerID="506ca61c6810d49d15b148c8317ddab223029f4ef5bc9179185df8615034010f"
Jul 08 17:55:16.997451 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:55:16.997422    2565 scope.go:117] "RemoveContainer" containerID="506ca61c6810d49d15b148c8317ddab223029f4ef5bc9179185df8615034010f"
Jul 08 17:55:16.997747 ip-10-0-142-172 kubenswrapper[2565]: E0708 17:55:16.997728    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"506ca61c6810d49d15b148c8317ddab223029f4ef5bc9179185df8615034010f\": container with ID starting with 506ca61c6810d49d15b148c8317ddab223029f4ef5bc9179185df8615034010f not found: ID does not exist" containerID="506ca61c6810d49d15b148c8317ddab223029f4ef5bc9179185df8615034010f"
Jul 08 17:55:16.997818 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:55:16.997755    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"506ca61c6810d49d15b148c8317ddab223029f4ef5bc9179185df8615034010f"} err="failed to get container status \"506ca61c6810d49d15b148c8317ddab223029f4ef5bc9179185df8615034010f\": rpc error: code = NotFound desc = could not find container \"506ca61c6810d49d15b148c8317ddab223029f4ef5bc9179185df8615034010f\": container with ID starting with 506ca61c6810d49d15b148c8317ddab223029f4ef5bc9179185df8615034010f not found: ID does not exist"
Jul 08 17:55:17.012778 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:55:17.012745    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-prefill-5fc5n8sgm"]
Jul 08 17:55:17.022267 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:55:17.022208    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-prefill-5fc5n8sgm"]
Jul 08 17:55:18.488432 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:55:18.488398    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0905e52a-beea-4a8d-b230-8b9a15d27082" path="/var/lib/kubelet/pods/0905e52a-beea-4a8d-b230-8b9a15d27082/volumes"
Jul 08 17:55:38.844798 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:55:38.844768    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46_6964cc10-b630-4b37-9005-73e5a9a47a08/main/0.log"
Jul 08 17:55:40.538212 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:55:40.538172    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46_6964cc10-b630-4b37-9005-73e5a9a47a08/main/0.log"
Jul 08 17:55:42.157196 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:55:42.157162    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46_6964cc10-b630-4b37-9005-73e5a9a47a08/main/0.log"
Jul 08 17:55:43.788597 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:55:43.788569    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46_6964cc10-b630-4b37-9005-73e5a9a47a08/main/0.log"
Jul 08 17:55:45.403642 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:55:45.403611    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46_6964cc10-b630-4b37-9005-73e5a9a47a08/main/0.log"
Jul 08 17:55:47.042551 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:55:47.042523    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46_6964cc10-b630-4b37-9005-73e5a9a47a08/main/0.log"
Jul 08 17:55:48.848396 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:55:48.848360    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46_6964cc10-b630-4b37-9005-73e5a9a47a08/main/0.log"
Jul 08 17:55:50.605690 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:55:50.605652    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46_6964cc10-b630-4b37-9005-73e5a9a47a08/main/0.log"
Jul 08 17:55:52.310321 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:55:52.310284    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46_6964cc10-b630-4b37-9005-73e5a9a47a08/main/0.log"
Jul 08 17:55:53.975464 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:55:53.975428    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46_6964cc10-b630-4b37-9005-73e5a9a47a08/main/0.log"
Jul 08 17:55:55.615975 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:55:55.615935    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46_6964cc10-b630-4b37-9005-73e5a9a47a08/main/0.log"
Jul 08 17:55:57.229963 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:55:57.229931    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46_6964cc10-b630-4b37-9005-73e5a9a47a08/main/0.log"
Jul 08 17:55:58.825379 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:55:58.825347    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46_6964cc10-b630-4b37-9005-73e5a9a47a08/main/0.log"
Jul 08 17:56:00.442023 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:00.441989    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46_6964cc10-b630-4b37-9005-73e5a9a47a08/main/0.log"
Jul 08 17:56:02.072188 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:02.072158    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46_6964cc10-b630-4b37-9005-73e5a9a47a08/main/0.log"
Jul 08 17:56:03.706084 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:03.706052    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-dqd46_6964cc10-b630-4b37-9005-73e5a9a47a08/main/0.log"
Jul 08 17:56:11.484751 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:11.484714    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-gxr6q_0df0bbdc-0eb7-45c7-a5c5-5bdd0cd08445/limitador/0.log"
Jul 08 17:56:11.507179 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:11.507149    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-kh4pg_95c1eafb-084e-4510-8912-44b1c63bc4cf/manager/0.log"
Jul 08 17:56:12.947289 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:12.947251    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-gxr6q_0df0bbdc-0eb7-45c7-a5c5-5bdd0cd08445/limitador/0.log"
Jul 08 17:56:12.968024 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:12.967990    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-kh4pg_95c1eafb-084e-4510-8912-44b1c63bc4cf/manager/0.log"
Jul 08 17:56:14.339091 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:14.339057    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-gxr6q_0df0bbdc-0eb7-45c7-a5c5-5bdd0cd08445/limitador/0.log"
Jul 08 17:56:14.401250 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:14.401206    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-kh4pg_95c1eafb-084e-4510-8912-44b1c63bc4cf/manager/0.log"
Jul 08 17:56:15.919673 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:15.919646    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-gxr6q_0df0bbdc-0eb7-45c7-a5c5-5bdd0cd08445/limitador/0.log"
Jul 08 17:56:15.973590 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:15.973558    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-kh4pg_95c1eafb-084e-4510-8912-44b1c63bc4cf/manager/0.log"
Jul 08 17:56:17.588186 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:17.588157    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-gxr6q_0df0bbdc-0eb7-45c7-a5c5-5bdd0cd08445/limitador/0.log"
Jul 08 17:56:17.612442 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:17.612419    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-kh4pg_95c1eafb-084e-4510-8912-44b1c63bc4cf/manager/0.log"
Jul 08 17:56:18.988434 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:18.988400    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-gxr6q_0df0bbdc-0eb7-45c7-a5c5-5bdd0cd08445/limitador/0.log"
Jul 08 17:56:19.020280 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:19.020250    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-kh4pg_95c1eafb-084e-4510-8912-44b1c63bc4cf/manager/0.log"
Jul 08 17:56:20.376892 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:20.376865    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-gxr6q_0df0bbdc-0eb7-45c7-a5c5-5bdd0cd08445/limitador/0.log"
Jul 08 17:56:20.396511 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:20.396463    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-kh4pg_95c1eafb-084e-4510-8912-44b1c63bc4cf/manager/0.log"
Jul 08 17:56:21.739945 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:21.739916    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-gxr6q_0df0bbdc-0eb7-45c7-a5c5-5bdd0cd08445/limitador/0.log"
Jul 08 17:56:21.761704 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:21.761667    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-kh4pg_95c1eafb-084e-4510-8912-44b1c63bc4cf/manager/0.log"
Jul 08 17:56:23.134644 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:23.134610    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-gxr6q_0df0bbdc-0eb7-45c7-a5c5-5bdd0cd08445/limitador/0.log"
Jul 08 17:56:23.153208 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:23.153176    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-kh4pg_95c1eafb-084e-4510-8912-44b1c63bc4cf/manager/0.log"
Jul 08 17:56:24.482399 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:24.482370    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-gxr6q_0df0bbdc-0eb7-45c7-a5c5-5bdd0cd08445/limitador/0.log"
Jul 08 17:56:24.501597 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:24.501561    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-kh4pg_95c1eafb-084e-4510-8912-44b1c63bc4cf/manager/0.log"
Jul 08 17:56:25.832461 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:25.832429    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-gxr6q_0df0bbdc-0eb7-45c7-a5c5-5bdd0cd08445/limitador/0.log"
Jul 08 17:56:25.852463 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:25.852429    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-kh4pg_95c1eafb-084e-4510-8912-44b1c63bc4cf/manager/0.log"
Jul 08 17:56:31.398019 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:31.397980    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6gvmb_4606c816-49c0-450f-a21f-7594bf0aaa89/global-pull-secret-syncer/0.log"
Jul 08 17:56:31.633610 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:31.633572    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-plbcq_462ebd3a-f548-4af5-8f83-20d342dc9441/konnectivity-agent/0.log"
Jul 08 17:56:31.719957 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:31.719918    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-172.ec2.internal_deb4e2f36b206a55798df1285a775313/haproxy/0.log"
Jul 08 17:56:35.825736 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:35.825697    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-69574b596d-gxr6q_0df0bbdc-0eb7-45c7-a5c5-5bdd0cd08445/limitador/0.log"
Jul 08 17:56:35.877003 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:35.876973    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6f9f468797-kh4pg_95c1eafb-084e-4510-8912-44b1c63bc4cf/manager/0.log"
Jul 08 17:56:37.922759 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:37.922665    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-85696fc556-mtdtp_05cab2a7-b107-4f76-98ae-0ddba230eb64/metrics-server/0.log"
Jul 08 17:56:37.995329 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:37.995298    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8fbnv_a16873bb-b3ad-4609-9007-0b2745e7bb83/node-exporter/0.log"
Jul 08 17:56:38.023698 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:38.023662    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8fbnv_a16873bb-b3ad-4609-9007-0b2745e7bb83/kube-rbac-proxy/0.log"
Jul 08 17:56:38.052146 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:38.052116    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8fbnv_a16873bb-b3ad-4609-9007-0b2745e7bb83/init-textfile/0.log"
Jul 08 17:56:38.444583 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:38.444552    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_302e3ff9-cc52-4edc-bf97-f9d108f4173a/prometheus/0.log"
Jul 08 17:56:38.467876 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:38.467845    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_302e3ff9-cc52-4edc-bf97-f9d108f4173a/config-reloader/0.log"
Jul 08 17:56:38.500280 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:38.500248    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_302e3ff9-cc52-4edc-bf97-f9d108f4173a/thanos-sidecar/0.log"
Jul 08 17:56:38.534602 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:38.534569    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_302e3ff9-cc52-4edc-bf97-f9d108f4173a/kube-rbac-proxy-web/0.log"
Jul 08 17:56:38.584728 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:38.584704    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_302e3ff9-cc52-4edc-bf97-f9d108f4173a/kube-rbac-proxy/0.log"
Jul 08 17:56:38.634183 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:38.634147    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_302e3ff9-cc52-4edc-bf97-f9d108f4173a/kube-rbac-proxy-thanos/0.log"
Jul 08 17:56:38.670684 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:38.670595    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_302e3ff9-cc52-4edc-bf97-f9d108f4173a/init-config-reloader/0.log"
Jul 08 17:56:42.821064 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:42.821030    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wf794/perf-node-gather-daemonset-xrpxm"]
Jul 08 17:56:42.821488 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:42.821348    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0905e52a-beea-4a8d-b230-8b9a15d27082" containerName="main"
Jul 08 17:56:42.821488 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:42.821359    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0905e52a-beea-4a8d-b230-8b9a15d27082" containerName="main"
Jul 08 17:56:42.821488 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:42.821410    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0905e52a-beea-4a8d-b230-8b9a15d27082" containerName="main"
Jul 08 17:56:42.824384 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:42.824365    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wf794/perf-node-gather-daemonset-xrpxm"
Jul 08 17:56:42.827124 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:42.827099    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wf794\"/\"openshift-service-ca.crt\""
Jul 08 17:56:42.827275 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:42.827099    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wf794\"/\"default-dockercfg-97555\""
Jul 08 17:56:42.827910 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:42.827892    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wf794\"/\"kube-root-ca.crt\""
Jul 08 17:56:42.833536 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:42.833513    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wf794/perf-node-gather-daemonset-xrpxm"]
Jul 08 17:56:42.900876 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:42.900832    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2bf1c342-0999-49c2-9a08-76b55d397454-sys\") pod \"perf-node-gather-daemonset-xrpxm\" (UID: \"2bf1c342-0999-49c2-9a08-76b55d397454\") " pod="openshift-must-gather-wf794/perf-node-gather-daemonset-xrpxm"
Jul 08 17:56:42.900876 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:42.900886    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2bf1c342-0999-49c2-9a08-76b55d397454-lib-modules\") pod \"perf-node-gather-daemonset-xrpxm\" (UID: \"2bf1c342-0999-49c2-9a08-76b55d397454\") " pod="openshift-must-gather-wf794/perf-node-gather-daemonset-xrpxm"
Jul 08 17:56:42.901137 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:42.900912    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6n2m\" (UniqueName: \"kubernetes.io/projected/2bf1c342-0999-49c2-9a08-76b55d397454-kube-api-access-c6n2m\") pod \"perf-node-gather-daemonset-xrpxm\" (UID: \"2bf1c342-0999-49c2-9a08-76b55d397454\") " pod="openshift-must-gather-wf794/perf-node-gather-daemonset-xrpxm"
Jul 08 17:56:42.901137 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:42.900950    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2bf1c342-0999-49c2-9a08-76b55d397454-podres\") pod \"perf-node-gather-daemonset-xrpxm\" (UID: \"2bf1c342-0999-49c2-9a08-76b55d397454\") " pod="openshift-must-gather-wf794/perf-node-gather-daemonset-xrpxm"
Jul 08 17:56:42.901137 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:42.901044    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2bf1c342-0999-49c2-9a08-76b55d397454-proc\") pod \"perf-node-gather-daemonset-xrpxm\" (UID: \"2bf1c342-0999-49c2-9a08-76b55d397454\") " pod="openshift-must-gather-wf794/perf-node-gather-daemonset-xrpxm"
Jul 08 17:56:43.002141 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:43.002085    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2bf1c342-0999-49c2-9a08-76b55d397454-podres\") pod \"perf-node-gather-daemonset-xrpxm\" (UID: \"2bf1c342-0999-49c2-9a08-76b55d397454\") " pod="openshift-must-gather-wf794/perf-node-gather-daemonset-xrpxm"
Jul 08 17:56:43.002141 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:43.002155    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2bf1c342-0999-49c2-9a08-76b55d397454-proc\") pod \"perf-node-gather-daemonset-xrpxm\" (UID: \"2bf1c342-0999-49c2-9a08-76b55d397454\") " pod="openshift-must-gather-wf794/perf-node-gather-daemonset-xrpxm"
Jul 08 17:56:43.002446 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:43.002198    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2bf1c342-0999-49c2-9a08-76b55d397454-sys\") pod \"perf-node-gather-daemonset-xrpxm\" (UID: \"2bf1c342-0999-49c2-9a08-76b55d397454\") " pod="openshift-must-gather-wf794/perf-node-gather-daemonset-xrpxm"
Jul 08 17:56:43.002446 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:43.002243    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2bf1c342-0999-49c2-9a08-76b55d397454-lib-modules\") pod \"perf-node-gather-daemonset-xrpxm\" (UID: \"2bf1c342-0999-49c2-9a08-76b55d397454\") " pod="openshift-must-gather-wf794/perf-node-gather-daemonset-xrpxm"
Jul 08 17:56:43.002446 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:43.002268    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6n2m\" (UniqueName: \"kubernetes.io/projected/2bf1c342-0999-49c2-9a08-76b55d397454-kube-api-access-c6n2m\") pod \"perf-node-gather-daemonset-xrpxm\" (UID: \"2bf1c342-0999-49c2-9a08-76b55d397454\") " pod="openshift-must-gather-wf794/perf-node-gather-daemonset-xrpxm"
Jul 08 17:56:43.002446 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:43.002290    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2bf1c342-0999-49c2-9a08-76b55d397454-podres\") pod \"perf-node-gather-daemonset-xrpxm\" (UID: \"2bf1c342-0999-49c2-9a08-76b55d397454\") " pod="openshift-must-gather-wf794/perf-node-gather-daemonset-xrpxm"
Jul 08 17:56:43.002446 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:43.002303    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2bf1c342-0999-49c2-9a08-76b55d397454-sys\") pod \"perf-node-gather-daemonset-xrpxm\" (UID: \"2bf1c342-0999-49c2-9a08-76b55d397454\") " pod="openshift-must-gather-wf794/perf-node-gather-daemonset-xrpxm"
Jul 08 17:56:43.002446 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:43.002292    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2bf1c342-0999-49c2-9a08-76b55d397454-proc\") pod \"perf-node-gather-daemonset-xrpxm\" (UID: \"2bf1c342-0999-49c2-9a08-76b55d397454\") " pod="openshift-must-gather-wf794/perf-node-gather-daemonset-xrpxm"
Jul 08 17:56:43.002446 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:43.002391    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2bf1c342-0999-49c2-9a08-76b55d397454-lib-modules\") pod \"perf-node-gather-daemonset-xrpxm\" (UID: \"2bf1c342-0999-49c2-9a08-76b55d397454\") " pod="openshift-must-gather-wf794/perf-node-gather-daemonset-xrpxm"
Jul 08 17:56:43.011799 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:43.011771    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6n2m\" (UniqueName: \"kubernetes.io/projected/2bf1c342-0999-49c2-9a08-76b55d397454-kube-api-access-c6n2m\") pod \"perf-node-gather-daemonset-xrpxm\" (UID: \"2bf1c342-0999-49c2-9a08-76b55d397454\") " pod="openshift-must-gather-wf794/perf-node-gather-daemonset-xrpxm"
Jul 08 17:56:43.135847 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:43.135746    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wf794/perf-node-gather-daemonset-xrpxm"
Jul 08 17:56:43.261413 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:43.261381    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-n8m9r_482c6fe9-2188-43e0-ba22-d1589eda4e39/dns/0.log"
Jul 08 17:56:43.273244 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:43.273195    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wf794/perf-node-gather-daemonset-xrpxm"]
Jul 08 17:56:43.276858 ip-10-0-142-172 kubenswrapper[2565]: W0708 17:56:43.276829    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2bf1c342_0999_49c2_9a08_76b55d397454.slice/crio-853f25b43f25115053d82e6e15b21fd05da0daf22a9d2acaca04540e10141397 WatchSource:0}: Error finding container 853f25b43f25115053d82e6e15b21fd05da0daf22a9d2acaca04540e10141397: Status 404 returned error can't find the container with id 853f25b43f25115053d82e6e15b21fd05da0daf22a9d2acaca04540e10141397
Jul 08 17:56:43.293923 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:43.293894    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-n8m9r_482c6fe9-2188-43e0-ba22-d1589eda4e39/kube-rbac-proxy/0.log"
Jul 08 17:56:43.333060 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:43.333026    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wf794/perf-node-gather-daemonset-xrpxm" event={"ID":"2bf1c342-0999-49c2-9a08-76b55d397454","Type":"ContainerStarted","Data":"853f25b43f25115053d82e6e15b21fd05da0daf22a9d2acaca04540e10141397"}
Jul 08 17:56:43.431011 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:43.430982    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jzrk9_decd5d3d-7bca-4b32-bf8f-1d060e617e56/dns-node-resolver/0.log"
Jul 08 17:56:44.001383 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:44.001352    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-57d76c5ff7-cp4cq_dfb432e6-c846-433e-a711-d12445351d36/registry/0.log"
Jul 08 17:56:44.103966 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:44.103932    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-t8k5z_455653e2-cc9e-4e39-a2b6-013b392b9d47/node-ca/0.log"
Jul 08 17:56:44.338176 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:44.338088    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wf794/perf-node-gather-daemonset-xrpxm" event={"ID":"2bf1c342-0999-49c2-9a08-76b55d397454","Type":"ContainerStarted","Data":"54d1880cfcfa406e68e9192772d5cb50a7bb3d74eab5a0a582f745138b5f9640"}
Jul 08 17:56:44.338176 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:44.338164    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wf794/perf-node-gather-daemonset-xrpxm"
Jul 08 17:56:44.357641 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:44.357585    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wf794/perf-node-gather-daemonset-xrpxm" podStartSLOduration=2.357569076 podStartE2EDuration="2.357569076s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:56:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:56:44.356544369 +0000 UTC m=+4938.457158939" watchObservedRunningTime="2026-07-08 17:56:44.357569076 +0000 UTC m=+4938.458183645"
Jul 08 17:56:46.209784 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:46.209747    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bcc5n_f1c0f82a-fa63-47b7-a3fc-5443f44a07ac/serve-healthcheck-canary/0.log"
Jul 08 17:56:46.851497 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:46.851465    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nk8jb_a1f9ebe4-e7cd-4413-a587-0c86effbd290/kube-rbac-proxy/0.log"
Jul 08 17:56:46.875996 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:46.875973    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nk8jb_a1f9ebe4-e7cd-4413-a587-0c86effbd290/exporter/0.log"
Jul 08 17:56:46.919489 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:46.919447    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nk8jb_a1f9ebe4-e7cd-4413-a587-0c86effbd290/extractor/0.log"
Jul 08 17:56:49.873302 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:49.873274    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6744679755-75qfd_4d68d98a-812d-45bf-8074-9d0a941779c4/manager/0.log"
Jul 08 17:56:49.927870 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:49.927841    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-58g4c_7ee380a3-c2e0-410b-9c9c-07eb5172f694/openshift-lws-operator/0.log"
Jul 08 17:56:50.353029 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:50.352997    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wf794/perf-node-gather-daemonset-xrpxm"
Jul 08 17:56:57.132282 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:57.132246    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-fvv6h_c7a8c765-396a-4ee6-b13c-bdd8634bcfb6/migrator/0.log"
Jul 08 17:56:57.162695 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:57.162668    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-fvv6h_c7a8c765-396a-4ee6-b13c-bdd8634bcfb6/graceful-termination/0.log"
Jul 08 17:56:58.630933 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:58.630901    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-8jxnm_7fcc3970-f944-4fcf-b05e-f11d98a8c762/kube-multus/0.log"
Jul 08 17:56:58.691718 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:58.691688    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6xpv2_682207f0-d9fc-46ac-a563-e0eb62eb3019/kube-multus-additional-cni-plugins/0.log"
Jul 08 17:56:58.718955 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:58.718923    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6xpv2_682207f0-d9fc-46ac-a563-e0eb62eb3019/egress-router-binary-copy/0.log"
Jul 08 17:56:58.742084 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:58.742052    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6xpv2_682207f0-d9fc-46ac-a563-e0eb62eb3019/cni-plugins/0.log"
Jul 08 17:56:58.767941 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:58.767914    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6xpv2_682207f0-d9fc-46ac-a563-e0eb62eb3019/bond-cni-plugin/0.log"
Jul 08 17:56:58.792941 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:58.792909    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6xpv2_682207f0-d9fc-46ac-a563-e0eb62eb3019/routeoverride-cni/0.log"
Jul 08 17:56:58.817516 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:58.817492    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6xpv2_682207f0-d9fc-46ac-a563-e0eb62eb3019/whereabouts-cni-bincopy/0.log"
Jul 08 17:56:58.841423 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:58.841394    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6xpv2_682207f0-d9fc-46ac-a563-e0eb62eb3019/whereabouts-cni/0.log"
Jul 08 17:56:59.419732 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:59.419680    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-psbhw_8eb4f440-8261-4651-a10a-1ccd5cb14f60/network-metrics-daemon/0.log"
Jul 08 17:56:59.441030 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:56:59.441004    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-psbhw_8eb4f440-8261-4651-a10a-1ccd5cb14f60/kube-rbac-proxy/0.log"
Jul 08 17:57:00.566717 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:57:00.566683    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jxfhc_4c07e006-6cb2-4bcf-9fba-751d0c4630b3/ovn-controller/0.log"
Jul 08 17:57:00.585478 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:57:00.585451    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jxfhc_4c07e006-6cb2-4bcf-9fba-751d0c4630b3/ovn-acl-logging/0.log"
Jul 08 17:57:00.611000 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:57:00.610971    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jxfhc_4c07e006-6cb2-4bcf-9fba-751d0c4630b3/kube-rbac-proxy-node/0.log"
Jul 08 17:57:00.633445 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:57:00.633416    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jxfhc_4c07e006-6cb2-4bcf-9fba-751d0c4630b3/kube-rbac-proxy-ovn-metrics/0.log"
Jul 08 17:57:00.661451 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:57:00.661419    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jxfhc_4c07e006-6cb2-4bcf-9fba-751d0c4630b3/northd/0.log"
Jul 08 17:57:00.694399 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:57:00.694367    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jxfhc_4c07e006-6cb2-4bcf-9fba-751d0c4630b3/nbdb/0.log"
Jul 08 17:57:00.773282 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:57:00.773255    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jxfhc_4c07e006-6cb2-4bcf-9fba-751d0c4630b3/sbdb/0.log"
Jul 08 17:57:00.893572 ip-10-0-142-172 kubenswrapper[2565]: I0708 17:57:00.893483    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jxfhc_4c07e006-6cb2-4bcf-9fba-751d0c4630b3/ovnkube-controller/0.log"