Sep 17 21:57:47.834606 ip-10-0-136-66 systemd[1]: Starting Kubernetes Kubelet...
Sep 17 21:57:48.258755 ip-10-0-136-66 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 21:57:48.258755 ip-10-0-136-66 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 17 21:57:48.258755 ip-10-0-136-66 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 21:57:48.258755 ip-10-0-136-66 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 17 21:57:48.258755 ip-10-0-136-66 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 21:57:48.259432 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.258833    2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 17 21:57:48.266330 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266314    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 21:57:48.266330 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266329    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 21:57:48.266401 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266333    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 21:57:48.266401 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266336    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 21:57:48.266401 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266341    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 21:57:48.266401 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266344    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 21:57:48.266401 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266347    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 21:57:48.266401 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266359    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 21:57:48.266401 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266362    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 21:57:48.266401 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266365    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 21:57:48.266401 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266367    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 21:57:48.266401 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266370    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 21:57:48.266401 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266373    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 21:57:48.266401 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266376    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 21:57:48.266401 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266379    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 21:57:48.266401 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266381    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 21:57:48.266401 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266384    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 21:57:48.266401 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266387    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 21:57:48.266401 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266390    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 21:57:48.266401 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266392    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 21:57:48.266401 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266395    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 21:57:48.266401 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266397    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 21:57:48.266879 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266400    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 21:57:48.266879 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266403    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 21:57:48.266879 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266406    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 21:57:48.266879 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266410    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 21:57:48.266879 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266412    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 21:57:48.266879 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266415    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 21:57:48.266879 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266418    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 21:57:48.266879 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266421    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 21:57:48.266879 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266424    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 21:57:48.266879 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266426    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 21:57:48.266879 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266429    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 21:57:48.266879 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266433    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 21:57:48.266879 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266438    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 21:57:48.266879 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266442    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 21:57:48.266879 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266446    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 21:57:48.266879 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266449    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 21:57:48.266879 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266453    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 21:57:48.266879 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266457    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 21:57:48.266879 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266460    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 21:57:48.267341 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266463    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 21:57:48.267341 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266466    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 21:57:48.267341 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266469    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 21:57:48.267341 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266472    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 21:57:48.267341 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266474    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 21:57:48.267341 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266477    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 21:57:48.267341 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266480    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 21:57:48.267341 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266483    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 21:57:48.267341 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266487    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 21:57:48.267341 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266490    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 21:57:48.267341 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266493    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 21:57:48.267341 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266495    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 21:57:48.267341 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266498    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 21:57:48.267341 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266501    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 21:57:48.267341 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266504    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 21:57:48.267341 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266507    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 21:57:48.267341 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266510    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 21:57:48.267341 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266512    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 21:57:48.267341 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266515    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 21:57:48.267820 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266518    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 21:57:48.267820 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266521    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 21:57:48.267820 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266524    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 21:57:48.267820 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266526    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 21:57:48.267820 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266528    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 21:57:48.267820 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266531    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 21:57:48.267820 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266534    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 21:57:48.267820 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266536    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 21:57:48.267820 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266539    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 21:57:48.267820 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266541    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 21:57:48.267820 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266544    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 21:57:48.267820 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266546    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 21:57:48.267820 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266549    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 21:57:48.267820 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266551    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 21:57:48.267820 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266554    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 21:57:48.267820 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266557    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 21:57:48.267820 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266559    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 21:57:48.267820 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266562    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 21:57:48.267820 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266564    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 21:57:48.267820 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266567    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 21:57:48.268294 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266569    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 21:57:48.268294 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266572    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 21:57:48.268294 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266575    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 21:57:48.268294 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266577    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 21:57:48.268294 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266580    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 21:57:48.268294 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266582    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 21:57:48.268294 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266585    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 21:57:48.268294 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266589    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 21:57:48.268294 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266592    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 21:57:48.268294 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266595    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 21:57:48.268294 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266597    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 21:57:48.268294 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266600    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 21:57:48.268294 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266602    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 21:57:48.268294 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266605    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 21:57:48.268294 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266607    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 21:57:48.268294 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266610    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 21:57:48.268294 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266612    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 21:57:48.268294 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266615    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 21:57:48.268294 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.266617    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 21:57:48.268294 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267271    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 21:57:48.268824 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267277    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 21:57:48.268824 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267283    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 21:57:48.268824 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267287    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 21:57:48.268824 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267290    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 21:57:48.268824 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267293    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 21:57:48.268824 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267296    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 21:57:48.268824 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267299    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 21:57:48.268824 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267301    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 21:57:48.268824 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267305    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 21:57:48.268824 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267308    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 21:57:48.268824 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267311    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 21:57:48.268824 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267314    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 21:57:48.268824 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267316    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 21:57:48.268824 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267319    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 21:57:48.268824 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267322    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 21:57:48.268824 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267324    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 21:57:48.268824 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267327    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 21:57:48.268824 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267330    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 21:57:48.268824 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267333    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 21:57:48.269312 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267336    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 21:57:48.269312 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267339    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 21:57:48.269312 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267341    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 21:57:48.269312 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267344    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 21:57:48.269312 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267366    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 21:57:48.269312 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267372    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 21:57:48.269312 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267375    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 21:57:48.269312 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267378    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 21:57:48.269312 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267381    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 21:57:48.269312 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267384    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 21:57:48.269312 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267386    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 21:57:48.269312 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267389    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 21:57:48.269312 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267392    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 21:57:48.269312 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267395    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 21:57:48.269312 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267397    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 21:57:48.269312 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267400    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 21:57:48.269312 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267403    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 21:57:48.269312 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267405    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 21:57:48.269312 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267408    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 21:57:48.269312 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267411    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 21:57:48.269832 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267414    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 21:57:48.269832 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267417    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 21:57:48.269832 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267421    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 21:57:48.269832 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267424    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 21:57:48.269832 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267427    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 21:57:48.269832 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267429    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 21:57:48.269832 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267432    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 21:57:48.269832 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267434    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 21:57:48.269832 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267437    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 21:57:48.269832 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267440    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 21:57:48.269832 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267442    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 21:57:48.269832 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267447    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 21:57:48.269832 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267450    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 21:57:48.269832 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267453    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 21:57:48.269832 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267456    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 21:57:48.269832 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267459    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 21:57:48.269832 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267462    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 21:57:48.269832 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267465    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 21:57:48.269832 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267468    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 21:57:48.269832 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267470    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 21:57:48.270327 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267473    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 21:57:48.270327 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267476    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 21:57:48.270327 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267478    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 21:57:48.270327 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267481    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 21:57:48.270327 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267483    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 21:57:48.270327 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267486    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 21:57:48.270327 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267489    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 21:57:48.270327 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267491    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 21:57:48.270327 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267493    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 21:57:48.270327 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267496    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 21:57:48.270327 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267499    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 21:57:48.270327 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267504    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 21:57:48.270327 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267507    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 21:57:48.270327 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267510    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 21:57:48.270327 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267513    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 21:57:48.270327 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267516    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 21:57:48.270327 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267519    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 21:57:48.270327 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267521    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 21:57:48.270327 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267524    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 21:57:48.270812 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267526    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 21:57:48.270812 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267529    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 21:57:48.270812 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267531    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 21:57:48.270812 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267534    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 21:57:48.270812 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267537    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 21:57:48.270812 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267540    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 21:57:48.270812 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267542    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 21:57:48.270812 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267545    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 21:57:48.270812 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267550    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 21:57:48.270812 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267552    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 21:57:48.270812 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267555    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 21:57:48.270812 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267558    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 21:57:48.270812 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267560    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 21:57:48.270812 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267563    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 21:57:48.270812 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267566    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 21:57:48.270812 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267569    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 21:57:48.270812 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267572    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 21:57:48.270812 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267574    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 21:57:48.270812 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267577    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 21:57:48.270812 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267579    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 21:57:48.271304 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.267992    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 21:57:48.271304 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268004    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 21:57:48.271304 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268008    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 21:57:48.271304 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268012    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 21:57:48.271304 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268014    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 21:57:48.271304 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268018    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 21:57:48.271304 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268020    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 21:57:48.271304 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268023    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 21:57:48.271304 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268025    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 21:57:48.271304 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268028    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 21:57:48.271304 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268031    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 21:57:48.271304 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268034    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 21:57:48.271304 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268036    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 21:57:48.271304 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268039    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 21:57:48.271304 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268042    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 21:57:48.271304 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268044    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 21:57:48.271304 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268048    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 21:57:48.271304 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268051    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 21:57:48.271304 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268053    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 21:57:48.271304 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268056    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 21:57:48.271795 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268059    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 21:57:48.271795 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268062    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 21:57:48.271795 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268064    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 21:57:48.271795 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268067    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 21:57:48.271795 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268069    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 21:57:48.271795 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268072    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 21:57:48.271795 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268074    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 21:57:48.271795 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268077    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 21:57:48.271795 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268080    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 21:57:48.271795 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268082    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 21:57:48.271795 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268085    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 21:57:48.271795 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268087    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 21:57:48.271795 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268090    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 21:57:48.271795 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268094    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 21:57:48.271795 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268096    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 21:57:48.271795 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268100    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 21:57:48.271795 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268102    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 21:57:48.271795 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268105    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 21:57:48.271795 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268107    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 21:57:48.271795 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268110    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 21:57:48.272286 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268113    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 21:57:48.272286 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268116    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 21:57:48.272286 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268118    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 21:57:48.272286 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268121    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 21:57:48.272286 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268123    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 21:57:48.272286 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268126    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 21:57:48.272286 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268129    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 21:57:48.272286 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268131    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 21:57:48.272286 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268134    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 21:57:48.272286 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268136    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 21:57:48.272286 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268139    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 21:57:48.272286 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268141    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 21:57:48.272286 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268144    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 21:57:48.272286 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268146    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 21:57:48.272286 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268149    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 21:57:48.272286 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268151    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 21:57:48.272286 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268154    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 21:57:48.272286 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268156    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 21:57:48.272286 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268159    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 21:57:48.272286 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268161    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 21:57:48.272794 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268164    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 21:57:48.272794 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268167    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 21:57:48.272794 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268169    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 21:57:48.272794 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268172    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 21:57:48.272794 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268175    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 21:57:48.272794 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268180    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 21:57:48.272794 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268185    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 21:57:48.272794 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268188    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 21:57:48.272794 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268191    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 21:57:48.272794 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268194    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 21:57:48.272794 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268197    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 21:57:48.272794 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268199    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 21:57:48.272794 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268202    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 21:57:48.272794 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268205    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 21:57:48.272794 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268207    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 21:57:48.272794 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268210    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 21:57:48.272794 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268212    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 21:57:48.272794 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268215    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 21:57:48.272794 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268219    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 21:57:48.273283 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268224    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 21:57:48.273283 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268227    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 21:57:48.273283 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268229    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 21:57:48.273283 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268233    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 21:57:48.273283 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268237    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 21:57:48.273283 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268240    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 21:57:48.273283 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268242    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 21:57:48.273283 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268245    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 21:57:48.273283 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268248    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 21:57:48.273283 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268251    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 21:57:48.273283 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268254    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 21:57:48.273283 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268257    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 21:57:48.273283 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268260    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 21:57:48.273283 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268263    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 21:57:48.273283 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268266    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 21:57:48.273283 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268269    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 21:57:48.273283 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268271    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 21:57:48.273283 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268274    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 21:57:48.273283 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268280    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 21:57:48.273283 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.268283    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 21:57:48.273825 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268365    2560 flags.go:64] FLAG: --address="0.0.0.0"
Sep 17 21:57:48.273825 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268402    2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 17 21:57:48.273825 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268409    2560 flags.go:64] FLAG: --anonymous-auth="true"
Sep 17 21:57:48.273825 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268413    2560 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 17 21:57:48.273825 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268418    2560 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 17 21:57:48.273825 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268421    2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 17 21:57:48.273825 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268425    2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 17 21:57:48.273825 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268429    2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 17 21:57:48.273825 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268433    2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 17 21:57:48.273825 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268436    2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 17 21:57:48.273825 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268439    2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 17 21:57:48.273825 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268442    2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 17 21:57:48.273825 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268445    2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 17 21:57:48.273825 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268448    2560 flags.go:64] FLAG: --cgroup-root=""
Sep 17 21:57:48.273825 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268451    2560 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 17 21:57:48.273825 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268454    2560 flags.go:64] FLAG: --client-ca-file=""
Sep 17 21:57:48.273825 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268457    2560 flags.go:64] FLAG: --cloud-provider="external"
Sep 17 21:57:48.273825 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268460    2560 flags.go:64] FLAG: --cluster-dns="[]"
Sep 17 21:57:48.273825 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268464    2560 flags.go:64] FLAG: --cluster-domain=""
Sep 17 21:57:48.273825 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268467    2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 17 21:57:48.273825 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268470    2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 17 21:57:48.273825 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268473    2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 17 21:57:48.273825 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268477    2560 flags.go:64] FLAG: --container-log-max-files="5"
Sep 17 21:57:48.273825 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268480    2560 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 17 21:57:48.274412 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268484    2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 17 21:57:48.274412 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268487    2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 17 21:57:48.274412 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268490    2560 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 17 21:57:48.274412 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268493    2560 flags.go:64] FLAG: --contention-profiling="false"
Sep 17 21:57:48.274412 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268514    2560 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 17 21:57:48.274412 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268518    2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 17 21:57:48.274412 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268524    2560 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 17 21:57:48.274412 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268527    2560 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 17 21:57:48.274412 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268532    2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 17 21:57:48.274412 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268535    2560 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 17 21:57:48.274412 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268538    2560 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 17 21:57:48.274412 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268541    2560 flags.go:64] FLAG: --enable-load-reader="false"
Sep 17 21:57:48.274412 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268544    2560 flags.go:64] FLAG: --enable-server="true"
Sep 17 21:57:48.274412 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268547    2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 17 21:57:48.274412 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268552    2560 flags.go:64] FLAG: --event-burst="100"
Sep 17 21:57:48.274412 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268555    2560 flags.go:64] FLAG: --event-qps="50"
Sep 17 21:57:48.274412 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268558    2560 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 17 21:57:48.274412 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268561    2560 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 17 21:57:48.274412 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268564    2560 flags.go:64] FLAG: --eviction-hard=""
Sep 17 21:57:48.274412 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268568    2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 17 21:57:48.274412 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268570    2560 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 17 21:57:48.274412 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268574    2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 17 21:57:48.274412 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268577    2560 flags.go:64] FLAG: --eviction-soft=""
Sep 17 21:57:48.274412 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268580    2560 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 17 21:57:48.274412 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268583    2560 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 17 21:57:48.275034 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268586    2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 17 21:57:48.275034 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268589    2560 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 17 21:57:48.275034 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268592    2560 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 17 21:57:48.275034 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268595    2560 flags.go:64] FLAG: --fail-swap-on="true"
Sep 17 21:57:48.275034 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268598    2560 flags.go:64] FLAG: --feature-gates=""
Sep 17 21:57:48.275034 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268602    2560 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 17 21:57:48.275034 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268605    2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 17 21:57:48.275034 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268608    2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 17 21:57:48.275034 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268611    2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 17 21:57:48.275034 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268614    2560 flags.go:64] FLAG: --healthz-port="10248"
Sep 17 21:57:48.275034 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268617    2560 flags.go:64] FLAG: --help="false"
Sep 17 21:57:48.275034 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268620    2560 flags.go:64] FLAG: --hostname-override="ip-10-0-136-66.ec2.internal"
Sep 17 21:57:48.275034 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268623    2560 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 17 21:57:48.275034 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268629    2560 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 17 21:57:48.275034 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268632    2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 17 21:57:48.275034 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268635    2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 17 21:57:48.275034 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268639    2560 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 17 21:57:48.275034 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268642    2560 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 17 21:57:48.275034 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268645    2560 flags.go:64] FLAG: --image-service-endpoint=""
Sep 17 21:57:48.275034 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268648    2560 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 17 21:57:48.275034 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268651    2560 flags.go:64] FLAG: --kube-api-burst="100"
Sep 17 21:57:48.275034 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268654    2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 17 21:57:48.275034 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268657    2560 flags.go:64] FLAG: --kube-api-qps="50"
Sep 17 21:57:48.275034 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268660    2560 flags.go:64] FLAG: --kube-reserved=""
Sep 17 21:57:48.275673 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268663    2560 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 17 21:57:48.275673 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268666    2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 17 21:57:48.275673 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268669    2560 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 17 21:57:48.275673 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268672    2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 17 21:57:48.275673 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268675    2560 flags.go:64] FLAG: --lock-file=""
Sep 17 21:57:48.275673 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268678    2560 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 17 21:57:48.275673 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268680    2560 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 17 21:57:48.275673 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268683    2560 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 17 21:57:48.275673 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268689    2560 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 17 21:57:48.275673 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268692    2560 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 17 21:57:48.275673 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268694    2560 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 17 21:57:48.275673 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268697    2560 flags.go:64] FLAG: --logging-format="text"
Sep 17 21:57:48.275673 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268700    2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 17 21:57:48.275673 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268703    2560 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 17 21:57:48.275673 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268706    2560 flags.go:64] FLAG: --manifest-url=""
Sep 17 21:57:48.275673 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268709    2560 flags.go:64] FLAG: --manifest-url-header=""
Sep 17 21:57:48.275673 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268713    2560 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 17 21:57:48.275673 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268716    2560 flags.go:64] FLAG: --max-open-files="1000000"
Sep 17 21:57:48.275673 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268720    2560 flags.go:64] FLAG: --max-pods="110"
Sep 17 21:57:48.275673 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268723    2560 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 17 21:57:48.275673 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268726    2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 17 21:57:48.275673 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268732    2560 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 17 21:57:48.275673 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268736    2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 17 21:57:48.275673 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268739    2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 17 21:57:48.275673 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268742    2560 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 17 21:57:48.276294 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268745    2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 17 21:57:48.276294 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268752    2560 flags.go:64] FLAG: --node-status-max-images="50"
Sep 17 21:57:48.276294 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268755    2560 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 17 21:57:48.276294 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268758    2560 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 17 21:57:48.276294 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268762    2560 flags.go:64] FLAG: --pod-cidr=""
Sep 17 21:57:48.276294 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268765    2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc"
Sep 17 21:57:48.276294 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268769    2560 flags.go:64] FLAG: --pod-manifest-path=""
Sep 17 21:57:48.276294 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268772    2560 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 17 21:57:48.276294 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268775    2560 flags.go:64] FLAG: --pods-per-core="0"
Sep 17 21:57:48.276294 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268779    2560 flags.go:64] FLAG: --port="10250"
Sep 17 21:57:48.276294 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268782    2560 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 17 21:57:48.276294 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268784    2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e8e9e3c07fd20f8d"
Sep 17 21:57:48.276294 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268788    2560 flags.go:64] FLAG: --qos-reserved=""
Sep 17 21:57:48.276294 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268791    2560 flags.go:64] FLAG: --read-only-port="10255"
Sep 17 21:57:48.276294 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268794    2560 flags.go:64] FLAG: --register-node="true"
Sep 17 21:57:48.276294 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268797    2560 flags.go:64] FLAG: --register-with-taints=""
Sep 17 21:57:48.276294 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268800    2560 flags.go:64] FLAG: --registry-burst="10"
Sep 17 21:57:48.276294 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268803    2560 flags.go:64] FLAG: --registry-qps="5"
Sep 17 21:57:48.276294 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268806    2560 flags.go:64] FLAG: --reserved-cpus=""
Sep 17 21:57:48.276294 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268809    2560 flags.go:64] FLAG: --reserved-memory=""
Sep 17 21:57:48.276294 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268813    2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 17 21:57:48.276294 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268816    2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 17 21:57:48.276294 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268819    2560 flags.go:64] FLAG: --rotate-certificates="false"
Sep 17 21:57:48.276294 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268822    2560 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 17 21:57:48.276294 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268825    2560 flags.go:64] FLAG: --runonce="false"
Sep 17 21:57:48.276908 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268828    2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 17 21:57:48.276908 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268831    2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 17 21:57:48.276908 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268834    2560 flags.go:64] FLAG: --seccomp-default="false"
Sep 17 21:57:48.276908 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268837    2560 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 17 21:57:48.276908 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268841    2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 17 21:57:48.276908 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268844    2560 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 17 21:57:48.276908 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268847    2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 17 21:57:48.276908 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268850    2560 flags.go:64] FLAG: --storage-driver-password="root"
Sep 17 21:57:48.276908 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268853    2560 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 17 21:57:48.276908 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268856    2560 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 17 21:57:48.276908 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268859    2560 flags.go:64] FLAG: --storage-driver-user="root"
Sep 17 21:57:48.276908 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268862    2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 17 21:57:48.276908 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268865    2560 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 17 21:57:48.276908 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268868    2560 flags.go:64] FLAG: --system-cgroups=""
Sep 17 21:57:48.276908 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268871    2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 17 21:57:48.276908 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268876    2560 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 17 21:57:48.276908 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268879    2560 flags.go:64] FLAG: --tls-cert-file=""
Sep 17 21:57:48.276908 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268882    2560 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 17 21:57:48.276908 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268885    2560 flags.go:64] FLAG: --tls-min-version=""
Sep 17 21:57:48.276908 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268888    2560 flags.go:64] FLAG: --tls-private-key-file=""
Sep 17 21:57:48.276908 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268891    2560 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 17 21:57:48.276908 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268894    2560 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 17 21:57:48.276908 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268897    2560 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 17 21:57:48.276908 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268900    2560 flags.go:64] FLAG: --v="2"
Sep 17 21:57:48.276908 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268904    2560 flags.go:64] FLAG: --version="false"
Sep 17 21:57:48.277577 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268907    2560 flags.go:64] FLAG: --vmodule=""
Sep 17 21:57:48.277577 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268911    2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 17 21:57:48.277577 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.268914    2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 17 21:57:48.277577 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269035    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 21:57:48.277577 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269040    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 21:57:48.277577 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269043    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 21:57:48.277577 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269046    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 21:57:48.277577 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269049    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 21:57:48.277577 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269051    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 21:57:48.277577 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269054    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 21:57:48.277577 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269057    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 21:57:48.277577 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269060    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 21:57:48.277577 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269062    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 21:57:48.277577 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269065    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 21:57:48.277577 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269068    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 21:57:48.277577 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269070    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 21:57:48.277577 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269073    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 21:57:48.277577 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269076    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 21:57:48.277577 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269079    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 21:57:48.277577 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269081    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 21:57:48.278061 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269084    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 21:57:48.278061 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269087    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 21:57:48.278061 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269089    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 21:57:48.278061 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269092    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 21:57:48.278061 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269094    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 21:57:48.278061 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269097    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 21:57:48.278061 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269099    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 21:57:48.278061 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269102    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 21:57:48.278061 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269105    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 21:57:48.278061 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269108    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 21:57:48.278061 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269110    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 21:57:48.278061 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269113    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 21:57:48.278061 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269115    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 21:57:48.278061 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269118    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 21:57:48.278061 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269121    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 21:57:48.278061 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269123    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 21:57:48.278061 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269126    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 21:57:48.278061 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269128    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 21:57:48.278061 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269131    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 21:57:48.278061 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269133    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 21:57:48.278576 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269138    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 21:57:48.278576 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269141    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 21:57:48.278576 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269146    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 21:57:48.278576 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269149    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 21:57:48.278576 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269152    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 21:57:48.278576 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269155    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 21:57:48.278576 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269157    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 21:57:48.278576 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269160    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 21:57:48.278576 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269163    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 21:57:48.278576 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269167    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 21:57:48.278576 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269169    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 21:57:48.278576 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269172    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 21:57:48.278576 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269175    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 21:57:48.278576 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269178    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 21:57:48.278576 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269181    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 21:57:48.278576 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269183    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 21:57:48.278576 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269186    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 21:57:48.278576 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269188    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 21:57:48.278576 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269191    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 21:57:48.279057 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269194    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 21:57:48.279057 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269196    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 21:57:48.279057 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269199    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 21:57:48.279057 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269201    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 21:57:48.279057 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269204    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 21:57:48.279057 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269206    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 21:57:48.279057 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269209    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 21:57:48.279057 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269211    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 21:57:48.279057 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269214    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 21:57:48.279057 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269216    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 21:57:48.279057 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269219    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 21:57:48.279057 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269222    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 21:57:48.279057 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269224    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 21:57:48.279057 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269227    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 21:57:48.279057 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269229    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 21:57:48.279057 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269233    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 21:57:48.279057 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269236    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 21:57:48.279057 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269239    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 21:57:48.279057 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269243    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 21:57:48.279057 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269246    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 21:57:48.279565 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269249    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 21:57:48.279565 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269252    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 21:57:48.279565 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269254    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 21:57:48.279565 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269257    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 21:57:48.279565 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269260    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 21:57:48.279565 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269263    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 21:57:48.279565 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269265    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 21:57:48.279565 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269268    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 21:57:48.279565 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269270    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 21:57:48.279565 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269273    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 21:57:48.279565 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269275    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 21:57:48.279565 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269278    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 21:57:48.279565 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269280    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 21:57:48.279565 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269283    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 21:57:48.279565 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269287    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 21:57:48.279565 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269290    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 21:57:48.279565 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269293    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 21:57:48.279565 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269296    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 21:57:48.279565 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269298    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 21:57:48.279565 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269301    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 21:57:48.280133 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269304    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 21:57:48.280133 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269307    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 21:57:48.280133 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.269310    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 21:57:48.280133 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.269314    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 21:57:48.280133 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.276780    2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 17 21:57:48.280133 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.276794    2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 17 21:57:48.280133 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.277796    2560 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 17 21:57:48.280133 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.277803    2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 17 21:57:48.280133 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.277865    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 21:57:48.280133 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.277870    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 21:57:48.280133 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.277874    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 21:57:48.280133 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.277877    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 21:57:48.280133 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.277881    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 21:57:48.280133 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.277884    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 21:57:48.280500 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.277887    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 21:57:48.280500 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.277895    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 21:57:48.280500 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.277898    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 21:57:48.280500 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.277901    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 21:57:48.280500 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.277904    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 21:57:48.280500 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.277906    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 21:57:48.280500 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.277909    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 21:57:48.280500 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.277912    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 21:57:48.280500 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.277915    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 21:57:48.280500 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.277917    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 21:57:48.280500 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.277920    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 21:57:48.280500 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.277923    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 21:57:48.280500 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.277926    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 21:57:48.280500 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.277929    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 21:57:48.280500 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.277931    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 21:57:48.280500 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.277934    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 21:57:48.280500 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.277937    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 21:57:48.280500 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.277940    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 21:57:48.280500 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.277942    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 21:57:48.281014 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.277945    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 21:57:48.281014 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.277948    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 21:57:48.281014 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.277951    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 21:57:48.281014 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.277954    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 21:57:48.281014 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.277957    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 21:57:48.281014 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.277960    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 21:57:48.281014 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.277963    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 21:57:48.281014 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.277965    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 21:57:48.281014 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.277969    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 21:57:48.281014 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.277973    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 21:57:48.281014 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.277976    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 21:57:48.281014 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.277979    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 21:57:48.281014 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.277982    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 21:57:48.281014 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.277985    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 21:57:48.281014 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.277987    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 21:57:48.281014 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.277995    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 21:57:48.281014 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.277998    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 21:57:48.281014 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278000    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 21:57:48.281014 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278003    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 21:57:48.281014 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278005    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 21:57:48.281530 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278008    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 21:57:48.281530 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278011    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 21:57:48.281530 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278014    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 21:57:48.281530 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278016    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 21:57:48.281530 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278019    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 21:57:48.281530 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278021    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 21:57:48.281530 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278024    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 21:57:48.281530 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278027    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 21:57:48.281530 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278030    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 21:57:48.281530 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278032    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 21:57:48.281530 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278035    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 21:57:48.281530 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278038    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 21:57:48.281530 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278040    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 21:57:48.281530 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278043    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 21:57:48.281530 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278046    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 21:57:48.281530 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278049    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 21:57:48.281530 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278051    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 21:57:48.281530 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278054    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 21:57:48.281530 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278057    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 21:57:48.281530 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278059    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 21:57:48.282021 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278062    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 21:57:48.282021 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278065    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 21:57:48.282021 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278068    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 21:57:48.282021 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278070    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 21:57:48.282021 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278073    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 21:57:48.282021 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278076    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 21:57:48.282021 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278079    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 21:57:48.282021 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278081    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 21:57:48.282021 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278090    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 21:57:48.282021 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278093    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 21:57:48.282021 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278096    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 21:57:48.282021 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278099    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 21:57:48.282021 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278101    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 21:57:48.282021 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278104    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 21:57:48.282021 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278106    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 21:57:48.282021 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278109    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 21:57:48.282021 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278112    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 21:57:48.282021 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278116    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 21:57:48.282021 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278119    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 21:57:48.282021 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278122    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 21:57:48.282588 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278124    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 21:57:48.282588 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278127    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 21:57:48.282588 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278130    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 21:57:48.282588 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278132    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 21:57:48.282588 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278135    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 21:57:48.282588 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278137    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 21:57:48.282588 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278140    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 21:57:48.282588 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278143    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 21:57:48.282588 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278146    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 21:57:48.282588 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278148    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 21:57:48.282588 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278151    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 21:57:48.282588 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278155    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 21:57:48.282588 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278158    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 21:57:48.282588 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278161    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 21:57:48.282938 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.278166    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 21:57:48.282938 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278327    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 21:57:48.282938 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278332    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 21:57:48.282938 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278335    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 21:57:48.282938 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278338    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 21:57:48.282938 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278341    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 21:57:48.282938 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278344    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 21:57:48.282938 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278366    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 21:57:48.282938 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278371    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 21:57:48.282938 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278374    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 21:57:48.282938 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278377    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 21:57:48.282938 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278380    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 21:57:48.282938 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278382    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 21:57:48.282938 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278385    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 21:57:48.282938 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278388    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 21:57:48.283335 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278391    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 21:57:48.283335 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278394    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 21:57:48.283335 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278397    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 21:57:48.283335 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278399    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 21:57:48.283335 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278402    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 21:57:48.283335 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278404    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 21:57:48.283335 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278407    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 21:57:48.283335 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278410    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 21:57:48.283335 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278412    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 21:57:48.283335 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278415    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 21:57:48.283335 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278418    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 21:57:48.283335 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278421    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 21:57:48.283335 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278423    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 21:57:48.283335 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278426    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 21:57:48.283335 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278428    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 21:57:48.283335 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278431    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 21:57:48.283335 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278433    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 21:57:48.283335 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278436    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 21:57:48.283335 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278439    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 21:57:48.283909 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278442    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 21:57:48.283909 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278446    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 21:57:48.283909 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278449    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 21:57:48.283909 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278451    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 21:57:48.283909 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278454    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 21:57:48.283909 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278456    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 21:57:48.283909 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278465    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 21:57:48.283909 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278468    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 21:57:48.283909 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278472    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 21:57:48.283909 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278475    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 21:57:48.283909 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278477    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 21:57:48.283909 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278480    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 21:57:48.283909 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278483    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 21:57:48.283909 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278486    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 21:57:48.283909 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278488    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 21:57:48.283909 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278491    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 21:57:48.283909 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278493    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 21:57:48.283909 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278496    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 21:57:48.283909 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278499    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 21:57:48.284389 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278501    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 21:57:48.284389 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278504    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 21:57:48.284389 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278506    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 21:57:48.284389 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278509    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 21:57:48.284389 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278511    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 21:57:48.284389 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278514    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 21:57:48.284389 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278517    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 21:57:48.284389 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278519    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 21:57:48.284389 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278522    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 21:57:48.284389 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278524    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 21:57:48.284389 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278527    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 21:57:48.284389 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278530    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 21:57:48.284389 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278532    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 21:57:48.284389 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278535    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 21:57:48.284389 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278537    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 21:57:48.284389 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278540    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 21:57:48.284389 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278542    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 21:57:48.284389 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278545    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 21:57:48.284389 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278548    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 21:57:48.284389 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278550    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 21:57:48.284980 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278559    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 21:57:48.284980 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278561    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 21:57:48.284980 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278564    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 21:57:48.284980 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278566    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 21:57:48.284980 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278569    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 21:57:48.284980 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278571    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 21:57:48.284980 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278574    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 21:57:48.284980 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278576    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 21:57:48.284980 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278579    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 21:57:48.284980 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278582    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 21:57:48.284980 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278585    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 21:57:48.284980 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278587    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 21:57:48.284980 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278590    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 21:57:48.284980 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278593    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 21:57:48.284980 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278595    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 21:57:48.284980 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278598    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 21:57:48.284980 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278601    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 21:57:48.284980 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278603    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 21:57:48.284980 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278606    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 21:57:48.284980 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278608    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 21:57:48.285596 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278611    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 21:57:48.285596 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278614    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 21:57:48.285596 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278616    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 21:57:48.285596 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278618    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 21:57:48.285596 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278621    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 21:57:48.285596 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278624    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 21:57:48.285596 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:48.278626    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 21:57:48.285596 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.278631    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 21:57:48.285596 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.278736    2560 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 17 21:57:48.285596 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.282182    2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 17 21:57:48.285596 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.283221    2560 server.go:1019] "Starting client certificate rotation"
Sep 17 21:57:48.285596 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.283346    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 17 21:57:48.285596 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.283417    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 17 21:57:48.288205 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.288186    2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 17 21:57:48.289261 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.289244    2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 17 21:57:48.299196 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.299178    2560 log.go:25] "Validated CRI v1 runtime API"
Sep 17 21:57:48.302334 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.302318    2560 log.go:25] "Validated CRI v1 image API"
Sep 17 21:57:48.303743 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.303726    2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 17 21:57:48.306045 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.306028    2560 fs.go:135] Filesystem UUIDs: map[0ec6b531-6659-4529-b7c0-85d73d6564d0:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 e967e6fc-5d34-40f7-8468-ff692b878b29:/dev/nvme0n1p3]
Sep 17 21:57:48.306090 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.306045    2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 17 21:57:48.311624 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.311450    2560 manager.go:216] Machine: {Timestamp:2026-09-17 21:57:48.310107363 +0000 UTC m=+0.369879365 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3084896 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21e7409349f022dd374a053e238537 SystemUUID:ec21e740-9349-f022-dd37-4a053e238537 BootID:3b4cd636-2d19-4aa0-9700-441858960d41 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:d5:36:96:bb Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:d5:36:96:bb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:52:d7:31:6f:8a:44 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 17 21:57:48.311624 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.311614    2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 17 21:57:48.311761 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.311683    2560 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 17 21:57:48.312220 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.312206    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 17 21:57:48.313788 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.313765    2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 17 21:57:48.313912 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.313792    2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-66.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 17 21:57:48.315189 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.315179    2560 topology_manager.go:138] "Creating topology manager with none policy"
Sep 17 21:57:48.315221 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.315192    2560 container_manager_linux.go:309] "Creating device plugin manager"
Sep 17 21:57:48.315221 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.315201    2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 17 21:57:48.316028 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.316018    2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 17 21:57:48.317711 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.317701    2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 17 21:57:48.322844 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.322833    2560 state_mem.go:36] "Initialized new in-memory state store"
Sep 17 21:57:48.322958 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.322948    2560 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 17 21:57:48.323026 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.322977    2560 kubelet.go:486] "Attempting to sync node with API server"
Sep 17 21:57:48.323026 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.322986    2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 17 21:57:48.323026 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.323001    2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 17 21:57:48.323026 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.323010    2560 kubelet.go:398] "Adding apiserver pod source"
Sep 17 21:57:48.323026 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.323019    2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 17 21:57:48.323345 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.323334    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 17 21:57:48.323393 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.323365    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 17 21:57:48.326438 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.326420    2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1"
Sep 17 21:57:48.329766 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.329752    2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 17 21:57:48.329824 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.329782    2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 17 21:57:48.331140 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.331129    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 17 21:57:48.331182 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.331145    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 17 21:57:48.331182 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.331151    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 17 21:57:48.331182 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.331156    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 17 21:57:48.331182 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.331165    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 17 21:57:48.331182 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.331171    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 17 21:57:48.331182 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.331184    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 17 21:57:48.331342 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.331189    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 17 21:57:48.331342 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.331196    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 17 21:57:48.331342 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.331201    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 17 21:57:48.331342 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.331209    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 17 21:57:48.331342 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.331214    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 17 21:57:48.331912 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.331902    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 17 21:57:48.331912 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.331911    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 17 21:57:48.336116 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.336098    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-66.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 17 21:57:48.336166 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:48.336132    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-66.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 17 21:57:48.336213 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:48.336163    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 17 21:57:48.336523 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.336511    2560 server.go:1268] "Started kubelet"
Sep 17 21:57:48.336647 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.336604    2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 17 21:57:48.336758 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.336588    2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 17 21:57:48.336830 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.336778    2560 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 17 21:57:48.337279 ip-10-0-136-66 systemd[1]: Started Kubernetes Kubelet.
Sep 17 21:57:48.338282 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.338254    2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 17 21:57:48.340396 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.340380    2560 server.go:310] "Adding debug handlers to kubelet server"
Sep 17 21:57:48.343096 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:48.342050    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-66.ec2.internal.18d63a8a7902fa7f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-66.ec2.internal,UID:ip-10-0-136-66.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-66.ec2.internal,},FirstTimestamp:2026-09-17 21:57:48.336487039 +0000 UTC m=+0.396259042,LastTimestamp:2026-09-17 21:57:48.336487039 +0000 UTC m=+0.396259042,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-66.ec2.internal,}"
Sep 17 21:57:48.343482 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:48.343460    2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 17 21:57:48.346646 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.346623    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 17 21:57:48.347291 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.347275    2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 17 21:57:48.347483 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:48.347465    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-66.ec2.internal\" not found"
Sep 17 21:57:48.347967 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.347952    2560 factory.go:55] Registering systemd factory
Sep 17 21:57:48.347967 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.347970    2560 factory.go:223] Registration of the systemd container factory successfully
Sep 17 21:57:48.348083 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.348002    2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 17 21:57:48.348200 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.348005    2560 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 17 21:57:48.348305 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.348209    2560 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 17 21:57:48.348305 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.348230    2560 factory.go:153] Registering CRI-O factory
Sep 17 21:57:48.348305 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.348243    2560 factory.go:223] Registration of the crio container factory successfully
Sep 17 21:57:48.348305 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.348286    2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 17 21:57:48.348305 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.348300    2560 reconstruct.go:97] "Volume reconstruction finished"
Sep 17 21:57:48.348305 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.348309    2560 reconciler.go:29] "Reconciler: start to sync state"
Sep 17 21:57:48.348573 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.348310    2560 factory.go:103] Registering Raw factory
Sep 17 21:57:48.348573 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.348339    2560 manager.go:1196] Started watching for new ooms in manager
Sep 17 21:57:48.348861 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.348851    2560 manager.go:349] Starting recovery of all containers
Sep 17 21:57:48.349661 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:48.349633    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 17 21:57:48.349767 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:48.349744    2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-66.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 17 21:57:48.358789 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.358769    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bgslp"
Sep 17 21:57:48.363055 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.361768    2560 manager.go:354] Recovery completed
Sep 17 21:57:48.366126 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.366110    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 21:57:48.366198 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.366109    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bgslp"
Sep 17 21:57:48.367888 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.367874    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-66.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 21:57:48.367958 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.367903    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-66.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 21:57:48.367958 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.367917    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-66.ec2.internal" event="NodeHasSufficientPID"
Sep 17 21:57:48.368475 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.368459    2560 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 17 21:57:48.368475 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.368474    2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 17 21:57:48.368621 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.368492    2560 state_mem.go:36] "Initialized new in-memory state store"
Sep 17 21:57:48.368621 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.368466    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 21:57:48.369290 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.369273    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-66.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 21:57:48.369373 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.369302    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-66.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 21:57:48.369373 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.369315    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-66.ec2.internal" event="NodeHasSufficientPID"
Sep 17 21:57:48.369694 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:48.369622    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-66.ec2.internal.18d63a8a7ae220ef  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-66.ec2.internal,UID:ip-10-0-136-66.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-66.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-66.ec2.internal,},FirstTimestamp:2026-09-17 21:57:48.367888623 +0000 UTC m=+0.427660626,LastTimestamp:2026-09-17 21:57:48.367888623 +0000 UTC m=+0.427660626,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-66.ec2.internal,}"
Sep 17 21:57:48.370680 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.370667    2560 policy_none.go:49] "None policy: Start"
Sep 17 21:57:48.370741 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.370685    2560 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 17 21:57:48.370741 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.370699    2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 17 21:57:48.372710 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.372697    2560 policy_none.go:47] "Start"
Sep 17 21:57:48.422309 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.408935    2560 manager.go:337] "Starting Device Plugin manager"
Sep 17 21:57:48.422309 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:48.408981    2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 17 21:57:48.422309 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.408994    2560 server.go:87] "Starting device plugin registration server"
Sep 17 21:57:48.422309 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.409252    2560 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 17 21:57:48.422309 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.409262    2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 17 21:57:48.422309 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.409386    2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 17 21:57:48.422309 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.409464    2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 17 21:57:48.422309 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.409473    2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 17 21:57:48.422309 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:48.409862    2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 17 21:57:48.422309 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:48.409900    2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-66.ec2.internal\" not found"
Sep 17 21:57:48.443875 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.443855    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 17 21:57:48.444999 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.444985    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 17 21:57:48.445078 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.445024    2560 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 17 21:57:48.445078 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.445045    2560 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 17 21:57:48.445170 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:48.445084    2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 17 21:57:48.447160 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.447141    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 21:57:48.509931 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.509856    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 21:57:48.510583 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.510569    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-66.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 21:57:48.510657 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.510593    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-66.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 21:57:48.510657 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.510604    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-66.ec2.internal" event="NodeHasSufficientPID"
Sep 17 21:57:48.510657 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.510625    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-66.ec2.internal"
Sep 17 21:57:48.518400 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.518385    2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-66.ec2.internal"
Sep 17 21:57:48.518480 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:48.518411    2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-66.ec2.internal\": node \"ip-10-0-136-66.ec2.internal\" not found"
Sep 17 21:57:48.535461 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:48.535443    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-66.ec2.internal\" not found"
Sep 17 21:57:48.545882 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.545854    2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-136-66.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-66.ec2.internal"]
Sep 17 21:57:48.545946 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.545920    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 21:57:48.546618 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.546601    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-66.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 21:57:48.546677 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.546629    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-66.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 21:57:48.546677 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.546640    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-66.ec2.internal" event="NodeHasSufficientPID"
Sep 17 21:57:48.550784 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.550772    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 21:57:48.550913 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.550898    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-66.ec2.internal"
Sep 17 21:57:48.550949 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.550930    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 21:57:48.551701 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.551569    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-66.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 21:57:48.551701 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.551612    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-66.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 21:57:48.551701 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.551629    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-66.ec2.internal" event="NodeHasSufficientPID"
Sep 17 21:57:48.553474 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.553454    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-66.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 21:57:48.553547 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.553483    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-66.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 21:57:48.553547 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.553498    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-66.ec2.internal" event="NodeHasSufficientPID"
Sep 17 21:57:48.555744 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.555729    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-66.ec2.internal"
Sep 17 21:57:48.555821 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.555753    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 21:57:48.556381 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.556366    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-66.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 21:57:48.556429 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.556393    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-66.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 21:57:48.556429 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.556404    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-66.ec2.internal" event="NodeHasSufficientPID"
Sep 17 21:57:48.582902 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:48.582879    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-66.ec2.internal\" not found" node="ip-10-0-136-66.ec2.internal"
Sep 17 21:57:48.587238 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:48.587222    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-66.ec2.internal\" not found" node="ip-10-0-136-66.ec2.internal"
Sep 17 21:57:48.635627 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:48.635612    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-66.ec2.internal\" not found"
Sep 17 21:57:48.649306 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.649286    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7cb3cec29cc11ab20979146634290fc1-config\") pod \"kube-apiserver-proxy-ip-10-0-136-66.ec2.internal\" (UID: \"7cb3cec29cc11ab20979146634290fc1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-66.ec2.internal"
Sep 17 21:57:48.649404 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.649308    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/26b4a5716c230966b81c335914c9476e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-66.ec2.internal\" (UID: \"26b4a5716c230966b81c335914c9476e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-66.ec2.internal"
Sep 17 21:57:48.649404 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.649327    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/26b4a5716c230966b81c335914c9476e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-66.ec2.internal\" (UID: \"26b4a5716c230966b81c335914c9476e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-66.ec2.internal"
Sep 17 21:57:48.736443 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:48.736424    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-66.ec2.internal\" not found"
Sep 17 21:57:48.749782 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.749763    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7cb3cec29cc11ab20979146634290fc1-config\") pod \"kube-apiserver-proxy-ip-10-0-136-66.ec2.internal\" (UID: \"7cb3cec29cc11ab20979146634290fc1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-66.ec2.internal"
Sep 17 21:57:48.749857 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.749787    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/26b4a5716c230966b81c335914c9476e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-66.ec2.internal\" (UID: \"26b4a5716c230966b81c335914c9476e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-66.ec2.internal"
Sep 17 21:57:48.749857 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.749804    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/26b4a5716c230966b81c335914c9476e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-66.ec2.internal\" (UID: \"26b4a5716c230966b81c335914c9476e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-66.ec2.internal"
Sep 17 21:57:48.749857 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.749848    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/26b4a5716c230966b81c335914c9476e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-66.ec2.internal\" (UID: \"26b4a5716c230966b81c335914c9476e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-66.ec2.internal"
Sep 17 21:57:48.749971 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.749875    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/26b4a5716c230966b81c335914c9476e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-66.ec2.internal\" (UID: \"26b4a5716c230966b81c335914c9476e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-66.ec2.internal"
Sep 17 21:57:48.749971 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.749876    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7cb3cec29cc11ab20979146634290fc1-config\") pod \"kube-apiserver-proxy-ip-10-0-136-66.ec2.internal\" (UID: \"7cb3cec29cc11ab20979146634290fc1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-66.ec2.internal"
Sep 17 21:57:48.837205 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:48.837165    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-66.ec2.internal\" not found"
Sep 17 21:57:48.885553 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.885529    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-66.ec2.internal"
Sep 17 21:57:48.890768 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:48.890674    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-66.ec2.internal"
Sep 17 21:57:48.938288 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:48.938263    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-66.ec2.internal\" not found"
Sep 17 21:57:49.038728 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:49.038699    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-66.ec2.internal\" not found"
Sep 17 21:57:49.139590 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:49.139565    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-66.ec2.internal\" not found"
Sep 17 21:57:49.240696 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:49.240667    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-66.ec2.internal\" not found"
Sep 17 21:57:49.282803 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:49.282775    2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 17 21:57:49.283239 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:49.282940    2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 17 21:57:49.341735 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:49.341710    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-66.ec2.internal\" not found"
Sep 17 21:57:49.362846 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:49.362828    2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 21:57:49.373620 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:49.373165    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-16 21:52:48 +0000 UTC" deadline="2028-04-29 18:27:33.8430211 +0000 UTC"
Sep 17 21:57:49.374066 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:49.373835    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14156h29m44.469191155s"
Sep 17 21:57:49.404814 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:49.404770    2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 21:57:49.448009 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:49.447993    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-66.ec2.internal"
Sep 17 21:57:49.457717 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:49.457696    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 17 21:57:49.458715 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:49.458696    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-66.ec2.internal"
Sep 17 21:57:49.469934 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:49.469916    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 17 21:57:49.513305 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:49.513284    2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 21:57:49.603003 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:49.602964    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cb3cec29cc11ab20979146634290fc1.slice/crio-e20b6fc9be4dbeb8198994ec494681d462481d7d337f71496bd18e8f4209530d WatchSource:0}: Error finding container e20b6fc9be4dbeb8198994ec494681d462481d7d337f71496bd18e8f4209530d: Status 404 returned error can't find the container with id e20b6fc9be4dbeb8198994ec494681d462481d7d337f71496bd18e8f4209530d
Sep 17 21:57:49.603276 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:49.603255    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26b4a5716c230966b81c335914c9476e.slice/crio-20bc4c4a7420a848b3fcbf6c5091fdd1901d9caeeeac0f47e4fbc3e77b409c04 WatchSource:0}: Error finding container 20bc4c4a7420a848b3fcbf6c5091fdd1901d9caeeeac0f47e4fbc3e77b409c04: Status 404 returned error can't find the container with id 20bc4c4a7420a848b3fcbf6c5091fdd1901d9caeeeac0f47e4fbc3e77b409c04
Sep 17 21:57:49.609425 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:49.609407    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 21:57:50.107032 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.106999    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 21:57:50.323841 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.323809    2560 apiserver.go:52] "Watching apiserver"
Sep 17 21:57:50.333494 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.333469    2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 17 21:57:50.334032 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.334008    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-br6wh","kube-system/konnectivity-agent-tprjw","kube-system/kube-apiserver-proxy-ip-10-0-136-66.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jj8hs","openshift-dns/node-resolver-hllvl","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-66.ec2.internal","openshift-multus/multus-additional-cni-plugins-nn2xs","openshift-multus/network-metrics-daemon-j58cx","openshift-cluster-node-tuning-operator/tuned-q8mts","openshift-image-registry/node-ca-z4bjm","openshift-multus/multus-scs8m","openshift-network-diagnostics/network-check-target-zdznt","openshift-network-operator/iptables-alerter-lff7k","openshift-ovn-kubernetes/ovnkube-node-llwgv"]
Sep 17 21:57:50.336649 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.336620    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hllvl"
Sep 17 21:57:50.339495 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.339469    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tprjw"
Sep 17 21:57:50.339613 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.339557    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 17 21:57:50.339684 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.339616    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4nk4m\""
Sep 17 21:57:50.340051 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.340023    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 17 21:57:50.342831 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.342808    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 17 21:57:50.342960 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.342907    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 17 21:57:50.343034 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.343004    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-kcphh\""
Sep 17 21:57:50.343533 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.343394    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lff7k"
Sep 17 21:57:50.345998 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.345974    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-z4bjm"
Sep 17 21:57:50.346113 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.346059    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-n68fq\""
Sep 17 21:57:50.346349 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.346186    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 17 21:57:50.346349 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.346270    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 17 21:57:50.346737 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.346614    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 17 21:57:50.347631 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.347611    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 17 21:57:50.348497 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.348132    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jj8hs"
Sep 17 21:57:50.348896 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.348788    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 17 21:57:50.348984 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.348903    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5nr5v\""
Sep 17 21:57:50.348984 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.348919    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 17 21:57:50.349094 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.348981    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 17 21:57:50.350690 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.350659    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-fbxhn\""
Sep 17 21:57:50.350798 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.350757    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 17 21:57:50.351136 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.351118    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nn2xs"
Sep 17 21:57:50.351320 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.351304    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 17 21:57:50.351510 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.351492    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 17 21:57:50.353686 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.353665    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 17 21:57:50.353877 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.353675    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j58cx"
Sep 17 21:57:50.353962 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.353895    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 17 21:57:50.353962 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.353928    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ht4gl\""
Sep 17 21:57:50.354067 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:50.353913    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j58cx" podUID="8dedff64-89fd-41e2-83e7-e5bdf85f3470"
Sep 17 21:57:50.354249 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.354229    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 17 21:57:50.354364 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.354301    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 17 21:57:50.354364 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.354327    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 17 21:57:50.355958 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.355936    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-q8mts"
Sep 17 21:57:50.358269 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.358216    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 17 21:57:50.358584 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.358557    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6505672f-86e4-439d-88c0-8b8ac9bcb987-konnectivity-ca\") pod \"konnectivity-agent-tprjw\" (UID: \"6505672f-86e4-439d-88c0-8b8ac9bcb987\") " pod="kube-system/konnectivity-agent-tprjw"
Sep 17 21:57:50.358683 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.358619    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/845f08e5-f5c6-430c-befa-727ab76b3a00-serviceca\") pod \"node-ca-z4bjm\" (UID: \"845f08e5-f5c6-430c-befa-727ab76b3a00\") " pod="openshift-image-registry/node-ca-z4bjm"
Sep 17 21:57:50.358683 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.358652    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcgf2\" (UniqueName: \"kubernetes.io/projected/3fb1b40d-8101-4632-8212-47eac7ec2425-kube-api-access-fcgf2\") pod \"aws-ebs-csi-driver-node-jj8hs\" (UID: \"3fb1b40d-8101-4632-8212-47eac7ec2425\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jj8hs"
Sep 17 21:57:50.358683 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.358680    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/00fb2a0f-d0d6-4d8d-8884-04fc3cd6aea4-system-cni-dir\") pod \"multus-additional-cni-plugins-nn2xs\" (UID: \"00fb2a0f-d0d6-4d8d-8884-04fc3cd6aea4\") " pod="openshift-multus/multus-additional-cni-plugins-nn2xs"
Sep 17 21:57:50.358849 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.358708    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/00fb2a0f-d0d6-4d8d-8884-04fc3cd6aea4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nn2xs\" (UID: \"00fb2a0f-d0d6-4d8d-8884-04fc3cd6aea4\") " pod="openshift-multus/multus-additional-cni-plugins-nn2xs"
Sep 17 21:57:50.358849 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.358756    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7ac7682e-e943-4684-9c1b-eee2c58acbf1-hosts-file\") pod \"node-resolver-hllvl\" (UID: \"7ac7682e-e943-4684-9c1b-eee2c58acbf1\") " pod="openshift-dns/node-resolver-hllvl"
Sep 17 21:57:50.358849 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.358802    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ac7682e-e943-4684-9c1b-eee2c58acbf1-tmp-dir\") pod \"node-resolver-hllvl\" (UID: \"7ac7682e-e943-4684-9c1b-eee2c58acbf1\") " pod="openshift-dns/node-resolver-hllvl"
Sep 17 21:57:50.358849 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.358830    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6505672f-86e4-439d-88c0-8b8ac9bcb987-agent-certs\") pod \"konnectivity-agent-tprjw\" (UID: \"6505672f-86e4-439d-88c0-8b8ac9bcb987\") " pod="kube-system/konnectivity-agent-tprjw"
Sep 17 21:57:50.359067 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.358860    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/09abe478-d8e5-4f5b-bec5-59b113bd11fa-iptables-alerter-script\") pod \"iptables-alerter-lff7k\" (UID: \"09abe478-d8e5-4f5b-bec5-59b113bd11fa\") " pod="openshift-network-operator/iptables-alerter-lff7k"
Sep 17 21:57:50.359067 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.358887    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 17 21:57:50.359067 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.358886    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/845f08e5-f5c6-430c-befa-727ab76b3a00-host\") pod \"node-ca-z4bjm\" (UID: \"845f08e5-f5c6-430c-befa-727ab76b3a00\") " pod="openshift-image-registry/node-ca-z4bjm"
Sep 17 21:57:50.359067 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.358887    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-rwtkk\""
Sep 17 21:57:50.359067 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.358935    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3fb1b40d-8101-4632-8212-47eac7ec2425-registration-dir\") pod \"aws-ebs-csi-driver-node-jj8hs\" (UID: \"3fb1b40d-8101-4632-8212-47eac7ec2425\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jj8hs"
Sep 17 21:57:50.359067 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.358978    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3fb1b40d-8101-4632-8212-47eac7ec2425-device-dir\") pod \"aws-ebs-csi-driver-node-jj8hs\" (UID: \"3fb1b40d-8101-4632-8212-47eac7ec2425\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jj8hs"
Sep 17 21:57:50.359067 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.359005    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/00fb2a0f-d0d6-4d8d-8884-04fc3cd6aea4-cni-binary-copy\") pod \"multus-additional-cni-plugins-nn2xs\" (UID: \"00fb2a0f-d0d6-4d8d-8884-04fc3cd6aea4\") " pod="openshift-multus/multus-additional-cni-plugins-nn2xs"
Sep 17 21:57:50.359477 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.359077    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/00fb2a0f-d0d6-4d8d-8884-04fc3cd6aea4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nn2xs\" (UID: \"00fb2a0f-d0d6-4d8d-8884-04fc3cd6aea4\") " pod="openshift-multus/multus-additional-cni-plugins-nn2xs"
Sep 17 21:57:50.359477 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.359110    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wr9n\" (UniqueName: \"kubernetes.io/projected/00fb2a0f-d0d6-4d8d-8884-04fc3cd6aea4-kube-api-access-4wr9n\") pod \"multus-additional-cni-plugins-nn2xs\" (UID: \"00fb2a0f-d0d6-4d8d-8884-04fc3cd6aea4\") " pod="openshift-multus/multus-additional-cni-plugins-nn2xs"
Sep 17 21:57:50.359477 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.359136    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/09abe478-d8e5-4f5b-bec5-59b113bd11fa-host-slash\") pod \"iptables-alerter-lff7k\" (UID: \"09abe478-d8e5-4f5b-bec5-59b113bd11fa\") " pod="openshift-network-operator/iptables-alerter-lff7k"
Sep 17 21:57:50.359477 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.359180    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4m6t\" (UniqueName: \"kubernetes.io/projected/845f08e5-f5c6-430c-befa-727ab76b3a00-kube-api-access-h4m6t\") pod \"node-ca-z4bjm\" (UID: \"845f08e5-f5c6-430c-befa-727ab76b3a00\") " pod="openshift-image-registry/node-ca-z4bjm"
Sep 17 21:57:50.359477 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.359209    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3fb1b40d-8101-4632-8212-47eac7ec2425-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jj8hs\" (UID: \"3fb1b40d-8101-4632-8212-47eac7ec2425\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jj8hs"
Sep 17 21:57:50.359477 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.359235    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3fb1b40d-8101-4632-8212-47eac7ec2425-sys-fs\") pod \"aws-ebs-csi-driver-node-jj8hs\" (UID: \"3fb1b40d-8101-4632-8212-47eac7ec2425\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jj8hs"
Sep 17 21:57:50.359477 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.359264    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gphl\" (UniqueName: \"kubernetes.io/projected/7ac7682e-e943-4684-9c1b-eee2c58acbf1-kube-api-access-7gphl\") pod \"node-resolver-hllvl\" (UID: \"7ac7682e-e943-4684-9c1b-eee2c58acbf1\") " pod="openshift-dns/node-resolver-hllvl"
Sep 17 21:57:50.359477 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.359293    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7r5xg\" (UniqueName: \"kubernetes.io/projected/09abe478-d8e5-4f5b-bec5-59b113bd11fa-kube-api-access-7r5xg\") pod \"iptables-alerter-lff7k\" (UID: \"09abe478-d8e5-4f5b-bec5-59b113bd11fa\") " pod="openshift-network-operator/iptables-alerter-lff7k"
Sep 17 21:57:50.359477 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.359318    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3fb1b40d-8101-4632-8212-47eac7ec2425-socket-dir\") pod \"aws-ebs-csi-driver-node-jj8hs\" (UID: \"3fb1b40d-8101-4632-8212-47eac7ec2425\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jj8hs"
Sep 17 21:57:50.359477 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.359349    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3fb1b40d-8101-4632-8212-47eac7ec2425-etc-selinux\") pod \"aws-ebs-csi-driver-node-jj8hs\" (UID: \"3fb1b40d-8101-4632-8212-47eac7ec2425\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jj8hs"
Sep 17 21:57:50.359477 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.359373    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/00fb2a0f-d0d6-4d8d-8884-04fc3cd6aea4-cnibin\") pod \"multus-additional-cni-plugins-nn2xs\" (UID: \"00fb2a0f-d0d6-4d8d-8884-04fc3cd6aea4\") " pod="openshift-multus/multus-additional-cni-plugins-nn2xs"
Sep 17 21:57:50.359477 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.359412    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/00fb2a0f-d0d6-4d8d-8884-04fc3cd6aea4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nn2xs\" (UID: \"00fb2a0f-d0d6-4d8d-8884-04fc3cd6aea4\") " pod="openshift-multus/multus-additional-cni-plugins-nn2xs"
Sep 17 21:57:50.360063 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.359651    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-br6wh"
Sep 17 21:57:50.360063 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:50.359712    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-br6wh" podUID="2c0000a6-1b43-479b-a06b-06eb5db40c2d"
Sep 17 21:57:50.363127 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.362656    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 17 21:57:50.363127 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.362899    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-scs8m"
Sep 17 21:57:50.365293 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.364918    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zdznt"
Sep 17 21:57:50.365293 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:50.364981    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zdznt" podUID="4a6387b2-b54c-44e0-909d-589e73c07248"
Sep 17 21:57:50.365506 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.365483    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-62twl\""
Sep 17 21:57:50.365593 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.365544    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 17 21:57:50.367683 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.367664    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:57:50.371337 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.371097    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 17 21:57:50.372169 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.371401    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 17 21:57:50.372169 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.371658    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 17 21:57:50.372169 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.371705    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 17 21:57:50.372169 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.372137    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 17 21:57:50.372852 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.372647    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-vsb7d\""
Sep 17 21:57:50.372852 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.372782    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 17 21:57:50.382225 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.382199    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-4tx78"
Sep 17 21:57:50.389891 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.389869    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-4tx78"
Sep 17 21:57:50.449563 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.449304    2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 17 21:57:50.451129 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.451081    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-66.ec2.internal" event={"ID":"26b4a5716c230966b81c335914c9476e","Type":"ContainerStarted","Data":"20bc4c4a7420a848b3fcbf6c5091fdd1901d9caeeeac0f47e4fbc3e77b409c04"}
Sep 17 21:57:50.453720 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.453687    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-66.ec2.internal" event={"ID":"7cb3cec29cc11ab20979146634290fc1","Type":"ContainerStarted","Data":"e20b6fc9be4dbeb8198994ec494681d462481d7d337f71496bd18e8f4209530d"}
Sep 17 21:57:50.459873 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.459846    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5cbc96f5-dc5a-46ab-b739-db19685500ac-host-kubelet\") pod \"ovnkube-node-llwgv\" (UID: \"5cbc96f5-dc5a-46ab-b739-db19685500ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:57:50.459976 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.459886    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5cbc96f5-dc5a-46ab-b739-db19685500ac-systemd-units\") pod \"ovnkube-node-llwgv\" (UID: \"5cbc96f5-dc5a-46ab-b739-db19685500ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:57:50.459976 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.459904    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5cbc96f5-dc5a-46ab-b739-db19685500ac-var-lib-openvswitch\") pod \"ovnkube-node-llwgv\" (UID: \"5cbc96f5-dc5a-46ab-b739-db19685500ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:57:50.459976 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.459938    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7r5xg\" (UniqueName: \"kubernetes.io/projected/09abe478-d8e5-4f5b-bec5-59b113bd11fa-kube-api-access-7r5xg\") pod \"iptables-alerter-lff7k\" (UID: \"09abe478-d8e5-4f5b-bec5-59b113bd11fa\") " pod="openshift-network-operator/iptables-alerter-lff7k"
Sep 17 21:57:50.460128 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.459994    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/00fb2a0f-d0d6-4d8d-8884-04fc3cd6aea4-cnibin\") pod \"multus-additional-cni-plugins-nn2xs\" (UID: \"00fb2a0f-d0d6-4d8d-8884-04fc3cd6aea4\") " pod="openshift-multus/multus-additional-cni-plugins-nn2xs"
Sep 17 21:57:50.460128 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.460041    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/93887b82-e82e-4df0-9821-51c194c31721-host\") pod \"tuned-q8mts\" (UID: \"93887b82-e82e-4df0-9821-51c194c31721\") " pod="openshift-cluster-node-tuning-operator/tuned-q8mts"
Sep 17 21:57:50.460128 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.460053    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/00fb2a0f-d0d6-4d8d-8884-04fc3cd6aea4-cnibin\") pod \"multus-additional-cni-plugins-nn2xs\" (UID: \"00fb2a0f-d0d6-4d8d-8884-04fc3cd6aea4\") " pod="openshift-multus/multus-additional-cni-plugins-nn2xs"
Sep 17 21:57:50.460128 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.460064    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-md225\" (UniqueName: \"kubernetes.io/projected/4a6387b2-b54c-44e0-909d-589e73c07248-kube-api-access-md225\") pod \"network-check-target-zdznt\" (UID: \"4a6387b2-b54c-44e0-909d-589e73c07248\") " pod="openshift-network-diagnostics/network-check-target-zdznt"
Sep 17 21:57:50.460128 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.460085    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5cbc96f5-dc5a-46ab-b739-db19685500ac-log-socket\") pod \"ovnkube-node-llwgv\" (UID: \"5cbc96f5-dc5a-46ab-b739-db19685500ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:57:50.460128 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.460104    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/00fb2a0f-d0d6-4d8d-8884-04fc3cd6aea4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nn2xs\" (UID: \"00fb2a0f-d0d6-4d8d-8884-04fc3cd6aea4\") " pod="openshift-multus/multus-additional-cni-plugins-nn2xs"
Sep 17 21:57:50.460128 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.460121    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7ac7682e-e943-4684-9c1b-eee2c58acbf1-hosts-file\") pod \"node-resolver-hllvl\" (UID: \"7ac7682e-e943-4684-9c1b-eee2c58acbf1\") " pod="openshift-dns/node-resolver-hllvl"
Sep 17 21:57:50.460507 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.460154    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/93887b82-e82e-4df0-9821-51c194c31721-lib-modules\") pod \"tuned-q8mts\" (UID: \"93887b82-e82e-4df0-9821-51c194c31721\") " pod="openshift-cluster-node-tuning-operator/tuned-q8mts"
Sep 17 21:57:50.460507 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.460206    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2c0000a6-1b43-479b-a06b-06eb5db40c2d-original-pull-secret\") pod \"global-pull-secret-syncer-br6wh\" (UID: \"2c0000a6-1b43-479b-a06b-06eb5db40c2d\") " pod="kube-system/global-pull-secret-syncer-br6wh"
Sep 17 21:57:50.460507 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.460213    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7ac7682e-e943-4684-9c1b-eee2c58acbf1-hosts-file\") pod \"node-resolver-hllvl\" (UID: \"7ac7682e-e943-4684-9c1b-eee2c58acbf1\") " pod="openshift-dns/node-resolver-hllvl"
Sep 17 21:57:50.460507 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.460233    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/42972d7a-57ce-429f-b1f4-cd2333a5c3ee-cnibin\") pod \"multus-scs8m\" (UID: \"42972d7a-57ce-429f-b1f4-cd2333a5c3ee\") " pod="openshift-multus/multus-scs8m"
Sep 17 21:57:50.460507 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.460267    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5cbc96f5-dc5a-46ab-b739-db19685500ac-ovn-node-metrics-cert\") pod \"ovnkube-node-llwgv\" (UID: \"5cbc96f5-dc5a-46ab-b739-db19685500ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:57:50.460507 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.460295    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9x8lb\" (UniqueName: \"kubernetes.io/projected/5cbc96f5-dc5a-46ab-b739-db19685500ac-kube-api-access-9x8lb\") pod \"ovnkube-node-llwgv\" (UID: \"5cbc96f5-dc5a-46ab-b739-db19685500ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:57:50.460507 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.460343    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3fb1b40d-8101-4632-8212-47eac7ec2425-device-dir\") pod \"aws-ebs-csi-driver-node-jj8hs\" (UID: \"3fb1b40d-8101-4632-8212-47eac7ec2425\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jj8hs"
Sep 17 21:57:50.460507 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.460389    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/00fb2a0f-d0d6-4d8d-8884-04fc3cd6aea4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nn2xs\" (UID: \"00fb2a0f-d0d6-4d8d-8884-04fc3cd6aea4\") " pod="openshift-multus/multus-additional-cni-plugins-nn2xs"
Sep 17 21:57:50.460903 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.460541    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wr9n\" (UniqueName: \"kubernetes.io/projected/00fb2a0f-d0d6-4d8d-8884-04fc3cd6aea4-kube-api-access-4wr9n\") pod \"multus-additional-cni-plugins-nn2xs\" (UID: \"00fb2a0f-d0d6-4d8d-8884-04fc3cd6aea4\") " pod="openshift-multus/multus-additional-cni-plugins-nn2xs"
Sep 17 21:57:50.460903 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.460573    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78znh\" (UniqueName: \"kubernetes.io/projected/8dedff64-89fd-41e2-83e7-e5bdf85f3470-kube-api-access-78znh\") pod \"network-metrics-daemon-j58cx\" (UID: \"8dedff64-89fd-41e2-83e7-e5bdf85f3470\") " pod="openshift-multus/network-metrics-daemon-j58cx"
Sep 17 21:57:50.460903 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.460579    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3fb1b40d-8101-4632-8212-47eac7ec2425-device-dir\") pod \"aws-ebs-csi-driver-node-jj8hs\" (UID: \"3fb1b40d-8101-4632-8212-47eac7ec2425\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jj8hs"
Sep 17 21:57:50.460903 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.460591    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/93887b82-e82e-4df0-9821-51c194c31721-sys\") pod \"tuned-q8mts\" (UID: \"93887b82-e82e-4df0-9821-51c194c31721\") " pod="openshift-cluster-node-tuning-operator/tuned-q8mts"
Sep 17 21:57:50.460903 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.460598    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/00fb2a0f-d0d6-4d8d-8884-04fc3cd6aea4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nn2xs\" (UID: \"00fb2a0f-d0d6-4d8d-8884-04fc3cd6aea4\") " pod="openshift-multus/multus-additional-cni-plugins-nn2xs"
Sep 17 21:57:50.460903 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.460619    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3fb1b40d-8101-4632-8212-47eac7ec2425-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jj8hs\" (UID: \"3fb1b40d-8101-4632-8212-47eac7ec2425\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jj8hs"
Sep 17 21:57:50.460903 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.460636    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/93887b82-e82e-4df0-9821-51c194c31721-run\") pod \"tuned-q8mts\" (UID: \"93887b82-e82e-4df0-9821-51c194c31721\") " pod="openshift-cluster-node-tuning-operator/tuned-q8mts"
Sep 17 21:57:50.460903 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.460653    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knddc\" (UniqueName: \"kubernetes.io/projected/93887b82-e82e-4df0-9821-51c194c31721-kube-api-access-knddc\") pod \"tuned-q8mts\" (UID: \"93887b82-e82e-4df0-9821-51c194c31721\") " pod="openshift-cluster-node-tuning-operator/tuned-q8mts"
Sep 17 21:57:50.460903 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.460669    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/42972d7a-57ce-429f-b1f4-cd2333a5c3ee-host-var-lib-cni-multus\") pod \"multus-scs8m\" (UID: \"42972d7a-57ce-429f-b1f4-cd2333a5c3ee\") " pod="openshift-multus/multus-scs8m"
Sep 17 21:57:50.460903 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.460685    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3fb1b40d-8101-4632-8212-47eac7ec2425-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jj8hs\" (UID: \"3fb1b40d-8101-4632-8212-47eac7ec2425\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jj8hs"
Sep 17 21:57:50.460903 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.460696    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5cbc96f5-dc5a-46ab-b739-db19685500ac-run-openvswitch\") pod \"ovnkube-node-llwgv\" (UID: \"5cbc96f5-dc5a-46ab-b739-db19685500ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:57:50.460903 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.460720    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5cbc96f5-dc5a-46ab-b739-db19685500ac-ovnkube-config\") pod \"ovnkube-node-llwgv\" (UID: \"5cbc96f5-dc5a-46ab-b739-db19685500ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:57:50.460903 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.460753    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/42972d7a-57ce-429f-b1f4-cd2333a5c3ee-host-run-netns\") pod \"multus-scs8m\" (UID: \"42972d7a-57ce-429f-b1f4-cd2333a5c3ee\") " pod="openshift-multus/multus-scs8m"
Sep 17 21:57:50.460903 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.460754    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/00fb2a0f-d0d6-4d8d-8884-04fc3cd6aea4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nn2xs\" (UID: \"00fb2a0f-d0d6-4d8d-8884-04fc3cd6aea4\") " pod="openshift-multus/multus-additional-cni-plugins-nn2xs"
Sep 17 21:57:50.460903 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.460807    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/42972d7a-57ce-429f-b1f4-cd2333a5c3ee-host-var-lib-cni-bin\") pod \"multus-scs8m\" (UID: \"42972d7a-57ce-429f-b1f4-cd2333a5c3ee\") " pod="openshift-multus/multus-scs8m"
Sep 17 21:57:50.460903 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.460851    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/93887b82-e82e-4df0-9821-51c194c31721-etc-sysctl-conf\") pod \"tuned-q8mts\" (UID: \"93887b82-e82e-4df0-9821-51c194c31721\") " pod="openshift-cluster-node-tuning-operator/tuned-q8mts"
Sep 17 21:57:50.461645 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.460885    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5cbc96f5-dc5a-46ab-b739-db19685500ac-host-run-ovn-kubernetes\") pod \"ovnkube-node-llwgv\" (UID: \"5cbc96f5-dc5a-46ab-b739-db19685500ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:57:50.461645 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.460911    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/93887b82-e82e-4df0-9821-51c194c31721-etc-sysctl-d\") pod \"tuned-q8mts\" (UID: \"93887b82-e82e-4df0-9821-51c194c31721\") " pod="openshift-cluster-node-tuning-operator/tuned-q8mts"
Sep 17 21:57:50.461645 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.460934    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/42972d7a-57ce-429f-b1f4-cd2333a5c3ee-multus-cni-dir\") pod \"multus-scs8m\" (UID: \"42972d7a-57ce-429f-b1f4-cd2333a5c3ee\") " pod="openshift-multus/multus-scs8m"
Sep 17 21:57:50.461645 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.460960    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/42972d7a-57ce-429f-b1f4-cd2333a5c3ee-multus-daemon-config\") pod \"multus-scs8m\" (UID: \"42972d7a-57ce-429f-b1f4-cd2333a5c3ee\") " pod="openshift-multus/multus-scs8m"
Sep 17 21:57:50.461645 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.460986    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/845f08e5-f5c6-430c-befa-727ab76b3a00-host\") pod \"node-ca-z4bjm\" (UID: \"845f08e5-f5c6-430c-befa-727ab76b3a00\") " pod="openshift-image-registry/node-ca-z4bjm"
Sep 17 21:57:50.461645 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.461012    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/00fb2a0f-d0d6-4d8d-8884-04fc3cd6aea4-cni-binary-copy\") pod \"multus-additional-cni-plugins-nn2xs\" (UID: \"00fb2a0f-d0d6-4d8d-8884-04fc3cd6aea4\") " pod="openshift-multus/multus-additional-cni-plugins-nn2xs"
Sep 17 21:57:50.461645 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.461045    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93887b82-e82e-4df0-9821-51c194c31721-etc-kubernetes\") pod \"tuned-q8mts\" (UID: \"93887b82-e82e-4df0-9821-51c194c31721\") " pod="openshift-cluster-node-tuning-operator/tuned-q8mts"
Sep 17 21:57:50.461645 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.461075    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/42972d7a-57ce-429f-b1f4-cd2333a5c3ee-multus-socket-dir-parent\") pod \"multus-scs8m\" (UID: \"42972d7a-57ce-429f-b1f4-cd2333a5c3ee\") " pod="openshift-multus/multus-scs8m"
Sep 17 21:57:50.461645 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.461101    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5cbc96f5-dc5a-46ab-b739-db19685500ac-etc-openvswitch\") pod \"ovnkube-node-llwgv\" (UID: \"5cbc96f5-dc5a-46ab-b739-db19685500ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:57:50.461645 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.461128    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4m6t\" (UniqueName: \"kubernetes.io/projected/845f08e5-f5c6-430c-befa-727ab76b3a00-kube-api-access-h4m6t\") pod \"node-ca-z4bjm\" (UID: \"845f08e5-f5c6-430c-befa-727ab76b3a00\") " pod="openshift-image-registry/node-ca-z4bjm"
Sep 17 21:57:50.461645 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.461170    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/845f08e5-f5c6-430c-befa-727ab76b3a00-host\") pod \"node-ca-z4bjm\" (UID: \"845f08e5-f5c6-430c-befa-727ab76b3a00\") " pod="openshift-image-registry/node-ca-z4bjm"
Sep 17 21:57:50.461645 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.461232    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/42972d7a-57ce-429f-b1f4-cd2333a5c3ee-multus-conf-dir\") pod \"multus-scs8m\" (UID: \"42972d7a-57ce-429f-b1f4-cd2333a5c3ee\") " pod="openshift-multus/multus-scs8m"
Sep 17 21:57:50.461645 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.461313    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjf6r\" (UniqueName: \"kubernetes.io/projected/42972d7a-57ce-429f-b1f4-cd2333a5c3ee-kube-api-access-sjf6r\") pod \"multus-scs8m\" (UID: \"42972d7a-57ce-429f-b1f4-cd2333a5c3ee\") " pod="openshift-multus/multus-scs8m"
Sep 17 21:57:50.461645 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.461343    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5cbc96f5-dc5a-46ab-b739-db19685500ac-run-systemd\") pod \"ovnkube-node-llwgv\" (UID: \"5cbc96f5-dc5a-46ab-b739-db19685500ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:57:50.461645 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.461403    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5cbc96f5-dc5a-46ab-b739-db19685500ac-node-log\") pod \"ovnkube-node-llwgv\" (UID: \"5cbc96f5-dc5a-46ab-b739-db19685500ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:57:50.461645 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.461460    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3fb1b40d-8101-4632-8212-47eac7ec2425-socket-dir\") pod \"aws-ebs-csi-driver-node-jj8hs\" (UID: \"3fb1b40d-8101-4632-8212-47eac7ec2425\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jj8hs"
Sep 17 21:57:50.461645 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.461487    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/93887b82-e82e-4df0-9821-51c194c31721-etc-systemd\") pod \"tuned-q8mts\" (UID: \"93887b82-e82e-4df0-9821-51c194c31721\") " pod="openshift-cluster-node-tuning-operator/tuned-q8mts"
Sep 17 21:57:50.462210 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.461511    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/42972d7a-57ce-429f-b1f4-cd2333a5c3ee-host-run-multus-certs\") pod \"multus-scs8m\" (UID: \"42972d7a-57ce-429f-b1f4-cd2333a5c3ee\") " pod="openshift-multus/multus-scs8m"
Sep 17 21:57:50.462210 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.461547    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcgf2\" (UniqueName: \"kubernetes.io/projected/3fb1b40d-8101-4632-8212-47eac7ec2425-kube-api-access-fcgf2\") pod \"aws-ebs-csi-driver-node-jj8hs\" (UID: \"3fb1b40d-8101-4632-8212-47eac7ec2425\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jj8hs"
Sep 17 21:57:50.462210 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.461576    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ac7682e-e943-4684-9c1b-eee2c58acbf1-tmp-dir\") pod \"node-resolver-hllvl\" (UID: \"7ac7682e-e943-4684-9c1b-eee2c58acbf1\") " pod="openshift-dns/node-resolver-hllvl"
Sep 17 21:57:50.462210 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.461603    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6505672f-86e4-439d-88c0-8b8ac9bcb987-agent-certs\") pod \"konnectivity-agent-tprjw\" (UID: \"6505672f-86e4-439d-88c0-8b8ac9bcb987\") " pod="kube-system/konnectivity-agent-tprjw"
Sep 17 21:57:50.462210 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.461631    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/93887b82-e82e-4df0-9821-51c194c31721-etc-modprobe-d\") pod \"tuned-q8mts\" (UID: \"93887b82-e82e-4df0-9821-51c194c31721\") " pod="openshift-cluster-node-tuning-operator/tuned-q8mts"
Sep 17 21:57:50.462210 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.461661    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/09abe478-d8e5-4f5b-bec5-59b113bd11fa-iptables-alerter-script\") pod \"iptables-alerter-lff7k\" (UID: \"09abe478-d8e5-4f5b-bec5-59b113bd11fa\") " pod="openshift-network-operator/iptables-alerter-lff7k"
Sep 17 21:57:50.462210 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.461663    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/00fb2a0f-d0d6-4d8d-8884-04fc3cd6aea4-cni-binary-copy\") pod \"multus-additional-cni-plugins-nn2xs\" (UID: \"00fb2a0f-d0d6-4d8d-8884-04fc3cd6aea4\") " pod="openshift-multus/multus-additional-cni-plugins-nn2xs"
Sep 17 21:57:50.462210 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.461690    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3fb1b40d-8101-4632-8212-47eac7ec2425-registration-dir\") pod \"aws-ebs-csi-driver-node-jj8hs\" (UID: \"3fb1b40d-8101-4632-8212-47eac7ec2425\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jj8hs"
Sep 17 21:57:50.462210 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.461717    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/93887b82-e82e-4df0-9821-51c194c31721-var-lib-kubelet\") pod \"tuned-q8mts\" (UID: \"93887b82-e82e-4df0-9821-51c194c31721\") " pod="openshift-cluster-node-tuning-operator/tuned-q8mts"
Sep 17 21:57:50.462210 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.461744    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2c0000a6-1b43-479b-a06b-06eb5db40c2d-dbus\") pod \"global-pull-secret-syncer-br6wh\" (UID: \"2c0000a6-1b43-479b-a06b-06eb5db40c2d\") " pod="kube-system/global-pull-secret-syncer-br6wh"
Sep 17 21:57:50.462210 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.461771    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42972d7a-57ce-429f-b1f4-cd2333a5c3ee-etc-kubernetes\") pod \"multus-scs8m\" (UID: \"42972d7a-57ce-429f-b1f4-cd2333a5c3ee\") " pod="openshift-multus/multus-scs8m"
Sep 17 21:57:50.462210 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.461804    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5cbc96f5-dc5a-46ab-b739-db19685500ac-host-run-netns\") pod \"ovnkube-node-llwgv\" (UID: \"5cbc96f5-dc5a-46ab-b739-db19685500ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:57:50.462210 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.461630    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3fb1b40d-8101-4632-8212-47eac7ec2425-socket-dir\") pod \"aws-ebs-csi-driver-node-jj8hs\" (UID: \"3fb1b40d-8101-4632-8212-47eac7ec2425\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jj8hs"
Sep 17 21:57:50.462210 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.461830    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5cbc96f5-dc5a-46ab-b739-db19685500ac-ovnkube-script-lib\") pod \"ovnkube-node-llwgv\" (UID: \"5cbc96f5-dc5a-46ab-b739-db19685500ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:57:50.462210 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.461866    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/42972d7a-57ce-429f-b1f4-cd2333a5c3ee-host-run-k8s-cni-cncf-io\") pod \"multus-scs8m\" (UID: \"42972d7a-57ce-429f-b1f4-cd2333a5c3ee\") " pod="openshift-multus/multus-scs8m"
Sep 17 21:57:50.462210 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.461897    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/09abe478-d8e5-4f5b-bec5-59b113bd11fa-host-slash\") pod \"iptables-alerter-lff7k\" (UID: \"09abe478-d8e5-4f5b-bec5-59b113bd11fa\") " pod="openshift-network-operator/iptables-alerter-lff7k"
Sep 17 21:57:50.462210 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.461915    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ac7682e-e943-4684-9c1b-eee2c58acbf1-tmp-dir\") pod \"node-resolver-hllvl\" (UID: \"7ac7682e-e943-4684-9c1b-eee2c58acbf1\") " pod="openshift-dns/node-resolver-hllvl"
Sep 17 21:57:50.463092 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.461924    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3fb1b40d-8101-4632-8212-47eac7ec2425-sys-fs\") pod \"aws-ebs-csi-driver-node-jj8hs\" (UID: \"3fb1b40d-8101-4632-8212-47eac7ec2425\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jj8hs"
Sep 17 21:57:50.463092 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.461954    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2c0000a6-1b43-479b-a06b-06eb5db40c2d-kubelet-config\") pod \"global-pull-secret-syncer-br6wh\" (UID: \"2c0000a6-1b43-479b-a06b-06eb5db40c2d\") " pod="kube-system/global-pull-secret-syncer-br6wh"
Sep 17 21:57:50.463092 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.461978    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/42972d7a-57ce-429f-b1f4-cd2333a5c3ee-cni-binary-copy\") pod \"multus-scs8m\" (UID: \"42972d7a-57ce-429f-b1f4-cd2333a5c3ee\") " pod="openshift-multus/multus-scs8m"
Sep 17 21:57:50.463092 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.462005    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5cbc96f5-dc5a-46ab-b739-db19685500ac-host-slash\") pod \"ovnkube-node-llwgv\" (UID: \"5cbc96f5-dc5a-46ab-b739-db19685500ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:57:50.463092 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.462027    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3fb1b40d-8101-4632-8212-47eac7ec2425-sys-fs\") pod \"aws-ebs-csi-driver-node-jj8hs\" (UID: \"3fb1b40d-8101-4632-8212-47eac7ec2425\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jj8hs"
Sep 17 21:57:50.463092 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.462030    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5cbc96f5-dc5a-46ab-b739-db19685500ac-host-cni-netd\") pod \"ovnkube-node-llwgv\" (UID: \"5cbc96f5-dc5a-46ab-b739-db19685500ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:57:50.463092 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.461925    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3fb1b40d-8101-4632-8212-47eac7ec2425-registration-dir\") pod \"aws-ebs-csi-driver-node-jj8hs\" (UID: \"3fb1b40d-8101-4632-8212-47eac7ec2425\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jj8hs"
Sep 17 21:57:50.463092 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.462070    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5cbc96f5-dc5a-46ab-b739-db19685500ac-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-llwgv\" (UID: \"5cbc96f5-dc5a-46ab-b739-db19685500ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:57:50.463092 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.462113    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3fb1b40d-8101-4632-8212-47eac7ec2425-etc-selinux\") pod \"aws-ebs-csi-driver-node-jj8hs\" (UID: \"3fb1b40d-8101-4632-8212-47eac7ec2425\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jj8hs"
Sep 17 21:57:50.463092 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.462147    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/09abe478-d8e5-4f5b-bec5-59b113bd11fa-host-slash\") pod \"iptables-alerter-lff7k\" (UID: \"09abe478-d8e5-4f5b-bec5-59b113bd11fa\") " pod="openshift-network-operator/iptables-alerter-lff7k"
Sep 17 21:57:50.463092 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.462165    2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 17 21:57:50.463092 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.462196    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/00fb2a0f-d0d6-4d8d-8884-04fc3cd6aea4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nn2xs\" (UID: \"00fb2a0f-d0d6-4d8d-8884-04fc3cd6aea4\") " pod="openshift-multus/multus-additional-cni-plugins-nn2xs"
Sep 17 21:57:50.463092 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.462290    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6505672f-86e4-439d-88c0-8b8ac9bcb987-konnectivity-ca\") pod \"konnectivity-agent-tprjw\" (UID: \"6505672f-86e4-439d-88c0-8b8ac9bcb987\") " pod="kube-system/konnectivity-agent-tprjw"
Sep 17 21:57:50.463092 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.462393    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3fb1b40d-8101-4632-8212-47eac7ec2425-etc-selinux\") pod \"aws-ebs-csi-driver-node-jj8hs\" (UID: \"3fb1b40d-8101-4632-8212-47eac7ec2425\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jj8hs"
Sep 17 21:57:50.463092 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.462437    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8dedff64-89fd-41e2-83e7-e5bdf85f3470-metrics-certs\") pod \"network-metrics-daemon-j58cx\" (UID: \"8dedff64-89fd-41e2-83e7-e5bdf85f3470\") " pod="openshift-multus/network-metrics-daemon-j58cx"
Sep 17 21:57:50.463092 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.462477    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/42972d7a-57ce-429f-b1f4-cd2333a5c3ee-hostroot\") pod \"multus-scs8m\" (UID: \"42972d7a-57ce-429f-b1f4-cd2333a5c3ee\") " pod="openshift-multus/multus-scs8m"
Sep 17 21:57:50.463092 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.462510    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5cbc96f5-dc5a-46ab-b739-db19685500ac-env-overrides\") pod \"ovnkube-node-llwgv\" (UID: \"5cbc96f5-dc5a-46ab-b739-db19685500ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:57:50.463959 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.462528    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/09abe478-d8e5-4f5b-bec5-59b113bd11fa-iptables-alerter-script\") pod \"iptables-alerter-lff7k\" (UID: \"09abe478-d8e5-4f5b-bec5-59b113bd11fa\") " pod="openshift-network-operator/iptables-alerter-lff7k"
Sep 17 21:57:50.463959 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.462551    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/845f08e5-f5c6-430c-befa-727ab76b3a00-serviceca\") pod \"node-ca-z4bjm\" (UID: \"845f08e5-f5c6-430c-befa-727ab76b3a00\") " pod="openshift-image-registry/node-ca-z4bjm"
Sep 17 21:57:50.463959 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.462587    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/00fb2a0f-d0d6-4d8d-8884-04fc3cd6aea4-system-cni-dir\") pod \"multus-additional-cni-plugins-nn2xs\" (UID: \"00fb2a0f-d0d6-4d8d-8884-04fc3cd6aea4\") " pod="openshift-multus/multus-additional-cni-plugins-nn2xs"
Sep 17 21:57:50.463959 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.462661    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/93887b82-e82e-4df0-9821-51c194c31721-etc-sysconfig\") pod \"tuned-q8mts\" (UID: \"93887b82-e82e-4df0-9821-51c194c31721\") " pod="openshift-cluster-node-tuning-operator/tuned-q8mts"
Sep 17 21:57:50.463959 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.462678    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/00fb2a0f-d0d6-4d8d-8884-04fc3cd6aea4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nn2xs\" (UID: \"00fb2a0f-d0d6-4d8d-8884-04fc3cd6aea4\") " pod="openshift-multus/multus-additional-cni-plugins-nn2xs"
Sep 17 21:57:50.463959 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.462714    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/93887b82-e82e-4df0-9821-51c194c31721-etc-tuned\") pod \"tuned-q8mts\" (UID: \"93887b82-e82e-4df0-9821-51c194c31721\") " pod="openshift-cluster-node-tuning-operator/tuned-q8mts"
Sep 17 21:57:50.463959 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.462740    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93887b82-e82e-4df0-9821-51c194c31721-tmp\") pod \"tuned-q8mts\" (UID: \"93887b82-e82e-4df0-9821-51c194c31721\") " pod="openshift-cluster-node-tuning-operator/tuned-q8mts"
Sep 17 21:57:50.463959 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.462758    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/00fb2a0f-d0d6-4d8d-8884-04fc3cd6aea4-system-cni-dir\") pod \"multus-additional-cni-plugins-nn2xs\" (UID: \"00fb2a0f-d0d6-4d8d-8884-04fc3cd6aea4\") " pod="openshift-multus/multus-additional-cni-plugins-nn2xs"
Sep 17 21:57:50.463959 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.462767    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/42972d7a-57ce-429f-b1f4-cd2333a5c3ee-system-cni-dir\") pod \"multus-scs8m\" (UID: \"42972d7a-57ce-429f-b1f4-cd2333a5c3ee\") " pod="openshift-multus/multus-scs8m"
Sep 17 21:57:50.463959 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.462831    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/42972d7a-57ce-429f-b1f4-cd2333a5c3ee-host-var-lib-kubelet\") pod \"multus-scs8m\" (UID: \"42972d7a-57ce-429f-b1f4-cd2333a5c3ee\") " pod="openshift-multus/multus-scs8m"
Sep 17 21:57:50.463959 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.462862    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5cbc96f5-dc5a-46ab-b739-db19685500ac-run-ovn\") pod \"ovnkube-node-llwgv\" (UID: \"5cbc96f5-dc5a-46ab-b739-db19685500ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:57:50.463959 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.462887    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gphl\" (UniqueName: \"kubernetes.io/projected/7ac7682e-e943-4684-9c1b-eee2c58acbf1-kube-api-access-7gphl\") pod \"node-resolver-hllvl\" (UID: \"7ac7682e-e943-4684-9c1b-eee2c58acbf1\") " pod="openshift-dns/node-resolver-hllvl"
Sep 17 21:57:50.463959 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.462906    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5cbc96f5-dc5a-46ab-b739-db19685500ac-host-cni-bin\") pod \"ovnkube-node-llwgv\" (UID: \"5cbc96f5-dc5a-46ab-b739-db19685500ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:57:50.463959 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.463003    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/845f08e5-f5c6-430c-befa-727ab76b3a00-serviceca\") pod \"node-ca-z4bjm\" (UID: \"845f08e5-f5c6-430c-befa-727ab76b3a00\") " pod="openshift-image-registry/node-ca-z4bjm"
Sep 17 21:57:50.463959 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.463377    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6505672f-86e4-439d-88c0-8b8ac9bcb987-konnectivity-ca\") pod \"konnectivity-agent-tprjw\" (UID: \"6505672f-86e4-439d-88c0-8b8ac9bcb987\") " pod="kube-system/konnectivity-agent-tprjw"
Sep 17 21:57:50.466665 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.466643    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6505672f-86e4-439d-88c0-8b8ac9bcb987-agent-certs\") pod \"konnectivity-agent-tprjw\" (UID: \"6505672f-86e4-439d-88c0-8b8ac9bcb987\") " pod="kube-system/konnectivity-agent-tprjw"
Sep 17 21:57:50.473188 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.473167    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wr9n\" (UniqueName: \"kubernetes.io/projected/00fb2a0f-d0d6-4d8d-8884-04fc3cd6aea4-kube-api-access-4wr9n\") pod \"multus-additional-cni-plugins-nn2xs\" (UID: \"00fb2a0f-d0d6-4d8d-8884-04fc3cd6aea4\") " pod="openshift-multus/multus-additional-cni-plugins-nn2xs"
Sep 17 21:57:50.473284 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.473222    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7r5xg\" (UniqueName: \"kubernetes.io/projected/09abe478-d8e5-4f5b-bec5-59b113bd11fa-kube-api-access-7r5xg\") pod \"iptables-alerter-lff7k\" (UID: \"09abe478-d8e5-4f5b-bec5-59b113bd11fa\") " pod="openshift-network-operator/iptables-alerter-lff7k"
Sep 17 21:57:50.473768 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.473724    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcgf2\" (UniqueName: \"kubernetes.io/projected/3fb1b40d-8101-4632-8212-47eac7ec2425-kube-api-access-fcgf2\") pod \"aws-ebs-csi-driver-node-jj8hs\" (UID: \"3fb1b40d-8101-4632-8212-47eac7ec2425\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jj8hs"
Sep 17 21:57:50.473870 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.473779    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4m6t\" (UniqueName: \"kubernetes.io/projected/845f08e5-f5c6-430c-befa-727ab76b3a00-kube-api-access-h4m6t\") pod \"node-ca-z4bjm\" (UID: \"845f08e5-f5c6-430c-befa-727ab76b3a00\") " pod="openshift-image-registry/node-ca-z4bjm"
Sep 17 21:57:50.474222 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.474200    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gphl\" (UniqueName: \"kubernetes.io/projected/7ac7682e-e943-4684-9c1b-eee2c58acbf1-kube-api-access-7gphl\") pod \"node-resolver-hllvl\" (UID: \"7ac7682e-e943-4684-9c1b-eee2c58acbf1\") " pod="openshift-dns/node-resolver-hllvl"
Sep 17 21:57:50.564556 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.564525    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8dedff64-89fd-41e2-83e7-e5bdf85f3470-metrics-certs\") pod \"network-metrics-daemon-j58cx\" (UID: \"8dedff64-89fd-41e2-83e7-e5bdf85f3470\") " pod="openshift-multus/network-metrics-daemon-j58cx"
Sep 17 21:57:50.564706 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.564567    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/42972d7a-57ce-429f-b1f4-cd2333a5c3ee-hostroot\") pod \"multus-scs8m\" (UID: \"42972d7a-57ce-429f-b1f4-cd2333a5c3ee\") " pod="openshift-multus/multus-scs8m"
Sep 17 21:57:50.564706 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.564589    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5cbc96f5-dc5a-46ab-b739-db19685500ac-env-overrides\") pod \"ovnkube-node-llwgv\" (UID: \"5cbc96f5-dc5a-46ab-b739-db19685500ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:57:50.564706 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.564659    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/93887b82-e82e-4df0-9821-51c194c31721-etc-sysconfig\") pod \"tuned-q8mts\" (UID: \"93887b82-e82e-4df0-9821-51c194c31721\") " pod="openshift-cluster-node-tuning-operator/tuned-q8mts"
Sep 17 21:57:50.564706 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.564677    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/93887b82-e82e-4df0-9821-51c194c31721-etc-tuned\") pod \"tuned-q8mts\" (UID: \"93887b82-e82e-4df0-9821-51c194c31721\") " pod="openshift-cluster-node-tuning-operator/tuned-q8mts"
Sep 17 21:57:50.564706 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.564698    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93887b82-e82e-4df0-9821-51c194c31721-tmp\") pod \"tuned-q8mts\" (UID: \"93887b82-e82e-4df0-9821-51c194c31721\") " pod="openshift-cluster-node-tuning-operator/tuned-q8mts"
Sep 17 21:57:50.564939 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.564741    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/42972d7a-57ce-429f-b1f4-cd2333a5c3ee-system-cni-dir\") pod \"multus-scs8m\" (UID: \"42972d7a-57ce-429f-b1f4-cd2333a5c3ee\") " pod="openshift-multus/multus-scs8m"
Sep 17 21:57:50.564939 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.564760    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/42972d7a-57ce-429f-b1f4-cd2333a5c3ee-host-var-lib-kubelet\") pod \"multus-scs8m\" (UID: \"42972d7a-57ce-429f-b1f4-cd2333a5c3ee\") " pod="openshift-multus/multus-scs8m"
Sep 17 21:57:50.564939 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.564782    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5cbc96f5-dc5a-46ab-b739-db19685500ac-run-ovn\") pod \"ovnkube-node-llwgv\" (UID: \"5cbc96f5-dc5a-46ab-b739-db19685500ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:57:50.564939 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.564848    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5cbc96f5-dc5a-46ab-b739-db19685500ac-host-cni-bin\") pod \"ovnkube-node-llwgv\" (UID: \"5cbc96f5-dc5a-46ab-b739-db19685500ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:57:50.564939 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.564875    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5cbc96f5-dc5a-46ab-b739-db19685500ac-host-kubelet\") pod \"ovnkube-node-llwgv\" (UID: \"5cbc96f5-dc5a-46ab-b739-db19685500ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:57:50.564939 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.564898    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5cbc96f5-dc5a-46ab-b739-db19685500ac-systemd-units\") pod \"ovnkube-node-llwgv\" (UID: \"5cbc96f5-dc5a-46ab-b739-db19685500ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:57:50.564939 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.564924    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5cbc96f5-dc5a-46ab-b739-db19685500ac-var-lib-openvswitch\") pod \"ovnkube-node-llwgv\" (UID: \"5cbc96f5-dc5a-46ab-b739-db19685500ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:57:50.565147 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.564945    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/93887b82-e82e-4df0-9821-51c194c31721-host\") pod \"tuned-q8mts\" (UID: \"93887b82-e82e-4df0-9821-51c194c31721\") " pod="openshift-cluster-node-tuning-operator/tuned-q8mts"
Sep 17 21:57:50.565147 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.564963    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-md225\" (UniqueName: \"kubernetes.io/projected/4a6387b2-b54c-44e0-909d-589e73c07248-kube-api-access-md225\") pod \"network-check-target-zdznt\" (UID: \"4a6387b2-b54c-44e0-909d-589e73c07248\") " pod="openshift-network-diagnostics/network-check-target-zdznt"
Sep 17 21:57:50.565147 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.564986    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5cbc96f5-dc5a-46ab-b739-db19685500ac-log-socket\") pod \"ovnkube-node-llwgv\" (UID: \"5cbc96f5-dc5a-46ab-b739-db19685500ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:57:50.565147 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.565013    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/93887b82-e82e-4df0-9821-51c194c31721-lib-modules\") pod \"tuned-q8mts\" (UID: \"93887b82-e82e-4df0-9821-51c194c31721\") " pod="openshift-cluster-node-tuning-operator/tuned-q8mts"
Sep 17 21:57:50.565147 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.565043    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2c0000a6-1b43-479b-a06b-06eb5db40c2d-original-pull-secret\") pod \"global-pull-secret-syncer-br6wh\" (UID: \"2c0000a6-1b43-479b-a06b-06eb5db40c2d\") " pod="kube-system/global-pull-secret-syncer-br6wh"
Sep 17 21:57:50.565147 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.565061    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/42972d7a-57ce-429f-b1f4-cd2333a5c3ee-cnibin\") pod \"multus-scs8m\" (UID: \"42972d7a-57ce-429f-b1f4-cd2333a5c3ee\") " pod="openshift-multus/multus-scs8m"
Sep 17 21:57:50.565147 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.565088    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5cbc96f5-dc5a-46ab-b739-db19685500ac-ovn-node-metrics-cert\") pod \"ovnkube-node-llwgv\" (UID: \"5cbc96f5-dc5a-46ab-b739-db19685500ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:57:50.565147 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.565110    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9x8lb\" (UniqueName: \"kubernetes.io/projected/5cbc96f5-dc5a-46ab-b739-db19685500ac-kube-api-access-9x8lb\") pod \"ovnkube-node-llwgv\" (UID: \"5cbc96f5-dc5a-46ab-b739-db19685500ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:57:50.565147 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.565133    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78znh\" (UniqueName: \"kubernetes.io/projected/8dedff64-89fd-41e2-83e7-e5bdf85f3470-kube-api-access-78znh\") pod \"network-metrics-daemon-j58cx\" (UID: \"8dedff64-89fd-41e2-83e7-e5bdf85f3470\") " pod="openshift-multus/network-metrics-daemon-j58cx"
Sep 17 21:57:50.565500 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.565154    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/93887b82-e82e-4df0-9821-51c194c31721-sys\") pod \"tuned-q8mts\" (UID: \"93887b82-e82e-4df0-9821-51c194c31721\") " pod="openshift-cluster-node-tuning-operator/tuned-q8mts"
Sep 17 21:57:50.565500 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.565180    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/93887b82-e82e-4df0-9821-51c194c31721-run\") pod \"tuned-q8mts\" (UID: \"93887b82-e82e-4df0-9821-51c194c31721\") " pod="openshift-cluster-node-tuning-operator/tuned-q8mts"
Sep 17 21:57:50.565500 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.565198    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knddc\" (UniqueName: \"kubernetes.io/projected/93887b82-e82e-4df0-9821-51c194c31721-kube-api-access-knddc\") pod \"tuned-q8mts\" (UID: \"93887b82-e82e-4df0-9821-51c194c31721\") " pod="openshift-cluster-node-tuning-operator/tuned-q8mts"
Sep 17 21:57:50.565500 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.565217    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/42972d7a-57ce-429f-b1f4-cd2333a5c3ee-host-var-lib-cni-multus\") pod \"multus-scs8m\" (UID: \"42972d7a-57ce-429f-b1f4-cd2333a5c3ee\") " pod="openshift-multus/multus-scs8m"
Sep 17 21:57:50.565500 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.565241    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5cbc96f5-dc5a-46ab-b739-db19685500ac-run-openvswitch\") pod \"ovnkube-node-llwgv\" (UID: \"5cbc96f5-dc5a-46ab-b739-db19685500ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:57:50.565500 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.565267    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5cbc96f5-dc5a-46ab-b739-db19685500ac-ovnkube-config\") pod \"ovnkube-node-llwgv\" (UID: \"5cbc96f5-dc5a-46ab-b739-db19685500ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:57:50.565500 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.565287    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/42972d7a-57ce-429f-b1f4-cd2333a5c3ee-host-run-netns\") pod \"multus-scs8m\" (UID: \"42972d7a-57ce-429f-b1f4-cd2333a5c3ee\") " pod="openshift-multus/multus-scs8m"
Sep 17 21:57:50.565500 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.565309    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/42972d7a-57ce-429f-b1f4-cd2333a5c3ee-host-var-lib-cni-bin\") pod \"multus-scs8m\" (UID: \"42972d7a-57ce-429f-b1f4-cd2333a5c3ee\") " pod="openshift-multus/multus-scs8m"
Sep 17 21:57:50.565500 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.565337    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/93887b82-e82e-4df0-9821-51c194c31721-etc-sysctl-conf\") pod \"tuned-q8mts\" (UID: \"93887b82-e82e-4df0-9821-51c194c31721\") " pod="openshift-cluster-node-tuning-operator/tuned-q8mts"
Sep 17 21:57:50.565500 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.565373    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5cbc96f5-dc5a-46ab-b739-db19685500ac-host-run-ovn-kubernetes\") pod \"ovnkube-node-llwgv\" (UID: \"5cbc96f5-dc5a-46ab-b739-db19685500ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:57:50.565500 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.565409    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/93887b82-e82e-4df0-9821-51c194c31721-etc-sysctl-d\") pod \"tuned-q8mts\" (UID: \"93887b82-e82e-4df0-9821-51c194c31721\") " pod="openshift-cluster-node-tuning-operator/tuned-q8mts"
Sep 17 21:57:50.565500 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.565466    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/42972d7a-57ce-429f-b1f4-cd2333a5c3ee-multus-cni-dir\") pod \"multus-scs8m\" (UID: \"42972d7a-57ce-429f-b1f4-cd2333a5c3ee\") " pod="openshift-multus/multus-scs8m"
Sep 17 21:57:50.566063 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.565514    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/42972d7a-57ce-429f-b1f4-cd2333a5c3ee-multus-daemon-config\") pod \"multus-scs8m\" (UID: \"42972d7a-57ce-429f-b1f4-cd2333a5c3ee\") " pod="openshift-multus/multus-scs8m"
Sep 17 21:57:50.566063 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.565552    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93887b82-e82e-4df0-9821-51c194c31721-etc-kubernetes\") pod \"tuned-q8mts\" (UID: \"93887b82-e82e-4df0-9821-51c194c31721\") " pod="openshift-cluster-node-tuning-operator/tuned-q8mts"
Sep 17 21:57:50.566063 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.565588    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/42972d7a-57ce-429f-b1f4-cd2333a5c3ee-multus-socket-dir-parent\") pod \"multus-scs8m\" (UID: \"42972d7a-57ce-429f-b1f4-cd2333a5c3ee\") " pod="openshift-multus/multus-scs8m"
Sep 17 21:57:50.566063 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.565626    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5cbc96f5-dc5a-46ab-b739-db19685500ac-etc-openvswitch\") pod \"ovnkube-node-llwgv\" (UID: \"5cbc96f5-dc5a-46ab-b739-db19685500ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:57:50.566063 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.565666    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/42972d7a-57ce-429f-b1f4-cd2333a5c3ee-multus-conf-dir\") pod \"multus-scs8m\" (UID: \"42972d7a-57ce-429f-b1f4-cd2333a5c3ee\") " pod="openshift-multus/multus-scs8m"
Sep 17 21:57:50.566063 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.565701    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjf6r\" (UniqueName: \"kubernetes.io/projected/42972d7a-57ce-429f-b1f4-cd2333a5c3ee-kube-api-access-sjf6r\") pod \"multus-scs8m\" (UID: \"42972d7a-57ce-429f-b1f4-cd2333a5c3ee\") " pod="openshift-multus/multus-scs8m"
Sep 17 21:57:50.566063 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.565731    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5cbc96f5-dc5a-46ab-b739-db19685500ac-run-systemd\") pod \"ovnkube-node-llwgv\" (UID: \"5cbc96f5-dc5a-46ab-b739-db19685500ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:57:50.566063 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.565765    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5cbc96f5-dc5a-46ab-b739-db19685500ac-node-log\") pod \"ovnkube-node-llwgv\" (UID: \"5cbc96f5-dc5a-46ab-b739-db19685500ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:57:50.566063 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.565803    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/93887b82-e82e-4df0-9821-51c194c31721-etc-systemd\") pod \"tuned-q8mts\" (UID: \"93887b82-e82e-4df0-9821-51c194c31721\") " pod="openshift-cluster-node-tuning-operator/tuned-q8mts"
Sep 17 21:57:50.566063 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.565842    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/42972d7a-57ce-429f-b1f4-cd2333a5c3ee-host-run-multus-certs\") pod \"multus-scs8m\" (UID: \"42972d7a-57ce-429f-b1f4-cd2333a5c3ee\") " pod="openshift-multus/multus-scs8m"
Sep 17 21:57:50.566063 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.565891    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/93887b82-e82e-4df0-9821-51c194c31721-etc-modprobe-d\") pod \"tuned-q8mts\" (UID: \"93887b82-e82e-4df0-9821-51c194c31721\") " pod="openshift-cluster-node-tuning-operator/tuned-q8mts"
Sep 17 21:57:50.566063 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.565933    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/93887b82-e82e-4df0-9821-51c194c31721-var-lib-kubelet\") pod \"tuned-q8mts\" (UID: \"93887b82-e82e-4df0-9821-51c194c31721\") " pod="openshift-cluster-node-tuning-operator/tuned-q8mts"
Sep 17 21:57:50.566063 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.565972    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2c0000a6-1b43-479b-a06b-06eb5db40c2d-dbus\") pod \"global-pull-secret-syncer-br6wh\" (UID: \"2c0000a6-1b43-479b-a06b-06eb5db40c2d\") " pod="kube-system/global-pull-secret-syncer-br6wh"
Sep 17 21:57:50.566063 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.566011    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42972d7a-57ce-429f-b1f4-cd2333a5c3ee-etc-kubernetes\") pod \"multus-scs8m\" (UID: \"42972d7a-57ce-429f-b1f4-cd2333a5c3ee\") " pod="openshift-multus/multus-scs8m"
Sep 17 21:57:50.566063 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.566047    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5cbc96f5-dc5a-46ab-b739-db19685500ac-host-run-netns\") pod \"ovnkube-node-llwgv\" (UID: \"5cbc96f5-dc5a-46ab-b739-db19685500ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:57:50.566856 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.566078    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5cbc96f5-dc5a-46ab-b739-db19685500ac-ovnkube-script-lib\") pod \"ovnkube-node-llwgv\" (UID: \"5cbc96f5-dc5a-46ab-b739-db19685500ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:57:50.566856 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.566116    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/42972d7a-57ce-429f-b1f4-cd2333a5c3ee-host-run-k8s-cni-cncf-io\") pod \"multus-scs8m\" (UID: \"42972d7a-57ce-429f-b1f4-cd2333a5c3ee\") " pod="openshift-multus/multus-scs8m"
Sep 17 21:57:50.566856 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.566157    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2c0000a6-1b43-479b-a06b-06eb5db40c2d-kubelet-config\") pod \"global-pull-secret-syncer-br6wh\" (UID: \"2c0000a6-1b43-479b-a06b-06eb5db40c2d\") " pod="kube-system/global-pull-secret-syncer-br6wh"
Sep 17 21:57:50.566856 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.566193    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/42972d7a-57ce-429f-b1f4-cd2333a5c3ee-cni-binary-copy\") pod \"multus-scs8m\" (UID: \"42972d7a-57ce-429f-b1f4-cd2333a5c3ee\") " pod="openshift-multus/multus-scs8m"
Sep 17 21:57:50.566856 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.566241    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5cbc96f5-dc5a-46ab-b739-db19685500ac-host-slash\") pod \"ovnkube-node-llwgv\" (UID: \"5cbc96f5-dc5a-46ab-b739-db19685500ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:57:50.566856 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.566276    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5cbc96f5-dc5a-46ab-b739-db19685500ac-host-cni-netd\") pod \"ovnkube-node-llwgv\" (UID: \"5cbc96f5-dc5a-46ab-b739-db19685500ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:57:50.566856 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.566311    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5cbc96f5-dc5a-46ab-b739-db19685500ac-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-llwgv\" (UID: \"5cbc96f5-dc5a-46ab-b739-db19685500ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:57:50.566856 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:50.566365    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 21:57:50.566856 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.566462    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5cbc96f5-dc5a-46ab-b739-db19685500ac-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-llwgv\" (UID: \"5cbc96f5-dc5a-46ab-b739-db19685500ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:57:50.566856 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:50.566483    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dedff64-89fd-41e2-83e7-e5bdf85f3470-metrics-certs podName:8dedff64-89fd-41e2-83e7-e5bdf85f3470 nodeName:}" failed. No retries permitted until 2026-09-17 21:57:51.066441447 +0000 UTC m=+3.126213457 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8dedff64-89fd-41e2-83e7-e5bdf85f3470-metrics-certs") pod "network-metrics-daemon-j58cx" (UID: "8dedff64-89fd-41e2-83e7-e5bdf85f3470") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 21:57:50.566856 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.566543    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/42972d7a-57ce-429f-b1f4-cd2333a5c3ee-hostroot\") pod \"multus-scs8m\" (UID: \"42972d7a-57ce-429f-b1f4-cd2333a5c3ee\") " pod="openshift-multus/multus-scs8m"
Sep 17 21:57:50.567449 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.567071    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5cbc96f5-dc5a-46ab-b739-db19685500ac-env-overrides\") pod \"ovnkube-node-llwgv\" (UID: \"5cbc96f5-dc5a-46ab-b739-db19685500ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:57:50.567449 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.567097    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5cbc96f5-dc5a-46ab-b739-db19685500ac-ovnkube-config\") pod \"ovnkube-node-llwgv\" (UID: \"5cbc96f5-dc5a-46ab-b739-db19685500ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:57:50.567449 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.567160    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/93887b82-e82e-4df0-9821-51c194c31721-etc-sysconfig\") pod \"tuned-q8mts\" (UID: \"93887b82-e82e-4df0-9821-51c194c31721\") " pod="openshift-cluster-node-tuning-operator/tuned-q8mts"
Sep 17 21:57:50.569339 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.569059    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/93887b82-e82e-4df0-9821-51c194c31721-lib-modules\") pod \"tuned-q8mts\" (UID: \"93887b82-e82e-4df0-9821-51c194c31721\") " pod="openshift-cluster-node-tuning-operator/tuned-q8mts"
Sep 17 21:57:50.569339 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.569188    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/42972d7a-57ce-429f-b1f4-cd2333a5c3ee-system-cni-dir\") pod \"multus-scs8m\" (UID: \"42972d7a-57ce-429f-b1f4-cd2333a5c3ee\") " pod="openshift-multus/multus-scs8m"
Sep 17 21:57:50.569339 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.569250    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/42972d7a-57ce-429f-b1f4-cd2333a5c3ee-host-var-lib-kubelet\") pod \"multus-scs8m\" (UID: \"42972d7a-57ce-429f-b1f4-cd2333a5c3ee\") " pod="openshift-multus/multus-scs8m"
Sep 17 21:57:50.569339 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.569287    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/42972d7a-57ce-429f-b1f4-cd2333a5c3ee-host-run-netns\") pod \"multus-scs8m\" (UID: \"42972d7a-57ce-429f-b1f4-cd2333a5c3ee\") " pod="openshift-multus/multus-scs8m"
Sep 17 21:57:50.569339 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.569310    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5cbc96f5-dc5a-46ab-b739-db19685500ac-run-ovn\") pod \"ovnkube-node-llwgv\" (UID: \"5cbc96f5-dc5a-46ab-b739-db19685500ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:57:50.569679 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.569360    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/42972d7a-57ce-429f-b1f4-cd2333a5c3ee-host-var-lib-cni-bin\") pod \"multus-scs8m\" (UID: \"42972d7a-57ce-429f-b1f4-cd2333a5c3ee\") " pod="openshift-multus/multus-scs8m"
Sep 17 21:57:50.569679 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.569367    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5cbc96f5-dc5a-46ab-b739-db19685500ac-host-cni-bin\") pod \"ovnkube-node-llwgv\" (UID: \"5cbc96f5-dc5a-46ab-b739-db19685500ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:57:50.569679 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.569447    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5cbc96f5-dc5a-46ab-b739-db19685500ac-systemd-units\") pod \"ovnkube-node-llwgv\" (UID: \"5cbc96f5-dc5a-46ab-b739-db19685500ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:57:50.569679 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.569500    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5cbc96f5-dc5a-46ab-b739-db19685500ac-var-lib-openvswitch\") pod \"ovnkube-node-llwgv\" (UID: \"5cbc96f5-dc5a-46ab-b739-db19685500ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:57:50.569679 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.569514    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/93887b82-e82e-4df0-9821-51c194c31721-etc-sysctl-conf\") pod \"tuned-q8mts\" (UID: \"93887b82-e82e-4df0-9821-51c194c31721\") " pod="openshift-cluster-node-tuning-operator/tuned-q8mts"
Sep 17 21:57:50.569679 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.569561    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5cbc96f5-dc5a-46ab-b739-db19685500ac-host-kubelet\") pod \"ovnkube-node-llwgv\" (UID: \"5cbc96f5-dc5a-46ab-b739-db19685500ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:57:50.569679 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.569576    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5cbc96f5-dc5a-46ab-b739-db19685500ac-log-socket\") pod \"ovnkube-node-llwgv\" (UID: \"5cbc96f5-dc5a-46ab-b739-db19685500ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:57:50.569679 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.569619    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/93887b82-e82e-4df0-9821-51c194c31721-host\") pod \"tuned-q8mts\" (UID: \"93887b82-e82e-4df0-9821-51c194c31721\") " pod="openshift-cluster-node-tuning-operator/tuned-q8mts"
Sep 17 21:57:50.569679 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.569677    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5cbc96f5-dc5a-46ab-b739-db19685500ac-host-run-ovn-kubernetes\") pod \"ovnkube-node-llwgv\" (UID: \"5cbc96f5-dc5a-46ab-b739-db19685500ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:57:50.570130 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.569781    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/93887b82-e82e-4df0-9821-51c194c31721-etc-sysctl-d\") pod \"tuned-q8mts\" (UID: \"93887b82-e82e-4df0-9821-51c194c31721\") " pod="openshift-cluster-node-tuning-operator/tuned-q8mts"
Sep 17 21:57:50.570130 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.569886    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/42972d7a-57ce-429f-b1f4-cd2333a5c3ee-multus-cni-dir\") pod \"multus-scs8m\" (UID: \"42972d7a-57ce-429f-b1f4-cd2333a5c3ee\") " pod="openshift-multus/multus-scs8m"
Sep 17 21:57:50.570130 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.569993    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5cbc96f5-dc5a-46ab-b739-db19685500ac-host-run-netns\") pod \"ovnkube-node-llwgv\" (UID: \"5cbc96f5-dc5a-46ab-b739-db19685500ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:57:50.570130 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.570011    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/93887b82-e82e-4df0-9821-51c194c31721-var-lib-kubelet\") pod \"tuned-q8mts\" (UID: \"93887b82-e82e-4df0-9821-51c194c31721\") " pod="openshift-cluster-node-tuning-operator/tuned-q8mts"
Sep 17 21:57:50.570798 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.570533    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2c0000a6-1b43-479b-a06b-06eb5db40c2d-kubelet-config\") pod \"global-pull-secret-syncer-br6wh\" (UID: \"2c0000a6-1b43-479b-a06b-06eb5db40c2d\") " pod="kube-system/global-pull-secret-syncer-br6wh"
Sep 17 21:57:50.570798 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.570633    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/93887b82-e82e-4df0-9821-51c194c31721-etc-modprobe-d\") pod \"tuned-q8mts\" (UID: \"93887b82-e82e-4df0-9821-51c194c31721\") " pod="openshift-cluster-node-tuning-operator/tuned-q8mts"
Sep 17 21:57:50.570798 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.570655    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5cbc96f5-dc5a-46ab-b739-db19685500ac-ovnkube-script-lib\") pod \"ovnkube-node-llwgv\" (UID: \"5cbc96f5-dc5a-46ab-b739-db19685500ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:57:50.570798 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.570681    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5cbc96f5-dc5a-46ab-b739-db19685500ac-run-openvswitch\") pod \"ovnkube-node-llwgv\" (UID: \"5cbc96f5-dc5a-46ab-b739-db19685500ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:57:50.570798 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.570731    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5cbc96f5-dc5a-46ab-b739-db19685500ac-host-slash\") pod \"ovnkube-node-llwgv\" (UID: \"5cbc96f5-dc5a-46ab-b739-db19685500ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:57:50.570798 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.570778    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42972d7a-57ce-429f-b1f4-cd2333a5c3ee-etc-kubernetes\") pod \"multus-scs8m\" (UID: \"42972d7a-57ce-429f-b1f4-cd2333a5c3ee\") " pod="openshift-multus/multus-scs8m"
Sep 17 21:57:50.571190 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.570831    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5cbc96f5-dc5a-46ab-b739-db19685500ac-host-cni-netd\") pod \"ovnkube-node-llwgv\" (UID: \"5cbc96f5-dc5a-46ab-b739-db19685500ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:57:50.571190 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.570884    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/42972d7a-57ce-429f-b1f4-cd2333a5c3ee-host-run-k8s-cni-cncf-io\") pod \"multus-scs8m\" (UID: \"42972d7a-57ce-429f-b1f4-cd2333a5c3ee\") " pod="openshift-multus/multus-scs8m"
Sep 17 21:57:50.571293 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.571219    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5cbc96f5-dc5a-46ab-b739-db19685500ac-run-systemd\") pod \"ovnkube-node-llwgv\" (UID: \"5cbc96f5-dc5a-46ab-b739-db19685500ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:57:50.571350 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.571327    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2c0000a6-1b43-479b-a06b-06eb5db40c2d-dbus\") pod \"global-pull-secret-syncer-br6wh\" (UID: \"2c0000a6-1b43-479b-a06b-06eb5db40c2d\") " pod="kube-system/global-pull-secret-syncer-br6wh"
Sep 17 21:57:50.571405 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.571382    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5cbc96f5-dc5a-46ab-b739-db19685500ac-node-log\") pod \"ovnkube-node-llwgv\" (UID: \"5cbc96f5-dc5a-46ab-b739-db19685500ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:57:50.571474 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.571454    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/93887b82-e82e-4df0-9821-51c194c31721-etc-systemd\") pod \"tuned-q8mts\" (UID: \"93887b82-e82e-4df0-9821-51c194c31721\") " pod="openshift-cluster-node-tuning-operator/tuned-q8mts"
Sep 17 21:57:50.571718 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:50.571701    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 21:57:50.571800 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:50.571758    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c0000a6-1b43-479b-a06b-06eb5db40c2d-original-pull-secret podName:2c0000a6-1b43-479b-a06b-06eb5db40c2d nodeName:}" failed. No retries permitted until 2026-09-17 21:57:51.071744262 +0000 UTC m=+3.131516252 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2c0000a6-1b43-479b-a06b-06eb5db40c2d-original-pull-secret") pod "global-pull-secret-syncer-br6wh" (UID: "2c0000a6-1b43-479b-a06b-06eb5db40c2d") : object "kube-system"/"original-pull-secret" not registered
Sep 17 21:57:50.571851 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.571815    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/42972d7a-57ce-429f-b1f4-cd2333a5c3ee-cnibin\") pod \"multus-scs8m\" (UID: \"42972d7a-57ce-429f-b1f4-cd2333a5c3ee\") " pod="openshift-multus/multus-scs8m"
Sep 17 21:57:50.571884 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.571866    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/42972d7a-57ce-429f-b1f4-cd2333a5c3ee-host-run-multus-certs\") pod \"multus-scs8m\" (UID: \"42972d7a-57ce-429f-b1f4-cd2333a5c3ee\") " pod="openshift-multus/multus-scs8m"
Sep 17 21:57:50.572111 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.572089    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/42972d7a-57ce-429f-b1f4-cd2333a5c3ee-multus-socket-dir-parent\") pod \"multus-scs8m\" (UID: \"42972d7a-57ce-429f-b1f4-cd2333a5c3ee\") " pod="openshift-multus/multus-scs8m"
Sep 17 21:57:50.572190 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.572143    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93887b82-e82e-4df0-9821-51c194c31721-etc-kubernetes\") pod \"tuned-q8mts\" (UID: \"93887b82-e82e-4df0-9821-51c194c31721\") " pod="openshift-cluster-node-tuning-operator/tuned-q8mts"
Sep 17 21:57:50.572253 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.572198    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5cbc96f5-dc5a-46ab-b739-db19685500ac-etc-openvswitch\") pod \"ovnkube-node-llwgv\" (UID: \"5cbc96f5-dc5a-46ab-b739-db19685500ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:57:50.572253 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.572233    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/42972d7a-57ce-429f-b1f4-cd2333a5c3ee-multus-daemon-config\") pod \"multus-scs8m\" (UID: \"42972d7a-57ce-429f-b1f4-cd2333a5c3ee\") " pod="openshift-multus/multus-scs8m"
Sep 17 21:57:50.572362 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.572247    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/42972d7a-57ce-429f-b1f4-cd2333a5c3ee-multus-conf-dir\") pod \"multus-scs8m\" (UID: \"42972d7a-57ce-429f-b1f4-cd2333a5c3ee\") " pod="openshift-multus/multus-scs8m"
Sep 17 21:57:50.572362 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.572251    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/42972d7a-57ce-429f-b1f4-cd2333a5c3ee-host-var-lib-cni-multus\") pod \"multus-scs8m\" (UID: \"42972d7a-57ce-429f-b1f4-cd2333a5c3ee\") " pod="openshift-multus/multus-scs8m"
Sep 17 21:57:50.572362 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.572352    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/93887b82-e82e-4df0-9821-51c194c31721-sys\") pod \"tuned-q8mts\" (UID: \"93887b82-e82e-4df0-9821-51c194c31721\") " pod="openshift-cluster-node-tuning-operator/tuned-q8mts"
Sep 17 21:57:50.572556 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.572436    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/93887b82-e82e-4df0-9821-51c194c31721-run\") pod \"tuned-q8mts\" (UID: \"93887b82-e82e-4df0-9821-51c194c31721\") " pod="openshift-cluster-node-tuning-operator/tuned-q8mts"
Sep 17 21:57:50.572655 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.572603    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93887b82-e82e-4df0-9821-51c194c31721-tmp\") pod \"tuned-q8mts\" (UID: \"93887b82-e82e-4df0-9821-51c194c31721\") " pod="openshift-cluster-node-tuning-operator/tuned-q8mts"
Sep 17 21:57:50.572738 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.572724    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/42972d7a-57ce-429f-b1f4-cd2333a5c3ee-cni-binary-copy\") pod \"multus-scs8m\" (UID: \"42972d7a-57ce-429f-b1f4-cd2333a5c3ee\") " pod="openshift-multus/multus-scs8m"
Sep 17 21:57:50.574103 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.574077    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5cbc96f5-dc5a-46ab-b739-db19685500ac-ovn-node-metrics-cert\") pod \"ovnkube-node-llwgv\" (UID: \"5cbc96f5-dc5a-46ab-b739-db19685500ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:57:50.574764 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.574734    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/93887b82-e82e-4df0-9821-51c194c31721-etc-tuned\") pod \"tuned-q8mts\" (UID: \"93887b82-e82e-4df0-9821-51c194c31721\") " pod="openshift-cluster-node-tuning-operator/tuned-q8mts"
Sep 17 21:57:50.576032 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:50.576011    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 21:57:50.576141 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:50.576039    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 21:57:50.576141 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:50.576054    2560 projected.go:196] Error preparing data for projected volume kube-api-access-md225 for pod openshift-network-diagnostics/network-check-target-zdznt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 21:57:50.576141 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:50.576128    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a6387b2-b54c-44e0-909d-589e73c07248-kube-api-access-md225 podName:4a6387b2-b54c-44e0-909d-589e73c07248 nodeName:}" failed. No retries permitted until 2026-09-17 21:57:51.076111435 +0000 UTC m=+3.135883429 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-md225" (UniqueName: "kubernetes.io/projected/4a6387b2-b54c-44e0-909d-589e73c07248-kube-api-access-md225") pod "network-check-target-zdznt" (UID: "4a6387b2-b54c-44e0-909d-589e73c07248") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 21:57:50.579056 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.579033    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjf6r\" (UniqueName: \"kubernetes.io/projected/42972d7a-57ce-429f-b1f4-cd2333a5c3ee-kube-api-access-sjf6r\") pod \"multus-scs8m\" (UID: \"42972d7a-57ce-429f-b1f4-cd2333a5c3ee\") " pod="openshift-multus/multus-scs8m"
Sep 17 21:57:50.579193 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.579174    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-78znh\" (UniqueName: \"kubernetes.io/projected/8dedff64-89fd-41e2-83e7-e5bdf85f3470-kube-api-access-78znh\") pod \"network-metrics-daemon-j58cx\" (UID: \"8dedff64-89fd-41e2-83e7-e5bdf85f3470\") " pod="openshift-multus/network-metrics-daemon-j58cx"
Sep 17 21:57:50.579739 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.579715    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9x8lb\" (UniqueName: \"kubernetes.io/projected/5cbc96f5-dc5a-46ab-b739-db19685500ac-kube-api-access-9x8lb\") pod \"ovnkube-node-llwgv\" (UID: \"5cbc96f5-dc5a-46ab-b739-db19685500ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:57:50.581241 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.581218    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knddc\" (UniqueName: \"kubernetes.io/projected/93887b82-e82e-4df0-9821-51c194c31721-kube-api-access-knddc\") pod \"tuned-q8mts\" (UID: \"93887b82-e82e-4df0-9821-51c194c31721\") " pod="openshift-cluster-node-tuning-operator/tuned-q8mts"
Sep 17 21:57:50.650910 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.650837    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hllvl"
Sep 17 21:57:50.659043 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.659013    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tprjw"
Sep 17 21:57:50.669834 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.669809    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nn2xs"
Sep 17 21:57:50.678902 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.678876    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lff7k"
Sep 17 21:57:50.686721 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.686698    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-z4bjm"
Sep 17 21:57:50.695052 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.695027    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jj8hs"
Sep 17 21:57:50.702823 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.702684    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-q8mts"
Sep 17 21:57:50.709886 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.709866    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-scs8m"
Sep 17 21:57:50.715708 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:50.715682    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:57:51.070327 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:51.070241    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8dedff64-89fd-41e2-83e7-e5bdf85f3470-metrics-certs\") pod \"network-metrics-daemon-j58cx\" (UID: \"8dedff64-89fd-41e2-83e7-e5bdf85f3470\") " pod="openshift-multus/network-metrics-daemon-j58cx"
Sep 17 21:57:51.070486 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:51.070444    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 21:57:51.070537 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:51.070529    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dedff64-89fd-41e2-83e7-e5bdf85f3470-metrics-certs podName:8dedff64-89fd-41e2-83e7-e5bdf85f3470 nodeName:}" failed. No retries permitted until 2026-09-17 21:57:52.070505644 +0000 UTC m=+4.130277642 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8dedff64-89fd-41e2-83e7-e5bdf85f3470-metrics-certs") pod "network-metrics-daemon-j58cx" (UID: "8dedff64-89fd-41e2-83e7-e5bdf85f3470") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 21:57:51.170921 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:51.170882    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-md225\" (UniqueName: \"kubernetes.io/projected/4a6387b2-b54c-44e0-909d-589e73c07248-kube-api-access-md225\") pod \"network-check-target-zdznt\" (UID: \"4a6387b2-b54c-44e0-909d-589e73c07248\") " pod="openshift-network-diagnostics/network-check-target-zdznt"
Sep 17 21:57:51.171093 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:51.170933    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2c0000a6-1b43-479b-a06b-06eb5db40c2d-original-pull-secret\") pod \"global-pull-secret-syncer-br6wh\" (UID: \"2c0000a6-1b43-479b-a06b-06eb5db40c2d\") " pod="kube-system/global-pull-secret-syncer-br6wh"
Sep 17 21:57:51.171093 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:51.171045    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 21:57:51.171093 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:51.171063    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 21:57:51.171093 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:51.171083    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 21:57:51.171093 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:51.171097    2560 projected.go:196] Error preparing data for projected volume kube-api-access-md225 for pod openshift-network-diagnostics/network-check-target-zdznt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 21:57:51.171323 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:51.171115    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c0000a6-1b43-479b-a06b-06eb5db40c2d-original-pull-secret podName:2c0000a6-1b43-479b-a06b-06eb5db40c2d nodeName:}" failed. No retries permitted until 2026-09-17 21:57:52.171095291 +0000 UTC m=+4.230867285 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2c0000a6-1b43-479b-a06b-06eb5db40c2d-original-pull-secret") pod "global-pull-secret-syncer-br6wh" (UID: "2c0000a6-1b43-479b-a06b-06eb5db40c2d") : object "kube-system"/"original-pull-secret" not registered
Sep 17 21:57:51.171323 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:51.171135    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a6387b2-b54c-44e0-909d-589e73c07248-kube-api-access-md225 podName:4a6387b2-b54c-44e0-909d-589e73c07248 nodeName:}" failed. No retries permitted until 2026-09-17 21:57:52.171123393 +0000 UTC m=+4.230895390 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-md225" (UniqueName: "kubernetes.io/projected/4a6387b2-b54c-44e0-909d-589e73c07248-kube-api-access-md225") pod "network-check-target-zdznt" (UID: "4a6387b2-b54c-44e0-909d-589e73c07248") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 21:57:51.393340 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:51.393253    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 21:52:50 +0000 UTC" deadline="2028-06-21 17:50:52.504912426 +0000 UTC"
Sep 17 21:57:51.393340 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:51.393286    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15427h53m1.111631492s"
Sep 17 21:57:51.445729 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:51.445699    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-br6wh"
Sep 17 21:57:51.445882 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:51.445807    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-br6wh" podUID="2c0000a6-1b43-479b-a06b-06eb5db40c2d"
Sep 17 21:57:51.698099 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:51.698067    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93887b82_e82e_4df0_9821_51c194c31721.slice/crio-b78824779b15ede230dfcaf5b3cfa33ae3ee41652c6f4d8686732b62529ccd63 WatchSource:0}: Error finding container b78824779b15ede230dfcaf5b3cfa33ae3ee41652c6f4d8686732b62529ccd63: Status 404 returned error can't find the container with id b78824779b15ede230dfcaf5b3cfa33ae3ee41652c6f4d8686732b62529ccd63
Sep 17 21:57:51.699744 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:51.699717    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cbc96f5_dc5a_46ab_b739_db19685500ac.slice/crio-3ccffe2b0e25bacb0e726a285fdc1f5ff759463b3b0d9eef722235d62d823600 WatchSource:0}: Error finding container 3ccffe2b0e25bacb0e726a285fdc1f5ff759463b3b0d9eef722235d62d823600: Status 404 returned error can't find the container with id 3ccffe2b0e25bacb0e726a285fdc1f5ff759463b3b0d9eef722235d62d823600
Sep 17 21:57:51.701898 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:51.701762    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fb1b40d_8101_4632_8212_47eac7ec2425.slice/crio-c49d6cea3f4143d1fe29fdbaee6102487ac1674e83ca2b7dc02ef049d5d90b96 WatchSource:0}: Error finding container c49d6cea3f4143d1fe29fdbaee6102487ac1674e83ca2b7dc02ef049d5d90b96: Status 404 returned error can't find the container with id c49d6cea3f4143d1fe29fdbaee6102487ac1674e83ca2b7dc02ef049d5d90b96
Sep 17 21:57:51.704306 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:57:51.704278    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod845f08e5_f5c6_430c_befa_727ab76b3a00.slice/crio-b98e6dfb033c6eeef728694013c611428dd4e078b055c4a5b2df9c63bd0f4454 WatchSource:0}: Error finding container b98e6dfb033c6eeef728694013c611428dd4e078b055c4a5b2df9c63bd0f4454: Status 404 returned error can't find the container with id b98e6dfb033c6eeef728694013c611428dd4e078b055c4a5b2df9c63bd0f4454
Sep 17 21:57:52.078759 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:52.078724    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8dedff64-89fd-41e2-83e7-e5bdf85f3470-metrics-certs\") pod \"network-metrics-daemon-j58cx\" (UID: \"8dedff64-89fd-41e2-83e7-e5bdf85f3470\") " pod="openshift-multus/network-metrics-daemon-j58cx"
Sep 17 21:57:52.078927 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:52.078904    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 21:57:52.078987 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:52.078977    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dedff64-89fd-41e2-83e7-e5bdf85f3470-metrics-certs podName:8dedff64-89fd-41e2-83e7-e5bdf85f3470 nodeName:}" failed. No retries permitted until 2026-09-17 21:57:54.078962038 +0000 UTC m=+6.138734034 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8dedff64-89fd-41e2-83e7-e5bdf85f3470-metrics-certs") pod "network-metrics-daemon-j58cx" (UID: "8dedff64-89fd-41e2-83e7-e5bdf85f3470") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 21:57:52.179707 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:52.179653    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-md225\" (UniqueName: \"kubernetes.io/projected/4a6387b2-b54c-44e0-909d-589e73c07248-kube-api-access-md225\") pod \"network-check-target-zdznt\" (UID: \"4a6387b2-b54c-44e0-909d-589e73c07248\") " pod="openshift-network-diagnostics/network-check-target-zdznt"
Sep 17 21:57:52.179906 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:52.179711    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2c0000a6-1b43-479b-a06b-06eb5db40c2d-original-pull-secret\") pod \"global-pull-secret-syncer-br6wh\" (UID: \"2c0000a6-1b43-479b-a06b-06eb5db40c2d\") " pod="kube-system/global-pull-secret-syncer-br6wh"
Sep 17 21:57:52.179906 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:52.179864    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 21:57:52.179906 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:52.179893    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 21:57:52.179906 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:52.179894    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 21:57:52.179906 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:52.179908    2560 projected.go:196] Error preparing data for projected volume kube-api-access-md225 for pod openshift-network-diagnostics/network-check-target-zdznt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 21:57:52.180141 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:52.179964    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c0000a6-1b43-479b-a06b-06eb5db40c2d-original-pull-secret podName:2c0000a6-1b43-479b-a06b-06eb5db40c2d nodeName:}" failed. No retries permitted until 2026-09-17 21:57:54.179940711 +0000 UTC m=+6.239712723 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2c0000a6-1b43-479b-a06b-06eb5db40c2d-original-pull-secret") pod "global-pull-secret-syncer-br6wh" (UID: "2c0000a6-1b43-479b-a06b-06eb5db40c2d") : object "kube-system"/"original-pull-secret" not registered
Sep 17 21:57:52.180141 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:52.179980    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a6387b2-b54c-44e0-909d-589e73c07248-kube-api-access-md225 podName:4a6387b2-b54c-44e0-909d-589e73c07248 nodeName:}" failed. No retries permitted until 2026-09-17 21:57:54.179973423 +0000 UTC m=+6.239745415 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-md225" (UniqueName: "kubernetes.io/projected/4a6387b2-b54c-44e0-909d-589e73c07248-kube-api-access-md225") pod "network-check-target-zdznt" (UID: "4a6387b2-b54c-44e0-909d-589e73c07248") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 21:57:52.393727 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:52.393598    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 21:52:50 +0000 UTC" deadline="2028-03-09 16:22:48.147266745 +0000 UTC"
Sep 17 21:57:52.393727 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:52.393641    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12930h24m55.753630329s"
Sep 17 21:57:52.447850 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:52.447816    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j58cx"
Sep 17 21:57:52.448010 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:52.447980    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j58cx" podUID="8dedff64-89fd-41e2-83e7-e5bdf85f3470"
Sep 17 21:57:52.448412 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:52.448390    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zdznt"
Sep 17 21:57:52.448538 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:52.448507    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zdznt" podUID="4a6387b2-b54c-44e0-909d-589e73c07248"
Sep 17 21:57:52.470725 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:52.470644    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tprjw" event={"ID":"6505672f-86e4-439d-88c0-8b8ac9bcb987","Type":"ContainerStarted","Data":"7bc430999ee4911331730008e3ad7bc75e844bf423165e2f38c1c1b837dc4820"}
Sep 17 21:57:52.478905 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:52.478820    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hllvl" event={"ID":"7ac7682e-e943-4684-9c1b-eee2c58acbf1","Type":"ContainerStarted","Data":"4f5d4939ba9a7ff10d4c0785cd33241ceabe7b90913804937e2824c852e0d011"}
Sep 17 21:57:52.487624 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:52.487591    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nn2xs" event={"ID":"00fb2a0f-d0d6-4d8d-8884-04fc3cd6aea4","Type":"ContainerStarted","Data":"82ea3734d0b9c7ebdf71da135e9a4a065a74793e25e7cb3e3e63e4c843e788e0"}
Sep 17 21:57:52.490101 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:52.490072    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-llwgv" event={"ID":"5cbc96f5-dc5a-46ab-b739-db19685500ac","Type":"ContainerStarted","Data":"3ccffe2b0e25bacb0e726a285fdc1f5ff759463b3b0d9eef722235d62d823600"}
Sep 17 21:57:52.501875 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:52.501846    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lff7k" event={"ID":"09abe478-d8e5-4f5b-bec5-59b113bd11fa","Type":"ContainerStarted","Data":"edd01e84d628c2f7cabad9cd10245f69f53a9fe3072f42c7fc563a49f248efdf"}
Sep 17 21:57:52.504763 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:52.504737    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-scs8m" event={"ID":"42972d7a-57ce-429f-b1f4-cd2333a5c3ee","Type":"ContainerStarted","Data":"8d2235a52dd307fcc59494521cc9085958b356f3cb9db0386366bc6805a99ec1"}
Sep 17 21:57:52.506487 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:52.506413    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-z4bjm" event={"ID":"845f08e5-f5c6-430c-befa-727ab76b3a00","Type":"ContainerStarted","Data":"b98e6dfb033c6eeef728694013c611428dd4e078b055c4a5b2df9c63bd0f4454"}
Sep 17 21:57:52.509039 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:52.508962    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jj8hs" event={"ID":"3fb1b40d-8101-4632-8212-47eac7ec2425","Type":"ContainerStarted","Data":"c49d6cea3f4143d1fe29fdbaee6102487ac1674e83ca2b7dc02ef049d5d90b96"}
Sep 17 21:57:52.517751 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:52.517727    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-q8mts" event={"ID":"93887b82-e82e-4df0-9821-51c194c31721","Type":"ContainerStarted","Data":"b78824779b15ede230dfcaf5b3cfa33ae3ee41652c6f4d8686732b62529ccd63"}
Sep 17 21:57:52.525636 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:52.525609    2560 generic.go:356] "Generic (PLEG): container finished" podID="26b4a5716c230966b81c335914c9476e" containerID="a535c9d5d02e7dab454cad5e7f828020d56df1ecec63f69c95f8b7bbce627cc4" exitCode=0
Sep 17 21:57:52.525737 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:52.525691    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-66.ec2.internal" event={"ID":"26b4a5716c230966b81c335914c9476e","Type":"ContainerDied","Data":"a535c9d5d02e7dab454cad5e7f828020d56df1ecec63f69c95f8b7bbce627cc4"}
Sep 17 21:57:52.530374 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:52.529959    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-66.ec2.internal" event={"ID":"7cb3cec29cc11ab20979146634290fc1","Type":"ContainerStarted","Data":"95ed0eb2c7cd25b506100dce9cf51342fd61291f77ed55906ef0a9e93464aa11"}
Sep 17 21:57:53.446033 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:53.445562    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-br6wh"
Sep 17 21:57:53.446033 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:53.445690    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-br6wh" podUID="2c0000a6-1b43-479b-a06b-06eb5db40c2d"
Sep 17 21:57:53.561436 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:53.561403    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-66.ec2.internal" event={"ID":"26b4a5716c230966b81c335914c9476e","Type":"ContainerStarted","Data":"a4e8b8057aac57dd678df08e0c90e38fb804f0216350e27fe6106b3eaa19644e"}
Sep 17 21:57:53.576874 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:53.576823    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-66.ec2.internal" podStartSLOduration=4.576803433 podStartE2EDuration="4.576803433s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 21:57:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:57:52.557338921 +0000 UTC m=+4.617110937" watchObservedRunningTime="2026-09-17 21:57:53.576803433 +0000 UTC m=+5.636575445"
Sep 17 21:57:54.098603 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:54.098560    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8dedff64-89fd-41e2-83e7-e5bdf85f3470-metrics-certs\") pod \"network-metrics-daemon-j58cx\" (UID: \"8dedff64-89fd-41e2-83e7-e5bdf85f3470\") " pod="openshift-multus/network-metrics-daemon-j58cx"
Sep 17 21:57:54.098790 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:54.098714    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 21:57:54.098790 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:54.098787    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dedff64-89fd-41e2-83e7-e5bdf85f3470-metrics-certs podName:8dedff64-89fd-41e2-83e7-e5bdf85f3470 nodeName:}" failed. No retries permitted until 2026-09-17 21:57:58.098767959 +0000 UTC m=+10.158539963 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8dedff64-89fd-41e2-83e7-e5bdf85f3470-metrics-certs") pod "network-metrics-daemon-j58cx" (UID: "8dedff64-89fd-41e2-83e7-e5bdf85f3470") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 21:57:54.199834 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:54.199797    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-md225\" (UniqueName: \"kubernetes.io/projected/4a6387b2-b54c-44e0-909d-589e73c07248-kube-api-access-md225\") pod \"network-check-target-zdznt\" (UID: \"4a6387b2-b54c-44e0-909d-589e73c07248\") " pod="openshift-network-diagnostics/network-check-target-zdznt"
Sep 17 21:57:54.200022 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:54.199853    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2c0000a6-1b43-479b-a06b-06eb5db40c2d-original-pull-secret\") pod \"global-pull-secret-syncer-br6wh\" (UID: \"2c0000a6-1b43-479b-a06b-06eb5db40c2d\") " pod="kube-system/global-pull-secret-syncer-br6wh"
Sep 17 21:57:54.200022 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:54.199973    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 21:57:54.200125 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:54.200031    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c0000a6-1b43-479b-a06b-06eb5db40c2d-original-pull-secret podName:2c0000a6-1b43-479b-a06b-06eb5db40c2d nodeName:}" failed. No retries permitted until 2026-09-17 21:57:58.200014396 +0000 UTC m=+10.259786390 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2c0000a6-1b43-479b-a06b-06eb5db40c2d-original-pull-secret") pod "global-pull-secret-syncer-br6wh" (UID: "2c0000a6-1b43-479b-a06b-06eb5db40c2d") : object "kube-system"/"original-pull-secret" not registered
Sep 17 21:57:54.200451 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:54.200433    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 21:57:54.200541 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:54.200461    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 21:57:54.200541 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:54.200473    2560 projected.go:196] Error preparing data for projected volume kube-api-access-md225 for pod openshift-network-diagnostics/network-check-target-zdznt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 21:57:54.200541 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:54.200517    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a6387b2-b54c-44e0-909d-589e73c07248-kube-api-access-md225 podName:4a6387b2-b54c-44e0-909d-589e73c07248 nodeName:}" failed. No retries permitted until 2026-09-17 21:57:58.200502364 +0000 UTC m=+10.260274359 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-md225" (UniqueName: "kubernetes.io/projected/4a6387b2-b54c-44e0-909d-589e73c07248-kube-api-access-md225") pod "network-check-target-zdznt" (UID: "4a6387b2-b54c-44e0-909d-589e73c07248") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 21:57:54.445538 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:54.445460    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j58cx"
Sep 17 21:57:54.445685 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:54.445601    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j58cx" podUID="8dedff64-89fd-41e2-83e7-e5bdf85f3470"
Sep 17 21:57:54.445685 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:54.445654    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zdznt"
Sep 17 21:57:54.445859 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:54.445810    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zdznt" podUID="4a6387b2-b54c-44e0-909d-589e73c07248"
Sep 17 21:57:55.446080 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:55.445526    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-br6wh"
Sep 17 21:57:55.446080 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:55.445665    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-br6wh" podUID="2c0000a6-1b43-479b-a06b-06eb5db40c2d"
Sep 17 21:57:56.445949 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:56.445859    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zdznt"
Sep 17 21:57:56.445949 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:56.445859    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j58cx"
Sep 17 21:57:56.446528 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:56.445997    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zdznt" podUID="4a6387b2-b54c-44e0-909d-589e73c07248"
Sep 17 21:57:56.446528 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:56.446408    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j58cx" podUID="8dedff64-89fd-41e2-83e7-e5bdf85f3470"
Sep 17 21:57:57.445834 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:57.445752    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-br6wh"
Sep 17 21:57:57.445965 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:57.445904    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-br6wh" podUID="2c0000a6-1b43-479b-a06b-06eb5db40c2d"
Sep 17 21:57:58.131077 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:58.130986    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8dedff64-89fd-41e2-83e7-e5bdf85f3470-metrics-certs\") pod \"network-metrics-daemon-j58cx\" (UID: \"8dedff64-89fd-41e2-83e7-e5bdf85f3470\") " pod="openshift-multus/network-metrics-daemon-j58cx"
Sep 17 21:57:58.131538 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:58.131168    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 21:57:58.131538 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:58.131239    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dedff64-89fd-41e2-83e7-e5bdf85f3470-metrics-certs podName:8dedff64-89fd-41e2-83e7-e5bdf85f3470 nodeName:}" failed. No retries permitted until 2026-09-17 21:58:06.131217947 +0000 UTC m=+18.190989950 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8dedff64-89fd-41e2-83e7-e5bdf85f3470-metrics-certs") pod "network-metrics-daemon-j58cx" (UID: "8dedff64-89fd-41e2-83e7-e5bdf85f3470") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 21:57:58.231937 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:58.231904    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-md225\" (UniqueName: \"kubernetes.io/projected/4a6387b2-b54c-44e0-909d-589e73c07248-kube-api-access-md225\") pod \"network-check-target-zdznt\" (UID: \"4a6387b2-b54c-44e0-909d-589e73c07248\") " pod="openshift-network-diagnostics/network-check-target-zdznt"
Sep 17 21:57:58.231937 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:58.231949    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2c0000a6-1b43-479b-a06b-06eb5db40c2d-original-pull-secret\") pod \"global-pull-secret-syncer-br6wh\" (UID: \"2c0000a6-1b43-479b-a06b-06eb5db40c2d\") " pod="kube-system/global-pull-secret-syncer-br6wh"
Sep 17 21:57:58.232166 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:58.232077    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 21:57:58.232166 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:58.232096    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 21:57:58.232166 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:58.232120    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 21:57:58.232166 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:58.232133    2560 projected.go:196] Error preparing data for projected volume kube-api-access-md225 for pod openshift-network-diagnostics/network-check-target-zdznt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 21:57:58.232166 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:58.232144    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c0000a6-1b43-479b-a06b-06eb5db40c2d-original-pull-secret podName:2c0000a6-1b43-479b-a06b-06eb5db40c2d nodeName:}" failed. No retries permitted until 2026-09-17 21:58:06.232124851 +0000 UTC m=+18.291896840 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2c0000a6-1b43-479b-a06b-06eb5db40c2d-original-pull-secret") pod "global-pull-secret-syncer-br6wh" (UID: "2c0000a6-1b43-479b-a06b-06eb5db40c2d") : object "kube-system"/"original-pull-secret" not registered
Sep 17 21:57:58.232472 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:58.232182    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a6387b2-b54c-44e0-909d-589e73c07248-kube-api-access-md225 podName:4a6387b2-b54c-44e0-909d-589e73c07248 nodeName:}" failed. No retries permitted until 2026-09-17 21:58:06.232165865 +0000 UTC m=+18.291937861 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-md225" (UniqueName: "kubernetes.io/projected/4a6387b2-b54c-44e0-909d-589e73c07248-kube-api-access-md225") pod "network-check-target-zdznt" (UID: "4a6387b2-b54c-44e0-909d-589e73c07248") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 21:57:58.447085 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:58.446964    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zdznt"
Sep 17 21:57:58.447085 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:58.447074    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zdznt" podUID="4a6387b2-b54c-44e0-909d-589e73c07248"
Sep 17 21:57:58.447299 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:58.447127    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j58cx"
Sep 17 21:57:58.447299 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:58.447256    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j58cx" podUID="8dedff64-89fd-41e2-83e7-e5bdf85f3470"
Sep 17 21:57:59.445381 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:57:59.445326    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-br6wh"
Sep 17 21:57:59.445838 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:57:59.445463    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-br6wh" podUID="2c0000a6-1b43-479b-a06b-06eb5db40c2d"
Sep 17 21:58:00.446094 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:00.446061    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zdznt"
Sep 17 21:58:00.446723 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:00.446188    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zdznt" podUID="4a6387b2-b54c-44e0-909d-589e73c07248"
Sep 17 21:58:00.446723 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:00.446062    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j58cx"
Sep 17 21:58:00.446723 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:00.446637    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j58cx" podUID="8dedff64-89fd-41e2-83e7-e5bdf85f3470"
Sep 17 21:58:01.446134 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:01.446097    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-br6wh"
Sep 17 21:58:01.446564 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:01.446225    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-br6wh" podUID="2c0000a6-1b43-479b-a06b-06eb5db40c2d"
Sep 17 21:58:02.446213 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:02.446128    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j58cx"
Sep 17 21:58:02.446213 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:02.446177    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zdznt"
Sep 17 21:58:02.446669 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:02.446276    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j58cx" podUID="8dedff64-89fd-41e2-83e7-e5bdf85f3470"
Sep 17 21:58:02.446669 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:02.446436    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zdznt" podUID="4a6387b2-b54c-44e0-909d-589e73c07248"
Sep 17 21:58:03.446009 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:03.445977    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-br6wh"
Sep 17 21:58:03.446173 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:03.446111    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-br6wh" podUID="2c0000a6-1b43-479b-a06b-06eb5db40c2d"
Sep 17 21:58:04.446291 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:04.446259    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zdznt"
Sep 17 21:58:04.446782 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:04.446404    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zdznt" podUID="4a6387b2-b54c-44e0-909d-589e73c07248"
Sep 17 21:58:04.446782 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:04.446466    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j58cx"
Sep 17 21:58:04.446782 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:04.446589    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j58cx" podUID="8dedff64-89fd-41e2-83e7-e5bdf85f3470"
Sep 17 21:58:05.445708 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:05.445675    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-br6wh"
Sep 17 21:58:05.445903 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:05.445807    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-br6wh" podUID="2c0000a6-1b43-479b-a06b-06eb5db40c2d"
Sep 17 21:58:06.191834 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:06.191800    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8dedff64-89fd-41e2-83e7-e5bdf85f3470-metrics-certs\") pod \"network-metrics-daemon-j58cx\" (UID: \"8dedff64-89fd-41e2-83e7-e5bdf85f3470\") " pod="openshift-multus/network-metrics-daemon-j58cx"
Sep 17 21:58:06.192298 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:06.192265    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 21:58:06.192443 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:06.192379    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dedff64-89fd-41e2-83e7-e5bdf85f3470-metrics-certs podName:8dedff64-89fd-41e2-83e7-e5bdf85f3470 nodeName:}" failed. No retries permitted until 2026-09-17 21:58:22.1923428 +0000 UTC m=+34.252114796 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8dedff64-89fd-41e2-83e7-e5bdf85f3470-metrics-certs") pod "network-metrics-daemon-j58cx" (UID: "8dedff64-89fd-41e2-83e7-e5bdf85f3470") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 21:58:06.292505 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:06.292473    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-md225\" (UniqueName: \"kubernetes.io/projected/4a6387b2-b54c-44e0-909d-589e73c07248-kube-api-access-md225\") pod \"network-check-target-zdznt\" (UID: \"4a6387b2-b54c-44e0-909d-589e73c07248\") " pod="openshift-network-diagnostics/network-check-target-zdznt"
Sep 17 21:58:06.292505 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:06.292514    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2c0000a6-1b43-479b-a06b-06eb5db40c2d-original-pull-secret\") pod \"global-pull-secret-syncer-br6wh\" (UID: \"2c0000a6-1b43-479b-a06b-06eb5db40c2d\") " pod="kube-system/global-pull-secret-syncer-br6wh"
Sep 17 21:58:06.292711 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:06.292618    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 21:58:06.292711 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:06.292690    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 21:58:06.292769 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:06.292715    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 21:58:06.292769 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:06.292728    2560 projected.go:196] Error preparing data for projected volume kube-api-access-md225 for pod openshift-network-diagnostics/network-check-target-zdznt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 21:58:06.292823 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:06.292695    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c0000a6-1b43-479b-a06b-06eb5db40c2d-original-pull-secret podName:2c0000a6-1b43-479b-a06b-06eb5db40c2d nodeName:}" failed. No retries permitted until 2026-09-17 21:58:22.292679901 +0000 UTC m=+34.352451890 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2c0000a6-1b43-479b-a06b-06eb5db40c2d-original-pull-secret") pod "global-pull-secret-syncer-br6wh" (UID: "2c0000a6-1b43-479b-a06b-06eb5db40c2d") : object "kube-system"/"original-pull-secret" not registered
Sep 17 21:58:06.292823 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:06.292801    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a6387b2-b54c-44e0-909d-589e73c07248-kube-api-access-md225 podName:4a6387b2-b54c-44e0-909d-589e73c07248 nodeName:}" failed. No retries permitted until 2026-09-17 21:58:22.292786799 +0000 UTC m=+34.352558788 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-md225" (UniqueName: "kubernetes.io/projected/4a6387b2-b54c-44e0-909d-589e73c07248-kube-api-access-md225") pod "network-check-target-zdznt" (UID: "4a6387b2-b54c-44e0-909d-589e73c07248") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 21:58:06.445863 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:06.445775    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j58cx"
Sep 17 21:58:06.445863 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:06.445802    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zdznt"
Sep 17 21:58:06.446056 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:06.445927    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j58cx" podUID="8dedff64-89fd-41e2-83e7-e5bdf85f3470"
Sep 17 21:58:06.446115 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:06.446053    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zdznt" podUID="4a6387b2-b54c-44e0-909d-589e73c07248"
Sep 17 21:58:07.445727 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:07.445686    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-br6wh"
Sep 17 21:58:07.446158 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:07.445797    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-br6wh" podUID="2c0000a6-1b43-479b-a06b-06eb5db40c2d"
Sep 17 21:58:08.447073 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:08.446996    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j58cx"
Sep 17 21:58:08.447533 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:08.447106    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zdznt"
Sep 17 21:58:08.447533 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:08.447145    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j58cx" podUID="8dedff64-89fd-41e2-83e7-e5bdf85f3470"
Sep 17 21:58:08.447533 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:08.447177    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zdznt" podUID="4a6387b2-b54c-44e0-909d-589e73c07248"
Sep 17 21:58:09.445375 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:09.445337    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-br6wh"
Sep 17 21:58:09.445521 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:09.445443    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-br6wh" podUID="2c0000a6-1b43-479b-a06b-06eb5db40c2d"
Sep 17 21:58:10.446118 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:10.445937    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j58cx"
Sep 17 21:58:10.446975 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:10.445967    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zdznt"
Sep 17 21:58:10.446975 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:10.446224    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j58cx" podUID="8dedff64-89fd-41e2-83e7-e5bdf85f3470"
Sep 17 21:58:10.446975 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:10.446291    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zdznt" podUID="4a6387b2-b54c-44e0-909d-589e73c07248"
Sep 17 21:58:10.602550 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:10.602508    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-scs8m" event={"ID":"42972d7a-57ce-429f-b1f4-cd2333a5c3ee","Type":"ContainerStarted","Data":"2ecbdf4d17b7dd66e9a9691cb38d7c666a174d9f505db5f92449d2121bcad711"}
Sep 17 21:58:10.607564 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:10.607526    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-z4bjm" event={"ID":"845f08e5-f5c6-430c-befa-727ab76b3a00","Type":"ContainerStarted","Data":"4fb5419e5e3a35c7b431e45dd070f8d808f4a75812da9278ad15eccd2d67e307"}
Sep 17 21:58:10.609066 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:10.609042    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jj8hs" event={"ID":"3fb1b40d-8101-4632-8212-47eac7ec2425","Type":"ContainerStarted","Data":"0a4c0f579823809f9abc09f674385838f71b889a00cf077c56029e6eaf3ceadf"}
Sep 17 21:58:10.610544 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:10.610515    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-q8mts" event={"ID":"93887b82-e82e-4df0-9821-51c194c31721","Type":"ContainerStarted","Data":"c662e51cacc0c9655dadfb30af8ab22397211a3e2129c29fa49e32b9c1853798"}
Sep 17 21:58:10.612000 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:10.611973    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tprjw" event={"ID":"6505672f-86e4-439d-88c0-8b8ac9bcb987","Type":"ContainerStarted","Data":"4b3a789819ebbe04e035afeb87a49096f5a44198fad4fa86cc3d2d50e475fa6a"}
Sep 17 21:58:10.613458 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:10.613431    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hllvl" event={"ID":"7ac7682e-e943-4684-9c1b-eee2c58acbf1","Type":"ContainerStarted","Data":"9ad0cf837566462fdea8f9036465fb200dd8a6f002959bb168ab5c08fe30283f"}
Sep 17 21:58:10.614893 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:10.614873    2560 generic.go:356] "Generic (PLEG): container finished" podID="00fb2a0f-d0d6-4d8d-8884-04fc3cd6aea4" containerID="d236582a86c4bd077b4c0f97ffbf478acd72d597503ae757afd464c675d35a68" exitCode=0
Sep 17 21:58:10.614984 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:10.614942    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nn2xs" event={"ID":"00fb2a0f-d0d6-4d8d-8884-04fc3cd6aea4","Type":"ContainerDied","Data":"d236582a86c4bd077b4c0f97ffbf478acd72d597503ae757afd464c675d35a68"}
Sep 17 21:58:10.618533 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:10.618504    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-llwgv" event={"ID":"5cbc96f5-dc5a-46ab-b739-db19685500ac","Type":"ContainerStarted","Data":"340c94bd862f501b4a08ac8e58b26e947e7f8fdeb7eb52ed922ed016e7274bc9"}
Sep 17 21:58:10.618623 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:10.618582    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-llwgv" event={"ID":"5cbc96f5-dc5a-46ab-b739-db19685500ac","Type":"ContainerStarted","Data":"206d73de835beeddca1c77c216fb16ac49da9d3b51cda232950cd7d9448c5ccd"}
Sep 17 21:58:10.618623 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:10.618614    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-llwgv" event={"ID":"5cbc96f5-dc5a-46ab-b739-db19685500ac","Type":"ContainerStarted","Data":"065e4cf4617693b2e9f91ef9f5708e19ceb4d3fdb562bc45c442716c82aaba1c"}
Sep 17 21:58:10.618691 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:10.618643    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-llwgv" event={"ID":"5cbc96f5-dc5a-46ab-b739-db19685500ac","Type":"ContainerStarted","Data":"974ee8a327df868d439f573c1424d2143e278cb001e71da0f526ecbe741cf64e"}
Sep 17 21:58:10.618691 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:10.618670    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-llwgv" event={"ID":"5cbc96f5-dc5a-46ab-b739-db19685500ac","Type":"ContainerStarted","Data":"467b8f399702f5cbef96dca60489001296ca35a01ae5058783a6f8eed5223b72"}
Sep 17 21:58:10.618749 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:10.618698    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-llwgv" event={"ID":"5cbc96f5-dc5a-46ab-b739-db19685500ac","Type":"ContainerStarted","Data":"f54e547316b884b0a33c95661d5f57e1a1fe2ef525c4b23a41daf08c61647907"}
Sep 17 21:58:10.618813 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:10.618779    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-66.ec2.internal" podStartSLOduration=21.618765787 podStartE2EDuration="21.618765787s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 21:57:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:57:53.577562309 +0000 UTC m=+5.637334321" watchObservedRunningTime="2026-09-17 21:58:10.618765787 +0000 UTC m=+22.678537798"
Sep 17 21:58:10.619050 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:10.619030    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-scs8m" podStartSLOduration=3.612654232 podStartE2EDuration="21.619023571s" totalImagesPullingTime="18.006369339s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 21:57:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:58:10.618710378 +0000 UTC m=+22.678482391" watchObservedRunningTime="2026-09-17 21:58:10.619023571 +0000 UTC m=+22.678795582"
Sep 17 21:58:10.650764 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:10.650720    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hllvl" podStartSLOduration=4.761271489 podStartE2EDuration="22.650705336s" totalImagesPullingTime="17.889433847s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 21:57:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:58:10.637837437 +0000 UTC m=+22.697609460" watchObservedRunningTime="2026-09-17 21:58:10.650705336 +0000 UTC m=+22.710477346"
Sep 17 21:58:10.651019 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:10.650990    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-z4bjm" podStartSLOduration=4.755874916 podStartE2EDuration="22.650980747s" totalImagesPullingTime="17.895105831s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 21:57:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:58:10.650433217 +0000 UTC m=+22.710205229" watchObservedRunningTime="2026-09-17 21:58:10.650980747 +0000 UTC m=+22.710752788"
Sep 17 21:58:10.666321 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:10.666287    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-q8mts" podStartSLOduration=3.765841637 podStartE2EDuration="21.666277514s" totalImagesPullingTime="17.900435877s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 21:57:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:58:10.665992125 +0000 UTC m=+22.725764137" watchObservedRunningTime="2026-09-17 21:58:10.666277514 +0000 UTC m=+22.726049524"
Sep 17 21:58:10.711214 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:10.711177    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-tprjw" podStartSLOduration=12.224947930999999 podStartE2EDuration="22.711160293s" totalImagesPullingTime="10.486212362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:57:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:58:10.682314107 +0000 UTC m=+22.742086117" watchObservedRunningTime="2026-09-17 21:58:10.711160293 +0000 UTC m=+22.770932305"
Sep 17 21:58:11.189607 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:11.189587    2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 17 21:58:11.421488 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:11.421337    2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-17T21:58:11.189603992Z","UUID":"5a7cef21-1196-452f-8e32-cbc77da33df6","Handler":null,"Name":"","Endpoint":""}
Sep 17 21:58:11.423261 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:11.423236    2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 17 21:58:11.423424 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:11.423273    2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 17 21:58:11.445202 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:11.445185    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-br6wh"
Sep 17 21:58:11.445297 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:11.445270    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-br6wh" podUID="2c0000a6-1b43-479b-a06b-06eb5db40c2d"
Sep 17 21:58:11.622568 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:11.622529    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lff7k" event={"ID":"09abe478-d8e5-4f5b-bec5-59b113bd11fa","Type":"ContainerStarted","Data":"19199551140d4cbcf0aac11b6724d06e26fc9d1c9ade58176f0546c49ab50a00"}
Sep 17 21:58:11.624874 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:11.624828    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jj8hs" event={"ID":"3fb1b40d-8101-4632-8212-47eac7ec2425","Type":"ContainerStarted","Data":"779e0b6bdb1712b4d7061f9d94cd0274640b5b4e2249bbe236b1fec3008f08e8"}
Sep 17 21:58:11.636584 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:11.636531    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-lff7k" podStartSLOduration=5.749308872 podStartE2EDuration="23.636513589s" totalImagesPullingTime="17.887204717s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 21:57:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:58:11.636019305 +0000 UTC m=+23.695791314" watchObservedRunningTime="2026-09-17 21:58:11.636513589 +0000 UTC m=+23.696285601"
Sep 17 21:58:12.446684 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:12.446496    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j58cx"
Sep 17 21:58:12.446684 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:12.446625    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j58cx" podUID="8dedff64-89fd-41e2-83e7-e5bdf85f3470"
Sep 17 21:58:12.447150 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:12.446908    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zdznt"
Sep 17 21:58:12.447150 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:12.447076    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zdznt" podUID="4a6387b2-b54c-44e0-909d-589e73c07248"
Sep 17 21:58:12.630565 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:12.630464    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jj8hs" event={"ID":"3fb1b40d-8101-4632-8212-47eac7ec2425","Type":"ContainerStarted","Data":"3cb85a868ee8f297d7614245780bbbaa9b62244b63a34991ef478c7e26851282"}
Sep 17 21:58:12.635046 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:12.635014    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-llwgv" event={"ID":"5cbc96f5-dc5a-46ab-b739-db19685500ac","Type":"ContainerStarted","Data":"e08c22f045e37e1c55c9a445e4a8d8f691c9e495f60abebeb8c4e332678d6121"}
Sep 17 21:58:12.648302 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:12.648257    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jj8hs" podStartSLOduration=3.327493834 podStartE2EDuration="23.648241551s" totalImagesPullingTime="20.320747717s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 21:57:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:58:12.646478327 +0000 UTC m=+24.706250339" watchObservedRunningTime="2026-09-17 21:58:12.648241551 +0000 UTC m=+24.708013563"
Sep 17 21:58:13.267386 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:13.267340    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-tprjw"
Sep 17 21:58:13.268150 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:13.268129    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-tprjw"
Sep 17 21:58:13.445604 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:13.445576    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-br6wh"
Sep 17 21:58:13.445752 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:13.445695    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-br6wh" podUID="2c0000a6-1b43-479b-a06b-06eb5db40c2d"
Sep 17 21:58:13.638317 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:13.638240    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-tprjw"
Sep 17 21:58:13.638735 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:13.638568    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-tprjw"
Sep 17 21:58:14.445663 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:14.445630    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j58cx"
Sep 17 21:58:14.445839 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:14.445778    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j58cx" podUID="8dedff64-89fd-41e2-83e7-e5bdf85f3470"
Sep 17 21:58:14.445918 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:14.445838    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zdznt"
Sep 17 21:58:14.445976 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:14.445945    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zdznt" podUID="4a6387b2-b54c-44e0-909d-589e73c07248"
Sep 17 21:58:15.446172 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:15.446029    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-br6wh"
Sep 17 21:58:15.446813 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:15.446269    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-br6wh" podUID="2c0000a6-1b43-479b-a06b-06eb5db40c2d"
Sep 17 21:58:15.643574 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:15.643547    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nn2xs" event={"ID":"00fb2a0f-d0d6-4d8d-8884-04fc3cd6aea4","Type":"ContainerStarted","Data":"37c4d77baa90adce14a8f92f1658062545200e5e66f8026ccf61b684877c8c85"}
Sep 17 21:58:15.647227 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:15.647190    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-llwgv" event={"ID":"5cbc96f5-dc5a-46ab-b739-db19685500ac","Type":"ContainerStarted","Data":"550c81117dab63bb742a6ad57c3a0a7b00088630fa867893643723b5da1262be"}
Sep 17 21:58:15.647408 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:15.647384    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:58:15.662108 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:15.662088    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:58:15.687788 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:15.687715    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-llwgv" podStartSLOduration=8.758288469 podStartE2EDuration="26.687702003s" totalImagesPullingTime="17.929413534s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 21:57:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:58:15.686195074 +0000 UTC m=+27.745967084" watchObservedRunningTime="2026-09-17 21:58:15.687702003 +0000 UTC m=+27.747474053"
Sep 17 21:58:16.057569 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:16.057538    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:58:16.445636 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:16.445556    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j58cx"
Sep 17 21:58:16.445832 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:16.445681    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j58cx" podUID="8dedff64-89fd-41e2-83e7-e5bdf85f3470"
Sep 17 21:58:16.445832 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:16.445756    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zdznt"
Sep 17 21:58:16.445920 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:16.445896    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zdznt" podUID="4a6387b2-b54c-44e0-909d-589e73c07248"
Sep 17 21:58:16.651079 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:16.651045    2560 generic.go:356] "Generic (PLEG): container finished" podID="00fb2a0f-d0d6-4d8d-8884-04fc3cd6aea4" containerID="37c4d77baa90adce14a8f92f1658062545200e5e66f8026ccf61b684877c8c85" exitCode=0
Sep 17 21:58:16.651661 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:16.651125    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nn2xs" event={"ID":"00fb2a0f-d0d6-4d8d-8884-04fc3cd6aea4","Type":"ContainerDied","Data":"37c4d77baa90adce14a8f92f1658062545200e5e66f8026ccf61b684877c8c85"}
Sep 17 21:58:16.651661 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:16.651597    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:58:16.666487 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:16.666462    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:58:17.097237 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:17.097004    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zdznt"]
Sep 17 21:58:17.097430 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:17.097408    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zdznt"
Sep 17 21:58:17.097530 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:17.097511    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zdznt" podUID="4a6387b2-b54c-44e0-909d-589e73c07248"
Sep 17 21:58:17.100310 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:17.100277    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-j58cx"]
Sep 17 21:58:17.100441 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:17.100428    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j58cx"
Sep 17 21:58:17.100565 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:17.100541    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j58cx" podUID="8dedff64-89fd-41e2-83e7-e5bdf85f3470"
Sep 17 21:58:17.100961 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:17.100940    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-br6wh"]
Sep 17 21:58:17.101053 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:17.101041    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-br6wh"
Sep 17 21:58:17.101159 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:17.101140    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-br6wh" podUID="2c0000a6-1b43-479b-a06b-06eb5db40c2d"
Sep 17 21:58:18.445959 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:18.445881    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j58cx"
Sep 17 21:58:18.446373 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:18.445972    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zdznt"
Sep 17 21:58:18.446373 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:18.445992    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j58cx" podUID="8dedff64-89fd-41e2-83e7-e5bdf85f3470"
Sep 17 21:58:18.446373 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:18.446056    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zdznt" podUID="4a6387b2-b54c-44e0-909d-589e73c07248"
Sep 17 21:58:18.446373 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:18.446072    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-br6wh"
Sep 17 21:58:18.446373 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:18.446174    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-br6wh" podUID="2c0000a6-1b43-479b-a06b-06eb5db40c2d"
Sep 17 21:58:18.657305 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:18.657278    2560 generic.go:356] "Generic (PLEG): container finished" podID="00fb2a0f-d0d6-4d8d-8884-04fc3cd6aea4" containerID="b21c4b0e740ca374367c4262849ad1a2f8f45fa8a8c68a003a422c8362b11299" exitCode=0
Sep 17 21:58:18.657456 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:18.657382    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nn2xs" event={"ID":"00fb2a0f-d0d6-4d8d-8884-04fc3cd6aea4","Type":"ContainerDied","Data":"b21c4b0e740ca374367c4262849ad1a2f8f45fa8a8c68a003a422c8362b11299"}
Sep 17 21:58:19.662212 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:19.662185    2560 generic.go:356] "Generic (PLEG): container finished" podID="00fb2a0f-d0d6-4d8d-8884-04fc3cd6aea4" containerID="e93c72aa61d4018358f1bc6c9967acfa9d19723870fdfd72835500d32f6c8dec" exitCode=0
Sep 17 21:58:19.662511 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:19.662239    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nn2xs" event={"ID":"00fb2a0f-d0d6-4d8d-8884-04fc3cd6aea4","Type":"ContainerDied","Data":"e93c72aa61d4018358f1bc6c9967acfa9d19723870fdfd72835500d32f6c8dec"}
Sep 17 21:58:20.446080 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:20.446050    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j58cx"
Sep 17 21:58:20.446242 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:20.446050    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-br6wh"
Sep 17 21:58:20.446242 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:20.446187    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j58cx" podUID="8dedff64-89fd-41e2-83e7-e5bdf85f3470"
Sep 17 21:58:20.446367 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:20.446242    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-br6wh" podUID="2c0000a6-1b43-479b-a06b-06eb5db40c2d"
Sep 17 21:58:20.446367 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:20.446050    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zdznt"
Sep 17 21:58:20.446367 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:20.446328    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zdznt" podUID="4a6387b2-b54c-44e0-909d-589e73c07248"
Sep 17 21:58:22.218624 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:22.218588    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8dedff64-89fd-41e2-83e7-e5bdf85f3470-metrics-certs\") pod \"network-metrics-daemon-j58cx\" (UID: \"8dedff64-89fd-41e2-83e7-e5bdf85f3470\") " pod="openshift-multus/network-metrics-daemon-j58cx"
Sep 17 21:58:22.219158 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:22.218753    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 21:58:22.219158 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:22.218832    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dedff64-89fd-41e2-83e7-e5bdf85f3470-metrics-certs podName:8dedff64-89fd-41e2-83e7-e5bdf85f3470 nodeName:}" failed. No retries permitted until 2026-09-17 21:58:54.218809948 +0000 UTC m=+66.278581952 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8dedff64-89fd-41e2-83e7-e5bdf85f3470-metrics-certs") pod "network-metrics-daemon-j58cx" (UID: "8dedff64-89fd-41e2-83e7-e5bdf85f3470") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 21:58:22.319540 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:22.319507    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-md225\" (UniqueName: \"kubernetes.io/projected/4a6387b2-b54c-44e0-909d-589e73c07248-kube-api-access-md225\") pod \"network-check-target-zdznt\" (UID: \"4a6387b2-b54c-44e0-909d-589e73c07248\") " pod="openshift-network-diagnostics/network-check-target-zdznt"
Sep 17 21:58:22.319696 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:22.319549    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2c0000a6-1b43-479b-a06b-06eb5db40c2d-original-pull-secret\") pod \"global-pull-secret-syncer-br6wh\" (UID: \"2c0000a6-1b43-479b-a06b-06eb5db40c2d\") " pod="kube-system/global-pull-secret-syncer-br6wh"
Sep 17 21:58:22.319696 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:22.319653    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 21:58:22.319696 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:22.319672    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 21:58:22.319696 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:22.319698    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 21:58:22.319898 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:22.319709    2560 projected.go:196] Error preparing data for projected volume kube-api-access-md225 for pod openshift-network-diagnostics/network-check-target-zdznt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 21:58:22.319898 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:22.319712    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c0000a6-1b43-479b-a06b-06eb5db40c2d-original-pull-secret podName:2c0000a6-1b43-479b-a06b-06eb5db40c2d nodeName:}" failed. No retries permitted until 2026-09-17 21:58:54.319695885 +0000 UTC m=+66.379467874 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2c0000a6-1b43-479b-a06b-06eb5db40c2d-original-pull-secret") pod "global-pull-secret-syncer-br6wh" (UID: "2c0000a6-1b43-479b-a06b-06eb5db40c2d") : object "kube-system"/"original-pull-secret" not registered
Sep 17 21:58:22.319898 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:22.319756    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a6387b2-b54c-44e0-909d-589e73c07248-kube-api-access-md225 podName:4a6387b2-b54c-44e0-909d-589e73c07248 nodeName:}" failed. No retries permitted until 2026-09-17 21:58:54.31973951 +0000 UTC m=+66.379511518 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-md225" (UniqueName: "kubernetes.io/projected/4a6387b2-b54c-44e0-909d-589e73c07248-kube-api-access-md225") pod "network-check-target-zdznt" (UID: "4a6387b2-b54c-44e0-909d-589e73c07248") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 21:58:22.448919 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:22.448884    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j58cx"
Sep 17 21:58:22.448919 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:22.448906    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zdznt"
Sep 17 21:58:22.449116 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:22.449025    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-br6wh"
Sep 17 21:58:22.449116 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:22.449039    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j58cx" podUID="8dedff64-89fd-41e2-83e7-e5bdf85f3470"
Sep 17 21:58:22.449197 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:22.449131    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-br6wh" podUID="2c0000a6-1b43-479b-a06b-06eb5db40c2d"
Sep 17 21:58:22.449247 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:22.449214    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zdznt" podUID="4a6387b2-b54c-44e0-909d-589e73c07248"
Sep 17 21:58:23.287816 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.287636    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-66.ec2.internal" event="NodeReady"
Sep 17 21:58:23.288197 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.287923    2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 17 21:58:23.320008 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.319979    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6d87985496-lns5f"]
Sep 17 21:58:23.347470 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.347443    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-j9ctg"]
Sep 17 21:58:23.347629 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.347570    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d87985496-lns5f"
Sep 17 21:58:23.350143 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.350120    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 17 21:58:23.350272 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.350226    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-nrw4l\""
Sep 17 21:58:23.350272 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.350241    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 17 21:58:23.350622 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.350602    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 17 21:58:23.356406 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.356384    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 17 21:58:23.373823 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.373794    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-5svbx"]
Sep 17 21:58:23.374296 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.374274    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-j9ctg"
Sep 17 21:58:23.377136 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.377110    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-dj44c\""
Sep 17 21:58:23.377330 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.377312    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 17 21:58:23.377412 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.377396    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 17 21:58:23.377880 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.377862    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 17 21:58:23.377940 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.377894    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 17 21:58:23.401315 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.401250    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-s2pc2"]
Sep 17 21:58:23.401496 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.401477    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-5svbx"
Sep 17 21:58:23.404365 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.404329    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 17 21:58:23.404467 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.404371    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 17 21:58:23.405551 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.405511    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 17 21:58:23.405675 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.405553    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-66dfl\""
Sep 17 21:58:23.405675 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.405563    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 17 21:58:23.419207 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.419186    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-85f68"]
Sep 17 21:58:23.419325 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.419283    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-s2pc2"
Sep 17 21:58:23.421583 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.421562    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 17 21:58:23.422125 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.422107    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 17 21:58:23.422204 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.422109    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 17 21:58:23.422311 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.422293    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-gw4tt\""
Sep 17 21:58:23.427554 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.427533    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/00b93628-c39c-4304-a072-ae9bd5ad3592-registry-certificates\") pod \"image-registry-6d87985496-lns5f\" (UID: \"00b93628-c39c-4304-a072-ae9bd5ad3592\") " pod="openshift-image-registry/image-registry-6d87985496-lns5f"
Sep 17 21:58:23.427647 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.427587    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/00b93628-c39c-4304-a072-ae9bd5ad3592-registry-tls\") pod \"image-registry-6d87985496-lns5f\" (UID: \"00b93628-c39c-4304-a072-ae9bd5ad3592\") " pod="openshift-image-registry/image-registry-6d87985496-lns5f"
Sep 17 21:58:23.427712 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.427661    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/00b93628-c39c-4304-a072-ae9bd5ad3592-image-registry-private-configuration\") pod \"image-registry-6d87985496-lns5f\" (UID: \"00b93628-c39c-4304-a072-ae9bd5ad3592\") " pod="openshift-image-registry/image-registry-6d87985496-lns5f"
Sep 17 21:58:23.427712 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.427702    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/00b93628-c39c-4304-a072-ae9bd5ad3592-ca-trust-extracted\") pod \"image-registry-6d87985496-lns5f\" (UID: \"00b93628-c39c-4304-a072-ae9bd5ad3592\") " pod="openshift-image-registry/image-registry-6d87985496-lns5f"
Sep 17 21:58:23.427800 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.427768    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/00b93628-c39c-4304-a072-ae9bd5ad3592-installation-pull-secrets\") pod \"image-registry-6d87985496-lns5f\" (UID: \"00b93628-c39c-4304-a072-ae9bd5ad3592\") " pod="openshift-image-registry/image-registry-6d87985496-lns5f"
Sep 17 21:58:23.427866 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.427847    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkthr\" (UniqueName: \"kubernetes.io/projected/00b93628-c39c-4304-a072-ae9bd5ad3592-kube-api-access-dkthr\") pod \"image-registry-6d87985496-lns5f\" (UID: \"00b93628-c39c-4304-a072-ae9bd5ad3592\") " pod="openshift-image-registry/image-registry-6d87985496-lns5f"
Sep 17 21:58:23.427922 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.427909    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/00b93628-c39c-4304-a072-ae9bd5ad3592-trusted-ca\") pod \"image-registry-6d87985496-lns5f\" (UID: \"00b93628-c39c-4304-a072-ae9bd5ad3592\") " pod="openshift-image-registry/image-registry-6d87985496-lns5f"
Sep 17 21:58:23.427974 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.427940    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/00b93628-c39c-4304-a072-ae9bd5ad3592-bound-sa-token\") pod \"image-registry-6d87985496-lns5f\" (UID: \"00b93628-c39c-4304-a072-ae9bd5ad3592\") " pod="openshift-image-registry/image-registry-6d87985496-lns5f"
Sep 17 21:58:23.437233 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.437214    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-jn6j9"]
Sep 17 21:58:23.437362 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.437336    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-85f68"
Sep 17 21:58:23.439962 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.439946    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 17 21:58:23.440115 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.440095    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 17 21:58:23.440196 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.440127    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-ph92s\""
Sep 17 21:58:23.447398 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.447375    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-6qz86"]
Sep 17 21:58:23.447490 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.447441    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-jn6j9"
Sep 17 21:58:23.450151 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.450131    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-dfwb6\""
Sep 17 21:58:23.450151 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.450145    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 17 21:58:23.450324 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.450304    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 17 21:58:23.450478 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.450462    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 17 21:58:23.450563 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.450545    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 17 21:58:23.463312 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.463293    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-xcr4j"]
Sep 17 21:58:23.463458 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.463427    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-6f9c644dd9-6qz86"
Sep 17 21:58:23.466164 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.466146    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-h7zvm\""
Sep 17 21:58:23.466253 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.466163    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 17 21:58:23.466253 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.466186    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 17 21:58:23.466253 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.466146    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 17 21:58:23.466427 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.466392    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 17 21:58:23.471757 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.471712    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 17 21:58:23.475339 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.475324    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5dcb767b8d-7lbgr"]
Sep 17 21:58:23.475442 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.475420    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-fd4bb46c-xcr4j"
Sep 17 21:58:23.478997 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.478030    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 17 21:58:23.478997 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.478082    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 17 21:58:23.478997 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.478036    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 17 21:58:23.478997 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.478386    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 17 21:58:23.478997 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.478796    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-9x6lc\""
Sep 17 21:58:23.489660 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.489636    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-2jjzd"]
Sep 17 21:58:23.489795 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.489777    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5dcb767b8d-7lbgr"
Sep 17 21:58:23.490465 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.490444    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 17 21:58:23.492538 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.492518    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 17 21:58:23.495590 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.495248    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 17 21:58:23.495590 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.495283    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 17 21:58:23.495590 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.495399    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 17 21:58:23.495590 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.495404    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 17 21:58:23.495590 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.495545    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-xjk5x\""
Sep 17 21:58:23.495951 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.495606    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 17 21:58:23.498083 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.498055    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tprjw_6505672f-86e4-439d-88c0-8b8ac9bcb987/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:23.505729 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.505710    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-85f68"]
Sep 17 21:58:23.505818 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.505744    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d87985496-lns5f"]
Sep 17 21:58:23.505818 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.505764    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-s2pc2"]
Sep 17 21:58:23.505818 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.505815    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-fgp46"]
Sep 17 21:58:23.505945 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.505823    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6446c8d75d-2jjzd"
Sep 17 21:58:23.508094 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.508077    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 17 21:58:23.508192 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.508177    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-7q889\""
Sep 17 21:58:23.508248 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.508202    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 17 21:58:23.519330 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.519313    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-5svbx"]
Sep 17 21:58:23.519422 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.519365    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-j9ctg"]
Sep 17 21:58:23.519422 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.519387    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-jn6j9"]
Sep 17 21:58:23.519422 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.519409    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5dcb767b8d-7lbgr"]
Sep 17 21:58:23.519538 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.519437    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zxdvm"]
Sep 17 21:58:23.519538 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.519408    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-fgp46"
Sep 17 21:58:23.522417 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.522399    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 17 21:58:23.522545 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.522525    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 17 21:58:23.522637 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.522594    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-8wx77\""
Sep 17 21:58:23.528396 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.528374    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/00b93628-c39c-4304-a072-ae9bd5ad3592-image-registry-private-configuration\") pod \"image-registry-6d87985496-lns5f\" (UID: \"00b93628-c39c-4304-a072-ae9bd5ad3592\") " pod="openshift-image-registry/image-registry-6d87985496-lns5f"
Sep 17 21:58:23.528504 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.528418    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/351c70fa-979d-49a3-926e-56becaec72ed-serving-cert\") pod \"service-ca-operator-57cdc4b768-jn6j9\" (UID: \"351c70fa-979d-49a3-926e-56becaec72ed\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-jn6j9"
Sep 17 21:58:23.528504 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.528447    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/00b93628-c39c-4304-a072-ae9bd5ad3592-ca-trust-extracted\") pod \"image-registry-6d87985496-lns5f\" (UID: \"00b93628-c39c-4304-a072-ae9bd5ad3592\") " pod="openshift-image-registry/image-registry-6d87985496-lns5f"
Sep 17 21:58:23.528504 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.528463    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/93344afa-73c8-4d4e-8d6f-47e08e79c050-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-5svbx\" (UID: \"93344afa-73c8-4d4e-8d6f-47e08e79c050\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-5svbx"
Sep 17 21:58:23.528504 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.528483    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/00b93628-c39c-4304-a072-ae9bd5ad3592-installation-pull-secrets\") pod \"image-registry-6d87985496-lns5f\" (UID: \"00b93628-c39c-4304-a072-ae9bd5ad3592\") " pod="openshift-image-registry/image-registry-6d87985496-lns5f"
Sep 17 21:58:23.528504 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.528504    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkthr\" (UniqueName: \"kubernetes.io/projected/00b93628-c39c-4304-a072-ae9bd5ad3592-kube-api-access-dkthr\") pod \"image-registry-6d87985496-lns5f\" (UID: \"00b93628-c39c-4304-a072-ae9bd5ad3592\") " pod="openshift-image-registry/image-registry-6d87985496-lns5f"
Sep 17 21:58:23.528820 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.528527    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e5738b3d-740b-4e0c-b1e4-9805f8621f85-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-s2pc2\" (UID: \"e5738b3d-740b-4e0c-b1e4-9805f8621f85\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-s2pc2"
Sep 17 21:58:23.528820 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.528569    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6k8f\" (UniqueName: \"kubernetes.io/projected/c2767d1f-5347-4d4e-8f72-c29ac89b09ef-kube-api-access-k6k8f\") pod \"kube-storage-version-migrator-operator-55889f7b47-j9ctg\" (UID: \"c2767d1f-5347-4d4e-8f72-c29ac89b09ef\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-j9ctg"
Sep 17 21:58:23.528820 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.528700    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/351c70fa-979d-49a3-926e-56becaec72ed-config\") pod \"service-ca-operator-57cdc4b768-jn6j9\" (UID: \"351c70fa-979d-49a3-926e-56becaec72ed\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-jn6j9"
Sep 17 21:58:23.528820 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.528735    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/00b93628-c39c-4304-a072-ae9bd5ad3592-trusted-ca\") pod \"image-registry-6d87985496-lns5f\" (UID: \"00b93628-c39c-4304-a072-ae9bd5ad3592\") " pod="openshift-image-registry/image-registry-6d87985496-lns5f"
Sep 17 21:58:23.528820 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.528762    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c2767d1f-5347-4d4e-8f72-c29ac89b09ef-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-j9ctg\" (UID: \"c2767d1f-5347-4d4e-8f72-c29ac89b09ef\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-j9ctg"
Sep 17 21:58:23.528820 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.528798    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/00b93628-c39c-4304-a072-ae9bd5ad3592-bound-sa-token\") pod \"image-registry-6d87985496-lns5f\" (UID: \"00b93628-c39c-4304-a072-ae9bd5ad3592\") " pod="openshift-image-registry/image-registry-6d87985496-lns5f"
Sep 17 21:58:23.528820 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.528821    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tz48z\" (UniqueName: \"kubernetes.io/projected/e5738b3d-740b-4e0c-b1e4-9805f8621f85-kube-api-access-tz48z\") pod \"cluster-samples-operator-685d7d68b5-s2pc2\" (UID: \"e5738b3d-740b-4e0c-b1e4-9805f8621f85\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-s2pc2"
Sep 17 21:58:23.529193 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.528879    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c2767d1f-5347-4d4e-8f72-c29ac89b09ef-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-j9ctg\" (UID: \"c2767d1f-5347-4d4e-8f72-c29ac89b09ef\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-j9ctg"
Sep 17 21:58:23.529193 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.528904    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/93344afa-73c8-4d4e-8d6f-47e08e79c050-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-5svbx\" (UID: \"93344afa-73c8-4d4e-8d6f-47e08e79c050\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-5svbx"
Sep 17 21:58:23.529193 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.528938    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7fl6\" (UniqueName: \"kubernetes.io/projected/6c3ce3c4-e0e9-4ca5-9932-be6418a30c00-kube-api-access-g7fl6\") pod \"volume-data-source-validator-5c4db8bdf9-85f68\" (UID: \"6c3ce3c4-e0e9-4ca5-9932-be6418a30c00\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-85f68"
Sep 17 21:58:23.529193 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.528956    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/00b93628-c39c-4304-a072-ae9bd5ad3592-ca-trust-extracted\") pod \"image-registry-6d87985496-lns5f\" (UID: \"00b93628-c39c-4304-a072-ae9bd5ad3592\") " pod="openshift-image-registry/image-registry-6d87985496-lns5f"
Sep 17 21:58:23.529193 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.528962    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbzkn\" (UniqueName: \"kubernetes.io/projected/351c70fa-979d-49a3-926e-56becaec72ed-kube-api-access-tbzkn\") pod \"service-ca-operator-57cdc4b768-jn6j9\" (UID: \"351c70fa-979d-49a3-926e-56becaec72ed\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-jn6j9"
Sep 17 21:58:23.529193 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.529034    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/00b93628-c39c-4304-a072-ae9bd5ad3592-registry-certificates\") pod \"image-registry-6d87985496-lns5f\" (UID: \"00b93628-c39c-4304-a072-ae9bd5ad3592\") " pod="openshift-image-registry/image-registry-6d87985496-lns5f"
Sep 17 21:58:23.529193 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.529068    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwmn6\" (UniqueName: \"kubernetes.io/projected/93344afa-73c8-4d4e-8d6f-47e08e79c050-kube-api-access-pwmn6\") pod \"cluster-monitoring-operator-847b8bd8d7-5svbx\" (UID: \"93344afa-73c8-4d4e-8d6f-47e08e79c050\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-5svbx"
Sep 17 21:58:23.529193 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.529116    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/00b93628-c39c-4304-a072-ae9bd5ad3592-registry-tls\") pod \"image-registry-6d87985496-lns5f\" (UID: \"00b93628-c39c-4304-a072-ae9bd5ad3592\") " pod="openshift-image-registry/image-registry-6d87985496-lns5f"
Sep 17 21:58:23.529606 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:23.529204    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 21:58:23.529606 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:23.529220    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d87985496-lns5f: secret "image-registry-tls" not found
Sep 17 21:58:23.529606 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:23.529276    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00b93628-c39c-4304-a072-ae9bd5ad3592-registry-tls podName:00b93628-c39c-4304-a072-ae9bd5ad3592 nodeName:}" failed. No retries permitted until 2026-09-17 21:58:24.029261574 +0000 UTC m=+36.089033573 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/00b93628-c39c-4304-a072-ae9bd5ad3592-registry-tls") pod "image-registry-6d87985496-lns5f" (UID: "00b93628-c39c-4304-a072-ae9bd5ad3592") : secret "image-registry-tls" not found
Sep 17 21:58:23.529606 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.529578    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/00b93628-c39c-4304-a072-ae9bd5ad3592-registry-certificates\") pod \"image-registry-6d87985496-lns5f\" (UID: \"00b93628-c39c-4304-a072-ae9bd5ad3592\") " pod="openshift-image-registry/image-registry-6d87985496-lns5f"
Sep 17 21:58:23.529811 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.529641    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/00b93628-c39c-4304-a072-ae9bd5ad3592-trusted-ca\") pod \"image-registry-6d87985496-lns5f\" (UID: \"00b93628-c39c-4304-a072-ae9bd5ad3592\") " pod="openshift-image-registry/image-registry-6d87985496-lns5f"
Sep 17 21:58:23.529874 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.529841    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4nccz"]
Sep 17 21:58:23.530019 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.530004    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zxdvm"
Sep 17 21:58:23.533402 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.533343    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/00b93628-c39c-4304-a072-ae9bd5ad3592-installation-pull-secrets\") pod \"image-registry-6d87985496-lns5f\" (UID: \"00b93628-c39c-4304-a072-ae9bd5ad3592\") " pod="openshift-image-registry/image-registry-6d87985496-lns5f"
Sep 17 21:58:23.533402 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.533388    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/00b93628-c39c-4304-a072-ae9bd5ad3592-image-registry-private-configuration\") pod \"image-registry-6d87985496-lns5f\" (UID: \"00b93628-c39c-4304-a072-ae9bd5ad3592\") " pod="openshift-image-registry/image-registry-6d87985496-lns5f"
Sep 17 21:58:23.533876 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.533858    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 17 21:58:23.533982 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.533921    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 17 21:58:23.533982 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.533932    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 17 21:58:23.534231 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.534211    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4blcd\""
Sep 17 21:58:23.535847 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.535829    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-6qz86"]
Sep 17 21:58:23.535928 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.535862    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-fgp46"]
Sep 17 21:58:23.535928 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.535882    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-2jjzd"]
Sep 17 21:58:23.535928 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.535899    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-xcr4j"]
Sep 17 21:58:23.535928 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.535916    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4nccz"]
Sep 17 21:58:23.536095 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.535940    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zxdvm"]
Sep 17 21:58:23.536095 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.535942    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4nccz"
Sep 17 21:58:23.538554 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.538537    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 17 21:58:23.538657 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.538568    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 17 21:58:23.538850 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.538834    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7dc29\""
Sep 17 21:58:23.551979 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.551941    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/00b93628-c39c-4304-a072-ae9bd5ad3592-bound-sa-token\") pod \"image-registry-6d87985496-lns5f\" (UID: \"00b93628-c39c-4304-a072-ae9bd5ad3592\") " pod="openshift-image-registry/image-registry-6d87985496-lns5f"
Sep 17 21:58:23.552141 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.552123    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkthr\" (UniqueName: \"kubernetes.io/projected/00b93628-c39c-4304-a072-ae9bd5ad3592-kube-api-access-dkthr\") pod \"image-registry-6d87985496-lns5f\" (UID: \"00b93628-c39c-4304-a072-ae9bd5ad3592\") " pod="openshift-image-registry/image-registry-6d87985496-lns5f"
Sep 17 21:58:23.624516 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.624482    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tprjw_6505672f-86e4-439d-88c0-8b8ac9bcb987/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:23.630509 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.630480    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c2767d1f-5347-4d4e-8f72-c29ac89b09ef-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-j9ctg\" (UID: \"c2767d1f-5347-4d4e-8f72-c29ac89b09ef\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-j9ctg"
Sep 17 21:58:23.630649 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.630521    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86-metrics-certs\") pod \"router-default-5dcb767b8d-7lbgr\" (UID: \"b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86\") " pod="openshift-ingress/router-default-5dcb767b8d-7lbgr"
Sep 17 21:58:23.630649 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.630547    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2127c519-5059-47bc-b905-2ac3bee41b8d-tmp-dir\") pod \"dns-default-4nccz\" (UID: \"2127c519-5059-47bc-b905-2ac3bee41b8d\") " pod="openshift-dns/dns-default-4nccz"
Sep 17 21:58:23.630649 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.630570    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d690701c-bcec-48f2-9978-b6aebbf77447-config\") pod \"console-operator-fd4bb46c-xcr4j\" (UID: \"d690701c-bcec-48f2-9978-b6aebbf77447\") " pod="openshift-console-operator/console-operator-fd4bb46c-xcr4j"
Sep 17 21:58:23.630649 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.630592    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwmn6\" (UniqueName: \"kubernetes.io/projected/93344afa-73c8-4d4e-8d6f-47e08e79c050-kube-api-access-pwmn6\") pod \"cluster-monitoring-operator-847b8bd8d7-5svbx\" (UID: \"93344afa-73c8-4d4e-8d6f-47e08e79c050\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-5svbx"
Sep 17 21:58:23.630649 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.630639    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86-stats-auth\") pod \"router-default-5dcb767b8d-7lbgr\" (UID: \"b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86\") " pod="openshift-ingress/router-default-5dcb767b8d-7lbgr"
Sep 17 21:58:23.630897 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.630674    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jq9lj\" (UniqueName: \"kubernetes.io/projected/059b6280-9215-4207-9aaa-570643410245-kube-api-access-jq9lj\") pod \"network-check-source-7cbc45fddc-fgp46\" (UID: \"059b6280-9215-4207-9aaa-570643410245\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-fgp46"
Sep 17 21:58:23.630897 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.630848    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74040bed-ca22-4af1-a397-223d527bceb7-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-6qz86\" (UID: \"74040bed-ca22-4af1-a397-223d527bceb7\") " pod="openshift-insights/insights-operator-6f9c644dd9-6qz86"
Sep 17 21:58:23.630897 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.630889    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6r5rd\" (UniqueName: \"kubernetes.io/projected/f0b6f107-f369-47b8-852b-ca599f331d5c-kube-api-access-6r5rd\") pod \"ingress-canary-zxdvm\" (UID: \"f0b6f107-f369-47b8-852b-ca599f331d5c\") " pod="openshift-ingress-canary/ingress-canary-zxdvm"
Sep 17 21:58:23.631049 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.630923    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/93344afa-73c8-4d4e-8d6f-47e08e79c050-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-5svbx\" (UID: \"93344afa-73c8-4d4e-8d6f-47e08e79c050\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-5svbx"
Sep 17 21:58:23.631049 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.630950    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e5738b3d-740b-4e0c-b1e4-9805f8621f85-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-s2pc2\" (UID: \"e5738b3d-740b-4e0c-b1e4-9805f8621f85\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-s2pc2"
Sep 17 21:58:23.631049 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.630976    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0718c57f-12b7-4062-b53c-777792631aec-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-2jjzd\" (UID: \"0718c57f-12b7-4062-b53c-777792631aec\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-2jjzd"
Sep 17 21:58:23.631049 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.631012    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c2767d1f-5347-4d4e-8f72-c29ac89b09ef-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-j9ctg\" (UID: \"c2767d1f-5347-4d4e-8f72-c29ac89b09ef\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-j9ctg"
Sep 17 21:58:23.631049 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.631035    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d690701c-bcec-48f2-9978-b6aebbf77447-trusted-ca\") pod \"console-operator-fd4bb46c-xcr4j\" (UID: \"d690701c-bcec-48f2-9978-b6aebbf77447\") " pod="openshift-console-operator/console-operator-fd4bb46c-xcr4j"
Sep 17 21:58:23.631297 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.631057    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74040bed-ca22-4af1-a397-223d527bceb7-tmp\") pod \"insights-operator-6f9c644dd9-6qz86\" (UID: \"74040bed-ca22-4af1-a397-223d527bceb7\") " pod="openshift-insights/insights-operator-6f9c644dd9-6qz86"
Sep 17 21:58:23.631297 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.631084    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smnbv\" (UniqueName: \"kubernetes.io/projected/b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86-kube-api-access-smnbv\") pod \"router-default-5dcb767b8d-7lbgr\" (UID: \"b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86\") " pod="openshift-ingress/router-default-5dcb767b8d-7lbgr"
Sep 17 21:58:23.631297 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.631106    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f0b6f107-f369-47b8-852b-ca599f331d5c-cert\") pod \"ingress-canary-zxdvm\" (UID: \"f0b6f107-f369-47b8-852b-ca599f331d5c\") " pod="openshift-ingress-canary/ingress-canary-zxdvm"
Sep 17 21:58:23.631297 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.631131    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tz48z\" (UniqueName: \"kubernetes.io/projected/e5738b3d-740b-4e0c-b1e4-9805f8621f85-kube-api-access-tz48z\") pod \"cluster-samples-operator-685d7d68b5-s2pc2\" (UID: \"e5738b3d-740b-4e0c-b1e4-9805f8621f85\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-s2pc2"
Sep 17 21:58:23.631297 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.631157    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jns79\" (UniqueName: \"kubernetes.io/projected/d690701c-bcec-48f2-9978-b6aebbf77447-kube-api-access-jns79\") pod \"console-operator-fd4bb46c-xcr4j\" (UID: \"d690701c-bcec-48f2-9978-b6aebbf77447\") " pod="openshift-console-operator/console-operator-fd4bb46c-xcr4j"
Sep 17 21:58:23.631297 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.631190    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2127c519-5059-47bc-b905-2ac3bee41b8d-metrics-tls\") pod \"dns-default-4nccz\" (UID: \"2127c519-5059-47bc-b905-2ac3bee41b8d\") " pod="openshift-dns/dns-default-4nccz"
Sep 17 21:58:23.631297 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.631214    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9579\" (UniqueName: \"kubernetes.io/projected/74040bed-ca22-4af1-a397-223d527bceb7-kube-api-access-x9579\") pod \"insights-operator-6f9c644dd9-6qz86\" (UID: \"74040bed-ca22-4af1-a397-223d527bceb7\") " pod="openshift-insights/insights-operator-6f9c644dd9-6qz86"
Sep 17 21:58:23.631297 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.631234    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c2767d1f-5347-4d4e-8f72-c29ac89b09ef-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-j9ctg\" (UID: \"c2767d1f-5347-4d4e-8f72-c29ac89b09ef\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-j9ctg"
Sep 17 21:58:23.631297 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.631251    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86-default-certificate\") pod \"router-default-5dcb767b8d-7lbgr\" (UID: \"b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86\") " pod="openshift-ingress/router-default-5dcb767b8d-7lbgr"
Sep 17 21:58:23.631297 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.631281    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/93344afa-73c8-4d4e-8d6f-47e08e79c050-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-5svbx\" (UID: \"93344afa-73c8-4d4e-8d6f-47e08e79c050\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-5svbx"
Sep 17 21:58:23.631790 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.631305    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7fl6\" (UniqueName: \"kubernetes.io/projected/6c3ce3c4-e0e9-4ca5-9932-be6418a30c00-kube-api-access-g7fl6\") pod \"volume-data-source-validator-5c4db8bdf9-85f68\" (UID: \"6c3ce3c4-e0e9-4ca5-9932-be6418a30c00\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-85f68"
Sep 17 21:58:23.631790 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.631330    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86-service-ca-bundle\") pod \"router-default-5dcb767b8d-7lbgr\" (UID: \"b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86\") " pod="openshift-ingress/router-default-5dcb767b8d-7lbgr"
Sep 17 21:58:23.631790 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:23.631333    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 17 21:58:23.631790 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:23.631508    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5738b3d-740b-4e0c-b1e4-9805f8621f85-samples-operator-tls podName:e5738b3d-740b-4e0c-b1e4-9805f8621f85 nodeName:}" failed. No retries permitted until 2026-09-17 21:58:24.131489911 +0000 UTC m=+36.191261916 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e5738b3d-740b-4e0c-b1e4-9805f8621f85-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-s2pc2" (UID: "e5738b3d-740b-4e0c-b1e4-9805f8621f85") : secret "samples-operator-tls" not found
Sep 17 21:58:23.631790 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:23.631436    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 17 21:58:23.631790 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:23.631618    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93344afa-73c8-4d4e-8d6f-47e08e79c050-cluster-monitoring-operator-tls podName:93344afa-73c8-4d4e-8d6f-47e08e79c050 nodeName:}" failed. No retries permitted until 2026-09-17 21:58:24.131605562 +0000 UTC m=+36.191377569 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/93344afa-73c8-4d4e-8d6f-47e08e79c050-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-5svbx" (UID: "93344afa-73c8-4d4e-8d6f-47e08e79c050") : secret "cluster-monitoring-operator-tls" not found
Sep 17 21:58:23.631790 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.631662    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0718c57f-12b7-4062-b53c-777792631aec-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-2jjzd\" (UID: \"0718c57f-12b7-4062-b53c-777792631aec\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-2jjzd"
Sep 17 21:58:23.631790 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.631694    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/93344afa-73c8-4d4e-8d6f-47e08e79c050-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-5svbx\" (UID: \"93344afa-73c8-4d4e-8d6f-47e08e79c050\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-5svbx"
Sep 17 21:58:23.631790 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.631717    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/351c70fa-979d-49a3-926e-56becaec72ed-serving-cert\") pod \"service-ca-operator-57cdc4b768-jn6j9\" (UID: \"351c70fa-979d-49a3-926e-56becaec72ed\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-jn6j9"
Sep 17 21:58:23.631790 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.631769    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/351c70fa-979d-49a3-926e-56becaec72ed-config\") pod \"service-ca-operator-57cdc4b768-jn6j9\" (UID: \"351c70fa-979d-49a3-926e-56becaec72ed\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-jn6j9"
Sep 17 21:58:23.632251 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.631833    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/74040bed-ca22-4af1-a397-223d527bceb7-serving-cert\") pod \"insights-operator-6f9c644dd9-6qz86\" (UID: \"74040bed-ca22-4af1-a397-223d527bceb7\") " pod="openshift-insights/insights-operator-6f9c644dd9-6qz86"
Sep 17 21:58:23.632251 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.631875    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6k8f\" (UniqueName: \"kubernetes.io/projected/c2767d1f-5347-4d4e-8f72-c29ac89b09ef-kube-api-access-k6k8f\") pod \"kube-storage-version-migrator-operator-55889f7b47-j9ctg\" (UID: \"c2767d1f-5347-4d4e-8f72-c29ac89b09ef\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-j9ctg"
Sep 17 21:58:23.632251 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.631901    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2127c519-5059-47bc-b905-2ac3bee41b8d-config-volume\") pod \"dns-default-4nccz\" (UID: \"2127c519-5059-47bc-b905-2ac3bee41b8d\") " pod="openshift-dns/dns-default-4nccz"
Sep 17 21:58:23.632251 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.632123    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/74040bed-ca22-4af1-a397-223d527bceb7-snapshots\") pod \"insights-operator-6f9c644dd9-6qz86\" (UID: \"74040bed-ca22-4af1-a397-223d527bceb7\") " pod="openshift-insights/insights-operator-6f9c644dd9-6qz86"
Sep 17 21:58:23.632251 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.632184    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmfhd\" (UniqueName: \"kubernetes.io/projected/2127c519-5059-47bc-b905-2ac3bee41b8d-kube-api-access-wmfhd\") pod \"dns-default-4nccz\" (UID: \"2127c519-5059-47bc-b905-2ac3bee41b8d\") " pod="openshift-dns/dns-default-4nccz"
Sep 17 21:58:23.632251 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.632234    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74040bed-ca22-4af1-a397-223d527bceb7-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-6qz86\" (UID: \"74040bed-ca22-4af1-a397-223d527bceb7\") " pod="openshift-insights/insights-operator-6f9c644dd9-6qz86"
Sep 17 21:58:23.632566 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.632267    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbzkn\" (UniqueName: \"kubernetes.io/projected/351c70fa-979d-49a3-926e-56becaec72ed-kube-api-access-tbzkn\") pod \"service-ca-operator-57cdc4b768-jn6j9\" (UID: \"351c70fa-979d-49a3-926e-56becaec72ed\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-jn6j9"
Sep 17 21:58:23.632566 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.632293    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d690701c-bcec-48f2-9978-b6aebbf77447-serving-cert\") pod \"console-operator-fd4bb46c-xcr4j\" (UID: \"d690701c-bcec-48f2-9978-b6aebbf77447\") " pod="openshift-console-operator/console-operator-fd4bb46c-xcr4j"
Sep 17 21:58:23.632566 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.632431    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/351c70fa-979d-49a3-926e-56becaec72ed-config\") pod \"service-ca-operator-57cdc4b768-jn6j9\" (UID: \"351c70fa-979d-49a3-926e-56becaec72ed\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-jn6j9"
Sep 17 21:58:23.634177 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.634156    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c2767d1f-5347-4d4e-8f72-c29ac89b09ef-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-j9ctg\" (UID: \"c2767d1f-5347-4d4e-8f72-c29ac89b09ef\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-j9ctg"
Sep 17 21:58:23.634544 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.634525    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/351c70fa-979d-49a3-926e-56becaec72ed-serving-cert\") pod \"service-ca-operator-57cdc4b768-jn6j9\" (UID: \"351c70fa-979d-49a3-926e-56becaec72ed\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-jn6j9"
Sep 17 21:58:23.640906 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.640529    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7fl6\" (UniqueName: \"kubernetes.io/projected/6c3ce3c4-e0e9-4ca5-9932-be6418a30c00-kube-api-access-g7fl6\") pod \"volume-data-source-validator-5c4db8bdf9-85f68\" (UID: \"6c3ce3c4-e0e9-4ca5-9932-be6418a30c00\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-85f68"
Sep 17 21:58:23.640906 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.640863    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbzkn\" (UniqueName: \"kubernetes.io/projected/351c70fa-979d-49a3-926e-56becaec72ed-kube-api-access-tbzkn\") pod \"service-ca-operator-57cdc4b768-jn6j9\" (UID: \"351c70fa-979d-49a3-926e-56becaec72ed\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-jn6j9"
Sep 17 21:58:23.641574 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.641551    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwmn6\" (UniqueName: \"kubernetes.io/projected/93344afa-73c8-4d4e-8d6f-47e08e79c050-kube-api-access-pwmn6\") pod \"cluster-monitoring-operator-847b8bd8d7-5svbx\" (UID: \"93344afa-73c8-4d4e-8d6f-47e08e79c050\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-5svbx"
Sep 17 21:58:23.641822 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.641778    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6k8f\" (UniqueName: \"kubernetes.io/projected/c2767d1f-5347-4d4e-8f72-c29ac89b09ef-kube-api-access-k6k8f\") pod \"kube-storage-version-migrator-operator-55889f7b47-j9ctg\" (UID: \"c2767d1f-5347-4d4e-8f72-c29ac89b09ef\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-j9ctg"
Sep 17 21:58:23.641926 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.641844    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tz48z\" (UniqueName: \"kubernetes.io/projected/e5738b3d-740b-4e0c-b1e4-9805f8621f85-kube-api-access-tz48z\") pod \"cluster-samples-operator-685d7d68b5-s2pc2\" (UID: \"e5738b3d-740b-4e0c-b1e4-9805f8621f85\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-s2pc2"
Sep 17 21:58:23.685620 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.685568    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-j9ctg"
Sep 17 21:58:23.733634 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.733608    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74040bed-ca22-4af1-a397-223d527bceb7-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-6qz86\" (UID: \"74040bed-ca22-4af1-a397-223d527bceb7\") " pod="openshift-insights/insights-operator-6f9c644dd9-6qz86"
Sep 17 21:58:23.733733 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.733647    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d690701c-bcec-48f2-9978-b6aebbf77447-serving-cert\") pod \"console-operator-fd4bb46c-xcr4j\" (UID: \"d690701c-bcec-48f2-9978-b6aebbf77447\") " pod="openshift-console-operator/console-operator-fd4bb46c-xcr4j"
Sep 17 21:58:23.733733 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.733688    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86-metrics-certs\") pod \"router-default-5dcb767b8d-7lbgr\" (UID: \"b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86\") " pod="openshift-ingress/router-default-5dcb767b8d-7lbgr"
Sep 17 21:58:23.733733 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.733707    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2127c519-5059-47bc-b905-2ac3bee41b8d-tmp-dir\") pod \"dns-default-4nccz\" (UID: \"2127c519-5059-47bc-b905-2ac3bee41b8d\") " pod="openshift-dns/dns-default-4nccz"
Sep 17 21:58:23.733900 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.733735    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d690701c-bcec-48f2-9978-b6aebbf77447-config\") pod \"console-operator-fd4bb46c-xcr4j\" (UID: \"d690701c-bcec-48f2-9978-b6aebbf77447\") " pod="openshift-console-operator/console-operator-fd4bb46c-xcr4j"
Sep 17 21:58:23.733900 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.733762    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86-stats-auth\") pod \"router-default-5dcb767b8d-7lbgr\" (UID: \"b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86\") " pod="openshift-ingress/router-default-5dcb767b8d-7lbgr"
Sep 17 21:58:23.733900 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.733788    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jq9lj\" (UniqueName: \"kubernetes.io/projected/059b6280-9215-4207-9aaa-570643410245-kube-api-access-jq9lj\") pod \"network-check-source-7cbc45fddc-fgp46\" (UID: \"059b6280-9215-4207-9aaa-570643410245\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-fgp46"
Sep 17 21:58:23.733900 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:23.733810    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 17 21:58:23.733900 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.733835    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74040bed-ca22-4af1-a397-223d527bceb7-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-6qz86\" (UID: \"74040bed-ca22-4af1-a397-223d527bceb7\") " pod="openshift-insights/insights-operator-6f9c644dd9-6qz86"
Sep 17 21:58:23.733900 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:23.733866    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86-metrics-certs podName:b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86 nodeName:}" failed. No retries permitted until 2026-09-17 21:58:24.23384699 +0000 UTC m=+36.293618987 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86-metrics-certs") pod "router-default-5dcb767b8d-7lbgr" (UID: "b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86") : secret "router-metrics-certs-default" not found
Sep 17 21:58:23.733900 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.733896    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6r5rd\" (UniqueName: \"kubernetes.io/projected/f0b6f107-f369-47b8-852b-ca599f331d5c-kube-api-access-6r5rd\") pod \"ingress-canary-zxdvm\" (UID: \"f0b6f107-f369-47b8-852b-ca599f331d5c\") " pod="openshift-ingress-canary/ingress-canary-zxdvm"
Sep 17 21:58:23.734269 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.733941    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0718c57f-12b7-4062-b53c-777792631aec-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-2jjzd\" (UID: \"0718c57f-12b7-4062-b53c-777792631aec\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-2jjzd"
Sep 17 21:58:23.734269 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.733975    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d690701c-bcec-48f2-9978-b6aebbf77447-trusted-ca\") pod \"console-operator-fd4bb46c-xcr4j\" (UID: \"d690701c-bcec-48f2-9978-b6aebbf77447\") " pod="openshift-console-operator/console-operator-fd4bb46c-xcr4j"
Sep 17 21:58:23.734269 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.734001    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74040bed-ca22-4af1-a397-223d527bceb7-tmp\") pod \"insights-operator-6f9c644dd9-6qz86\" (UID: \"74040bed-ca22-4af1-a397-223d527bceb7\") " pod="openshift-insights/insights-operator-6f9c644dd9-6qz86"
Sep 17 21:58:23.734269 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.734031    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smnbv\" (UniqueName: \"kubernetes.io/projected/b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86-kube-api-access-smnbv\") pod \"router-default-5dcb767b8d-7lbgr\" (UID: \"b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86\") " pod="openshift-ingress/router-default-5dcb767b8d-7lbgr"
Sep 17 21:58:23.734269 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.734054    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f0b6f107-f369-47b8-852b-ca599f331d5c-cert\") pod \"ingress-canary-zxdvm\" (UID: \"f0b6f107-f369-47b8-852b-ca599f331d5c\") " pod="openshift-ingress-canary/ingress-canary-zxdvm"
Sep 17 21:58:23.734269 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.734080    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jns79\" (UniqueName: \"kubernetes.io/projected/d690701c-bcec-48f2-9978-b6aebbf77447-kube-api-access-jns79\") pod \"console-operator-fd4bb46c-xcr4j\" (UID: \"d690701c-bcec-48f2-9978-b6aebbf77447\") " pod="openshift-console-operator/console-operator-fd4bb46c-xcr4j"
Sep 17 21:58:23.734269 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:23.734151    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 17 21:58:23.734269 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:23.734215    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0718c57f-12b7-4062-b53c-777792631aec-networking-console-plugin-cert podName:0718c57f-12b7-4062-b53c-777792631aec nodeName:}" failed. No retries permitted until 2026-09-17 21:58:24.234198011 +0000 UTC m=+36.293970021 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0718c57f-12b7-4062-b53c-777792631aec-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-2jjzd" (UID: "0718c57f-12b7-4062-b53c-777792631aec") : secret "networking-console-plugin-cert" not found
Sep 17 21:58:23.734269 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.734240    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2127c519-5059-47bc-b905-2ac3bee41b8d-metrics-tls\") pod \"dns-default-4nccz\" (UID: \"2127c519-5059-47bc-b905-2ac3bee41b8d\") " pod="openshift-dns/dns-default-4nccz"
Sep 17 21:58:23.734776 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.734275    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9579\" (UniqueName: \"kubernetes.io/projected/74040bed-ca22-4af1-a397-223d527bceb7-kube-api-access-x9579\") pod \"insights-operator-6f9c644dd9-6qz86\" (UID: \"74040bed-ca22-4af1-a397-223d527bceb7\") " pod="openshift-insights/insights-operator-6f9c644dd9-6qz86"
Sep 17 21:58:23.734776 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.734316    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86-default-certificate\") pod \"router-default-5dcb767b8d-7lbgr\" (UID: \"b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86\") " pod="openshift-ingress/router-default-5dcb767b8d-7lbgr"
Sep 17 21:58:23.734776 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.734331    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74040bed-ca22-4af1-a397-223d527bceb7-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-6qz86\" (UID: \"74040bed-ca22-4af1-a397-223d527bceb7\") " pod="openshift-insights/insights-operator-6f9c644dd9-6qz86"
Sep 17 21:58:23.734776 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.734381    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86-service-ca-bundle\") pod \"router-default-5dcb767b8d-7lbgr\" (UID: \"b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86\") " pod="openshift-ingress/router-default-5dcb767b8d-7lbgr"
Sep 17 21:58:23.734776 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.734418    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0718c57f-12b7-4062-b53c-777792631aec-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-2jjzd\" (UID: \"0718c57f-12b7-4062-b53c-777792631aec\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-2jjzd"
Sep 17 21:58:23.734776 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.734436    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74040bed-ca22-4af1-a397-223d527bceb7-tmp\") pod \"insights-operator-6f9c644dd9-6qz86\" (UID: \"74040bed-ca22-4af1-a397-223d527bceb7\") " pod="openshift-insights/insights-operator-6f9c644dd9-6qz86"
Sep 17 21:58:23.734776 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.734467    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/74040bed-ca22-4af1-a397-223d527bceb7-serving-cert\") pod \"insights-operator-6f9c644dd9-6qz86\" (UID: \"74040bed-ca22-4af1-a397-223d527bceb7\") " pod="openshift-insights/insights-operator-6f9c644dd9-6qz86"
Sep 17 21:58:23.734776 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.734481    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d690701c-bcec-48f2-9978-b6aebbf77447-config\") pod \"console-operator-fd4bb46c-xcr4j\" (UID: \"d690701c-bcec-48f2-9978-b6aebbf77447\") " pod="openshift-console-operator/console-operator-fd4bb46c-xcr4j"
Sep 17 21:58:23.734776 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.734497    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2127c519-5059-47bc-b905-2ac3bee41b8d-config-volume\") pod \"dns-default-4nccz\" (UID: \"2127c519-5059-47bc-b905-2ac3bee41b8d\") " pod="openshift-dns/dns-default-4nccz"
Sep 17 21:58:23.734776 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.734523    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/74040bed-ca22-4af1-a397-223d527bceb7-snapshots\") pod \"insights-operator-6f9c644dd9-6qz86\" (UID: \"74040bed-ca22-4af1-a397-223d527bceb7\") " pod="openshift-insights/insights-operator-6f9c644dd9-6qz86"
Sep 17 21:58:23.734776 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.734532    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74040bed-ca22-4af1-a397-223d527bceb7-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-6qz86\" (UID: \"74040bed-ca22-4af1-a397-223d527bceb7\") " pod="openshift-insights/insights-operator-6f9c644dd9-6qz86"
Sep 17 21:58:23.734776 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.734556    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmfhd\" (UniqueName: \"kubernetes.io/projected/2127c519-5059-47bc-b905-2ac3bee41b8d-kube-api-access-wmfhd\") pod \"dns-default-4nccz\" (UID: \"2127c519-5059-47bc-b905-2ac3bee41b8d\") " pod="openshift-dns/dns-default-4nccz"
Sep 17 21:58:23.735364 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.734791    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2127c519-5059-47bc-b905-2ac3bee41b8d-tmp-dir\") pod \"dns-default-4nccz\" (UID: \"2127c519-5059-47bc-b905-2ac3bee41b8d\") " pod="openshift-dns/dns-default-4nccz"
Sep 17 21:58:23.735364 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:23.734861    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 21:58:23.735364 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:23.734914    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2127c519-5059-47bc-b905-2ac3bee41b8d-metrics-tls podName:2127c519-5059-47bc-b905-2ac3bee41b8d nodeName:}" failed. No retries permitted until 2026-09-17 21:58:24.234899714 +0000 UTC m=+36.294671709 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2127c519-5059-47bc-b905-2ac3bee41b8d-metrics-tls") pod "dns-default-4nccz" (UID: "2127c519-5059-47bc-b905-2ac3bee41b8d") : secret "dns-default-metrics-tls" not found
Sep 17 21:58:23.735364 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.735136    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2127c519-5059-47bc-b905-2ac3bee41b8d-config-volume\") pod \"dns-default-4nccz\" (UID: \"2127c519-5059-47bc-b905-2ac3bee41b8d\") " pod="openshift-dns/dns-default-4nccz"
Sep 17 21:58:23.735364 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:23.735208    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86-service-ca-bundle podName:b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86 nodeName:}" failed. No retries permitted until 2026-09-17 21:58:24.235192006 +0000 UTC m=+36.294964016 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86-service-ca-bundle") pod "router-default-5dcb767b8d-7lbgr" (UID: "b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86") : configmap references non-existent config key: service-ca.crt
Sep 17 21:58:23.735364 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.735269    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d690701c-bcec-48f2-9978-b6aebbf77447-trusted-ca\") pod \"console-operator-fd4bb46c-xcr4j\" (UID: \"d690701c-bcec-48f2-9978-b6aebbf77447\") " pod="openshift-console-operator/console-operator-fd4bb46c-xcr4j"
Sep 17 21:58:23.735683 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.735429    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/74040bed-ca22-4af1-a397-223d527bceb7-snapshots\") pod \"insights-operator-6f9c644dd9-6qz86\" (UID: \"74040bed-ca22-4af1-a397-223d527bceb7\") " pod="openshift-insights/insights-operator-6f9c644dd9-6qz86"
Sep 17 21:58:23.735882 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.735854    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0718c57f-12b7-4062-b53c-777792631aec-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-2jjzd\" (UID: \"0718c57f-12b7-4062-b53c-777792631aec\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-2jjzd"
Sep 17 21:58:23.736639 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.736616    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d690701c-bcec-48f2-9978-b6aebbf77447-serving-cert\") pod \"console-operator-fd4bb46c-xcr4j\" (UID: \"d690701c-bcec-48f2-9978-b6aebbf77447\") " pod="openshift-console-operator/console-operator-fd4bb46c-xcr4j"
Sep 17 21:58:23.737329 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.737305    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/74040bed-ca22-4af1-a397-223d527bceb7-serving-cert\") pod \"insights-operator-6f9c644dd9-6qz86\" (UID: \"74040bed-ca22-4af1-a397-223d527bceb7\") " pod="openshift-insights/insights-operator-6f9c644dd9-6qz86"
Sep 17 21:58:23.737566 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.737547    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f0b6f107-f369-47b8-852b-ca599f331d5c-cert\") pod \"ingress-canary-zxdvm\" (UID: \"f0b6f107-f369-47b8-852b-ca599f331d5c\") " pod="openshift-ingress-canary/ingress-canary-zxdvm"
Sep 17 21:58:23.737740 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.737717    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86-stats-auth\") pod \"router-default-5dcb767b8d-7lbgr\" (UID: \"b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86\") " pod="openshift-ingress/router-default-5dcb767b8d-7lbgr"
Sep 17 21:58:23.737991 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.737975    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86-default-certificate\") pod \"router-default-5dcb767b8d-7lbgr\" (UID: \"b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86\") " pod="openshift-ingress/router-default-5dcb767b8d-7lbgr"
Sep 17 21:58:23.743219 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.743195    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6r5rd\" (UniqueName: \"kubernetes.io/projected/f0b6f107-f369-47b8-852b-ca599f331d5c-kube-api-access-6r5rd\") pod \"ingress-canary-zxdvm\" (UID: \"f0b6f107-f369-47b8-852b-ca599f331d5c\") " pod="openshift-ingress-canary/ingress-canary-zxdvm"
Sep 17 21:58:23.743579 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.743561    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smnbv\" (UniqueName: \"kubernetes.io/projected/b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86-kube-api-access-smnbv\") pod \"router-default-5dcb767b8d-7lbgr\" (UID: \"b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86\") " pod="openshift-ingress/router-default-5dcb767b8d-7lbgr"
Sep 17 21:58:23.743964 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.743947    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jq9lj\" (UniqueName: \"kubernetes.io/projected/059b6280-9215-4207-9aaa-570643410245-kube-api-access-jq9lj\") pod \"network-check-source-7cbc45fddc-fgp46\" (UID: \"059b6280-9215-4207-9aaa-570643410245\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-fgp46"
Sep 17 21:58:23.744030 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.743958    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9579\" (UniqueName: \"kubernetes.io/projected/74040bed-ca22-4af1-a397-223d527bceb7-kube-api-access-x9579\") pod \"insights-operator-6f9c644dd9-6qz86\" (UID: \"74040bed-ca22-4af1-a397-223d527bceb7\") " pod="openshift-insights/insights-operator-6f9c644dd9-6qz86"
Sep 17 21:58:23.744166 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.744148    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jns79\" (UniqueName: \"kubernetes.io/projected/d690701c-bcec-48f2-9978-b6aebbf77447-kube-api-access-jns79\") pod \"console-operator-fd4bb46c-xcr4j\" (UID: \"d690701c-bcec-48f2-9978-b6aebbf77447\") " pod="openshift-console-operator/console-operator-fd4bb46c-xcr4j"
Sep 17 21:58:23.744366 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.744338    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmfhd\" (UniqueName: \"kubernetes.io/projected/2127c519-5059-47bc-b905-2ac3bee41b8d-kube-api-access-wmfhd\") pod \"dns-default-4nccz\" (UID: \"2127c519-5059-47bc-b905-2ac3bee41b8d\") " pod="openshift-dns/dns-default-4nccz"
Sep 17 21:58:23.747331 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.747315    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-85f68"
Sep 17 21:58:23.757316 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.757296    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-jn6j9"
Sep 17 21:58:23.774201 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.774184    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-6f9c644dd9-6qz86"
Sep 17 21:58:23.787057 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.787031    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-fd4bb46c-xcr4j"
Sep 17 21:58:23.829326 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.829306    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-fgp46"
Sep 17 21:58:23.848211 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:23.848195    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zxdvm"
Sep 17 21:58:24.037847 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:24.037821    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/00b93628-c39c-4304-a072-ae9bd5ad3592-registry-tls\") pod \"image-registry-6d87985496-lns5f\" (UID: \"00b93628-c39c-4304-a072-ae9bd5ad3592\") " pod="openshift-image-registry/image-registry-6d87985496-lns5f"
Sep 17 21:58:24.038000 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:24.037979    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 21:58:24.038038 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:24.038004    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d87985496-lns5f: secret "image-registry-tls" not found
Sep 17 21:58:24.038074 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:24.038068    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00b93628-c39c-4304-a072-ae9bd5ad3592-registry-tls podName:00b93628-c39c-4304-a072-ae9bd5ad3592 nodeName:}" failed. No retries permitted until 2026-09-17 21:58:25.0380492 +0000 UTC m=+37.097821194 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/00b93628-c39c-4304-a072-ae9bd5ad3592-registry-tls") pod "image-registry-6d87985496-lns5f" (UID: "00b93628-c39c-4304-a072-ae9bd5ad3592") : secret "image-registry-tls" not found
Sep 17 21:58:24.138509 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:24.138478    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e5738b3d-740b-4e0c-b1e4-9805f8621f85-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-s2pc2\" (UID: \"e5738b3d-740b-4e0c-b1e4-9805f8621f85\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-s2pc2"
Sep 17 21:58:24.138612 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:24.138539    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/93344afa-73c8-4d4e-8d6f-47e08e79c050-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-5svbx\" (UID: \"93344afa-73c8-4d4e-8d6f-47e08e79c050\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-5svbx"
Sep 17 21:58:24.138662 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:24.138615    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 17 21:58:24.138662 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:24.138655    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 17 21:58:24.138726 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:24.138675    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5738b3d-740b-4e0c-b1e4-9805f8621f85-samples-operator-tls podName:e5738b3d-740b-4e0c-b1e4-9805f8621f85 nodeName:}" failed. No retries permitted until 2026-09-17 21:58:25.138658945 +0000 UTC m=+37.198430961 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e5738b3d-740b-4e0c-b1e4-9805f8621f85-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-s2pc2" (UID: "e5738b3d-740b-4e0c-b1e4-9805f8621f85") : secret "samples-operator-tls" not found
Sep 17 21:58:24.138726 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:24.138692    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93344afa-73c8-4d4e-8d6f-47e08e79c050-cluster-monitoring-operator-tls podName:93344afa-73c8-4d4e-8d6f-47e08e79c050 nodeName:}" failed. No retries permitted until 2026-09-17 21:58:25.138682 +0000 UTC m=+37.198453989 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/93344afa-73c8-4d4e-8d6f-47e08e79c050-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-5svbx" (UID: "93344afa-73c8-4d4e-8d6f-47e08e79c050") : secret "cluster-monitoring-operator-tls" not found
Sep 17 21:58:24.214923 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:24.214721    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-jn6j9"]
Sep 17 21:58:24.215426 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:24.215374    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-85f68"]
Sep 17 21:58:24.224448 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:24.219723    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-j9ctg"]
Sep 17 21:58:24.224448 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:24.221848    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zxdvm"]
Sep 17 21:58:24.224448 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:24.223879    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-xcr4j"]
Sep 17 21:58:24.227101 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:24.227050    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-fgp46"]
Sep 17 21:58:24.229103 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:24.228486    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-6qz86"]
Sep 17 21:58:24.239311 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:24.239208    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86-metrics-certs\") pod \"router-default-5dcb767b8d-7lbgr\" (UID: \"b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86\") " pod="openshift-ingress/router-default-5dcb767b8d-7lbgr"
Sep 17 21:58:24.239311 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:24.239291    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0718c57f-12b7-4062-b53c-777792631aec-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-2jjzd\" (UID: \"0718c57f-12b7-4062-b53c-777792631aec\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-2jjzd"
Sep 17 21:58:24.239469 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:24.239333    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2127c519-5059-47bc-b905-2ac3bee41b8d-metrics-tls\") pod \"dns-default-4nccz\" (UID: \"2127c519-5059-47bc-b905-2ac3bee41b8d\") " pod="openshift-dns/dns-default-4nccz"
Sep 17 21:58:24.239469 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:24.239401    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 17 21:58:24.239469 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:24.239450    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86-metrics-certs podName:b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86 nodeName:}" failed. No retries permitted until 2026-09-17 21:58:25.239433897 +0000 UTC m=+37.299205886 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86-metrics-certs") pod "router-default-5dcb767b8d-7lbgr" (UID: "b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86") : secret "router-metrics-certs-default" not found
Sep 17 21:58:24.239469 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:24.239405    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86-service-ca-bundle\") pod \"router-default-5dcb767b8d-7lbgr\" (UID: \"b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86\") " pod="openshift-ingress/router-default-5dcb767b8d-7lbgr"
Sep 17 21:58:24.239668 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:24.239487    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 17 21:58:24.239668 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:24.239488    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86-service-ca-bundle podName:b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86 nodeName:}" failed. No retries permitted until 2026-09-17 21:58:25.23947353 +0000 UTC m=+37.299245538 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86-service-ca-bundle") pod "router-default-5dcb767b8d-7lbgr" (UID: "b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86") : configmap references non-existent config key: service-ca.crt
Sep 17 21:58:24.239668 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:24.239550    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0718c57f-12b7-4062-b53c-777792631aec-networking-console-plugin-cert podName:0718c57f-12b7-4062-b53c-777792631aec nodeName:}" failed. No retries permitted until 2026-09-17 21:58:25.239533768 +0000 UTC m=+37.299305757 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0718c57f-12b7-4062-b53c-777792631aec-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-2jjzd" (UID: "0718c57f-12b7-4062-b53c-777792631aec") : secret "networking-console-plugin-cert" not found
Sep 17 21:58:24.239668 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:24.239493    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 21:58:24.239668 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:24.239587    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2127c519-5059-47bc-b905-2ac3bee41b8d-metrics-tls podName:2127c519-5059-47bc-b905-2ac3bee41b8d nodeName:}" failed. No retries permitted until 2026-09-17 21:58:25.239576887 +0000 UTC m=+37.299348903 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2127c519-5059-47bc-b905-2ac3bee41b8d-metrics-tls") pod "dns-default-4nccz" (UID: "2127c519-5059-47bc-b905-2ac3bee41b8d") : secret "dns-default-metrics-tls" not found
Sep 17 21:58:24.449647 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:24.449628    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-br6wh"
Sep 17 21:58:24.450193 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:24.449629    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j58cx"
Sep 17 21:58:24.450193 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:24.449629    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zdznt"
Sep 17 21:58:24.452335 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:24.452315    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 17 21:58:24.452450 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:24.452374    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nbkcq\""
Sep 17 21:58:24.452450 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:24.452319    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 17 21:58:24.452450 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:24.452440    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-278n4\""
Sep 17 21:58:24.673991 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:24.673956    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-85f68" event={"ID":"6c3ce3c4-e0e9-4ca5-9932-be6418a30c00","Type":"ContainerStarted","Data":"6cf32b659f355d018faaa2d7e93636d4e79503137aff0962513875d7d88f119b"}
Sep 17 21:58:24.675133 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:24.675105    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-jn6j9" event={"ID":"351c70fa-979d-49a3-926e-56becaec72ed","Type":"ContainerStarted","Data":"c8038bc81cdbca9c21c2a7dc72f7b2dd5c8721b5a7d05572e0c826c9c52ebfd9"}
Sep 17 21:58:24.676212 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:24.676196    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-6qz86" event={"ID":"74040bed-ca22-4af1-a397-223d527bceb7","Type":"ContainerStarted","Data":"110e5f37b9ccd38abd51177961fa51f01246af1156c44ac18bd66ff0054d5fa4"}
Sep 17 21:58:24.677375 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:24.677342    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zxdvm" event={"ID":"f0b6f107-f369-47b8-852b-ca599f331d5c","Type":"ContainerStarted","Data":"acd12d107aab924ca7d6c4898edc6e1da7b12eceb6f338163aa87ce30cca45bc"}
Sep 17 21:58:24.678286 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:24.678267    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-j9ctg" event={"ID":"c2767d1f-5347-4d4e-8f72-c29ac89b09ef","Type":"ContainerStarted","Data":"798e6113c977f16f11d8c00bec4875714c74a01e9d08a7bf3680dcbd88635696"}
Sep 17 21:58:24.679330 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:24.679311    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-fgp46" event={"ID":"059b6280-9215-4207-9aaa-570643410245","Type":"ContainerStarted","Data":"866b1b87f98e182d88ae81fc2dc75df7c1f81c70b5298bc6f97b940259f596b5"}
Sep 17 21:58:24.680418 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:24.680396    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-xcr4j" event={"ID":"d690701c-bcec-48f2-9978-b6aebbf77447","Type":"ContainerStarted","Data":"74fdf09833f6ca2da5633dc887df4fb6bd64a7e6710252fefe9945170dd70e29"}
Sep 17 21:58:24.683116 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:24.683097    2560 generic.go:356] "Generic (PLEG): container finished" podID="00fb2a0f-d0d6-4d8d-8884-04fc3cd6aea4" containerID="745aae4705bae51072bf4b90002eda8ec071b96660fc38fc3baa6123c8a2bba3" exitCode=0
Sep 17 21:58:24.683205 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:24.683131    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nn2xs" event={"ID":"00fb2a0f-d0d6-4d8d-8884-04fc3cd6aea4","Type":"ContainerDied","Data":"745aae4705bae51072bf4b90002eda8ec071b96660fc38fc3baa6123c8a2bba3"}
Sep 17 21:58:25.047091 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:25.047009    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/00b93628-c39c-4304-a072-ae9bd5ad3592-registry-tls\") pod \"image-registry-6d87985496-lns5f\" (UID: \"00b93628-c39c-4304-a072-ae9bd5ad3592\") " pod="openshift-image-registry/image-registry-6d87985496-lns5f"
Sep 17 21:58:25.047257 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:25.047162    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 21:58:25.047257 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:25.047184    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d87985496-lns5f: secret "image-registry-tls" not found
Sep 17 21:58:25.047257 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:25.047250    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00b93628-c39c-4304-a072-ae9bd5ad3592-registry-tls podName:00b93628-c39c-4304-a072-ae9bd5ad3592 nodeName:}" failed. No retries permitted until 2026-09-17 21:58:27.047231806 +0000 UTC m=+39.107003818 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/00b93628-c39c-4304-a072-ae9bd5ad3592-registry-tls") pod "image-registry-6d87985496-lns5f" (UID: "00b93628-c39c-4304-a072-ae9bd5ad3592") : secret "image-registry-tls" not found
Sep 17 21:58:25.147827 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:25.147793    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e5738b3d-740b-4e0c-b1e4-9805f8621f85-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-s2pc2\" (UID: \"e5738b3d-740b-4e0c-b1e4-9805f8621f85\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-s2pc2"
Sep 17 21:58:25.148003 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:25.147880    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/93344afa-73c8-4d4e-8d6f-47e08e79c050-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-5svbx\" (UID: \"93344afa-73c8-4d4e-8d6f-47e08e79c050\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-5svbx"
Sep 17 21:58:25.148073 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:25.148037    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 17 21:58:25.148121 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:25.148098    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93344afa-73c8-4d4e-8d6f-47e08e79c050-cluster-monitoring-operator-tls podName:93344afa-73c8-4d4e-8d6f-47e08e79c050 nodeName:}" failed. No retries permitted until 2026-09-17 21:58:27.1480806 +0000 UTC m=+39.207852604 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/93344afa-73c8-4d4e-8d6f-47e08e79c050-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-5svbx" (UID: "93344afa-73c8-4d4e-8d6f-47e08e79c050") : secret "cluster-monitoring-operator-tls" not found
Sep 17 21:58:25.148523 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:25.148502    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 17 21:58:25.148618 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:25.148570    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5738b3d-740b-4e0c-b1e4-9805f8621f85-samples-operator-tls podName:e5738b3d-740b-4e0c-b1e4-9805f8621f85 nodeName:}" failed. No retries permitted until 2026-09-17 21:58:27.148545918 +0000 UTC m=+39.208317926 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e5738b3d-740b-4e0c-b1e4-9805f8621f85-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-s2pc2" (UID: "e5738b3d-740b-4e0c-b1e4-9805f8621f85") : secret "samples-operator-tls" not found
Sep 17 21:58:25.248766 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:25.248729    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0718c57f-12b7-4062-b53c-777792631aec-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-2jjzd\" (UID: \"0718c57f-12b7-4062-b53c-777792631aec\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-2jjzd"
Sep 17 21:58:25.248947 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:25.248932    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 17 21:58:25.249011 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:25.248999    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0718c57f-12b7-4062-b53c-777792631aec-networking-console-plugin-cert podName:0718c57f-12b7-4062-b53c-777792631aec nodeName:}" failed. No retries permitted until 2026-09-17 21:58:27.248979405 +0000 UTC m=+39.308751396 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0718c57f-12b7-4062-b53c-777792631aec-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-2jjzd" (UID: "0718c57f-12b7-4062-b53c-777792631aec") : secret "networking-console-plugin-cert" not found
Sep 17 21:58:25.249367 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:25.248793    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2127c519-5059-47bc-b905-2ac3bee41b8d-metrics-tls\") pod \"dns-default-4nccz\" (UID: \"2127c519-5059-47bc-b905-2ac3bee41b8d\") " pod="openshift-dns/dns-default-4nccz"
Sep 17 21:58:25.249463 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:25.249423    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86-service-ca-bundle\") pod \"router-default-5dcb767b8d-7lbgr\" (UID: \"b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86\") " pod="openshift-ingress/router-default-5dcb767b8d-7lbgr"
Sep 17 21:58:25.249529 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:25.249515    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86-metrics-certs\") pod \"router-default-5dcb767b8d-7lbgr\" (UID: \"b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86\") " pod="openshift-ingress/router-default-5dcb767b8d-7lbgr"
Sep 17 21:58:25.249657 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:25.249645    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 17 21:58:25.249719 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:25.249692    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86-metrics-certs podName:b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86 nodeName:}" failed. No retries permitted until 2026-09-17 21:58:27.249679046 +0000 UTC m=+39.309451038 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86-metrics-certs") pod "router-default-5dcb767b8d-7lbgr" (UID: "b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86") : secret "router-metrics-certs-default" not found
Sep 17 21:58:25.249780 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:25.249752    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 21:58:25.249846 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:25.249781    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2127c519-5059-47bc-b905-2ac3bee41b8d-metrics-tls podName:2127c519-5059-47bc-b905-2ac3bee41b8d nodeName:}" failed. No retries permitted until 2026-09-17 21:58:27.249770563 +0000 UTC m=+39.309542554 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2127c519-5059-47bc-b905-2ac3bee41b8d-metrics-tls") pod "dns-default-4nccz" (UID: "2127c519-5059-47bc-b905-2ac3bee41b8d") : secret "dns-default-metrics-tls" not found
Sep 17 21:58:25.249901 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:25.249849    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86-service-ca-bundle podName:b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86 nodeName:}" failed. No retries permitted until 2026-09-17 21:58:27.249838602 +0000 UTC m=+39.309610594 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86-service-ca-bundle") pod "router-default-5dcb767b8d-7lbgr" (UID: "b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86") : configmap references non-existent config key: service-ca.crt
Sep 17 21:58:25.495508 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:25.495366    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tprjw_6505672f-86e4-439d-88c0-8b8ac9bcb987/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:25.596193 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:25.596083    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tprjw_6505672f-86e4-439d-88c0-8b8ac9bcb987/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:25.698499 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:25.698434    2560 generic.go:356] "Generic (PLEG): container finished" podID="00fb2a0f-d0d6-4d8d-8884-04fc3cd6aea4" containerID="80cf93a83e66f4d45099f3eec1ccc2a353e104d98f6325bc74f356eff0b7edc9" exitCode=0
Sep 17 21:58:25.698689 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:25.698514    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nn2xs" event={"ID":"00fb2a0f-d0d6-4d8d-8884-04fc3cd6aea4","Type":"ContainerDied","Data":"80cf93a83e66f4d45099f3eec1ccc2a353e104d98f6325bc74f356eff0b7edc9"}
Sep 17 21:58:26.708560 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:26.708441    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nn2xs" event={"ID":"00fb2a0f-d0d6-4d8d-8884-04fc3cd6aea4","Type":"ContainerStarted","Data":"ab1961d657496fc844d749b306c444cd29693253f2b602988d6b5ab01703e191"}
Sep 17 21:58:26.712076 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:26.711499    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-85f68" event={"ID":"6c3ce3c4-e0e9-4ca5-9932-be6418a30c00","Type":"ContainerStarted","Data":"ba166a268ef3bf6f19b55b3b3276a795ba2968f5882691d848e8f527bbbd9c06"}
Sep 17 21:58:26.731895 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:26.731697    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-nn2xs" podStartSLOduration=8.495859207 podStartE2EDuration="37.731679258s" totalImagesPullingTime="29.235820051s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 21:57:49 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:58:26.729711617 +0000 UTC m=+38.789483631" watchObservedRunningTime="2026-09-17 21:58:26.731679258 +0000 UTC m=+38.791451269"
Sep 17 21:58:26.825781 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:26.825743    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tprjw_6505672f-86e4-439d-88c0-8b8ac9bcb987/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:26.876373 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:26.876308    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tprjw_6505672f-86e4-439d-88c0-8b8ac9bcb987/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:26.925595 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:26.925519    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tprjw_6505672f-86e4-439d-88c0-8b8ac9bcb987/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:27.068685 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:27.068644    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/00b93628-c39c-4304-a072-ae9bd5ad3592-registry-tls\") pod \"image-registry-6d87985496-lns5f\" (UID: \"00b93628-c39c-4304-a072-ae9bd5ad3592\") " pod="openshift-image-registry/image-registry-6d87985496-lns5f"
Sep 17 21:58:27.068869 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:27.068814    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 21:58:27.068869 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:27.068834    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d87985496-lns5f: secret "image-registry-tls" not found
Sep 17 21:58:27.068986 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:27.068902    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00b93628-c39c-4304-a072-ae9bd5ad3592-registry-tls podName:00b93628-c39c-4304-a072-ae9bd5ad3592 nodeName:}" failed. No retries permitted until 2026-09-17 21:58:31.068880586 +0000 UTC m=+43.128652588 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/00b93628-c39c-4304-a072-ae9bd5ad3592-registry-tls") pod "image-registry-6d87985496-lns5f" (UID: "00b93628-c39c-4304-a072-ae9bd5ad3592") : secret "image-registry-tls" not found
Sep 17 21:58:27.169971 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:27.169935    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e5738b3d-740b-4e0c-b1e4-9805f8621f85-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-s2pc2\" (UID: \"e5738b3d-740b-4e0c-b1e4-9805f8621f85\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-s2pc2"
Sep 17 21:58:27.170160 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:27.170021    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/93344afa-73c8-4d4e-8d6f-47e08e79c050-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-5svbx\" (UID: \"93344afa-73c8-4d4e-8d6f-47e08e79c050\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-5svbx"
Sep 17 21:58:27.170160 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:27.170083    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 17 21:58:27.170160 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:27.170132    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 17 21:58:27.170160 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:27.170147    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5738b3d-740b-4e0c-b1e4-9805f8621f85-samples-operator-tls podName:e5738b3d-740b-4e0c-b1e4-9805f8621f85 nodeName:}" failed. No retries permitted until 2026-09-17 21:58:31.170128992 +0000 UTC m=+43.229900982 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e5738b3d-740b-4e0c-b1e4-9805f8621f85-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-s2pc2" (UID: "e5738b3d-740b-4e0c-b1e4-9805f8621f85") : secret "samples-operator-tls" not found
Sep 17 21:58:27.170346 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:27.170168    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93344afa-73c8-4d4e-8d6f-47e08e79c050-cluster-monitoring-operator-tls podName:93344afa-73c8-4d4e-8d6f-47e08e79c050 nodeName:}" failed. No retries permitted until 2026-09-17 21:58:31.17015682 +0000 UTC m=+43.229928823 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/93344afa-73c8-4d4e-8d6f-47e08e79c050-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-5svbx" (UID: "93344afa-73c8-4d4e-8d6f-47e08e79c050") : secret "cluster-monitoring-operator-tls" not found
Sep 17 21:58:27.270893 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:27.270862    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86-metrics-certs\") pod \"router-default-5dcb767b8d-7lbgr\" (UID: \"b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86\") " pod="openshift-ingress/router-default-5dcb767b8d-7lbgr"
Sep 17 21:58:27.271073 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:27.270948    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0718c57f-12b7-4062-b53c-777792631aec-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-2jjzd\" (UID: \"0718c57f-12b7-4062-b53c-777792631aec\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-2jjzd"
Sep 17 21:58:27.271073 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:27.270994    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2127c519-5059-47bc-b905-2ac3bee41b8d-metrics-tls\") pod \"dns-default-4nccz\" (UID: \"2127c519-5059-47bc-b905-2ac3bee41b8d\") " pod="openshift-dns/dns-default-4nccz"
Sep 17 21:58:27.271073 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:27.271030    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 17 21:58:27.271073 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:27.271058    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86-service-ca-bundle\") pod \"router-default-5dcb767b8d-7lbgr\" (UID: \"b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86\") " pod="openshift-ingress/router-default-5dcb767b8d-7lbgr"
Sep 17 21:58:27.271292 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:27.271061    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 17 21:58:27.271292 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:27.271103    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86-metrics-certs podName:b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86 nodeName:}" failed. No retries permitted until 2026-09-17 21:58:31.27108246 +0000 UTC m=+43.330854455 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86-metrics-certs") pod "router-default-5dcb767b8d-7lbgr" (UID: "b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86") : secret "router-metrics-certs-default" not found
Sep 17 21:58:27.271292 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:27.271114    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 21:58:27.271292 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:27.271134    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0718c57f-12b7-4062-b53c-777792631aec-networking-console-plugin-cert podName:0718c57f-12b7-4062-b53c-777792631aec nodeName:}" failed. No retries permitted until 2026-09-17 21:58:31.271121681 +0000 UTC m=+43.330893689 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0718c57f-12b7-4062-b53c-777792631aec-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-2jjzd" (UID: "0718c57f-12b7-4062-b53c-777792631aec") : secret "networking-console-plugin-cert" not found
Sep 17 21:58:27.271292 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:27.271162    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2127c519-5059-47bc-b905-2ac3bee41b8d-metrics-tls podName:2127c519-5059-47bc-b905-2ac3bee41b8d nodeName:}" failed. No retries permitted until 2026-09-17 21:58:31.271147492 +0000 UTC m=+43.330919498 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2127c519-5059-47bc-b905-2ac3bee41b8d-metrics-tls") pod "dns-default-4nccz" (UID: "2127c519-5059-47bc-b905-2ac3bee41b8d") : secret "dns-default-metrics-tls" not found
Sep 17 21:58:27.271292 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:27.271216    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86-service-ca-bundle podName:b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86 nodeName:}" failed. No retries permitted until 2026-09-17 21:58:31.271208374 +0000 UTC m=+43.330980362 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86-service-ca-bundle") pod "router-default-5dcb767b8d-7lbgr" (UID: "b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86") : configmap references non-existent config key: service-ca.crt
Sep 17 21:58:27.688874 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:27.688828    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tprjw_6505672f-86e4-439d-88c0-8b8ac9bcb987/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:27.742751 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:27.742720    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tprjw_6505672f-86e4-439d-88c0-8b8ac9bcb987/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:28.513921 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:28.513885    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tprjw_6505672f-86e4-439d-88c0-8b8ac9bcb987/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:28.564485 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:28.564448    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tprjw_6505672f-86e4-439d-88c0-8b8ac9bcb987/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:29.322420 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:29.322380    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tprjw_6505672f-86e4-439d-88c0-8b8ac9bcb987/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:29.375634 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:29.375592    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tprjw_6505672f-86e4-439d-88c0-8b8ac9bcb987/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:30.357233 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:30.357161    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tprjw_6505672f-86e4-439d-88c0-8b8ac9bcb987/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:30.462734 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:30.462707    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-tprjw_6505672f-86e4-439d-88c0-8b8ac9bcb987/konnectivity-agent/0.log" limit=1024
Sep 17 21:58:31.100455 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:31.100426    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/00b93628-c39c-4304-a072-ae9bd5ad3592-registry-tls\") pod \"image-registry-6d87985496-lns5f\" (UID: \"00b93628-c39c-4304-a072-ae9bd5ad3592\") " pod="openshift-image-registry/image-registry-6d87985496-lns5f"
Sep 17 21:58:31.100646 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:31.100591    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 21:58:31.100646 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:31.100613    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d87985496-lns5f: secret "image-registry-tls" not found
Sep 17 21:58:31.100763 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:31.100670    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00b93628-c39c-4304-a072-ae9bd5ad3592-registry-tls podName:00b93628-c39c-4304-a072-ae9bd5ad3592 nodeName:}" failed. No retries permitted until 2026-09-17 21:58:39.100655105 +0000 UTC m=+51.160427093 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/00b93628-c39c-4304-a072-ae9bd5ad3592-registry-tls") pod "image-registry-6d87985496-lns5f" (UID: "00b93628-c39c-4304-a072-ae9bd5ad3592") : secret "image-registry-tls" not found
Sep 17 21:58:31.201321 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:31.201283    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e5738b3d-740b-4e0c-b1e4-9805f8621f85-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-s2pc2\" (UID: \"e5738b3d-740b-4e0c-b1e4-9805f8621f85\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-s2pc2"
Sep 17 21:58:31.201489 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:31.201390    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/93344afa-73c8-4d4e-8d6f-47e08e79c050-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-5svbx\" (UID: \"93344afa-73c8-4d4e-8d6f-47e08e79c050\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-5svbx"
Sep 17 21:58:31.201489 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:31.201456    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 17 21:58:31.201593 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:31.201502    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 17 21:58:31.201593 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:31.201527    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5738b3d-740b-4e0c-b1e4-9805f8621f85-samples-operator-tls podName:e5738b3d-740b-4e0c-b1e4-9805f8621f85 nodeName:}" failed. No retries permitted until 2026-09-17 21:58:39.201512051 +0000 UTC m=+51.261284040 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e5738b3d-740b-4e0c-b1e4-9805f8621f85-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-s2pc2" (UID: "e5738b3d-740b-4e0c-b1e4-9805f8621f85") : secret "samples-operator-tls" not found
Sep 17 21:58:31.201593 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:31.201553    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93344afa-73c8-4d4e-8d6f-47e08e79c050-cluster-monitoring-operator-tls podName:93344afa-73c8-4d4e-8d6f-47e08e79c050 nodeName:}" failed. No retries permitted until 2026-09-17 21:58:39.201537163 +0000 UTC m=+51.261309157 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/93344afa-73c8-4d4e-8d6f-47e08e79c050-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-5svbx" (UID: "93344afa-73c8-4d4e-8d6f-47e08e79c050") : secret "cluster-monitoring-operator-tls" not found
Sep 17 21:58:31.302284 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:31.302252    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2127c519-5059-47bc-b905-2ac3bee41b8d-metrics-tls\") pod \"dns-default-4nccz\" (UID: \"2127c519-5059-47bc-b905-2ac3bee41b8d\") " pod="openshift-dns/dns-default-4nccz"
Sep 17 21:58:31.302442 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:31.302314    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86-service-ca-bundle\") pod \"router-default-5dcb767b8d-7lbgr\" (UID: \"b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86\") " pod="openshift-ingress/router-default-5dcb767b8d-7lbgr"
Sep 17 21:58:31.302442 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:31.302416    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86-metrics-certs\") pod \"router-default-5dcb767b8d-7lbgr\" (UID: \"b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86\") " pod="openshift-ingress/router-default-5dcb767b8d-7lbgr"
Sep 17 21:58:31.302543 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:31.302434    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 21:58:31.302543 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:31.302493    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0718c57f-12b7-4062-b53c-777792631aec-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-2jjzd\" (UID: \"0718c57f-12b7-4062-b53c-777792631aec\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-2jjzd"
Sep 17 21:58:31.302543 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:31.302511    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86-service-ca-bundle podName:b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86 nodeName:}" failed. No retries permitted until 2026-09-17 21:58:39.30248807 +0000 UTC m=+51.362260065 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86-service-ca-bundle") pod "router-default-5dcb767b8d-7lbgr" (UID: "b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86") : configmap references non-existent config key: service-ca.crt
Sep 17 21:58:31.302675 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:31.302549    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2127c519-5059-47bc-b905-2ac3bee41b8d-metrics-tls podName:2127c519-5059-47bc-b905-2ac3bee41b8d nodeName:}" failed. No retries permitted until 2026-09-17 21:58:39.302538811 +0000 UTC m=+51.362310803 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2127c519-5059-47bc-b905-2ac3bee41b8d-metrics-tls") pod "dns-default-4nccz" (UID: "2127c519-5059-47bc-b905-2ac3bee41b8d") : secret "dns-default-metrics-tls" not found
Sep 17 21:58:31.302675 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:31.302563    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 17 21:58:31.302675 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:31.302563    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 17 21:58:31.302675 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:31.302609    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0718c57f-12b7-4062-b53c-777792631aec-networking-console-plugin-cert podName:0718c57f-12b7-4062-b53c-777792631aec nodeName:}" failed. No retries permitted until 2026-09-17 21:58:39.302594318 +0000 UTC m=+51.362366308 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0718c57f-12b7-4062-b53c-777792631aec-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-2jjzd" (UID: "0718c57f-12b7-4062-b53c-777792631aec") : secret "networking-console-plugin-cert" not found
Sep 17 21:58:31.302675 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:31.302675    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86-metrics-certs podName:b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86 nodeName:}" failed. No retries permitted until 2026-09-17 21:58:39.302654651 +0000 UTC m=+51.362426663 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86-metrics-certs") pod "router-default-5dcb767b8d-7lbgr" (UID: "b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86") : secret "router-metrics-certs-default" not found
Sep 17 21:58:32.737650 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:32.737371    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-jn6j9" event={"ID":"351c70fa-979d-49a3-926e-56becaec72ed","Type":"ContainerStarted","Data":"b3ca3d491b404b3831037755dd31d286c0b1bedda652604c9e10397213114a33"}
Sep 17 21:58:32.739248 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:32.739222    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-6qz86" event={"ID":"74040bed-ca22-4af1-a397-223d527bceb7","Type":"ContainerStarted","Data":"876255e2a4abda2b97c3f5e14b10956c67af264c6b03ada6408c7a3f417485ec"}
Sep 17 21:58:32.740868 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:32.740843    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zxdvm" event={"ID":"f0b6f107-f369-47b8-852b-ca599f331d5c","Type":"ContainerStarted","Data":"3464de0d029a1226f68ef862855ab5e6f6d267dd2f7b5a57601f521299897920"}
Sep 17 21:58:32.742597 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:32.742571    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-j9ctg" event={"ID":"c2767d1f-5347-4d4e-8f72-c29ac89b09ef","Type":"ContainerStarted","Data":"200037c3e71b3479308d83514e44b74b8bd3f981c223651fa196212847787f63"}
Sep 17 21:58:32.744705 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:32.744476    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-fgp46" event={"ID":"059b6280-9215-4207-9aaa-570643410245","Type":"ContainerStarted","Data":"4eb2935ab60a14885095251b0f22323b3bd131952b111943d0d5ad2d81e5256c"}
Sep 17 21:58:32.746209 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:32.746189    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-xcr4j_d690701c-bcec-48f2-9978-b6aebbf77447/console-operator/0.log"
Sep 17 21:58:32.746315 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:32.746226    2560 generic.go:356] "Generic (PLEG): container finished" podID="d690701c-bcec-48f2-9978-b6aebbf77447" containerID="851ef400748f582abf855d466838811a3a10209abbc655f8de281766b1ba179d" exitCode=255
Sep 17 21:58:32.746315 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:32.746275    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-xcr4j" event={"ID":"d690701c-bcec-48f2-9978-b6aebbf77447","Type":"ContainerDied","Data":"851ef400748f582abf855d466838811a3a10209abbc655f8de281766b1ba179d"}
Sep 17 21:58:32.746437 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:32.746427    2560 scope.go:117] "RemoveContainer" containerID="851ef400748f582abf855d466838811a3a10209abbc655f8de281766b1ba179d"
Sep 17 21:58:32.754538 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:32.754505    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-85f68" podStartSLOduration=38.586908579 podStartE2EDuration="40.754492035s" totalImagesPullingTime="2.167583456s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:57:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:58:26.746278191 +0000 UTC m=+38.806050203" watchObservedRunningTime="2026-09-17 21:58:32.754492035 +0000 UTC m=+44.814264049"
Sep 17 21:58:32.754702 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:32.754685    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-jn6j9" podStartSLOduration=32.871755657 podStartE2EDuration="40.754679254s" totalImagesPullingTime="7.882923597s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:57:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:58:32.753769639 +0000 UTC m=+44.813541654" watchObservedRunningTime="2026-09-17 21:58:32.754679254 +0000 UTC m=+44.814451268"
Sep 17 21:58:32.772190 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:32.772146    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-j9ctg" podStartSLOduration=32.885668503 podStartE2EDuration="40.772128887s" totalImagesPullingTime="7.886460384s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:57:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:58:32.770637191 +0000 UTC m=+44.830409202" watchObservedRunningTime="2026-09-17 21:58:32.772128887 +0000 UTC m=+44.831900895"
Sep 17 21:58:32.812043 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:32.811999    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-6f9c644dd9-6qz86" podStartSLOduration=32.930760853 podStartE2EDuration="40.811980835s" totalImagesPullingTime="7.881219982s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:57:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:58:32.791939504 +0000 UTC m=+44.851711516" watchObservedRunningTime="2026-09-17 21:58:32.811980835 +0000 UTC m=+44.871752847"
Sep 17 21:58:32.832041 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:32.831991    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-fgp46" podStartSLOduration=32.940743057 podStartE2EDuration="40.831970787s" totalImagesPullingTime="7.89122773s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:57:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:58:32.830525019 +0000 UTC m=+44.890297031" watchObservedRunningTime="2026-09-17 21:58:32.831970787 +0000 UTC m=+44.891742802"
Sep 17 21:58:32.849382 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:32.849312    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zxdvm" podStartSLOduration=1.966758271 podStartE2EDuration="9.849292825s" totalImagesPullingTime="7.882534554s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:58:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:58:32.84861972 +0000 UTC m=+44.908391732" watchObservedRunningTime="2026-09-17 21:58:32.849292825 +0000 UTC m=+44.909064841"
Sep 17 21:58:33.323256 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:33.323201    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6kzh8"]
Sep 17 21:58:33.337272 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:33.337246    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6kzh8"]
Sep 17 21:58:33.337659 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:33.337643    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6kzh8"
Sep 17 21:58:33.341242 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:33.340405    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 17 21:58:33.341242 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:33.340830    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 17 21:58:33.341242 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:33.341028    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tsmwz\""
Sep 17 21:58:33.418217 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:33.418143    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/985c7fb9-46f9-49aa-b6b8-07fd3597ba51-data-volume\") pod \"insights-runtime-extractor-6kzh8\" (UID: \"985c7fb9-46f9-49aa-b6b8-07fd3597ba51\") " pod="openshift-insights/insights-runtime-extractor-6kzh8"
Sep 17 21:58:33.418217 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:33.418205    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/985c7fb9-46f9-49aa-b6b8-07fd3597ba51-crio-socket\") pod \"insights-runtime-extractor-6kzh8\" (UID: \"985c7fb9-46f9-49aa-b6b8-07fd3597ba51\") " pod="openshift-insights/insights-runtime-extractor-6kzh8"
Sep 17 21:58:33.418425 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:33.418234    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/985c7fb9-46f9-49aa-b6b8-07fd3597ba51-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6kzh8\" (UID: \"985c7fb9-46f9-49aa-b6b8-07fd3597ba51\") " pod="openshift-insights/insights-runtime-extractor-6kzh8"
Sep 17 21:58:33.418425 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:33.418381    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cl7x\" (UniqueName: \"kubernetes.io/projected/985c7fb9-46f9-49aa-b6b8-07fd3597ba51-kube-api-access-8cl7x\") pod \"insights-runtime-extractor-6kzh8\" (UID: \"985c7fb9-46f9-49aa-b6b8-07fd3597ba51\") " pod="openshift-insights/insights-runtime-extractor-6kzh8"
Sep 17 21:58:33.418513 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:33.418500    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/985c7fb9-46f9-49aa-b6b8-07fd3597ba51-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6kzh8\" (UID: \"985c7fb9-46f9-49aa-b6b8-07fd3597ba51\") " pod="openshift-insights/insights-runtime-extractor-6kzh8"
Sep 17 21:58:33.519791 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:33.519758    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/985c7fb9-46f9-49aa-b6b8-07fd3597ba51-data-volume\") pod \"insights-runtime-extractor-6kzh8\" (UID: \"985c7fb9-46f9-49aa-b6b8-07fd3597ba51\") " pod="openshift-insights/insights-runtime-extractor-6kzh8"
Sep 17 21:58:33.519989 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:33.519803    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/985c7fb9-46f9-49aa-b6b8-07fd3597ba51-crio-socket\") pod \"insights-runtime-extractor-6kzh8\" (UID: \"985c7fb9-46f9-49aa-b6b8-07fd3597ba51\") " pod="openshift-insights/insights-runtime-extractor-6kzh8"
Sep 17 21:58:33.519989 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:33.519823    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/985c7fb9-46f9-49aa-b6b8-07fd3597ba51-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6kzh8\" (UID: \"985c7fb9-46f9-49aa-b6b8-07fd3597ba51\") " pod="openshift-insights/insights-runtime-extractor-6kzh8"
Sep 17 21:58:33.519989 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:33.519895    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cl7x\" (UniqueName: \"kubernetes.io/projected/985c7fb9-46f9-49aa-b6b8-07fd3597ba51-kube-api-access-8cl7x\") pod \"insights-runtime-extractor-6kzh8\" (UID: \"985c7fb9-46f9-49aa-b6b8-07fd3597ba51\") " pod="openshift-insights/insights-runtime-extractor-6kzh8"
Sep 17 21:58:33.519989 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:33.519908    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/985c7fb9-46f9-49aa-b6b8-07fd3597ba51-crio-socket\") pod \"insights-runtime-extractor-6kzh8\" (UID: \"985c7fb9-46f9-49aa-b6b8-07fd3597ba51\") " pod="openshift-insights/insights-runtime-extractor-6kzh8"
Sep 17 21:58:33.519989 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:33.519978    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/985c7fb9-46f9-49aa-b6b8-07fd3597ba51-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6kzh8\" (UID: \"985c7fb9-46f9-49aa-b6b8-07fd3597ba51\") " pod="openshift-insights/insights-runtime-extractor-6kzh8"
Sep 17 21:58:33.520244 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:33.520019    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 21:58:33.520244 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:33.520064    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 21:58:33.520244 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:33.520088    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/985c7fb9-46f9-49aa-b6b8-07fd3597ba51-insights-runtime-extractor-tls podName:985c7fb9-46f9-49aa-b6b8-07fd3597ba51 nodeName:}" failed. No retries permitted until 2026-09-17 21:58:34.020068232 +0000 UTC m=+46.079840235 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/985c7fb9-46f9-49aa-b6b8-07fd3597ba51-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6kzh8" (UID: "985c7fb9-46f9-49aa-b6b8-07fd3597ba51") : secret "insights-runtime-extractor-tls" not found
Sep 17 21:58:33.520244 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:33.520113    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/985c7fb9-46f9-49aa-b6b8-07fd3597ba51-kube-rbac-proxy-cm podName:985c7fb9-46f9-49aa-b6b8-07fd3597ba51 nodeName:}" failed. No retries permitted until 2026-09-17 21:58:34.020096731 +0000 UTC m=+46.079868719 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/985c7fb9-46f9-49aa-b6b8-07fd3597ba51-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6kzh8" (UID: "985c7fb9-46f9-49aa-b6b8-07fd3597ba51") : configmap "kube-rbac-proxy" not found
Sep 17 21:58:33.520244 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:33.520152    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/985c7fb9-46f9-49aa-b6b8-07fd3597ba51-data-volume\") pod \"insights-runtime-extractor-6kzh8\" (UID: \"985c7fb9-46f9-49aa-b6b8-07fd3597ba51\") " pod="openshift-insights/insights-runtime-extractor-6kzh8"
Sep 17 21:58:33.529974 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:33.529952    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cl7x\" (UniqueName: \"kubernetes.io/projected/985c7fb9-46f9-49aa-b6b8-07fd3597ba51-kube-api-access-8cl7x\") pod \"insights-runtime-extractor-6kzh8\" (UID: \"985c7fb9-46f9-49aa-b6b8-07fd3597ba51\") " pod="openshift-insights/insights-runtime-extractor-6kzh8"
Sep 17 21:58:33.751830 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:33.751805    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-xcr4j_d690701c-bcec-48f2-9978-b6aebbf77447/console-operator/1.log"
Sep 17 21:58:33.752306 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:33.752288    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-xcr4j_d690701c-bcec-48f2-9978-b6aebbf77447/console-operator/0.log"
Sep 17 21:58:33.752409 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:33.752330    2560 generic.go:356] "Generic (PLEG): container finished" podID="d690701c-bcec-48f2-9978-b6aebbf77447" containerID="e6691557b1010b6e58e43ca9a7e35f33e4b7a447ea5e2d7375302caa89ba3442" exitCode=255
Sep 17 21:58:33.752409 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:33.752393    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-xcr4j" event={"ID":"d690701c-bcec-48f2-9978-b6aebbf77447","Type":"ContainerDied","Data":"e6691557b1010b6e58e43ca9a7e35f33e4b7a447ea5e2d7375302caa89ba3442"}
Sep 17 21:58:33.752504 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:33.752485    2560 scope.go:117] "RemoveContainer" containerID="851ef400748f582abf855d466838811a3a10209abbc655f8de281766b1ba179d"
Sep 17 21:58:33.752835 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:33.752653    2560 scope.go:117] "RemoveContainer" containerID="e6691557b1010b6e58e43ca9a7e35f33e4b7a447ea5e2d7375302caa89ba3442"
Sep 17 21:58:33.752937 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:33.752834    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-xcr4j_openshift-console-operator(d690701c-bcec-48f2-9978-b6aebbf77447)\"" pod="openshift-console-operator/console-operator-fd4bb46c-xcr4j" podUID="d690701c-bcec-48f2-9978-b6aebbf77447"
Sep 17 21:58:33.787309 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:33.787288    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-fd4bb46c-xcr4j"
Sep 17 21:58:33.787439 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:33.787332    2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-fd4bb46c-xcr4j"
Sep 17 21:58:34.024859 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:34.024778    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/985c7fb9-46f9-49aa-b6b8-07fd3597ba51-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6kzh8\" (UID: \"985c7fb9-46f9-49aa-b6b8-07fd3597ba51\") " pod="openshift-insights/insights-runtime-extractor-6kzh8"
Sep 17 21:58:34.024988 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:34.024923    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 21:58:34.024988 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:34.024939    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/985c7fb9-46f9-49aa-b6b8-07fd3597ba51-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6kzh8\" (UID: \"985c7fb9-46f9-49aa-b6b8-07fd3597ba51\") " pod="openshift-insights/insights-runtime-extractor-6kzh8"
Sep 17 21:58:34.025056 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:34.025021    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/985c7fb9-46f9-49aa-b6b8-07fd3597ba51-insights-runtime-extractor-tls podName:985c7fb9-46f9-49aa-b6b8-07fd3597ba51 nodeName:}" failed. No retries permitted until 2026-09-17 21:58:35.025000036 +0000 UTC m=+47.084772029 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/985c7fb9-46f9-49aa-b6b8-07fd3597ba51-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6kzh8" (UID: "985c7fb9-46f9-49aa-b6b8-07fd3597ba51") : secret "insights-runtime-extractor-tls" not found
Sep 17 21:58:34.025101 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:34.025083    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 21:58:34.025172 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:34.025160    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/985c7fb9-46f9-49aa-b6b8-07fd3597ba51-kube-rbac-proxy-cm podName:985c7fb9-46f9-49aa-b6b8-07fd3597ba51 nodeName:}" failed. No retries permitted until 2026-09-17 21:58:35.02514315 +0000 UTC m=+47.084915146 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/985c7fb9-46f9-49aa-b6b8-07fd3597ba51-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6kzh8" (UID: "985c7fb9-46f9-49aa-b6b8-07fd3597ba51") : configmap "kube-rbac-proxy" not found
Sep 17 21:58:34.757211 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:34.757184    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-xcr4j_d690701c-bcec-48f2-9978-b6aebbf77447/console-operator/1.log"
Sep 17 21:58:34.757650 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:34.757524    2560 scope.go:117] "RemoveContainer" containerID="e6691557b1010b6e58e43ca9a7e35f33e4b7a447ea5e2d7375302caa89ba3442"
Sep 17 21:58:34.757711 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:34.757681    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-xcr4j_openshift-console-operator(d690701c-bcec-48f2-9978-b6aebbf77447)\"" pod="openshift-console-operator/console-operator-fd4bb46c-xcr4j" podUID="d690701c-bcec-48f2-9978-b6aebbf77447"
Sep 17 21:58:35.032966 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:35.032931    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/985c7fb9-46f9-49aa-b6b8-07fd3597ba51-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6kzh8\" (UID: \"985c7fb9-46f9-49aa-b6b8-07fd3597ba51\") " pod="openshift-insights/insights-runtime-extractor-6kzh8"
Sep 17 21:58:35.033162 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:35.033039    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/985c7fb9-46f9-49aa-b6b8-07fd3597ba51-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6kzh8\" (UID: \"985c7fb9-46f9-49aa-b6b8-07fd3597ba51\") " pod="openshift-insights/insights-runtime-extractor-6kzh8"
Sep 17 21:58:35.033162 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:35.033049    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 21:58:35.033162 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:35.033140    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/985c7fb9-46f9-49aa-b6b8-07fd3597ba51-kube-rbac-proxy-cm podName:985c7fb9-46f9-49aa-b6b8-07fd3597ba51 nodeName:}" failed. No retries permitted until 2026-09-17 21:58:37.033123204 +0000 UTC m=+49.092895194 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/985c7fb9-46f9-49aa-b6b8-07fd3597ba51-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6kzh8" (UID: "985c7fb9-46f9-49aa-b6b8-07fd3597ba51") : configmap "kube-rbac-proxy" not found
Sep 17 21:58:35.033308 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:35.033177    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 21:58:35.033308 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:35.033233    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/985c7fb9-46f9-49aa-b6b8-07fd3597ba51-insights-runtime-extractor-tls podName:985c7fb9-46f9-49aa-b6b8-07fd3597ba51 nodeName:}" failed. No retries permitted until 2026-09-17 21:58:37.033220439 +0000 UTC m=+49.092992428 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/985c7fb9-46f9-49aa-b6b8-07fd3597ba51-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6kzh8" (UID: "985c7fb9-46f9-49aa-b6b8-07fd3597ba51") : secret "insights-runtime-extractor-tls" not found
Sep 17 21:58:35.115798 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:35.115778    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hllvl_7ac7682e-e943-4684-9c1b-eee2c58acbf1/dns-node-resolver/0.log"
Sep 17 21:58:35.760531 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:35.760493    2560 scope.go:117] "RemoveContainer" containerID="e6691557b1010b6e58e43ca9a7e35f33e4b7a447ea5e2d7375302caa89ba3442"
Sep 17 21:58:35.760959 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:35.760692    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-xcr4j_openshift-console-operator(d690701c-bcec-48f2-9978-b6aebbf77447)\"" pod="openshift-console-operator/console-operator-fd4bb46c-xcr4j" podUID="d690701c-bcec-48f2-9978-b6aebbf77447"
Sep 17 21:58:36.116440 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:36.116370    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-z4bjm_845f08e5-f5c6-430c-befa-727ab76b3a00/node-ca/0.log"
Sep 17 21:58:36.716192 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:36.716147    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zxdvm_f0b6f107-f369-47b8-852b-ca599f331d5c/serve-healthcheck-canary/0.log"
Sep 17 21:58:37.050652 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:37.050621    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/985c7fb9-46f9-49aa-b6b8-07fd3597ba51-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6kzh8\" (UID: \"985c7fb9-46f9-49aa-b6b8-07fd3597ba51\") " pod="openshift-insights/insights-runtime-extractor-6kzh8"
Sep 17 21:58:37.051126 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:37.050722    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/985c7fb9-46f9-49aa-b6b8-07fd3597ba51-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6kzh8\" (UID: \"985c7fb9-46f9-49aa-b6b8-07fd3597ba51\") " pod="openshift-insights/insights-runtime-extractor-6kzh8"
Sep 17 21:58:37.051126 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:37.050805    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 21:58:37.051126 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:37.050840    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 21:58:37.051126 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:37.050885    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/985c7fb9-46f9-49aa-b6b8-07fd3597ba51-insights-runtime-extractor-tls podName:985c7fb9-46f9-49aa-b6b8-07fd3597ba51 nodeName:}" failed. No retries permitted until 2026-09-17 21:58:41.050865811 +0000 UTC m=+53.110637808 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/985c7fb9-46f9-49aa-b6b8-07fd3597ba51-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6kzh8" (UID: "985c7fb9-46f9-49aa-b6b8-07fd3597ba51") : secret "insights-runtime-extractor-tls" not found
Sep 17 21:58:37.051126 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:37.050907    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/985c7fb9-46f9-49aa-b6b8-07fd3597ba51-kube-rbac-proxy-cm podName:985c7fb9-46f9-49aa-b6b8-07fd3597ba51 nodeName:}" failed. No retries permitted until 2026-09-17 21:58:41.050895701 +0000 UTC m=+53.110667696 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/985c7fb9-46f9-49aa-b6b8-07fd3597ba51-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6kzh8" (UID: "985c7fb9-46f9-49aa-b6b8-07fd3597ba51") : configmap "kube-rbac-proxy" not found
Sep 17 21:58:39.166595 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:39.166561    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/00b93628-c39c-4304-a072-ae9bd5ad3592-registry-tls\") pod \"image-registry-6d87985496-lns5f\" (UID: \"00b93628-c39c-4304-a072-ae9bd5ad3592\") " pod="openshift-image-registry/image-registry-6d87985496-lns5f"
Sep 17 21:58:39.166962 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:39.166735    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 21:58:39.166962 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:39.166755    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d87985496-lns5f: secret "image-registry-tls" not found
Sep 17 21:58:39.166962 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:39.166821    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00b93628-c39c-4304-a072-ae9bd5ad3592-registry-tls podName:00b93628-c39c-4304-a072-ae9bd5ad3592 nodeName:}" failed. No retries permitted until 2026-09-17 21:58:55.166805359 +0000 UTC m=+67.226577348 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/00b93628-c39c-4304-a072-ae9bd5ad3592-registry-tls") pod "image-registry-6d87985496-lns5f" (UID: "00b93628-c39c-4304-a072-ae9bd5ad3592") : secret "image-registry-tls" not found
Sep 17 21:58:39.267298 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:39.267267    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e5738b3d-740b-4e0c-b1e4-9805f8621f85-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-s2pc2\" (UID: \"e5738b3d-740b-4e0c-b1e4-9805f8621f85\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-s2pc2"
Sep 17 21:58:39.267454 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:39.267339    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/93344afa-73c8-4d4e-8d6f-47e08e79c050-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-5svbx\" (UID: \"93344afa-73c8-4d4e-8d6f-47e08e79c050\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-5svbx"
Sep 17 21:58:39.267454 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:39.267410    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 17 21:58:39.267528 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:39.267470    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5738b3d-740b-4e0c-b1e4-9805f8621f85-samples-operator-tls podName:e5738b3d-740b-4e0c-b1e4-9805f8621f85 nodeName:}" failed. No retries permitted until 2026-09-17 21:58:55.267456423 +0000 UTC m=+67.327228412 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e5738b3d-740b-4e0c-b1e4-9805f8621f85-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-s2pc2" (UID: "e5738b3d-740b-4e0c-b1e4-9805f8621f85") : secret "samples-operator-tls" not found
Sep 17 21:58:39.267528 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:39.267482    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 17 21:58:39.267607 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:39.267532    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93344afa-73c8-4d4e-8d6f-47e08e79c050-cluster-monitoring-operator-tls podName:93344afa-73c8-4d4e-8d6f-47e08e79c050 nodeName:}" failed. No retries permitted until 2026-09-17 21:58:55.267516166 +0000 UTC m=+67.327288155 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/93344afa-73c8-4d4e-8d6f-47e08e79c050-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-5svbx" (UID: "93344afa-73c8-4d4e-8d6f-47e08e79c050") : secret "cluster-monitoring-operator-tls" not found
Sep 17 21:58:39.368266 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:39.368239    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86-metrics-certs\") pod \"router-default-5dcb767b8d-7lbgr\" (UID: \"b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86\") " pod="openshift-ingress/router-default-5dcb767b8d-7lbgr"
Sep 17 21:58:39.368413 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:39.368315    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0718c57f-12b7-4062-b53c-777792631aec-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-2jjzd\" (UID: \"0718c57f-12b7-4062-b53c-777792631aec\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-2jjzd"
Sep 17 21:58:39.368413 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:39.368394    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 17 21:58:39.368413 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:39.368375    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2127c519-5059-47bc-b905-2ac3bee41b8d-metrics-tls\") pod \"dns-default-4nccz\" (UID: \"2127c519-5059-47bc-b905-2ac3bee41b8d\") " pod="openshift-dns/dns-default-4nccz"
Sep 17 21:58:39.368572 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:39.368442    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 17 21:58:39.368572 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:39.368451    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86-metrics-certs podName:b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86 nodeName:}" failed. No retries permitted until 2026-09-17 21:58:55.368435484 +0000 UTC m=+67.428207483 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86-metrics-certs") pod "router-default-5dcb767b8d-7lbgr" (UID: "b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86") : secret "router-metrics-certs-default" not found
Sep 17 21:58:39.368572 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:39.368490    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 21:58:39.368572 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:39.368521    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86-service-ca-bundle\") pod \"router-default-5dcb767b8d-7lbgr\" (UID: \"b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86\") " pod="openshift-ingress/router-default-5dcb767b8d-7lbgr"
Sep 17 21:58:39.368572 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:39.368543    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0718c57f-12b7-4062-b53c-777792631aec-networking-console-plugin-cert podName:0718c57f-12b7-4062-b53c-777792631aec nodeName:}" failed. No retries permitted until 2026-09-17 21:58:55.368511899 +0000 UTC m=+67.428283892 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0718c57f-12b7-4062-b53c-777792631aec-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-2jjzd" (UID: "0718c57f-12b7-4062-b53c-777792631aec") : secret "networking-console-plugin-cert" not found
Sep 17 21:58:39.368572 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:39.368566    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2127c519-5059-47bc-b905-2ac3bee41b8d-metrics-tls podName:2127c519-5059-47bc-b905-2ac3bee41b8d nodeName:}" failed. No retries permitted until 2026-09-17 21:58:55.368559631 +0000 UTC m=+67.428331619 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2127c519-5059-47bc-b905-2ac3bee41b8d-metrics-tls") pod "dns-default-4nccz" (UID: "2127c519-5059-47bc-b905-2ac3bee41b8d") : secret "dns-default-metrics-tls" not found
Sep 17 21:58:39.368765 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:39.368585    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86-service-ca-bundle podName:b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86 nodeName:}" failed. No retries permitted until 2026-09-17 21:58:55.368579559 +0000 UTC m=+67.428351548 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86-service-ca-bundle") pod "router-default-5dcb767b8d-7lbgr" (UID: "b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86") : configmap references non-existent config key: service-ca.crt
Sep 17 21:58:41.083106 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:41.083073    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/985c7fb9-46f9-49aa-b6b8-07fd3597ba51-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6kzh8\" (UID: \"985c7fb9-46f9-49aa-b6b8-07fd3597ba51\") " pod="openshift-insights/insights-runtime-extractor-6kzh8"
Sep 17 21:58:41.083497 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:41.083177    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/985c7fb9-46f9-49aa-b6b8-07fd3597ba51-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6kzh8\" (UID: \"985c7fb9-46f9-49aa-b6b8-07fd3597ba51\") " pod="openshift-insights/insights-runtime-extractor-6kzh8"
Sep 17 21:58:41.083497 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:41.083224    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 21:58:41.083497 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:58:41.083286    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/985c7fb9-46f9-49aa-b6b8-07fd3597ba51-insights-runtime-extractor-tls podName:985c7fb9-46f9-49aa-b6b8-07fd3597ba51 nodeName:}" failed. No retries permitted until 2026-09-17 21:58:49.083271873 +0000 UTC m=+61.143043861 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/985c7fb9-46f9-49aa-b6b8-07fd3597ba51-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6kzh8" (UID: "985c7fb9-46f9-49aa-b6b8-07fd3597ba51") : secret "insights-runtime-extractor-tls" not found
Sep 17 21:58:41.083705 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:41.083689    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/985c7fb9-46f9-49aa-b6b8-07fd3597ba51-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6kzh8\" (UID: \"985c7fb9-46f9-49aa-b6b8-07fd3597ba51\") " pod="openshift-insights/insights-runtime-extractor-6kzh8"
Sep 17 21:58:48.451628 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:48.451601    2560 scope.go:117] "RemoveContainer" containerID="e6691557b1010b6e58e43ca9a7e35f33e4b7a447ea5e2d7375302caa89ba3442"
Sep 17 21:58:48.675647 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:48.675617    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-llwgv"
Sep 17 21:58:48.800415 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:48.800387    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-xcr4j_d690701c-bcec-48f2-9978-b6aebbf77447/console-operator/1.log"
Sep 17 21:58:48.800567 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:48.800460    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-xcr4j" event={"ID":"d690701c-bcec-48f2-9978-b6aebbf77447","Type":"ContainerStarted","Data":"de07e468ed60446628a21aeec2dbfd60d047c0bbb11d8409d2bd53ea7f33915e"}
Sep 17 21:58:48.800825 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:48.800806    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-fd4bb46c-xcr4j"
Sep 17 21:58:48.818539 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:48.818491    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-fd4bb46c-xcr4j" podStartSLOduration=48.936915786 podStartE2EDuration="56.818478096s" totalImagesPullingTime="7.88156231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:57:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:58:48.817647408 +0000 UTC m=+60.877419433" watchObservedRunningTime="2026-09-17 21:58:48.818478096 +0000 UTC m=+60.878250106"
Sep 17 21:58:49.153172 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:49.153091    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/985c7fb9-46f9-49aa-b6b8-07fd3597ba51-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6kzh8\" (UID: \"985c7fb9-46f9-49aa-b6b8-07fd3597ba51\") " pod="openshift-insights/insights-runtime-extractor-6kzh8"
Sep 17 21:58:49.155494 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:49.155463    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/985c7fb9-46f9-49aa-b6b8-07fd3597ba51-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6kzh8\" (UID: \"985c7fb9-46f9-49aa-b6b8-07fd3597ba51\") " pod="openshift-insights/insights-runtime-extractor-6kzh8"
Sep 17 21:58:49.251934 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:49.251900    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-fd4bb46c-xcr4j"
Sep 17 21:58:49.256476 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:49.256452    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tsmwz\""
Sep 17 21:58:49.264728 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:49.264705    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6kzh8"
Sep 17 21:58:49.547248 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:49.547191    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6kzh8"]
Sep 17 21:58:49.549497 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:58:49.549472    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod985c7fb9_46f9_49aa_b6b8_07fd3597ba51.slice/crio-d0595159dab90d00842c542081c928659fadfa5b87f514f4eab8756d8fd1b222 WatchSource:0}: Error finding container d0595159dab90d00842c542081c928659fadfa5b87f514f4eab8756d8fd1b222: Status 404 returned error can't find the container with id d0595159dab90d00842c542081c928659fadfa5b87f514f4eab8756d8fd1b222
Sep 17 21:58:49.805011 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:49.804936    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6kzh8" event={"ID":"985c7fb9-46f9-49aa-b6b8-07fd3597ba51","Type":"ContainerStarted","Data":"070d869baaaab3be57b598a9455b082762d6fd084f8ce685c4bafcd6f72d276a"}
Sep 17 21:58:49.805011 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:49.804994    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6kzh8" event={"ID":"985c7fb9-46f9-49aa-b6b8-07fd3597ba51","Type":"ContainerStarted","Data":"d0595159dab90d00842c542081c928659fadfa5b87f514f4eab8756d8fd1b222"}
Sep 17 21:58:50.810511 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:50.810473    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6kzh8" event={"ID":"985c7fb9-46f9-49aa-b6b8-07fd3597ba51","Type":"ContainerStarted","Data":"01ecc39cb60369d541a20f37f33e712d62adccb07cee6f90a1e3e87d729e3d36"}
Sep 17 21:58:51.815407 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:51.815304    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6kzh8" event={"ID":"985c7fb9-46f9-49aa-b6b8-07fd3597ba51","Type":"ContainerStarted","Data":"393db4976dfb733d059a0c3cc484b5c91b798688f2d64f31b6d604f40745f6c5"}
Sep 17 21:58:51.835133 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:51.835088    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6kzh8" podStartSLOduration=16.984693313 podStartE2EDuration="18.83507318s" totalImagesPullingTime="1.850379867s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 21:58:33 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:58:51.832394953 +0000 UTC m=+63.892166964" watchObservedRunningTime="2026-09-17 21:58:51.83507318 +0000 UTC m=+63.894845210"
Sep 17 21:58:54.297426 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:54.297391    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8dedff64-89fd-41e2-83e7-e5bdf85f3470-metrics-certs\") pod \"network-metrics-daemon-j58cx\" (UID: \"8dedff64-89fd-41e2-83e7-e5bdf85f3470\") " pod="openshift-multus/network-metrics-daemon-j58cx"
Sep 17 21:58:54.300156 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:54.300139    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 17 21:58:54.310177 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:54.310152    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8dedff64-89fd-41e2-83e7-e5bdf85f3470-metrics-certs\") pod \"network-metrics-daemon-j58cx\" (UID: \"8dedff64-89fd-41e2-83e7-e5bdf85f3470\") " pod="openshift-multus/network-metrics-daemon-j58cx"
Sep 17 21:58:54.398819 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:54.398781    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2c0000a6-1b43-479b-a06b-06eb5db40c2d-original-pull-secret\") pod \"global-pull-secret-syncer-br6wh\" (UID: \"2c0000a6-1b43-479b-a06b-06eb5db40c2d\") " pod="kube-system/global-pull-secret-syncer-br6wh"
Sep 17 21:58:54.398934 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:54.398845    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-md225\" (UniqueName: \"kubernetes.io/projected/4a6387b2-b54c-44e0-909d-589e73c07248-kube-api-access-md225\") pod \"network-check-target-zdznt\" (UID: \"4a6387b2-b54c-44e0-909d-589e73c07248\") " pod="openshift-network-diagnostics/network-check-target-zdznt"
Sep 17 21:58:54.401102 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:54.401085    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-md225\" (UniqueName: \"kubernetes.io/projected/4a6387b2-b54c-44e0-909d-589e73c07248-kube-api-access-md225\") pod \"network-check-target-zdznt\" (UID: \"4a6387b2-b54c-44e0-909d-589e73c07248\") " pod="openshift-network-diagnostics/network-check-target-zdznt"
Sep 17 21:58:54.401402 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:54.401376    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 17 21:58:54.411309 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:54.411290    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2c0000a6-1b43-479b-a06b-06eb5db40c2d-original-pull-secret\") pod \"global-pull-secret-syncer-br6wh\" (UID: \"2c0000a6-1b43-479b-a06b-06eb5db40c2d\") " pod="kube-system/global-pull-secret-syncer-br6wh"
Sep 17 21:58:54.478659 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:54.478631    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-br6wh"
Sep 17 21:58:54.486930 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:54.486913    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nbkcq\""
Sep 17 21:58:54.491143 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:54.491123    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-278n4\""
Sep 17 21:58:54.495216 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:54.495192    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j58cx"
Sep 17 21:58:54.499289 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:54.499272    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zdznt"
Sep 17 21:58:54.747259 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:54.747231    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-br6wh"]
Sep 17 21:58:54.750007 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:58:54.749982    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c0000a6_1b43_479b_a06b_06eb5db40c2d.slice/crio-d4a6ef46d5a0206ec8aba81f8fdbc6ceb3762c08e33fd44e3b8304ab13c58bba WatchSource:0}: Error finding container d4a6ef46d5a0206ec8aba81f8fdbc6ceb3762c08e33fd44e3b8304ab13c58bba: Status 404 returned error can't find the container with id d4a6ef46d5a0206ec8aba81f8fdbc6ceb3762c08e33fd44e3b8304ab13c58bba
Sep 17 21:58:54.771409 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:54.771385    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-j58cx"]
Sep 17 21:58:54.774398 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:58:54.774370    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dedff64_89fd_41e2_83e7_e5bdf85f3470.slice/crio-04b6fe3c28267f7438581cf61f45c8c02966f9cb40b61e25bf1dca2f6bbe0a6a WatchSource:0}: Error finding container 04b6fe3c28267f7438581cf61f45c8c02966f9cb40b61e25bf1dca2f6bbe0a6a: Status 404 returned error can't find the container with id 04b6fe3c28267f7438581cf61f45c8c02966f9cb40b61e25bf1dca2f6bbe0a6a
Sep 17 21:58:54.775422 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:54.775401    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zdznt"]
Sep 17 21:58:54.778264 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:58:54.778239    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a6387b2_b54c_44e0_909d_589e73c07248.slice/crio-05cebf02b4d614136168cd2a99336fe99ed88879fe91366fe73b26b9d6f09e38 WatchSource:0}: Error finding container 05cebf02b4d614136168cd2a99336fe99ed88879fe91366fe73b26b9d6f09e38: Status 404 returned error can't find the container with id 05cebf02b4d614136168cd2a99336fe99ed88879fe91366fe73b26b9d6f09e38
Sep 17 21:58:54.825685 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:54.825655    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zdznt" event={"ID":"4a6387b2-b54c-44e0-909d-589e73c07248","Type":"ContainerStarted","Data":"05cebf02b4d614136168cd2a99336fe99ed88879fe91366fe73b26b9d6f09e38"}
Sep 17 21:58:54.826764 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:54.826744    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-br6wh" event={"ID":"2c0000a6-1b43-479b-a06b-06eb5db40c2d","Type":"ContainerStarted","Data":"d4a6ef46d5a0206ec8aba81f8fdbc6ceb3762c08e33fd44e3b8304ab13c58bba"}
Sep 17 21:58:54.827894 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:54.827872    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-j58cx" event={"ID":"8dedff64-89fd-41e2-83e7-e5bdf85f3470","Type":"ContainerStarted","Data":"04b6fe3c28267f7438581cf61f45c8c02966f9cb40b61e25bf1dca2f6bbe0a6a"}
Sep 17 21:58:55.206657 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:55.206583    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/00b93628-c39c-4304-a072-ae9bd5ad3592-registry-tls\") pod \"image-registry-6d87985496-lns5f\" (UID: \"00b93628-c39c-4304-a072-ae9bd5ad3592\") " pod="openshift-image-registry/image-registry-6d87985496-lns5f"
Sep 17 21:58:55.208768 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:55.208750    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/00b93628-c39c-4304-a072-ae9bd5ad3592-registry-tls\") pod \"image-registry-6d87985496-lns5f\" (UID: \"00b93628-c39c-4304-a072-ae9bd5ad3592\") " pod="openshift-image-registry/image-registry-6d87985496-lns5f"
Sep 17 21:58:55.307180 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:55.307138    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e5738b3d-740b-4e0c-b1e4-9805f8621f85-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-s2pc2\" (UID: \"e5738b3d-740b-4e0c-b1e4-9805f8621f85\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-s2pc2"
Sep 17 21:58:55.307649 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:55.307239    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/93344afa-73c8-4d4e-8d6f-47e08e79c050-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-5svbx\" (UID: \"93344afa-73c8-4d4e-8d6f-47e08e79c050\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-5svbx"
Sep 17 21:58:55.309988 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:55.309940    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e5738b3d-740b-4e0c-b1e4-9805f8621f85-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-s2pc2\" (UID: \"e5738b3d-740b-4e0c-b1e4-9805f8621f85\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-s2pc2"
Sep 17 21:58:55.310110 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:55.310017    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/93344afa-73c8-4d4e-8d6f-47e08e79c050-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-5svbx\" (UID: \"93344afa-73c8-4d4e-8d6f-47e08e79c050\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-5svbx"
Sep 17 21:58:55.407692 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:55.407648    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86-metrics-certs\") pod \"router-default-5dcb767b8d-7lbgr\" (UID: \"b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86\") " pod="openshift-ingress/router-default-5dcb767b8d-7lbgr"
Sep 17 21:58:55.407933 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:55.407726    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0718c57f-12b7-4062-b53c-777792631aec-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-2jjzd\" (UID: \"0718c57f-12b7-4062-b53c-777792631aec\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-2jjzd"
Sep 17 21:58:55.407933 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:55.407768    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2127c519-5059-47bc-b905-2ac3bee41b8d-metrics-tls\") pod \"dns-default-4nccz\" (UID: \"2127c519-5059-47bc-b905-2ac3bee41b8d\") " pod="openshift-dns/dns-default-4nccz"
Sep 17 21:58:55.407933 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:55.407806    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86-service-ca-bundle\") pod \"router-default-5dcb767b8d-7lbgr\" (UID: \"b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86\") " pod="openshift-ingress/router-default-5dcb767b8d-7lbgr"
Sep 17 21:58:55.408580 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:55.408550    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86-service-ca-bundle\") pod \"router-default-5dcb767b8d-7lbgr\" (UID: \"b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86\") " pod="openshift-ingress/router-default-5dcb767b8d-7lbgr"
Sep 17 21:58:55.410402 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:55.410345    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86-metrics-certs\") pod \"router-default-5dcb767b8d-7lbgr\" (UID: \"b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86\") " pod="openshift-ingress/router-default-5dcb767b8d-7lbgr"
Sep 17 21:58:55.410658 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:55.410638    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2127c519-5059-47bc-b905-2ac3bee41b8d-metrics-tls\") pod \"dns-default-4nccz\" (UID: \"2127c519-5059-47bc-b905-2ac3bee41b8d\") " pod="openshift-dns/dns-default-4nccz"
Sep 17 21:58:55.410720 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:55.410702    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0718c57f-12b7-4062-b53c-777792631aec-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-2jjzd\" (UID: \"0718c57f-12b7-4062-b53c-777792631aec\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-2jjzd"
Sep 17 21:58:55.463609 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:55.463548    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-nrw4l\""
Sep 17 21:58:55.471746 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:55.471720    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d87985496-lns5f"
Sep 17 21:58:55.513294 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:55.513262    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-66dfl\""
Sep 17 21:58:55.521662 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:55.521641    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-5svbx"
Sep 17 21:58:55.531286 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:55.531222    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-gw4tt\""
Sep 17 21:58:55.539381 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:55.539340    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-s2pc2"
Sep 17 21:58:55.605543 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:55.605282    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-xjk5x\""
Sep 17 21:58:55.610886 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:55.610658    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5dcb767b8d-7lbgr"
Sep 17 21:58:55.618164 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:55.618144    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-7q889\""
Sep 17 21:58:55.626375 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:55.626341    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6446c8d75d-2jjzd"
Sep 17 21:58:55.661852 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:55.661829    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7dc29\""
Sep 17 21:58:55.669608 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:55.669579    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4nccz"
Sep 17 21:58:55.774607 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:55.774522    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d87985496-lns5f"]
Sep 17 21:58:55.836052 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:55.836014    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zdznt" event={"ID":"4a6387b2-b54c-44e0-909d-589e73c07248","Type":"ContainerStarted","Data":"c88cf8d3fe19d9af166c996bc66f2cf7dbfdfe47d174b2deba8f1ccf1ebc4ee9"}
Sep 17 21:58:55.836202 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:55.836142    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-zdznt"
Sep 17 21:58:55.844281 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:55.844247    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-5svbx"]
Sep 17 21:58:55.868279 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:55.868230    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-zdznt" podStartSLOduration=66.868217443 podStartE2EDuration="1m6.868217443s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:57:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:58:55.867475074 +0000 UTC m=+67.927247076" watchObservedRunningTime="2026-09-17 21:58:55.868217443 +0000 UTC m=+67.927989454"
Sep 17 21:58:55.896135 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:58:55.896105    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00b93628_c39c_4304_a072_ae9bd5ad3592.slice/crio-8b9b99adff430068430253e1bfb120c3c9b757323f0754bb17a8d8f967e5eed3 WatchSource:0}: Error finding container 8b9b99adff430068430253e1bfb120c3c9b757323f0754bb17a8d8f967e5eed3: Status 404 returned error can't find the container with id 8b9b99adff430068430253e1bfb120c3c9b757323f0754bb17a8d8f967e5eed3
Sep 17 21:58:55.897210 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:58:55.897115    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93344afa_73c8_4d4e_8d6f_47e08e79c050.slice/crio-17ea378f62c53f0eb3f5002a06e20dd0ea61e5f0c31614ced4c2b5a3e64bfc54 WatchSource:0}: Error finding container 17ea378f62c53f0eb3f5002a06e20dd0ea61e5f0c31614ced4c2b5a3e64bfc54: Status 404 returned error can't find the container with id 17ea378f62c53f0eb3f5002a06e20dd0ea61e5f0c31614ced4c2b5a3e64bfc54
Sep 17 21:58:56.196878 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:56.196836    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4nccz"]
Sep 17 21:58:56.199676 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:56.199604    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-s2pc2"]
Sep 17 21:58:56.202977 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:56.202952    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5dcb767b8d-7lbgr"]
Sep 17 21:58:56.210183 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:56.210156    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-2jjzd"]
Sep 17 21:58:56.248771 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:58:56.248729    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2127c519_5059_47bc_b905_2ac3bee41b8d.slice/crio-f02e1271bbb0af612d4848afb58b67beba250f80801d305ce6e8ee5c664920ae WatchSource:0}: Error finding container f02e1271bbb0af612d4848afb58b67beba250f80801d305ce6e8ee5c664920ae: Status 404 returned error can't find the container with id f02e1271bbb0af612d4848afb58b67beba250f80801d305ce6e8ee5c664920ae
Sep 17 21:58:56.251241 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:58:56.251057    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4aec7ce_0e26_4c9c_b89f_e4b827ff9f86.slice/crio-9598ee75d56ba9e206029ae2ca4a574ec71083074593e998d70d8039e1da0b35 WatchSource:0}: Error finding container 9598ee75d56ba9e206029ae2ca4a574ec71083074593e998d70d8039e1da0b35: Status 404 returned error can't find the container with id 9598ee75d56ba9e206029ae2ca4a574ec71083074593e998d70d8039e1da0b35
Sep 17 21:58:56.252244 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:58:56.252026    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0718c57f_12b7_4062_b53c_777792631aec.slice/crio-0fa8f572a1528a8e0f380ee7c50e202bffa2b278110dfb383a991476bcf16733 WatchSource:0}: Error finding container 0fa8f572a1528a8e0f380ee7c50e202bffa2b278110dfb383a991476bcf16733: Status 404 returned error can't find the container with id 0fa8f572a1528a8e0f380ee7c50e202bffa2b278110dfb383a991476bcf16733
Sep 17 21:58:56.845434 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:56.845331    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5dcb767b8d-7lbgr" event={"ID":"b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86","Type":"ContainerStarted","Data":"3b56b40711765ab16d1d5a5bf74b877bafdf4601e6925756f8415fa73d07b413"}
Sep 17 21:58:56.845434 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:56.845415    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5dcb767b8d-7lbgr" event={"ID":"b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86","Type":"ContainerStarted","Data":"9598ee75d56ba9e206029ae2ca4a574ec71083074593e998d70d8039e1da0b35"}
Sep 17 21:58:56.848808 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:56.848777    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6446c8d75d-2jjzd" event={"ID":"0718c57f-12b7-4062-b53c-777792631aec","Type":"ContainerStarted","Data":"0fa8f572a1528a8e0f380ee7c50e202bffa2b278110dfb383a991476bcf16733"}
Sep 17 21:58:56.853757 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:56.853703    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-j58cx" event={"ID":"8dedff64-89fd-41e2-83e7-e5bdf85f3470","Type":"ContainerStarted","Data":"040761bf8c8c299ccb10e34df7ae7584026ad3296a8c4fe40ecf4fd7fae131e9"}
Sep 17 21:58:56.853757 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:56.853752    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-j58cx" event={"ID":"8dedff64-89fd-41e2-83e7-e5bdf85f3470","Type":"ContainerStarted","Data":"f77aec99412ed3f93579b19bb831120fe3f5f731545cb535b1aaf404322cbf75"}
Sep 17 21:58:56.855199 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:56.855172    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-s2pc2" event={"ID":"e5738b3d-740b-4e0c-b1e4-9805f8621f85","Type":"ContainerStarted","Data":"bb8b81ab2d5787af17b0355a6396f750afdc5eeea6240fd8812e596e2f7feca7"}
Sep 17 21:58:56.857647 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:56.857621    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4nccz" event={"ID":"2127c519-5059-47bc-b905-2ac3bee41b8d","Type":"ContainerStarted","Data":"f02e1271bbb0af612d4848afb58b67beba250f80801d305ce6e8ee5c664920ae"}
Sep 17 21:58:56.862564 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:56.862539    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d87985496-lns5f" event={"ID":"00b93628-c39c-4304-a072-ae9bd5ad3592","Type":"ContainerStarted","Data":"ac64b86a8fd5d9d8f4e5c40feed44e21f7728407d0f0f6bc282fa64a861c8150"}
Sep 17 21:58:56.862661 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:56.862586    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d87985496-lns5f" event={"ID":"00b93628-c39c-4304-a072-ae9bd5ad3592","Type":"ContainerStarted","Data":"8b9b99adff430068430253e1bfb120c3c9b757323f0754bb17a8d8f967e5eed3"}
Sep 17 21:58:56.863076 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:56.863054    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6d87985496-lns5f"
Sep 17 21:58:56.867019 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:56.866954    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-5svbx" event={"ID":"93344afa-73c8-4d4e-8d6f-47e08e79c050","Type":"ContainerStarted","Data":"17ea378f62c53f0eb3f5002a06e20dd0ea61e5f0c31614ced4c2b5a3e64bfc54"}
Sep 17 21:58:56.874303 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:56.871095    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5dcb767b8d-7lbgr" podStartSLOduration=64.871078004 podStartE2EDuration="1m4.871078004s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:57:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:58:56.870546799 +0000 UTC m=+68.930318811" watchObservedRunningTime="2026-09-17 21:58:56.871078004 +0000 UTC m=+68.930850016"
Sep 17 21:58:56.890943 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:56.890890    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6d87985496-lns5f" podStartSLOduration=67.890871608 podStartE2EDuration="1m7.890871608s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:57:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:58:56.890299924 +0000 UTC m=+68.950071935" watchObservedRunningTime="2026-09-17 21:58:56.890871608 +0000 UTC m=+68.950643620"
Sep 17 21:58:56.912048 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:56.911545    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-j58cx" podStartSLOduration=66.423339756 podStartE2EDuration="1m7.911525122s" totalImagesPullingTime="1.488185366s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:57:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:58:56.909966056 +0000 UTC m=+68.969738071" watchObservedRunningTime="2026-09-17 21:58:56.911525122 +0000 UTC m=+68.971297134"
Sep 17 21:58:57.611657 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:57.611622    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5dcb767b8d-7lbgr"
Sep 17 21:58:57.614865 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:57.614649    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5dcb767b8d-7lbgr"
Sep 17 21:58:57.871764 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:57.871646    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5dcb767b8d-7lbgr"
Sep 17 21:58:57.872710 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:58:57.872684    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5dcb767b8d-7lbgr"
Sep 17 21:59:02.890168 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:02.890124    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-br6wh" event={"ID":"2c0000a6-1b43-479b-a06b-06eb5db40c2d","Type":"ContainerStarted","Data":"3c51d56ce4054763845cd0e38b1478db95180544a2dc8650badcfeee5640c7db"}
Sep 17 21:59:02.891750 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:02.891726    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6446c8d75d-2jjzd" event={"ID":"0718c57f-12b7-4062-b53c-777792631aec","Type":"ContainerStarted","Data":"393e7953350785053c280f10ceb4b35a76f8608f6f5a327dc6925cfa599b635d"}
Sep 17 21:59:02.893621 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:02.893601    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-s2pc2" event={"ID":"e5738b3d-740b-4e0c-b1e4-9805f8621f85","Type":"ContainerStarted","Data":"db2013f40375fc2240449a9d01132bb9e8c8d7d238d165ce25002121126fe11d"}
Sep 17 21:59:02.893710 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:02.893639    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-s2pc2" event={"ID":"e5738b3d-740b-4e0c-b1e4-9805f8621f85","Type":"ContainerStarted","Data":"fe56271e6eb4e864c44372b3f26e44d17597cda3da77ed8701cdce0a04c9cce6"}
Sep 17 21:59:02.895238 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:02.895216    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4nccz" event={"ID":"2127c519-5059-47bc-b905-2ac3bee41b8d","Type":"ContainerStarted","Data":"7013b3ccc2e7da00015d03340522201666f1c51fd2c93493f767287736147a10"}
Sep 17 21:59:02.895317 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:02.895263    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4nccz"
Sep 17 21:59:02.895317 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:02.895286    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4nccz" event={"ID":"2127c519-5059-47bc-b905-2ac3bee41b8d","Type":"ContainerStarted","Data":"6b0320a2e31d04785513acaf96229026b6aa0cdff8ab4d0d3b8a22b9d59b20f9"}
Sep 17 21:59:02.896690 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:02.896672    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-5svbx" event={"ID":"93344afa-73c8-4d4e-8d6f-47e08e79c050","Type":"ContainerStarted","Data":"ac552031c2459d527040afe565e3c676eaf1d66425b14efea97c01950a063629"}
Sep 17 21:59:02.905299 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:02.905260    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-br6wh" podStartSLOduration=66.748872165 podStartE2EDuration="1m13.905247543s" totalImagesPullingTime="7.156375378s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 21:57:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:59:02.904487005 +0000 UTC m=+74.964259017" watchObservedRunningTime="2026-09-17 21:59:02.905247543 +0000 UTC m=+74.965019553"
Sep 17 21:59:02.922466 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:02.922425    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6446c8d75d-2jjzd" podStartSLOduration=36.273915337 podStartE2EDuration="41.922413149s" totalImagesPullingTime="5.648497812s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:58:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:59:02.922116038 +0000 UTC m=+74.981888050" watchObservedRunningTime="2026-09-17 21:59:02.922413149 +0000 UTC m=+74.982185179"
Sep 17 21:59:02.947578 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:02.947523    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-s2pc2" podStartSLOduration=65.336123735 podStartE2EDuration="1m10.947504412s" totalImagesPullingTime="5.611380677s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:57:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:59:02.946951602 +0000 UTC m=+75.006723615" watchObservedRunningTime="2026-09-17 21:59:02.947504412 +0000 UTC m=+75.007276426"
Sep 17 21:59:02.966997 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:02.966951    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-5svbx" podStartSLOduration=64.958565204 podStartE2EDuration="1m10.966939452s" totalImagesPullingTime="6.008374248s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:57:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:59:02.965961063 +0000 UTC m=+75.025733079" watchObservedRunningTime="2026-09-17 21:59:02.966939452 +0000 UTC m=+75.026711463"
Sep 17 21:59:02.982568 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:02.982526    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-4nccz" podStartSLOduration=34.32953965 podStartE2EDuration="39.982508493s" totalImagesPullingTime="5.652968843s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:58:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:59:02.981247518 +0000 UTC m=+75.041019529" watchObservedRunningTime="2026-09-17 21:59:02.982508493 +0000 UTC m=+75.042280505"
Sep 17 21:59:12.903252 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:12.903140    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4nccz"
Sep 17 21:59:15.476566 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:15.476526    2560 patch_prober.go:28] interesting pod/image-registry-6d87985496-lns5f container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 17 21:59:15.476933 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:15.476577    2560 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6d87985496-lns5f" podUID="00b93628-c39c-4304-a072-ae9bd5ad3592" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 21:59:16.920253 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:16.920218    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-c29sg"]
Sep 17 21:59:16.923223 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:16.923198    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-c29sg"
Sep 17 21:59:16.925928 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:16.925901    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 17 21:59:16.926067 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:16.925942    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 17 21:59:16.926067 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:16.926045    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 17 21:59:16.926294 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:16.926278    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 17 21:59:16.927180 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:16.927161    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-sjmkc\""
Sep 17 21:59:17.075940 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:17.075905    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2296adbd-b902-481f-b1ac-1c8d12ceee82-node-exporter-textfile\") pod \"node-exporter-c29sg\" (UID: \"2296adbd-b902-481f-b1ac-1c8d12ceee82\") " pod="openshift-monitoring/node-exporter-c29sg"
Sep 17 21:59:17.076124 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:17.075967    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2296adbd-b902-481f-b1ac-1c8d12ceee82-node-exporter-wtmp\") pod \"node-exporter-c29sg\" (UID: \"2296adbd-b902-481f-b1ac-1c8d12ceee82\") " pod="openshift-monitoring/node-exporter-c29sg"
Sep 17 21:59:17.076124 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:17.075999    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2296adbd-b902-481f-b1ac-1c8d12ceee82-sys\") pod \"node-exporter-c29sg\" (UID: \"2296adbd-b902-481f-b1ac-1c8d12ceee82\") " pod="openshift-monitoring/node-exporter-c29sg"
Sep 17 21:59:17.076124 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:17.076019    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2296adbd-b902-481f-b1ac-1c8d12ceee82-node-exporter-tls\") pod \"node-exporter-c29sg\" (UID: \"2296adbd-b902-481f-b1ac-1c8d12ceee82\") " pod="openshift-monitoring/node-exporter-c29sg"
Sep 17 21:59:17.076124 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:17.076036    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2296adbd-b902-481f-b1ac-1c8d12ceee82-metrics-client-ca\") pod \"node-exporter-c29sg\" (UID: \"2296adbd-b902-481f-b1ac-1c8d12ceee82\") " pod="openshift-monitoring/node-exporter-c29sg"
Sep 17 21:59:17.076124 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:17.076057    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2296adbd-b902-481f-b1ac-1c8d12ceee82-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c29sg\" (UID: \"2296adbd-b902-481f-b1ac-1c8d12ceee82\") " pod="openshift-monitoring/node-exporter-c29sg"
Sep 17 21:59:17.076338 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:17.076132    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2296adbd-b902-481f-b1ac-1c8d12ceee82-root\") pod \"node-exporter-c29sg\" (UID: \"2296adbd-b902-481f-b1ac-1c8d12ceee82\") " pod="openshift-monitoring/node-exporter-c29sg"
Sep 17 21:59:17.076338 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:17.076189    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2296adbd-b902-481f-b1ac-1c8d12ceee82-node-exporter-accelerators-collector-config\") pod \"node-exporter-c29sg\" (UID: \"2296adbd-b902-481f-b1ac-1c8d12ceee82\") " pod="openshift-monitoring/node-exporter-c29sg"
Sep 17 21:59:17.076338 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:17.076236    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ckvf\" (UniqueName: \"kubernetes.io/projected/2296adbd-b902-481f-b1ac-1c8d12ceee82-kube-api-access-2ckvf\") pod \"node-exporter-c29sg\" (UID: \"2296adbd-b902-481f-b1ac-1c8d12ceee82\") " pod="openshift-monitoring/node-exporter-c29sg"
Sep 17 21:59:17.176822 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:17.176736    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2296adbd-b902-481f-b1ac-1c8d12ceee82-node-exporter-accelerators-collector-config\") pod \"node-exporter-c29sg\" (UID: \"2296adbd-b902-481f-b1ac-1c8d12ceee82\") " pod="openshift-monitoring/node-exporter-c29sg"
Sep 17 21:59:17.176822 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:17.176779    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ckvf\" (UniqueName: \"kubernetes.io/projected/2296adbd-b902-481f-b1ac-1c8d12ceee82-kube-api-access-2ckvf\") pod \"node-exporter-c29sg\" (UID: \"2296adbd-b902-481f-b1ac-1c8d12ceee82\") " pod="openshift-monitoring/node-exporter-c29sg"
Sep 17 21:59:17.176822 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:17.176801    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2296adbd-b902-481f-b1ac-1c8d12ceee82-node-exporter-textfile\") pod \"node-exporter-c29sg\" (UID: \"2296adbd-b902-481f-b1ac-1c8d12ceee82\") " pod="openshift-monitoring/node-exporter-c29sg"
Sep 17 21:59:17.177080 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:17.176838    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2296adbd-b902-481f-b1ac-1c8d12ceee82-node-exporter-wtmp\") pod \"node-exporter-c29sg\" (UID: \"2296adbd-b902-481f-b1ac-1c8d12ceee82\") " pod="openshift-monitoring/node-exporter-c29sg"
Sep 17 21:59:17.177080 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:17.176854    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2296adbd-b902-481f-b1ac-1c8d12ceee82-sys\") pod \"node-exporter-c29sg\" (UID: \"2296adbd-b902-481f-b1ac-1c8d12ceee82\") " pod="openshift-monitoring/node-exporter-c29sg"
Sep 17 21:59:17.177080 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:17.176870    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2296adbd-b902-481f-b1ac-1c8d12ceee82-node-exporter-tls\") pod \"node-exporter-c29sg\" (UID: \"2296adbd-b902-481f-b1ac-1c8d12ceee82\") " pod="openshift-monitoring/node-exporter-c29sg"
Sep 17 21:59:17.177080 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:59:17.176949    2560 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 17 21:59:17.177080 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:17.176949    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2296adbd-b902-481f-b1ac-1c8d12ceee82-sys\") pod \"node-exporter-c29sg\" (UID: \"2296adbd-b902-481f-b1ac-1c8d12ceee82\") " pod="openshift-monitoring/node-exporter-c29sg"
Sep 17 21:59:17.177080 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:17.176999    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2296adbd-b902-481f-b1ac-1c8d12ceee82-node-exporter-wtmp\") pod \"node-exporter-c29sg\" (UID: \"2296adbd-b902-481f-b1ac-1c8d12ceee82\") " pod="openshift-monitoring/node-exporter-c29sg"
Sep 17 21:59:17.177080 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:59:17.177027    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2296adbd-b902-481f-b1ac-1c8d12ceee82-node-exporter-tls podName:2296adbd-b902-481f-b1ac-1c8d12ceee82 nodeName:}" failed. No retries permitted until 2026-09-17 21:59:17.677007513 +0000 UTC m=+89.736779519 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/2296adbd-b902-481f-b1ac-1c8d12ceee82-node-exporter-tls") pod "node-exporter-c29sg" (UID: "2296adbd-b902-481f-b1ac-1c8d12ceee82") : secret "node-exporter-tls" not found
Sep 17 21:59:17.177080 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:17.177046    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2296adbd-b902-481f-b1ac-1c8d12ceee82-metrics-client-ca\") pod \"node-exporter-c29sg\" (UID: \"2296adbd-b902-481f-b1ac-1c8d12ceee82\") " pod="openshift-monitoring/node-exporter-c29sg"
Sep 17 21:59:17.177080 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:17.177072    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2296adbd-b902-481f-b1ac-1c8d12ceee82-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c29sg\" (UID: \"2296adbd-b902-481f-b1ac-1c8d12ceee82\") " pod="openshift-monitoring/node-exporter-c29sg"
Sep 17 21:59:17.177519 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:17.177114    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2296adbd-b902-481f-b1ac-1c8d12ceee82-root\") pod \"node-exporter-c29sg\" (UID: \"2296adbd-b902-481f-b1ac-1c8d12ceee82\") " pod="openshift-monitoring/node-exporter-c29sg"
Sep 17 21:59:17.177519 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:17.177209    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2296adbd-b902-481f-b1ac-1c8d12ceee82-root\") pod \"node-exporter-c29sg\" (UID: \"2296adbd-b902-481f-b1ac-1c8d12ceee82\") " pod="openshift-monitoring/node-exporter-c29sg"
Sep 17 21:59:17.177519 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:17.177213    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2296adbd-b902-481f-b1ac-1c8d12ceee82-node-exporter-textfile\") pod \"node-exporter-c29sg\" (UID: \"2296adbd-b902-481f-b1ac-1c8d12ceee82\") " pod="openshift-monitoring/node-exporter-c29sg"
Sep 17 21:59:17.177649 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:17.177606    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2296adbd-b902-481f-b1ac-1c8d12ceee82-node-exporter-accelerators-collector-config\") pod \"node-exporter-c29sg\" (UID: \"2296adbd-b902-481f-b1ac-1c8d12ceee82\") " pod="openshift-monitoring/node-exporter-c29sg"
Sep 17 21:59:17.177684 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:17.177671    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2296adbd-b902-481f-b1ac-1c8d12ceee82-metrics-client-ca\") pod \"node-exporter-c29sg\" (UID: \"2296adbd-b902-481f-b1ac-1c8d12ceee82\") " pod="openshift-monitoring/node-exporter-c29sg"
Sep 17 21:59:17.179278 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:17.179262    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2296adbd-b902-481f-b1ac-1c8d12ceee82-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c29sg\" (UID: \"2296adbd-b902-481f-b1ac-1c8d12ceee82\") " pod="openshift-monitoring/node-exporter-c29sg"
Sep 17 21:59:17.186861 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:17.186841    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ckvf\" (UniqueName: \"kubernetes.io/projected/2296adbd-b902-481f-b1ac-1c8d12ceee82-kube-api-access-2ckvf\") pod \"node-exporter-c29sg\" (UID: \"2296adbd-b902-481f-b1ac-1c8d12ceee82\") " pod="openshift-monitoring/node-exporter-c29sg"
Sep 17 21:59:17.681566 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:17.681531    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2296adbd-b902-481f-b1ac-1c8d12ceee82-node-exporter-tls\") pod \"node-exporter-c29sg\" (UID: \"2296adbd-b902-481f-b1ac-1c8d12ceee82\") " pod="openshift-monitoring/node-exporter-c29sg"
Sep 17 21:59:17.683880 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:17.683851    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2296adbd-b902-481f-b1ac-1c8d12ceee82-node-exporter-tls\") pod \"node-exporter-c29sg\" (UID: \"2296adbd-b902-481f-b1ac-1c8d12ceee82\") " pod="openshift-monitoring/node-exporter-c29sg"
Sep 17 21:59:17.832612 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:17.832572    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-c29sg"
Sep 17 21:59:17.843535 ip-10-0-136-66 kubenswrapper[2560]: W0917 21:59:17.843506    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2296adbd_b902_481f_b1ac_1c8d12ceee82.slice/crio-81f8821465ea52a0cf1a4e2f4d2a13b64481458e8fd111e9c2e0806c523ccac0 WatchSource:0}: Error finding container 81f8821465ea52a0cf1a4e2f4d2a13b64481458e8fd111e9c2e0806c523ccac0: Status 404 returned error can't find the container with id 81f8821465ea52a0cf1a4e2f4d2a13b64481458e8fd111e9c2e0806c523ccac0
Sep 17 21:59:17.953545 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:17.953461    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c29sg" event={"ID":"2296adbd-b902-481f-b1ac-1c8d12ceee82","Type":"ContainerStarted","Data":"81f8821465ea52a0cf1a4e2f4d2a13b64481458e8fd111e9c2e0806c523ccac0"}
Sep 17 21:59:18.880965 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:18.880920    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6d87985496-lns5f"
Sep 17 21:59:18.959606 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:18.959570    2560 generic.go:356] "Generic (PLEG): container finished" podID="2296adbd-b902-481f-b1ac-1c8d12ceee82" containerID="f51f4c7342d9545d4fa71de704cd37fc9aae19ce4ea55658f21ddd60b16c0154" exitCode=0
Sep 17 21:59:18.960019 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:18.959636    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c29sg" event={"ID":"2296adbd-b902-481f-b1ac-1c8d12ceee82","Type":"ContainerDied","Data":"f51f4c7342d9545d4fa71de704cd37fc9aae19ce4ea55658f21ddd60b16c0154"}
Sep 17 21:59:19.965527 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:19.965492    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c29sg" event={"ID":"2296adbd-b902-481f-b1ac-1c8d12ceee82","Type":"ContainerStarted","Data":"492b90026a9b689f211e3d7a4b9c10a5af9ccb94324be8302054aaedee3611be"}
Sep 17 21:59:19.965893 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:19.965544    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c29sg" event={"ID":"2296adbd-b902-481f-b1ac-1c8d12ceee82","Type":"ContainerStarted","Data":"39eb52f5268a0e9a15bcc068c7d1fe840d058d8966a8529a0226067e3a9c20bf"}
Sep 17 21:59:19.985264 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:19.985213    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-c29sg" podStartSLOduration=2.979108934 podStartE2EDuration="3.985196023s" totalImagesPullingTime="941.642638ms" totalInitContainerRuntime="64.444451ms" isStatefulPod=true podCreationTimestamp="2026-09-17 21:59:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:59:19.984937548 +0000 UTC m=+92.044709572" watchObservedRunningTime="2026-09-17 21:59:19.985196023 +0000 UTC m=+92.044968034"
Sep 17 21:59:20.556095 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:20.556060    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6d87985496-lns5f"]
Sep 17 21:59:26.869541 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:26.869505    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-zdznt"
Sep 17 21:59:44.060308 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:44.060270    2560 generic.go:356] "Generic (PLEG): container finished" podID="351c70fa-979d-49a3-926e-56becaec72ed" containerID="b3ca3d491b404b3831037755dd31d286c0b1bedda652604c9e10397213114a33" exitCode=0
Sep 17 21:59:44.060721 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:44.060317    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-jn6j9" event={"ID":"351c70fa-979d-49a3-926e-56becaec72ed","Type":"ContainerDied","Data":"b3ca3d491b404b3831037755dd31d286c0b1bedda652604c9e10397213114a33"}
Sep 17 21:59:44.060721 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:44.060647    2560 scope.go:117] "RemoveContainer" containerID="b3ca3d491b404b3831037755dd31d286c0b1bedda652604c9e10397213114a33"
Sep 17 21:59:45.065751 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:45.065712    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-jn6j9" event={"ID":"351c70fa-979d-49a3-926e-56becaec72ed","Type":"ContainerStarted","Data":"e230d3d5ca65259ec621aa0fdef8f4b5823ecb9eb4919768454a123a6b70bab7"}
Sep 17 21:59:45.574932 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:45.574883    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6d87985496-lns5f" podUID="00b93628-c39c-4304-a072-ae9bd5ad3592" containerName="registry" containerID="cri-o://ac64b86a8fd5d9d8f4e5c40feed44e21f7728407d0f0f6bc282fa64a861c8150" gracePeriod=30
Sep 17 21:59:45.809769 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:45.809745    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d87985496-lns5f"
Sep 17 21:59:45.911161 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:45.911076    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/00b93628-c39c-4304-a072-ae9bd5ad3592-installation-pull-secrets\") pod \"00b93628-c39c-4304-a072-ae9bd5ad3592\" (UID: \"00b93628-c39c-4304-a072-ae9bd5ad3592\") "
Sep 17 21:59:45.911161 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:45.911136    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dkthr\" (UniqueName: \"kubernetes.io/projected/00b93628-c39c-4304-a072-ae9bd5ad3592-kube-api-access-dkthr\") pod \"00b93628-c39c-4304-a072-ae9bd5ad3592\" (UID: \"00b93628-c39c-4304-a072-ae9bd5ad3592\") "
Sep 17 21:59:45.911417 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:45.911180    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/00b93628-c39c-4304-a072-ae9bd5ad3592-image-registry-private-configuration\") pod \"00b93628-c39c-4304-a072-ae9bd5ad3592\" (UID: \"00b93628-c39c-4304-a072-ae9bd5ad3592\") "
Sep 17 21:59:45.911417 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:45.911208    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/00b93628-c39c-4304-a072-ae9bd5ad3592-registry-certificates\") pod \"00b93628-c39c-4304-a072-ae9bd5ad3592\" (UID: \"00b93628-c39c-4304-a072-ae9bd5ad3592\") "
Sep 17 21:59:45.911417 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:45.911234    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/00b93628-c39c-4304-a072-ae9bd5ad3592-trusted-ca\") pod \"00b93628-c39c-4304-a072-ae9bd5ad3592\" (UID: \"00b93628-c39c-4304-a072-ae9bd5ad3592\") "
Sep 17 21:59:45.911417 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:45.911288    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/00b93628-c39c-4304-a072-ae9bd5ad3592-registry-tls\") pod \"00b93628-c39c-4304-a072-ae9bd5ad3592\" (UID: \"00b93628-c39c-4304-a072-ae9bd5ad3592\") "
Sep 17 21:59:45.911417 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:45.911328    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/00b93628-c39c-4304-a072-ae9bd5ad3592-ca-trust-extracted\") pod \"00b93628-c39c-4304-a072-ae9bd5ad3592\" (UID: \"00b93628-c39c-4304-a072-ae9bd5ad3592\") "
Sep 17 21:59:45.911417 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:45.911376    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/00b93628-c39c-4304-a072-ae9bd5ad3592-bound-sa-token\") pod \"00b93628-c39c-4304-a072-ae9bd5ad3592\" (UID: \"00b93628-c39c-4304-a072-ae9bd5ad3592\") "
Sep 17 21:59:45.911841 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:45.911806    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00b93628-c39c-4304-a072-ae9bd5ad3592-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "00b93628-c39c-4304-a072-ae9bd5ad3592" (UID: "00b93628-c39c-4304-a072-ae9bd5ad3592"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 21:59:45.912002 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:45.911972    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00b93628-c39c-4304-a072-ae9bd5ad3592-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "00b93628-c39c-4304-a072-ae9bd5ad3592" (UID: "00b93628-c39c-4304-a072-ae9bd5ad3592"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 21:59:45.913822 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:45.913790    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00b93628-c39c-4304-a072-ae9bd5ad3592-kube-api-access-dkthr" (OuterVolumeSpecName: "kube-api-access-dkthr") pod "00b93628-c39c-4304-a072-ae9bd5ad3592" (UID: "00b93628-c39c-4304-a072-ae9bd5ad3592"). InnerVolumeSpecName "kube-api-access-dkthr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 21:59:45.913952 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:45.913816    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00b93628-c39c-4304-a072-ae9bd5ad3592-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "00b93628-c39c-4304-a072-ae9bd5ad3592" (UID: "00b93628-c39c-4304-a072-ae9bd5ad3592"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 21:59:45.913952 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:45.913925    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00b93628-c39c-4304-a072-ae9bd5ad3592-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "00b93628-c39c-4304-a072-ae9bd5ad3592" (UID: "00b93628-c39c-4304-a072-ae9bd5ad3592"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 21:59:45.913952 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:45.913928    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00b93628-c39c-4304-a072-ae9bd5ad3592-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "00b93628-c39c-4304-a072-ae9bd5ad3592" (UID: "00b93628-c39c-4304-a072-ae9bd5ad3592"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 21:59:45.914181 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:45.914161    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00b93628-c39c-4304-a072-ae9bd5ad3592-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "00b93628-c39c-4304-a072-ae9bd5ad3592" (UID: "00b93628-c39c-4304-a072-ae9bd5ad3592"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 21:59:45.919957 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:45.919932    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00b93628-c39c-4304-a072-ae9bd5ad3592-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "00b93628-c39c-4304-a072-ae9bd5ad3592" (UID: "00b93628-c39c-4304-a072-ae9bd5ad3592"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 21:59:46.012451 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:46.012416    2560 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/00b93628-c39c-4304-a072-ae9bd5ad3592-bound-sa-token\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\""
Sep 17 21:59:46.012451 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:46.012448    2560 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/00b93628-c39c-4304-a072-ae9bd5ad3592-installation-pull-secrets\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\""
Sep 17 21:59:46.012451 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:46.012458    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dkthr\" (UniqueName: \"kubernetes.io/projected/00b93628-c39c-4304-a072-ae9bd5ad3592-kube-api-access-dkthr\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\""
Sep 17 21:59:46.012648 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:46.012468    2560 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/00b93628-c39c-4304-a072-ae9bd5ad3592-image-registry-private-configuration\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\""
Sep 17 21:59:46.012648 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:46.012477    2560 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/00b93628-c39c-4304-a072-ae9bd5ad3592-registry-certificates\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\""
Sep 17 21:59:46.012648 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:46.012485    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/00b93628-c39c-4304-a072-ae9bd5ad3592-trusted-ca\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\""
Sep 17 21:59:46.012648 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:46.012494    2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/00b93628-c39c-4304-a072-ae9bd5ad3592-registry-tls\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\""
Sep 17 21:59:46.012648 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:46.012503    2560 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/00b93628-c39c-4304-a072-ae9bd5ad3592-ca-trust-extracted\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\""
Sep 17 21:59:46.070659 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:46.070627    2560 generic.go:356] "Generic (PLEG): container finished" podID="00b93628-c39c-4304-a072-ae9bd5ad3592" containerID="ac64b86a8fd5d9d8f4e5c40feed44e21f7728407d0f0f6bc282fa64a861c8150" exitCode=0
Sep 17 21:59:46.071010 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:46.070674    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d87985496-lns5f"
Sep 17 21:59:46.071010 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:46.070712    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d87985496-lns5f" event={"ID":"00b93628-c39c-4304-a072-ae9bd5ad3592","Type":"ContainerDied","Data":"ac64b86a8fd5d9d8f4e5c40feed44e21f7728407d0f0f6bc282fa64a861c8150"}
Sep 17 21:59:46.071010 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:46.070770    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d87985496-lns5f" event={"ID":"00b93628-c39c-4304-a072-ae9bd5ad3592","Type":"ContainerDied","Data":"8b9b99adff430068430253e1bfb120c3c9b757323f0754bb17a8d8f967e5eed3"}
Sep 17 21:59:46.071010 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:46.070798    2560 scope.go:117] "RemoveContainer" containerID="ac64b86a8fd5d9d8f4e5c40feed44e21f7728407d0f0f6bc282fa64a861c8150"
Sep 17 21:59:46.079242 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:46.079220    2560 scope.go:117] "RemoveContainer" containerID="ac64b86a8fd5d9d8f4e5c40feed44e21f7728407d0f0f6bc282fa64a861c8150"
Sep 17 21:59:46.079545 ip-10-0-136-66 kubenswrapper[2560]: E0917 21:59:46.079525    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac64b86a8fd5d9d8f4e5c40feed44e21f7728407d0f0f6bc282fa64a861c8150\": container with ID starting with ac64b86a8fd5d9d8f4e5c40feed44e21f7728407d0f0f6bc282fa64a861c8150 not found: ID does not exist" containerID="ac64b86a8fd5d9d8f4e5c40feed44e21f7728407d0f0f6bc282fa64a861c8150"
Sep 17 21:59:46.079607 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:46.079553    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac64b86a8fd5d9d8f4e5c40feed44e21f7728407d0f0f6bc282fa64a861c8150"} err="failed to get container status \"ac64b86a8fd5d9d8f4e5c40feed44e21f7728407d0f0f6bc282fa64a861c8150\": rpc error: code = NotFound desc = could not find container \"ac64b86a8fd5d9d8f4e5c40feed44e21f7728407d0f0f6bc282fa64a861c8150\": container with ID starting with ac64b86a8fd5d9d8f4e5c40feed44e21f7728407d0f0f6bc282fa64a861c8150 not found: ID does not exist"
Sep 17 21:59:46.091068 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:46.091038    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6d87985496-lns5f"]
Sep 17 21:59:46.094695 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:46.094671    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6d87985496-lns5f"]
Sep 17 21:59:46.450564 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:46.450523    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00b93628-c39c-4304-a072-ae9bd5ad3592" path="/var/lib/kubelet/pods/00b93628-c39c-4304-a072-ae9bd5ad3592/volumes"
Sep 17 21:59:53.097346 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:53.097309    2560 generic.go:356] "Generic (PLEG): container finished" podID="74040bed-ca22-4af1-a397-223d527bceb7" containerID="876255e2a4abda2b97c3f5e14b10956c67af264c6b03ada6408c7a3f417485ec" exitCode=0
Sep 17 21:59:53.097752 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:53.097382    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-6qz86" event={"ID":"74040bed-ca22-4af1-a397-223d527bceb7","Type":"ContainerDied","Data":"876255e2a4abda2b97c3f5e14b10956c67af264c6b03ada6408c7a3f417485ec"}
Sep 17 21:59:53.097752 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:53.097707    2560 scope.go:117] "RemoveContainer" containerID="876255e2a4abda2b97c3f5e14b10956c67af264c6b03ada6408c7a3f417485ec"
Sep 17 21:59:54.102716 ip-10-0-136-66 kubenswrapper[2560]: I0917 21:59:54.102685    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-6qz86" event={"ID":"74040bed-ca22-4af1-a397-223d527bceb7","Type":"ContainerStarted","Data":"17a56ea3dfc7ced979da19fda78efc4934444bf12cd95e8306ad527705ab7c28"}
Sep 17 22:00:03.137398 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:00:03.137336    2560 generic.go:356] "Generic (PLEG): container finished" podID="c2767d1f-5347-4d4e-8f72-c29ac89b09ef" containerID="200037c3e71b3479308d83514e44b74b8bd3f981c223651fa196212847787f63" exitCode=0
Sep 17 22:00:03.137787 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:00:03.137408    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-j9ctg" event={"ID":"c2767d1f-5347-4d4e-8f72-c29ac89b09ef","Type":"ContainerDied","Data":"200037c3e71b3479308d83514e44b74b8bd3f981c223651fa196212847787f63"}
Sep 17 22:00:03.137787 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:00:03.137724    2560 scope.go:117] "RemoveContainer" containerID="200037c3e71b3479308d83514e44b74b8bd3f981c223651fa196212847787f63"
Sep 17 22:00:04.143818 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:00:04.143783    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-j9ctg" event={"ID":"c2767d1f-5347-4d4e-8f72-c29ac89b09ef","Type":"ContainerStarted","Data":"52213bb9264c4f05665ae165d0a9b4e21e55ddf649a1cd7e04df119a2c149340"}
Sep 17 22:00:41.119102 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:00:41.119000    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-f88797c9-sc8js"]
Sep 17 22:00:41.119585 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:00:41.119340    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00b93628-c39c-4304-a072-ae9bd5ad3592" containerName="registry"
Sep 17 22:00:41.119585 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:00:41.119371    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="00b93628-c39c-4304-a072-ae9bd5ad3592" containerName="registry"
Sep 17 22:00:41.119585 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:00:41.119441    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="00b93628-c39c-4304-a072-ae9bd5ad3592" containerName="registry"
Sep 17 22:00:41.122433 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:00:41.122416    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-f88797c9-sc8js"
Sep 17 22:00:41.124938 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:00:41.124914    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 17 22:00:41.125089 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:00:41.124961    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 17 22:00:41.125089 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:00:41.125029    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 17 22:00:41.125089 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:00:41.124915    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 17 22:00:41.125266 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:00:41.125192    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-vc8zs\""
Sep 17 22:00:41.125441 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:00:41.125423    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 17 22:00:41.130391 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:00:41.130370    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 17 22:00:41.132697 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:00:41.132676    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-f88797c9-sc8js"]
Sep 17 22:00:41.229577 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:00:41.229537    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/390b6528-d7c4-4381-9c0f-d3ff1d4e75da-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-f88797c9-sc8js\" (UID: \"390b6528-d7c4-4381-9c0f-d3ff1d4e75da\") " pod="openshift-monitoring/telemeter-client-f88797c9-sc8js"
Sep 17 22:00:41.229577 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:00:41.229582    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/390b6528-d7c4-4381-9c0f-d3ff1d4e75da-metrics-client-ca\") pod \"telemeter-client-f88797c9-sc8js\" (UID: \"390b6528-d7c4-4381-9c0f-d3ff1d4e75da\") " pod="openshift-monitoring/telemeter-client-f88797c9-sc8js"
Sep 17 22:00:41.229852 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:00:41.229605    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/390b6528-d7c4-4381-9c0f-d3ff1d4e75da-federate-client-tls\") pod \"telemeter-client-f88797c9-sc8js\" (UID: \"390b6528-d7c4-4381-9c0f-d3ff1d4e75da\") " pod="openshift-monitoring/telemeter-client-f88797c9-sc8js"
Sep 17 22:00:41.229852 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:00:41.229665    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/390b6528-d7c4-4381-9c0f-d3ff1d4e75da-telemeter-client-tls\") pod \"telemeter-client-f88797c9-sc8js\" (UID: \"390b6528-d7c4-4381-9c0f-d3ff1d4e75da\") " pod="openshift-monitoring/telemeter-client-f88797c9-sc8js"
Sep 17 22:00:41.229852 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:00:41.229687    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/390b6528-d7c4-4381-9c0f-d3ff1d4e75da-serving-certs-ca-bundle\") pod \"telemeter-client-f88797c9-sc8js\" (UID: \"390b6528-d7c4-4381-9c0f-d3ff1d4e75da\") " pod="openshift-monitoring/telemeter-client-f88797c9-sc8js"
Sep 17 22:00:41.229852 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:00:41.229783    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98mnz\" (UniqueName: \"kubernetes.io/projected/390b6528-d7c4-4381-9c0f-d3ff1d4e75da-kube-api-access-98mnz\") pod \"telemeter-client-f88797c9-sc8js\" (UID: \"390b6528-d7c4-4381-9c0f-d3ff1d4e75da\") " pod="openshift-monitoring/telemeter-client-f88797c9-sc8js"
Sep 17 22:00:41.229852 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:00:41.229830    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/390b6528-d7c4-4381-9c0f-d3ff1d4e75da-telemeter-trusted-ca-bundle\") pod \"telemeter-client-f88797c9-sc8js\" (UID: \"390b6528-d7c4-4381-9c0f-d3ff1d4e75da\") " pod="openshift-monitoring/telemeter-client-f88797c9-sc8js"
Sep 17 22:00:41.230045 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:00:41.229875    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/390b6528-d7c4-4381-9c0f-d3ff1d4e75da-secret-telemeter-client\") pod \"telemeter-client-f88797c9-sc8js\" (UID: \"390b6528-d7c4-4381-9c0f-d3ff1d4e75da\") " pod="openshift-monitoring/telemeter-client-f88797c9-sc8js"
Sep 17 22:00:41.330393 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:00:41.330332    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/390b6528-d7c4-4381-9c0f-d3ff1d4e75da-secret-telemeter-client\") pod \"telemeter-client-f88797c9-sc8js\" (UID: \"390b6528-d7c4-4381-9c0f-d3ff1d4e75da\") " pod="openshift-monitoring/telemeter-client-f88797c9-sc8js"
Sep 17 22:00:41.330606 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:00:41.330418    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/390b6528-d7c4-4381-9c0f-d3ff1d4e75da-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-f88797c9-sc8js\" (UID: \"390b6528-d7c4-4381-9c0f-d3ff1d4e75da\") " pod="openshift-monitoring/telemeter-client-f88797c9-sc8js"
Sep 17 22:00:41.330606 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:00:41.330440    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/390b6528-d7c4-4381-9c0f-d3ff1d4e75da-metrics-client-ca\") pod \"telemeter-client-f88797c9-sc8js\" (UID: \"390b6528-d7c4-4381-9c0f-d3ff1d4e75da\") " pod="openshift-monitoring/telemeter-client-f88797c9-sc8js"
Sep 17 22:00:41.330606 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:00:41.330461    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/390b6528-d7c4-4381-9c0f-d3ff1d4e75da-federate-client-tls\") pod \"telemeter-client-f88797c9-sc8js\" (UID: \"390b6528-d7c4-4381-9c0f-d3ff1d4e75da\") " pod="openshift-monitoring/telemeter-client-f88797c9-sc8js"
Sep 17 22:00:41.330606 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:00:41.330482    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/390b6528-d7c4-4381-9c0f-d3ff1d4e75da-telemeter-client-tls\") pod \"telemeter-client-f88797c9-sc8js\" (UID: \"390b6528-d7c4-4381-9c0f-d3ff1d4e75da\") " pod="openshift-monitoring/telemeter-client-f88797c9-sc8js"
Sep 17 22:00:41.330606 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:00:41.330502    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/390b6528-d7c4-4381-9c0f-d3ff1d4e75da-serving-certs-ca-bundle\") pod \"telemeter-client-f88797c9-sc8js\" (UID: \"390b6528-d7c4-4381-9c0f-d3ff1d4e75da\") " pod="openshift-monitoring/telemeter-client-f88797c9-sc8js"
Sep 17 22:00:41.330606 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:00:41.330539    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98mnz\" (UniqueName: \"kubernetes.io/projected/390b6528-d7c4-4381-9c0f-d3ff1d4e75da-kube-api-access-98mnz\") pod \"telemeter-client-f88797c9-sc8js\" (UID: \"390b6528-d7c4-4381-9c0f-d3ff1d4e75da\") " pod="openshift-monitoring/telemeter-client-f88797c9-sc8js"
Sep 17 22:00:41.330606 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:00:41.330566    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/390b6528-d7c4-4381-9c0f-d3ff1d4e75da-telemeter-trusted-ca-bundle\") pod \"telemeter-client-f88797c9-sc8js\" (UID: \"390b6528-d7c4-4381-9c0f-d3ff1d4e75da\") " pod="openshift-monitoring/telemeter-client-f88797c9-sc8js"
Sep 17 22:00:41.331475 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:00:41.331445    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/390b6528-d7c4-4381-9c0f-d3ff1d4e75da-serving-certs-ca-bundle\") pod \"telemeter-client-f88797c9-sc8js\" (UID: \"390b6528-d7c4-4381-9c0f-d3ff1d4e75da\") " pod="openshift-monitoring/telemeter-client-f88797c9-sc8js"
Sep 17 22:00:41.331615 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:00:41.331450    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/390b6528-d7c4-4381-9c0f-d3ff1d4e75da-metrics-client-ca\") pod \"telemeter-client-f88797c9-sc8js\" (UID: \"390b6528-d7c4-4381-9c0f-d3ff1d4e75da\") " pod="openshift-monitoring/telemeter-client-f88797c9-sc8js"
Sep 17 22:00:41.331680 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:00:41.331658    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/390b6528-d7c4-4381-9c0f-d3ff1d4e75da-telemeter-trusted-ca-bundle\") pod \"telemeter-client-f88797c9-sc8js\" (UID: \"390b6528-d7c4-4381-9c0f-d3ff1d4e75da\") " pod="openshift-monitoring/telemeter-client-f88797c9-sc8js"
Sep 17 22:00:41.333164 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:00:41.333140    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/390b6528-d7c4-4381-9c0f-d3ff1d4e75da-telemeter-client-tls\") pod \"telemeter-client-f88797c9-sc8js\" (UID: \"390b6528-d7c4-4381-9c0f-d3ff1d4e75da\") " pod="openshift-monitoring/telemeter-client-f88797c9-sc8js"
Sep 17 22:00:41.333266 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:00:41.333218    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/390b6528-d7c4-4381-9c0f-d3ff1d4e75da-federate-client-tls\") pod \"telemeter-client-f88797c9-sc8js\" (UID: \"390b6528-d7c4-4381-9c0f-d3ff1d4e75da\") " pod="openshift-monitoring/telemeter-client-f88797c9-sc8js"
Sep 17 22:00:41.333575 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:00:41.333552    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/390b6528-d7c4-4381-9c0f-d3ff1d4e75da-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-f88797c9-sc8js\" (UID: \"390b6528-d7c4-4381-9c0f-d3ff1d4e75da\") " pod="openshift-monitoring/telemeter-client-f88797c9-sc8js"
Sep 17 22:00:41.333630 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:00:41.333589    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/390b6528-d7c4-4381-9c0f-d3ff1d4e75da-secret-telemeter-client\") pod \"telemeter-client-f88797c9-sc8js\" (UID: \"390b6528-d7c4-4381-9c0f-d3ff1d4e75da\") " pod="openshift-monitoring/telemeter-client-f88797c9-sc8js"
Sep 17 22:00:41.339019 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:00:41.338998    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98mnz\" (UniqueName: \"kubernetes.io/projected/390b6528-d7c4-4381-9c0f-d3ff1d4e75da-kube-api-access-98mnz\") pod \"telemeter-client-f88797c9-sc8js\" (UID: \"390b6528-d7c4-4381-9c0f-d3ff1d4e75da\") " pod="openshift-monitoring/telemeter-client-f88797c9-sc8js"
Sep 17 22:00:41.433134 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:00:41.433044    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-f88797c9-sc8js"
Sep 17 22:00:41.712393 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:00:41.712346    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-f88797c9-sc8js"]
Sep 17 22:00:41.714168 ip-10-0-136-66 kubenswrapper[2560]: W0917 22:00:41.714140    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod390b6528_d7c4_4381_9c0f_d3ff1d4e75da.slice/crio-07d9e9e3d8ba53aee3d6ca3d884f011acfe3971fea69944d96c413f32ef92761 WatchSource:0}: Error finding container 07d9e9e3d8ba53aee3d6ca3d884f011acfe3971fea69944d96c413f32ef92761: Status 404 returned error can't find the container with id 07d9e9e3d8ba53aee3d6ca3d884f011acfe3971fea69944d96c413f32ef92761
Sep 17 22:00:42.282981 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:00:42.282944    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-f88797c9-sc8js" event={"ID":"390b6528-d7c4-4381-9c0f-d3ff1d4e75da","Type":"ContainerStarted","Data":"07d9e9e3d8ba53aee3d6ca3d884f011acfe3971fea69944d96c413f32ef92761"}
Sep 17 22:00:44.292687 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:00:44.292599    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-f88797c9-sc8js" event={"ID":"390b6528-d7c4-4381-9c0f-d3ff1d4e75da","Type":"ContainerStarted","Data":"44b2c395f18c1e0acb59f4e33c00c54b34f5e0b8063f21202e41c087742a052f"}
Sep 17 22:00:45.298526 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:00:45.298488    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-f88797c9-sc8js" event={"ID":"390b6528-d7c4-4381-9c0f-d3ff1d4e75da","Type":"ContainerStarted","Data":"d47dced0cfb25ef3edb9ec54e7cbe1fdf3a7335d010cb070a364b417d83de02e"}
Sep 17 22:00:45.298908 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:00:45.298543    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-f88797c9-sc8js" event={"ID":"390b6528-d7c4-4381-9c0f-d3ff1d4e75da","Type":"ContainerStarted","Data":"b6863bd2d1d348f378ccb3f94711a78655d9ec49328f3b3e9f4dfcba3ea11425"}
Sep 17 22:00:45.321654 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:00:45.321597    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-f88797c9-sc8js" podStartSLOduration=0.990917344 podStartE2EDuration="4.321578475s" totalImagesPullingTime="3.330661131s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:00:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:00:45.320938397 +0000 UTC m=+177.380710407" watchObservedRunningTime="2026-09-17 22:00:45.321578475 +0000 UTC m=+177.381350486"
Sep 17 22:01:40.042867 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:01:40.042827    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-69b4dd798-z6qff"]
Sep 17 22:01:40.047292 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:01:40.047272    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69b4dd798-z6qff"
Sep 17 22:01:40.051011 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:01:40.050985    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 17 22:01:40.051152 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:01:40.050985    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 17 22:01:40.051152 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:01:40.050984    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 17 22:01:40.051152 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:01:40.051000    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 17 22:01:40.057752 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:01:40.057727    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-69b4dd798-z6qff"]
Sep 17 22:01:40.094241 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:01:40.093993    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6cc777e0-5f84-4c7a-b1ff-26708d64e82d-tmp\") pod \"klusterlet-addon-workmgr-69b4dd798-z6qff\" (UID: \"6cc777e0-5f84-4c7a-b1ff-26708d64e82d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69b4dd798-z6qff"
Sep 17 22:01:40.094241 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:01:40.094116    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/6cc777e0-5f84-4c7a-b1ff-26708d64e82d-klusterlet-config\") pod \"klusterlet-addon-workmgr-69b4dd798-z6qff\" (UID: \"6cc777e0-5f84-4c7a-b1ff-26708d64e82d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69b4dd798-z6qff"
Sep 17 22:01:40.094241 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:01:40.094165    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhqtk\" (UniqueName: \"kubernetes.io/projected/6cc777e0-5f84-4c7a-b1ff-26708d64e82d-kube-api-access-dhqtk\") pod \"klusterlet-addon-workmgr-69b4dd798-z6qff\" (UID: \"6cc777e0-5f84-4c7a-b1ff-26708d64e82d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69b4dd798-z6qff"
Sep 17 22:01:40.195264 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:01:40.195216    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6cc777e0-5f84-4c7a-b1ff-26708d64e82d-tmp\") pod \"klusterlet-addon-workmgr-69b4dd798-z6qff\" (UID: \"6cc777e0-5f84-4c7a-b1ff-26708d64e82d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69b4dd798-z6qff"
Sep 17 22:01:40.195459 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:01:40.195277    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/6cc777e0-5f84-4c7a-b1ff-26708d64e82d-klusterlet-config\") pod \"klusterlet-addon-workmgr-69b4dd798-z6qff\" (UID: \"6cc777e0-5f84-4c7a-b1ff-26708d64e82d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69b4dd798-z6qff"
Sep 17 22:01:40.195459 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:01:40.195295    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhqtk\" (UniqueName: \"kubernetes.io/projected/6cc777e0-5f84-4c7a-b1ff-26708d64e82d-kube-api-access-dhqtk\") pod \"klusterlet-addon-workmgr-69b4dd798-z6qff\" (UID: \"6cc777e0-5f84-4c7a-b1ff-26708d64e82d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69b4dd798-z6qff"
Sep 17 22:01:40.195749 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:01:40.195722    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6cc777e0-5f84-4c7a-b1ff-26708d64e82d-tmp\") pod \"klusterlet-addon-workmgr-69b4dd798-z6qff\" (UID: \"6cc777e0-5f84-4c7a-b1ff-26708d64e82d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69b4dd798-z6qff"
Sep 17 22:01:40.197838 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:01:40.197819    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/6cc777e0-5f84-4c7a-b1ff-26708d64e82d-klusterlet-config\") pod \"klusterlet-addon-workmgr-69b4dd798-z6qff\" (UID: \"6cc777e0-5f84-4c7a-b1ff-26708d64e82d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69b4dd798-z6qff"
Sep 17 22:01:40.203798 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:01:40.203774    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhqtk\" (UniqueName: \"kubernetes.io/projected/6cc777e0-5f84-4c7a-b1ff-26708d64e82d-kube-api-access-dhqtk\") pod \"klusterlet-addon-workmgr-69b4dd798-z6qff\" (UID: \"6cc777e0-5f84-4c7a-b1ff-26708d64e82d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69b4dd798-z6qff"
Sep 17 22:01:40.357326 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:01:40.357230    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69b4dd798-z6qff"
Sep 17 22:01:40.626862 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:01:40.626664    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-69b4dd798-z6qff"]
Sep 17 22:01:40.629542 ip-10-0-136-66 kubenswrapper[2560]: W0917 22:01:40.629509    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cc777e0_5f84_4c7a_b1ff_26708d64e82d.slice/crio-ac9dc44463c3d50063c3045ffcfbe9c3a76b8bb296c93654c36e0fbe15f7779a WatchSource:0}: Error finding container ac9dc44463c3d50063c3045ffcfbe9c3a76b8bb296c93654c36e0fbe15f7779a: Status 404 returned error can't find the container with id ac9dc44463c3d50063c3045ffcfbe9c3a76b8bb296c93654c36e0fbe15f7779a
Sep 17 22:01:41.508075 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:01:41.508037    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69b4dd798-z6qff" event={"ID":"6cc777e0-5f84-4c7a-b1ff-26708d64e82d","Type":"ContainerStarted","Data":"ac9dc44463c3d50063c3045ffcfbe9c3a76b8bb296c93654c36e0fbe15f7779a"}
Sep 17 22:01:45.527092 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:01:45.527040    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69b4dd798-z6qff" event={"ID":"6cc777e0-5f84-4c7a-b1ff-26708d64e82d","Type":"ContainerStarted","Data":"ac1ae16f70330e0530d30b01f2d59f9c44f04e7413e8d38320732a4bb01e506e"}
Sep 17 22:01:45.527581 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:01:45.527192    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69b4dd798-z6qff"
Sep 17 22:01:45.528994 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:01:45.528973    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69b4dd798-z6qff"
Sep 17 22:01:45.542216 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:01:45.542166    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69b4dd798-z6qff" podStartSLOduration=1.189414608 podStartE2EDuration="5.542150905s" totalImagesPullingTime="4.352736297s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:01:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:01:45.541866754 +0000 UTC m=+237.601638764" watchObservedRunningTime="2026-09-17 22:01:45.542150905 +0000 UTC m=+237.601922917"
Sep 17 22:02:48.358707 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:02:48.358679    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-xcr4j_d690701c-bcec-48f2-9978-b6aebbf77447/console-operator/1.log"
Sep 17 22:02:48.361879 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:02:48.361858    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-xcr4j_d690701c-bcec-48f2-9978-b6aebbf77447/console-operator/1.log"
Sep 17 22:02:48.370476 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:02:48.370451    2560 kubelet.go:1648] "Image garbage collection succeeded"
Sep 17 22:03:57.336818 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:03:57.336735    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-79b679679b-xcbnv"]
Sep 17 22:03:57.339088 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:03:57.339064    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-79b679679b-xcbnv"
Sep 17 22:03:57.343024 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:03:57.343002    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-dkwhk\""
Sep 17 22:03:57.343163 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:03:57.343035    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Sep 17 22:03:57.343163 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:03:57.342997    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\""
Sep 17 22:03:57.343163 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:03:57.343082    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Sep 17 22:03:57.344321 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:03:57.344301    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-645f9c8fd6-z7jp4"]
Sep 17 22:03:57.346642 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:03:57.346626    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-645f9c8fd6-z7jp4"
Sep 17 22:03:57.349164 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:03:57.349102    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\""
Sep 17 22:03:57.349691 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:03:57.349671    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-2f9tw\""
Sep 17 22:03:57.349948 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:03:57.349924    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-79b679679b-xcbnv"]
Sep 17 22:03:57.357131 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:03:57.357110    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-645f9c8fd6-z7jp4"]
Sep 17 22:03:57.454827 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:03:57.454785    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jg2f\" (UniqueName: \"kubernetes.io/projected/eb9f1ca5-98b7-4c22-90fa-bf43f2180796-kube-api-access-8jg2f\") pod \"kserve-controller-manager-79b679679b-xcbnv\" (UID: \"eb9f1ca5-98b7-4c22-90fa-bf43f2180796\") " pod="kserve/kserve-controller-manager-79b679679b-xcbnv"
Sep 17 22:03:57.454827 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:03:57.454825    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxr4s\" (UniqueName: \"kubernetes.io/projected/e310cd03-3d77-4e42-a0f6-c359f558ac91-kube-api-access-hxr4s\") pod \"llmisvc-controller-manager-645f9c8fd6-z7jp4\" (UID: \"e310cd03-3d77-4e42-a0f6-c359f558ac91\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-z7jp4"
Sep 17 22:03:57.455028 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:03:57.454855    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e310cd03-3d77-4e42-a0f6-c359f558ac91-cert\") pod \"llmisvc-controller-manager-645f9c8fd6-z7jp4\" (UID: \"e310cd03-3d77-4e42-a0f6-c359f558ac91\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-z7jp4"
Sep 17 22:03:57.455028 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:03:57.454957    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb9f1ca5-98b7-4c22-90fa-bf43f2180796-cert\") pod \"kserve-controller-manager-79b679679b-xcbnv\" (UID: \"eb9f1ca5-98b7-4c22-90fa-bf43f2180796\") " pod="kserve/kserve-controller-manager-79b679679b-xcbnv"
Sep 17 22:03:57.556060 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:03:57.556019    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb9f1ca5-98b7-4c22-90fa-bf43f2180796-cert\") pod \"kserve-controller-manager-79b679679b-xcbnv\" (UID: \"eb9f1ca5-98b7-4c22-90fa-bf43f2180796\") " pod="kserve/kserve-controller-manager-79b679679b-xcbnv"
Sep 17 22:03:57.556248 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:03:57.556082    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jg2f\" (UniqueName: \"kubernetes.io/projected/eb9f1ca5-98b7-4c22-90fa-bf43f2180796-kube-api-access-8jg2f\") pod \"kserve-controller-manager-79b679679b-xcbnv\" (UID: \"eb9f1ca5-98b7-4c22-90fa-bf43f2180796\") " pod="kserve/kserve-controller-manager-79b679679b-xcbnv"
Sep 17 22:03:57.556248 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:03:57.556102    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxr4s\" (UniqueName: \"kubernetes.io/projected/e310cd03-3d77-4e42-a0f6-c359f558ac91-kube-api-access-hxr4s\") pod \"llmisvc-controller-manager-645f9c8fd6-z7jp4\" (UID: \"e310cd03-3d77-4e42-a0f6-c359f558ac91\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-z7jp4"
Sep 17 22:03:57.556248 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:03:57.556135    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e310cd03-3d77-4e42-a0f6-c359f558ac91-cert\") pod \"llmisvc-controller-manager-645f9c8fd6-z7jp4\" (UID: \"e310cd03-3d77-4e42-a0f6-c359f558ac91\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-z7jp4"
Sep 17 22:03:57.556248 ip-10-0-136-66 kubenswrapper[2560]: E0917 22:03:57.556193    2560 secret.go:189] Couldn't get secret kserve/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Sep 17 22:03:57.556482 ip-10-0-136-66 kubenswrapper[2560]: E0917 22:03:57.556288    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb9f1ca5-98b7-4c22-90fa-bf43f2180796-cert podName:eb9f1ca5-98b7-4c22-90fa-bf43f2180796 nodeName:}" failed. No retries permitted until 2026-09-17 22:03:58.056263682 +0000 UTC m=+370.116035685 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/eb9f1ca5-98b7-4c22-90fa-bf43f2180796-cert") pod "kserve-controller-manager-79b679679b-xcbnv" (UID: "eb9f1ca5-98b7-4c22-90fa-bf43f2180796") : secret "kserve-webhook-server-cert" not found
Sep 17 22:03:57.558571 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:03:57.558546    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e310cd03-3d77-4e42-a0f6-c359f558ac91-cert\") pod \"llmisvc-controller-manager-645f9c8fd6-z7jp4\" (UID: \"e310cd03-3d77-4e42-a0f6-c359f558ac91\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-z7jp4"
Sep 17 22:03:57.564852 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:03:57.564832    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jg2f\" (UniqueName: \"kubernetes.io/projected/eb9f1ca5-98b7-4c22-90fa-bf43f2180796-kube-api-access-8jg2f\") pod \"kserve-controller-manager-79b679679b-xcbnv\" (UID: \"eb9f1ca5-98b7-4c22-90fa-bf43f2180796\") " pod="kserve/kserve-controller-manager-79b679679b-xcbnv"
Sep 17 22:03:57.564943 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:03:57.564856    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxr4s\" (UniqueName: \"kubernetes.io/projected/e310cd03-3d77-4e42-a0f6-c359f558ac91-kube-api-access-hxr4s\") pod \"llmisvc-controller-manager-645f9c8fd6-z7jp4\" (UID: \"e310cd03-3d77-4e42-a0f6-c359f558ac91\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-z7jp4"
Sep 17 22:03:57.659039 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:03:57.658948    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-645f9c8fd6-z7jp4"
Sep 17 22:03:57.938832 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:03:57.938746    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-645f9c8fd6-z7jp4"]
Sep 17 22:03:57.942265 ip-10-0-136-66 kubenswrapper[2560]: W0917 22:03:57.942236    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode310cd03_3d77_4e42_a0f6_c359f558ac91.slice/crio-09f5412f6f4fb2dc54bf96fc86134a531c7d12830cdf02b516afdac5e27ab7ab WatchSource:0}: Error finding container 09f5412f6f4fb2dc54bf96fc86134a531c7d12830cdf02b516afdac5e27ab7ab: Status 404 returned error can't find the container with id 09f5412f6f4fb2dc54bf96fc86134a531c7d12830cdf02b516afdac5e27ab7ab
Sep 17 22:03:57.943697 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:03:57.943679    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 22:03:58.023359 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:03:58.023312    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-645f9c8fd6-z7jp4" event={"ID":"e310cd03-3d77-4e42-a0f6-c359f558ac91","Type":"ContainerStarted","Data":"09f5412f6f4fb2dc54bf96fc86134a531c7d12830cdf02b516afdac5e27ab7ab"}
Sep 17 22:03:58.059755 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:03:58.059715    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb9f1ca5-98b7-4c22-90fa-bf43f2180796-cert\") pod \"kserve-controller-manager-79b679679b-xcbnv\" (UID: \"eb9f1ca5-98b7-4c22-90fa-bf43f2180796\") " pod="kserve/kserve-controller-manager-79b679679b-xcbnv"
Sep 17 22:03:58.062094 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:03:58.062076    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb9f1ca5-98b7-4c22-90fa-bf43f2180796-cert\") pod \"kserve-controller-manager-79b679679b-xcbnv\" (UID: \"eb9f1ca5-98b7-4c22-90fa-bf43f2180796\") " pod="kserve/kserve-controller-manager-79b679679b-xcbnv"
Sep 17 22:03:58.249544 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:03:58.249506    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-79b679679b-xcbnv"
Sep 17 22:03:58.517991 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:03:58.517964    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-79b679679b-xcbnv"]
Sep 17 22:03:58.520213 ip-10-0-136-66 kubenswrapper[2560]: W0917 22:03:58.520187    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb9f1ca5_98b7_4c22_90fa_bf43f2180796.slice/crio-60e9024901a0b44d1811d66cb56c9239d3b65722a11077b326f50913552970b6 WatchSource:0}: Error finding container 60e9024901a0b44d1811d66cb56c9239d3b65722a11077b326f50913552970b6: Status 404 returned error can't find the container with id 60e9024901a0b44d1811d66cb56c9239d3b65722a11077b326f50913552970b6
Sep 17 22:03:59.029282 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:03:59.029237    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-79b679679b-xcbnv" event={"ID":"eb9f1ca5-98b7-4c22-90fa-bf43f2180796","Type":"ContainerStarted","Data":"60e9024901a0b44d1811d66cb56c9239d3b65722a11077b326f50913552970b6"}
Sep 17 22:04:02.046459 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:04:02.046422    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-645f9c8fd6-z7jp4" event={"ID":"e310cd03-3d77-4e42-a0f6-c359f558ac91","Type":"ContainerStarted","Data":"06fb0dc2e7469813ec9d7fdcc8c66589617990e0427a409e9ebd18845c690e23"}
Sep 17 22:04:02.046945 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:04:02.046499    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-645f9c8fd6-z7jp4"
Sep 17 22:04:02.048552 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:04:02.048522    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-79b679679b-xcbnv" event={"ID":"eb9f1ca5-98b7-4c22-90fa-bf43f2180796","Type":"ContainerStarted","Data":"dd4a7124e26252ae5832aed82d62653d2b9b9949e70107d71f387f0cb8db3c6e"}
Sep 17 22:04:02.048688 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:04:02.048654    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-79b679679b-xcbnv"
Sep 17 22:04:02.064410 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:04:02.064342    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-645f9c8fd6-z7jp4" podStartSLOduration=1.310076811 podStartE2EDuration="5.064323951s" totalImagesPullingTime="3.75424714s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:03:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:04:02.06288418 +0000 UTC m=+374.122656191" watchObservedRunningTime="2026-09-17 22:04:02.064323951 +0000 UTC m=+374.124095961"
Sep 17 22:04:02.079658 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:04:02.079607    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-79b679679b-xcbnv" podStartSLOduration=1.901887947 podStartE2EDuration="5.07958846s" totalImagesPullingTime="3.177700513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:03:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:04:02.078547686 +0000 UTC m=+374.138319694" watchObservedRunningTime="2026-09-17 22:04:02.07958846 +0000 UTC m=+374.139360472"
Sep 17 22:04:33.054800 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:04:33.054766    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-645f9c8fd6-z7jp4"
Sep 17 22:04:33.057579 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:04:33.057559    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-79b679679b-xcbnv"
Sep 17 22:04:39.736119 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:04:39.736073    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-79b679679b-xcbnv"]
Sep 17 22:04:39.736637 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:04:39.736416    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve/kserve-controller-manager-79b679679b-xcbnv" podUID="eb9f1ca5-98b7-4c22-90fa-bf43f2180796" containerName="manager" containerID="cri-o://dd4a7124e26252ae5832aed82d62653d2b9b9949e70107d71f387f0cb8db3c6e" gracePeriod=10
Sep 17 22:04:39.760534 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:04:39.760504    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-79b679679b-bkdhf"]
Sep 17 22:04:39.762740 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:04:39.762723    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-79b679679b-bkdhf"
Sep 17 22:04:39.773590 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:04:39.773559    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-79b679679b-bkdhf"]
Sep 17 22:04:39.884536 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:04:39.884501    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ntjc\" (UniqueName: \"kubernetes.io/projected/cf4e775b-bb8d-44a5-9010-24958cf2f264-kube-api-access-8ntjc\") pod \"kserve-controller-manager-79b679679b-bkdhf\" (UID: \"cf4e775b-bb8d-44a5-9010-24958cf2f264\") " pod="kserve/kserve-controller-manager-79b679679b-bkdhf"
Sep 17 22:04:39.884706 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:04:39.884570    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cf4e775b-bb8d-44a5-9010-24958cf2f264-cert\") pod \"kserve-controller-manager-79b679679b-bkdhf\" (UID: \"cf4e775b-bb8d-44a5-9010-24958cf2f264\") " pod="kserve/kserve-controller-manager-79b679679b-bkdhf"
Sep 17 22:04:39.970104 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:04:39.970078    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-79b679679b-xcbnv"
Sep 17 22:04:39.985412 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:04:39.985377    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cf4e775b-bb8d-44a5-9010-24958cf2f264-cert\") pod \"kserve-controller-manager-79b679679b-bkdhf\" (UID: \"cf4e775b-bb8d-44a5-9010-24958cf2f264\") " pod="kserve/kserve-controller-manager-79b679679b-bkdhf"
Sep 17 22:04:39.985568 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:04:39.985463    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ntjc\" (UniqueName: \"kubernetes.io/projected/cf4e775b-bb8d-44a5-9010-24958cf2f264-kube-api-access-8ntjc\") pod \"kserve-controller-manager-79b679679b-bkdhf\" (UID: \"cf4e775b-bb8d-44a5-9010-24958cf2f264\") " pod="kserve/kserve-controller-manager-79b679679b-bkdhf"
Sep 17 22:04:39.988189 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:04:39.988127    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cf4e775b-bb8d-44a5-9010-24958cf2f264-cert\") pod \"kserve-controller-manager-79b679679b-bkdhf\" (UID: \"cf4e775b-bb8d-44a5-9010-24958cf2f264\") " pod="kserve/kserve-controller-manager-79b679679b-bkdhf"
Sep 17 22:04:39.996438 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:04:39.996410    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ntjc\" (UniqueName: \"kubernetes.io/projected/cf4e775b-bb8d-44a5-9010-24958cf2f264-kube-api-access-8ntjc\") pod \"kserve-controller-manager-79b679679b-bkdhf\" (UID: \"cf4e775b-bb8d-44a5-9010-24958cf2f264\") " pod="kserve/kserve-controller-manager-79b679679b-bkdhf"
Sep 17 22:04:40.086139 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:04:40.086101    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8jg2f\" (UniqueName: \"kubernetes.io/projected/eb9f1ca5-98b7-4c22-90fa-bf43f2180796-kube-api-access-8jg2f\") pod \"eb9f1ca5-98b7-4c22-90fa-bf43f2180796\" (UID: \"eb9f1ca5-98b7-4c22-90fa-bf43f2180796\") "
Sep 17 22:04:40.086312 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:04:40.086167    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb9f1ca5-98b7-4c22-90fa-bf43f2180796-cert\") pod \"eb9f1ca5-98b7-4c22-90fa-bf43f2180796\" (UID: \"eb9f1ca5-98b7-4c22-90fa-bf43f2180796\") "
Sep 17 22:04:40.088378 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:04:40.088320    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb9f1ca5-98b7-4c22-90fa-bf43f2180796-cert" (OuterVolumeSpecName: "cert") pod "eb9f1ca5-98b7-4c22-90fa-bf43f2180796" (UID: "eb9f1ca5-98b7-4c22-90fa-bf43f2180796"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 22:04:40.088378 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:04:40.088334    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb9f1ca5-98b7-4c22-90fa-bf43f2180796-kube-api-access-8jg2f" (OuterVolumeSpecName: "kube-api-access-8jg2f") pod "eb9f1ca5-98b7-4c22-90fa-bf43f2180796" (UID: "eb9f1ca5-98b7-4c22-90fa-bf43f2180796"). InnerVolumeSpecName "kube-api-access-8jg2f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 22:04:40.114501 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:04:40.114466    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-79b679679b-bkdhf"
Sep 17 22:04:40.187011 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:04:40.186978    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8jg2f\" (UniqueName: \"kubernetes.io/projected/eb9f1ca5-98b7-4c22-90fa-bf43f2180796-kube-api-access-8jg2f\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\""
Sep 17 22:04:40.187011 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:04:40.187007    2560 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb9f1ca5-98b7-4c22-90fa-bf43f2180796-cert\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\""
Sep 17 22:04:40.200124 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:04:40.200094    2560 generic.go:356] "Generic (PLEG): container finished" podID="eb9f1ca5-98b7-4c22-90fa-bf43f2180796" containerID="dd4a7124e26252ae5832aed82d62653d2b9b9949e70107d71f387f0cb8db3c6e" exitCode=0
Sep 17 22:04:40.200306 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:04:40.200149    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-79b679679b-xcbnv"
Sep 17 22:04:40.200306 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:04:40.200184    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-79b679679b-xcbnv" event={"ID":"eb9f1ca5-98b7-4c22-90fa-bf43f2180796","Type":"ContainerDied","Data":"dd4a7124e26252ae5832aed82d62653d2b9b9949e70107d71f387f0cb8db3c6e"}
Sep 17 22:04:40.200306 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:04:40.200247    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-79b679679b-xcbnv" event={"ID":"eb9f1ca5-98b7-4c22-90fa-bf43f2180796","Type":"ContainerDied","Data":"60e9024901a0b44d1811d66cb56c9239d3b65722a11077b326f50913552970b6"}
Sep 17 22:04:40.200306 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:04:40.200279    2560 scope.go:117] "RemoveContainer" containerID="dd4a7124e26252ae5832aed82d62653d2b9b9949e70107d71f387f0cb8db3c6e"
Sep 17 22:04:40.208645 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:04:40.208629    2560 scope.go:117] "RemoveContainer" containerID="dd4a7124e26252ae5832aed82d62653d2b9b9949e70107d71f387f0cb8db3c6e"
Sep 17 22:04:40.208944 ip-10-0-136-66 kubenswrapper[2560]: E0917 22:04:40.208924    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd4a7124e26252ae5832aed82d62653d2b9b9949e70107d71f387f0cb8db3c6e\": container with ID starting with dd4a7124e26252ae5832aed82d62653d2b9b9949e70107d71f387f0cb8db3c6e not found: ID does not exist" containerID="dd4a7124e26252ae5832aed82d62653d2b9b9949e70107d71f387f0cb8db3c6e"
Sep 17 22:04:40.209020 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:04:40.208950    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd4a7124e26252ae5832aed82d62653d2b9b9949e70107d71f387f0cb8db3c6e"} err="failed to get container status \"dd4a7124e26252ae5832aed82d62653d2b9b9949e70107d71f387f0cb8db3c6e\": rpc error: code = NotFound desc = could not find container \"dd4a7124e26252ae5832aed82d62653d2b9b9949e70107d71f387f0cb8db3c6e\": container with ID starting with dd4a7124e26252ae5832aed82d62653d2b9b9949e70107d71f387f0cb8db3c6e not found: ID does not exist"
Sep 17 22:04:40.220711 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:04:40.220685    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-79b679679b-xcbnv"]
Sep 17 22:04:40.224082 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:04:40.224055    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-79b679679b-xcbnv"]
Sep 17 22:04:40.379992 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:04:40.379968    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-79b679679b-bkdhf"]
Sep 17 22:04:40.382821 ip-10-0-136-66 kubenswrapper[2560]: W0917 22:04:40.382797    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf4e775b_bb8d_44a5_9010_24958cf2f264.slice/crio-6e89ed84a2738f9cbc727fc872515fcd9ee006dedbcac53ad0deeab13085a91f WatchSource:0}: Error finding container 6e89ed84a2738f9cbc727fc872515fcd9ee006dedbcac53ad0deeab13085a91f: Status 404 returned error can't find the container with id 6e89ed84a2738f9cbc727fc872515fcd9ee006dedbcac53ad0deeab13085a91f
Sep 17 22:04:40.451727 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:04:40.451695    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb9f1ca5-98b7-4c22-90fa-bf43f2180796" path="/var/lib/kubelet/pods/eb9f1ca5-98b7-4c22-90fa-bf43f2180796/volumes"
Sep 17 22:04:41.205787 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:04:41.205683    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-79b679679b-bkdhf" event={"ID":"cf4e775b-bb8d-44a5-9010-24958cf2f264","Type":"ContainerStarted","Data":"caa6bec31d60dd75d2ef84ca1f925d0d52d50a84c215d81fb1eb4b6dea1cb630"}
Sep 17 22:04:41.205787 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:04:41.205740    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-79b679679b-bkdhf" event={"ID":"cf4e775b-bb8d-44a5-9010-24958cf2f264","Type":"ContainerStarted","Data":"6e89ed84a2738f9cbc727fc872515fcd9ee006dedbcac53ad0deeab13085a91f"}
Sep 17 22:04:41.205787 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:04:41.205768    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-79b679679b-bkdhf"
Sep 17 22:04:41.221571 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:04:41.221519    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-79b679679b-bkdhf" podStartSLOduration=1.8585287529999999 podStartE2EDuration="2.221503636s" totalImagesPullingTime="362.974883ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:04:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:04:41.220400981 +0000 UTC m=+413.280172991" watchObservedRunningTime="2026-09-17 22:04:41.221503636 +0000 UTC m=+413.281275647"
Sep 17 22:05:12.215429 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:05:12.215333    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-79b679679b-bkdhf"
Sep 17 22:05:29.812180 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:05:29.812147    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-init-22r2n"]
Sep 17 22:05:29.812659 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:05:29.812454    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb9f1ca5-98b7-4c22-90fa-bf43f2180796" containerName="manager"
Sep 17 22:05:29.812659 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:05:29.812465    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb9f1ca5-98b7-4c22-90fa-bf43f2180796" containerName="manager"
Sep 17 22:05:29.812659 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:05:29.812528    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb9f1ca5-98b7-4c22-90fa-bf43f2180796" containerName="manager"
Sep 17 22:05:29.815477 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:05:29.815460    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-22r2n"
Sep 17 22:05:29.817995 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:05:29.817976    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"hf-token\""
Sep 17 22:05:29.818122 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:05:29.818017    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\""
Sep 17 22:05:29.818122 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:05:29.818017    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-mfzp6\""
Sep 17 22:05:29.822724 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:05:29.822700    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-22r2n"]
Sep 17 22:05:29.898664 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:05:29.898623    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/89d3b046-e8f4-4881-9292-a4d9db5321c3-model-cache\") pod \"s3-init-22r2n\" (UID: \"89d3b046-e8f4-4881-9292-a4d9db5321c3\") " pod="kserve/s3-init-22r2n"
Sep 17 22:05:29.898860 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:05:29.898682    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pnjs\" (UniqueName: \"kubernetes.io/projected/89d3b046-e8f4-4881-9292-a4d9db5321c3-kube-api-access-8pnjs\") pod \"s3-init-22r2n\" (UID: \"89d3b046-e8f4-4881-9292-a4d9db5321c3\") " pod="kserve/s3-init-22r2n"
Sep 17 22:05:29.999497 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:05:29.999464    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pnjs\" (UniqueName: \"kubernetes.io/projected/89d3b046-e8f4-4881-9292-a4d9db5321c3-kube-api-access-8pnjs\") pod \"s3-init-22r2n\" (UID: \"89d3b046-e8f4-4881-9292-a4d9db5321c3\") " pod="kserve/s3-init-22r2n"
Sep 17 22:05:29.999677 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:05:29.999531    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/89d3b046-e8f4-4881-9292-a4d9db5321c3-model-cache\") pod \"s3-init-22r2n\" (UID: \"89d3b046-e8f4-4881-9292-a4d9db5321c3\") " pod="kserve/s3-init-22r2n"
Sep 17 22:05:29.999894 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:05:29.999877    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/89d3b046-e8f4-4881-9292-a4d9db5321c3-model-cache\") pod \"s3-init-22r2n\" (UID: \"89d3b046-e8f4-4881-9292-a4d9db5321c3\") " pod="kserve/s3-init-22r2n"
Sep 17 22:05:30.010462 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:05:30.010436    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pnjs\" (UniqueName: \"kubernetes.io/projected/89d3b046-e8f4-4881-9292-a4d9db5321c3-kube-api-access-8pnjs\") pod \"s3-init-22r2n\" (UID: \"89d3b046-e8f4-4881-9292-a4d9db5321c3\") " pod="kserve/s3-init-22r2n"
Sep 17 22:05:30.133345 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:05:30.133254    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-22r2n"
Sep 17 22:05:30.400141 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:05:30.400115    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-22r2n"]
Sep 17 22:05:30.402837 ip-10-0-136-66 kubenswrapper[2560]: W0917 22:05:30.402808    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod89d3b046_e8f4_4881_9292_a4d9db5321c3.slice/crio-6cb180c97ca0d77e252b0eed644cf8f096d106bdd92aab6e868bf9c5408824b3 WatchSource:0}: Error finding container 6cb180c97ca0d77e252b0eed644cf8f096d106bdd92aab6e868bf9c5408824b3: Status 404 returned error can't find the container with id 6cb180c97ca0d77e252b0eed644cf8f096d106bdd92aab6e868bf9c5408824b3
Sep 17 22:05:31.402577 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:05:31.402538    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-22r2n" event={"ID":"89d3b046-e8f4-4881-9292-a4d9db5321c3","Type":"ContainerStarted","Data":"6cb180c97ca0d77e252b0eed644cf8f096d106bdd92aab6e868bf9c5408824b3"}
Sep 17 22:05:35.420344 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:05:35.420281    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-22r2n" event={"ID":"89d3b046-e8f4-4881-9292-a4d9db5321c3","Type":"ContainerStarted","Data":"1d4a8279ff4df17e93ca7abe69f8ef3cc8a7584c47e7558281e458034eddf5e9"}
Sep 17 22:05:37.430051 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:05:37.430013    2560 generic.go:356] "Generic (PLEG): container finished" podID="89d3b046-e8f4-4881-9292-a4d9db5321c3" containerID="1d4a8279ff4df17e93ca7abe69f8ef3cc8a7584c47e7558281e458034eddf5e9" exitCode=0
Sep 17 22:05:37.430472 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:05:37.430082    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-22r2n" event={"ID":"89d3b046-e8f4-4881-9292-a4d9db5321c3","Type":"ContainerDied","Data":"1d4a8279ff4df17e93ca7abe69f8ef3cc8a7584c47e7558281e458034eddf5e9"}
Sep 17 22:05:42.455155 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:05:42.455121    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-22r2n" event={"ID":"89d3b046-e8f4-4881-9292-a4d9db5321c3","Type":"ContainerStarted","Data":"eac233b3abc1be5f7f5dce189d5d3db12acd793685b976d54181e2f9a8711f70"}
Sep 17 22:05:42.471021 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:05:42.470965    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-init-22r2n" podStartSLOduration=2.553359058 podStartE2EDuration="13.470949807s" totalImagesPullingTime="8.614934997s" totalInitContainerRuntime="2.302655752s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:05:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:05:42.469562899 +0000 UTC m=+474.529334900" watchObservedRunningTime="2026-09-17 22:05:42.470949807 +0000 UTC m=+474.530721818"
Sep 17 22:06:47.709090 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:06:47.709056    2560 generic.go:356] "Generic (PLEG): container finished" podID="89d3b046-e8f4-4881-9292-a4d9db5321c3" containerID="eac233b3abc1be5f7f5dce189d5d3db12acd793685b976d54181e2f9a8711f70" exitCode=0
Sep 17 22:06:47.709535 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:06:47.709097    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-22r2n" event={"ID":"89d3b046-e8f4-4881-9292-a4d9db5321c3","Type":"ContainerDied","Data":"eac233b3abc1be5f7f5dce189d5d3db12acd793685b976d54181e2f9a8711f70"}
Sep 17 22:06:48.839983 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:06:48.839955    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-22r2n"
Sep 17 22:06:48.941002 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:06:48.940953    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/89d3b046-e8f4-4881-9292-a4d9db5321c3-model-cache\") pod \"89d3b046-e8f4-4881-9292-a4d9db5321c3\" (UID: \"89d3b046-e8f4-4881-9292-a4d9db5321c3\") "
Sep 17 22:06:48.941180 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:06:48.941045    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8pnjs\" (UniqueName: \"kubernetes.io/projected/89d3b046-e8f4-4881-9292-a4d9db5321c3-kube-api-access-8pnjs\") pod \"89d3b046-e8f4-4881-9292-a4d9db5321c3\" (UID: \"89d3b046-e8f4-4881-9292-a4d9db5321c3\") "
Sep 17 22:06:48.943153 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:06:48.943120    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89d3b046-e8f4-4881-9292-a4d9db5321c3-kube-api-access-8pnjs" (OuterVolumeSpecName: "kube-api-access-8pnjs") pod "89d3b046-e8f4-4881-9292-a4d9db5321c3" (UID: "89d3b046-e8f4-4881-9292-a4d9db5321c3"). InnerVolumeSpecName "kube-api-access-8pnjs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 22:06:48.959863 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:06:48.959830    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89d3b046-e8f4-4881-9292-a4d9db5321c3-model-cache" (OuterVolumeSpecName: "model-cache") pod "89d3b046-e8f4-4881-9292-a4d9db5321c3" (UID: "89d3b046-e8f4-4881-9292-a4d9db5321c3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:06:49.041699 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:06:49.041666    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8pnjs\" (UniqueName: \"kubernetes.io/projected/89d3b046-e8f4-4881-9292-a4d9db5321c3-kube-api-access-8pnjs\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\""
Sep 17 22:06:49.041699 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:06:49.041696    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/89d3b046-e8f4-4881-9292-a4d9db5321c3-model-cache\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\""
Sep 17 22:06:49.718393 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:06:49.718342    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-22r2n"
Sep 17 22:06:49.718564 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:06:49.718389    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-22r2n" event={"ID":"89d3b046-e8f4-4881-9292-a4d9db5321c3","Type":"ContainerDied","Data":"6cb180c97ca0d77e252b0eed644cf8f096d106bdd92aab6e868bf9c5408824b3"}
Sep 17 22:06:49.718564 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:06:49.718433    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6cb180c97ca0d77e252b0eed644cf8f096d106bdd92aab6e868bf9c5408824b3"
Sep 17 22:07:01.319508 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.319466    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-5854c-predictor-6b4b8df9b6-s96tc"]
Sep 17 22:07:01.319926 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.319770    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89d3b046-e8f4-4881-9292-a4d9db5321c3" containerName="download-hf-model"
Sep 17 22:07:01.319926 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.319782    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="89d3b046-e8f4-4881-9292-a4d9db5321c3" containerName="download-hf-model"
Sep 17 22:07:01.319926 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.319802    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89d3b046-e8f4-4881-9292-a4d9db5321c3" containerName="s3-init"
Sep 17 22:07:01.319926 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.319810    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="89d3b046-e8f4-4881-9292-a4d9db5321c3" containerName="s3-init"
Sep 17 22:07:01.319926 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.319859    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="89d3b046-e8f4-4881-9292-a4d9db5321c3" containerName="s3-init"
Sep 17 22:07:01.323097 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.323079    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-5854c-predictor-6b4b8df9b6-s96tc"
Sep 17 22:07:01.325708 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.325684    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Sep 17 22:07:01.326776 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.326753    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-5854c-predictor-serving-cert\""
Sep 17 22:07:01.326776 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.326774    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-fx5q8\""
Sep 17 22:07:01.326953 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.326782    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Sep 17 22:07:01.326953 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.326817    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-5854c-kube-rbac-proxy-sar-config\""
Sep 17 22:07:01.333752 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.333725    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-5854c-predictor-6b4b8df9b6-s96tc"]
Sep 17 22:07:01.447272 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.447238    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d65798af-0569-40cc-bba8-57e4c85a4fa1-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-5854c-predictor-6b4b8df9b6-s96tc\" (UID: \"d65798af-0569-40cc-bba8-57e4c85a4fa1\") " pod="kserve-ci-e2e-test/success-200-isvc-5854c-predictor-6b4b8df9b6-s96tc"
Sep 17 22:07:01.447457 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.447299    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d65798af-0569-40cc-bba8-57e4c85a4fa1-proxy-tls\") pod \"success-200-isvc-5854c-predictor-6b4b8df9b6-s96tc\" (UID: \"d65798af-0569-40cc-bba8-57e4c85a4fa1\") " pod="kserve-ci-e2e-test/success-200-isvc-5854c-predictor-6b4b8df9b6-s96tc"
Sep 17 22:07:01.447457 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.447319    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjwpt\" (UniqueName: \"kubernetes.io/projected/d65798af-0569-40cc-bba8-57e4c85a4fa1-kube-api-access-rjwpt\") pod \"success-200-isvc-5854c-predictor-6b4b8df9b6-s96tc\" (UID: \"d65798af-0569-40cc-bba8-57e4c85a4fa1\") " pod="kserve-ci-e2e-test/success-200-isvc-5854c-predictor-6b4b8df9b6-s96tc"
Sep 17 22:07:01.548070 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.548037    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d65798af-0569-40cc-bba8-57e4c85a4fa1-proxy-tls\") pod \"success-200-isvc-5854c-predictor-6b4b8df9b6-s96tc\" (UID: \"d65798af-0569-40cc-bba8-57e4c85a4fa1\") " pod="kserve-ci-e2e-test/success-200-isvc-5854c-predictor-6b4b8df9b6-s96tc"
Sep 17 22:07:01.548070 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.548073    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjwpt\" (UniqueName: \"kubernetes.io/projected/d65798af-0569-40cc-bba8-57e4c85a4fa1-kube-api-access-rjwpt\") pod \"success-200-isvc-5854c-predictor-6b4b8df9b6-s96tc\" (UID: \"d65798af-0569-40cc-bba8-57e4c85a4fa1\") " pod="kserve-ci-e2e-test/success-200-isvc-5854c-predictor-6b4b8df9b6-s96tc"
Sep 17 22:07:01.548302 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.548107    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d65798af-0569-40cc-bba8-57e4c85a4fa1-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-5854c-predictor-6b4b8df9b6-s96tc\" (UID: \"d65798af-0569-40cc-bba8-57e4c85a4fa1\") " pod="kserve-ci-e2e-test/success-200-isvc-5854c-predictor-6b4b8df9b6-s96tc"
Sep 17 22:07:01.548818 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.548793    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d65798af-0569-40cc-bba8-57e4c85a4fa1-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-5854c-predictor-6b4b8df9b6-s96tc\" (UID: \"d65798af-0569-40cc-bba8-57e4c85a4fa1\") " pod="kserve-ci-e2e-test/success-200-isvc-5854c-predictor-6b4b8df9b6-s96tc"
Sep 17 22:07:01.550766 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.550726    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d65798af-0569-40cc-bba8-57e4c85a4fa1-proxy-tls\") pod \"success-200-isvc-5854c-predictor-6b4b8df9b6-s96tc\" (UID: \"d65798af-0569-40cc-bba8-57e4c85a4fa1\") " pod="kserve-ci-e2e-test/success-200-isvc-5854c-predictor-6b4b8df9b6-s96tc"
Sep 17 22:07:01.556045 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.556017    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjwpt\" (UniqueName: \"kubernetes.io/projected/d65798af-0569-40cc-bba8-57e4c85a4fa1-kube-api-access-rjwpt\") pod \"success-200-isvc-5854c-predictor-6b4b8df9b6-s96tc\" (UID: \"d65798af-0569-40cc-bba8-57e4c85a4fa1\") " pod="kserve-ci-e2e-test/success-200-isvc-5854c-predictor-6b4b8df9b6-s96tc"
Sep 17 22:07:01.601775 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.601690    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm"]
Sep 17 22:07:01.605587 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.605564    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm"
Sep 17 22:07:01.608175 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.608151    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Sep 17 22:07:01.608310 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.608192    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-1-predictor-serving-cert\""
Sep 17 22:07:01.608310 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.608262    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Sep 17 22:07:01.608449 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.608424    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-1-kube-rbac-proxy-sar-config\""
Sep 17 22:07:01.615097 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.615077    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm"]
Sep 17 22:07:01.633752 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.633716    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-5854c-predictor-6b4b8df9b6-s96tc"
Sep 17 22:07:01.699765 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.699725    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6tvxh"]
Sep 17 22:07:01.703724 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.703700    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6tvxh"
Sep 17 22:07:01.707846 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.707822    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-predictor-serving-cert\""
Sep 17 22:07:01.707973 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.707825    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-kube-rbac-proxy-sar-config\""
Sep 17 22:07:01.713280 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.713241    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6tvxh"]
Sep 17 22:07:01.750218 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.750181    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/597d10f8-4378-4c6f-a191-8e132e3a52ef-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm\" (UID: \"597d10f8-4378-4c6f-a191-8e132e3a52ef\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm"
Sep 17 22:07:01.750218 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.750222    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/597d10f8-4378-4c6f-a191-8e132e3a52ef-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm\" (UID: \"597d10f8-4378-4c6f-a191-8e132e3a52ef\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm"
Sep 17 22:07:01.750456 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.750246    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vztgw\" (UniqueName: \"kubernetes.io/projected/597d10f8-4378-4c6f-a191-8e132e3a52ef-kube-api-access-vztgw\") pod \"isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm\" (UID: \"597d10f8-4378-4c6f-a191-8e132e3a52ef\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm"
Sep 17 22:07:01.750456 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.750342    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/597d10f8-4378-4c6f-a191-8e132e3a52ef-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm\" (UID: \"597d10f8-4378-4c6f-a191-8e132e3a52ef\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm"
Sep 17 22:07:01.750456 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.750424    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/597d10f8-4378-4c6f-a191-8e132e3a52ef-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm\" (UID: \"597d10f8-4378-4c6f-a191-8e132e3a52ef\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm"
Sep 17 22:07:01.851267 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.851233    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ca00b930-fc79-4176-8a4e-cb280f838cb3-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-6tvxh\" (UID: \"ca00b930-fc79-4176-8a4e-cb280f838cb3\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6tvxh"
Sep 17 22:07:01.851443 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.851274    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ca00b930-fc79-4176-8a4e-cb280f838cb3-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-6tvxh\" (UID: \"ca00b930-fc79-4176-8a4e-cb280f838cb3\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6tvxh"
Sep 17 22:07:01.851443 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.851304    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ca00b930-fc79-4176-8a4e-cb280f838cb3-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-6tvxh\" (UID: \"ca00b930-fc79-4176-8a4e-cb280f838cb3\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6tvxh"
Sep 17 22:07:01.851443 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.851380    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ca00b930-fc79-4176-8a4e-cb280f838cb3-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-6tvxh\" (UID: \"ca00b930-fc79-4176-8a4e-cb280f838cb3\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6tvxh"
Sep 17 22:07:01.851443 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.851419    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/597d10f8-4378-4c6f-a191-8e132e3a52ef-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm\" (UID: \"597d10f8-4378-4c6f-a191-8e132e3a52ef\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm"
Sep 17 22:07:01.851608 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.851469    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/597d10f8-4378-4c6f-a191-8e132e3a52ef-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm\" (UID: \"597d10f8-4378-4c6f-a191-8e132e3a52ef\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm"
Sep 17 22:07:01.851608 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.851507    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vztgw\" (UniqueName: \"kubernetes.io/projected/597d10f8-4378-4c6f-a191-8e132e3a52ef-kube-api-access-vztgw\") pod \"isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm\" (UID: \"597d10f8-4378-4c6f-a191-8e132e3a52ef\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm"
Sep 17 22:07:01.851608 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.851544    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54wdr\" (UniqueName: \"kubernetes.io/projected/ca00b930-fc79-4176-8a4e-cb280f838cb3-kube-api-access-54wdr\") pod \"isvc-xgboost-graph-predictor-555fc69d56-6tvxh\" (UID: \"ca00b930-fc79-4176-8a4e-cb280f838cb3\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6tvxh"
Sep 17 22:07:01.851608 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.851586    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/597d10f8-4378-4c6f-a191-8e132e3a52ef-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm\" (UID: \"597d10f8-4378-4c6f-a191-8e132e3a52ef\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm"
Sep 17 22:07:01.851817 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.851639    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/597d10f8-4378-4c6f-a191-8e132e3a52ef-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm\" (UID: \"597d10f8-4378-4c6f-a191-8e132e3a52ef\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm"
Sep 17 22:07:01.851929 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.851897    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/597d10f8-4378-4c6f-a191-8e132e3a52ef-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm\" (UID: \"597d10f8-4378-4c6f-a191-8e132e3a52ef\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm"
Sep 17 22:07:01.852368 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.852335    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/597d10f8-4378-4c6f-a191-8e132e3a52ef-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm\" (UID: \"597d10f8-4378-4c6f-a191-8e132e3a52ef\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm"
Sep 17 22:07:01.852607 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.852582    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/597d10f8-4378-4c6f-a191-8e132e3a52ef-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm\" (UID: \"597d10f8-4378-4c6f-a191-8e132e3a52ef\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm"
Sep 17 22:07:01.854636 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.854605    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/597d10f8-4378-4c6f-a191-8e132e3a52ef-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm\" (UID: \"597d10f8-4378-4c6f-a191-8e132e3a52ef\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm"
Sep 17 22:07:01.859932 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.859906    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vztgw\" (UniqueName: \"kubernetes.io/projected/597d10f8-4378-4c6f-a191-8e132e3a52ef-kube-api-access-vztgw\") pod \"isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm\" (UID: \"597d10f8-4378-4c6f-a191-8e132e3a52ef\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm"
Sep 17 22:07:01.907842 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.907802    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-5854c-predictor-6b4b8df9b6-s96tc"]
Sep 17 22:07:01.911699 ip-10-0-136-66 kubenswrapper[2560]: W0917 22:07:01.911668    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd65798af_0569_40cc_bba8_57e4c85a4fa1.slice/crio-154e921221a5cca2240d14f1640b91dd5fc8c7da206a34c0e93ea41edada0848 WatchSource:0}: Error finding container 154e921221a5cca2240d14f1640b91dd5fc8c7da206a34c0e93ea41edada0848: Status 404 returned error can't find the container with id 154e921221a5cca2240d14f1640b91dd5fc8c7da206a34c0e93ea41edada0848
Sep 17 22:07:01.917244 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.917218    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr"]
Sep 17 22:07:01.917328 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.917305    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm"
Sep 17 22:07:01.921582 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.921567    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr"
Sep 17 22:07:01.924000 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.923970    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-2-kube-rbac-proxy-sar-config\""
Sep 17 22:07:01.924172 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.924157    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-2-predictor-serving-cert\""
Sep 17 22:07:01.930547 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.930395    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr"]
Sep 17 22:07:01.952226 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.952193    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ca00b930-fc79-4176-8a4e-cb280f838cb3-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-6tvxh\" (UID: \"ca00b930-fc79-4176-8a4e-cb280f838cb3\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6tvxh"
Sep 17 22:07:01.952226 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.952227    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ca00b930-fc79-4176-8a4e-cb280f838cb3-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-6tvxh\" (UID: \"ca00b930-fc79-4176-8a4e-cb280f838cb3\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6tvxh"
Sep 17 22:07:01.952475 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.952248    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ca00b930-fc79-4176-8a4e-cb280f838cb3-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-6tvxh\" (UID: \"ca00b930-fc79-4176-8a4e-cb280f838cb3\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6tvxh"
Sep 17 22:07:01.952475 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.952301    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ca00b930-fc79-4176-8a4e-cb280f838cb3-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-6tvxh\" (UID: \"ca00b930-fc79-4176-8a4e-cb280f838cb3\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6tvxh"
Sep 17 22:07:01.952475 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.952370    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54wdr\" (UniqueName: \"kubernetes.io/projected/ca00b930-fc79-4176-8a4e-cb280f838cb3-kube-api-access-54wdr\") pod \"isvc-xgboost-graph-predictor-555fc69d56-6tvxh\" (UID: \"ca00b930-fc79-4176-8a4e-cb280f838cb3\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6tvxh"
Sep 17 22:07:01.952475 ip-10-0-136-66 kubenswrapper[2560]: E0917 22:07:01.952407    2560 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-xgboost-graph-predictor-serving-cert: secret "isvc-xgboost-graph-predictor-serving-cert" not found
Sep 17 22:07:01.952678 ip-10-0-136-66 kubenswrapper[2560]: E0917 22:07:01.952511    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca00b930-fc79-4176-8a4e-cb280f838cb3-proxy-tls podName:ca00b930-fc79-4176-8a4e-cb280f838cb3 nodeName:}" failed. No retries permitted until 2026-09-17 22:07:02.452483479 +0000 UTC m=+554.512255470 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/ca00b930-fc79-4176-8a4e-cb280f838cb3-proxy-tls") pod "isvc-xgboost-graph-predictor-555fc69d56-6tvxh" (UID: "ca00b930-fc79-4176-8a4e-cb280f838cb3") : secret "isvc-xgboost-graph-predictor-serving-cert" not found
Sep 17 22:07:01.952983 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.952961    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ca00b930-fc79-4176-8a4e-cb280f838cb3-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-6tvxh\" (UID: \"ca00b930-fc79-4176-8a4e-cb280f838cb3\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6tvxh"
Sep 17 22:07:01.953081 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.953030    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ca00b930-fc79-4176-8a4e-cb280f838cb3-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-6tvxh\" (UID: \"ca00b930-fc79-4176-8a4e-cb280f838cb3\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6tvxh"
Sep 17 22:07:01.953081 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.953037    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ca00b930-fc79-4176-8a4e-cb280f838cb3-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-6tvxh\" (UID: \"ca00b930-fc79-4176-8a4e-cb280f838cb3\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6tvxh"
Sep 17 22:07:01.961275 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:01.961247    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54wdr\" (UniqueName: \"kubernetes.io/projected/ca00b930-fc79-4176-8a4e-cb280f838cb3-kube-api-access-54wdr\") pod \"isvc-xgboost-graph-predictor-555fc69d56-6tvxh\" (UID: \"ca00b930-fc79-4176-8a4e-cb280f838cb3\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6tvxh"
Sep 17 22:07:02.053266 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:02.053229    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/398c4373-3943-4ac6-8bdd-3c0fb7cf53c1-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr\" (UID: \"398c4373-3943-4ac6-8bdd-3c0fb7cf53c1\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr"
Sep 17 22:07:02.053266 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:02.053269    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/398c4373-3943-4ac6-8bdd-3c0fb7cf53c1-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr\" (UID: \"398c4373-3943-4ac6-8bdd-3c0fb7cf53c1\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr"
Sep 17 22:07:02.053496 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:02.053305    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/398c4373-3943-4ac6-8bdd-3c0fb7cf53c1-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr\" (UID: \"398c4373-3943-4ac6-8bdd-3c0fb7cf53c1\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr"
Sep 17 22:07:02.053496 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:02.053409    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/398c4373-3943-4ac6-8bdd-3c0fb7cf53c1-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr\" (UID: \"398c4373-3943-4ac6-8bdd-3c0fb7cf53c1\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr"
Sep 17 22:07:02.053496 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:02.053453    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzgvg\" (UniqueName: \"kubernetes.io/projected/398c4373-3943-4ac6-8bdd-3c0fb7cf53c1-kube-api-access-nzgvg\") pod \"isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr\" (UID: \"398c4373-3943-4ac6-8bdd-3c0fb7cf53c1\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr"
Sep 17 22:07:02.154123 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:02.154038    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/398c4373-3943-4ac6-8bdd-3c0fb7cf53c1-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr\" (UID: \"398c4373-3943-4ac6-8bdd-3c0fb7cf53c1\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr"
Sep 17 22:07:02.154123 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:02.154077    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/398c4373-3943-4ac6-8bdd-3c0fb7cf53c1-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr\" (UID: \"398c4373-3943-4ac6-8bdd-3c0fb7cf53c1\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr"
Sep 17 22:07:02.154315 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:02.154127    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/398c4373-3943-4ac6-8bdd-3c0fb7cf53c1-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr\" (UID: \"398c4373-3943-4ac6-8bdd-3c0fb7cf53c1\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr"
Sep 17 22:07:02.154315 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:02.154285    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/398c4373-3943-4ac6-8bdd-3c0fb7cf53c1-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr\" (UID: \"398c4373-3943-4ac6-8bdd-3c0fb7cf53c1\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr"
Sep 17 22:07:02.154444 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:02.154322    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzgvg\" (UniqueName: \"kubernetes.io/projected/398c4373-3943-4ac6-8bdd-3c0fb7cf53c1-kube-api-access-nzgvg\") pod \"isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr\" (UID: \"398c4373-3943-4ac6-8bdd-3c0fb7cf53c1\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr"
Sep 17 22:07:02.154553 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:02.154530    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/398c4373-3943-4ac6-8bdd-3c0fb7cf53c1-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr\" (UID: \"398c4373-3943-4ac6-8bdd-3c0fb7cf53c1\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr"
Sep 17 22:07:02.154842 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:02.154813    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/398c4373-3943-4ac6-8bdd-3c0fb7cf53c1-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr\" (UID: \"398c4373-3943-4ac6-8bdd-3c0fb7cf53c1\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr"
Sep 17 22:07:02.155083 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:02.155059    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/398c4373-3943-4ac6-8bdd-3c0fb7cf53c1-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr\" (UID: \"398c4373-3943-4ac6-8bdd-3c0fb7cf53c1\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr"
Sep 17 22:07:02.156711 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:02.156690    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/398c4373-3943-4ac6-8bdd-3c0fb7cf53c1-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr\" (UID: \"398c4373-3943-4ac6-8bdd-3c0fb7cf53c1\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr"
Sep 17 22:07:02.161895 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:02.161869    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzgvg\" (UniqueName: \"kubernetes.io/projected/398c4373-3943-4ac6-8bdd-3c0fb7cf53c1-kube-api-access-nzgvg\") pod \"isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr\" (UID: \"398c4373-3943-4ac6-8bdd-3c0fb7cf53c1\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr"
Sep 17 22:07:02.192057 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:02.192029    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm"]
Sep 17 22:07:02.194201 ip-10-0-136-66 kubenswrapper[2560]: W0917 22:07:02.194172    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod597d10f8_4378_4c6f_a191_8e132e3a52ef.slice/crio-9f386f0cdf7f87bdca65c550852c89173e0ee4d324c1ee7d5b7a0159bf1d59ca WatchSource:0}: Error finding container 9f386f0cdf7f87bdca65c550852c89173e0ee4d324c1ee7d5b7a0159bf1d59ca: Status 404 returned error can't find the container with id 9f386f0cdf7f87bdca65c550852c89173e0ee4d324c1ee7d5b7a0159bf1d59ca
Sep 17 22:07:02.234162 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:02.234133    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr"
Sep 17 22:07:02.456698 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:02.456624    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ca00b930-fc79-4176-8a4e-cb280f838cb3-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-6tvxh\" (UID: \"ca00b930-fc79-4176-8a4e-cb280f838cb3\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6tvxh"
Sep 17 22:07:02.459049 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:02.459030    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ca00b930-fc79-4176-8a4e-cb280f838cb3-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-6tvxh\" (UID: \"ca00b930-fc79-4176-8a4e-cb280f838cb3\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6tvxh"
Sep 17 22:07:02.513072 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:02.512775    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr"]
Sep 17 22:07:02.517299 ip-10-0-136-66 kubenswrapper[2560]: W0917 22:07:02.517266    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod398c4373_3943_4ac6_8bdd_3c0fb7cf53c1.slice/crio-54ad9c7347cd83e9dee2ed77d05b56b37a641cbbb9e21fb15969eb3f8de573a7 WatchSource:0}: Error finding container 54ad9c7347cd83e9dee2ed77d05b56b37a641cbbb9e21fb15969eb3f8de573a7: Status 404 returned error can't find the container with id 54ad9c7347cd83e9dee2ed77d05b56b37a641cbbb9e21fb15969eb3f8de573a7
Sep 17 22:07:02.631572 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:02.616817    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6tvxh"
Sep 17 22:07:02.780227 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:02.780185    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr" event={"ID":"398c4373-3943-4ac6-8bdd-3c0fb7cf53c1","Type":"ContainerStarted","Data":"636425a03d3d1b3b67f3827058ba0dfd561926590541327a7b43c47b3dc42826"}
Sep 17 22:07:02.780516 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:02.780266    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr" event={"ID":"398c4373-3943-4ac6-8bdd-3c0fb7cf53c1","Type":"ContainerStarted","Data":"54ad9c7347cd83e9dee2ed77d05b56b37a641cbbb9e21fb15969eb3f8de573a7"}
Sep 17 22:07:02.787810 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:02.787123    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm" event={"ID":"597d10f8-4378-4c6f-a191-8e132e3a52ef","Type":"ContainerStarted","Data":"9f4ce6f1bc8dc2a24ca9e57f2d13b56a0745de8f4e5142ebed41edeb0ae5cc28"}
Sep 17 22:07:02.787810 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:02.787201    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm" event={"ID":"597d10f8-4378-4c6f-a191-8e132e3a52ef","Type":"ContainerStarted","Data":"9f386f0cdf7f87bdca65c550852c89173e0ee4d324c1ee7d5b7a0159bf1d59ca"}
Sep 17 22:07:02.790504 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:02.790428    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-5854c-predictor-6b4b8df9b6-s96tc" event={"ID":"d65798af-0569-40cc-bba8-57e4c85a4fa1","Type":"ContainerStarted","Data":"154e921221a5cca2240d14f1640b91dd5fc8c7da206a34c0e93ea41edada0848"}
Sep 17 22:07:02.975041 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:02.974937    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6tvxh"]
Sep 17 22:07:02.986951 ip-10-0-136-66 kubenswrapper[2560]: W0917 22:07:02.986909    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca00b930_fc79_4176_8a4e_cb280f838cb3.slice/crio-e6375ac0b3bfe5048d81efa4e904c64a2c0250272d8a86c8899cbcae0d115195 WatchSource:0}: Error finding container e6375ac0b3bfe5048d81efa4e904c64a2c0250272d8a86c8899cbcae0d115195: Status 404 returned error can't find the container with id e6375ac0b3bfe5048d81efa4e904c64a2c0250272d8a86c8899cbcae0d115195
Sep 17 22:07:03.801343 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:03.801300    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6tvxh" event={"ID":"ca00b930-fc79-4176-8a4e-cb280f838cb3","Type":"ContainerStarted","Data":"f8a90835e88d15350f9aad4d56b5aa394ababf270851497656c6a2a20e1fc3a8"}
Sep 17 22:07:03.801823 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:03.801402    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6tvxh" event={"ID":"ca00b930-fc79-4176-8a4e-cb280f838cb3","Type":"ContainerStarted","Data":"e6375ac0b3bfe5048d81efa4e904c64a2c0250272d8a86c8899cbcae0d115195"}
Sep 17 22:07:07.828226 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:07.828187    2560 generic.go:356] "Generic (PLEG): container finished" podID="398c4373-3943-4ac6-8bdd-3c0fb7cf53c1" containerID="636425a03d3d1b3b67f3827058ba0dfd561926590541327a7b43c47b3dc42826" exitCode=0
Sep 17 22:07:07.828696 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:07.828265    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr" event={"ID":"398c4373-3943-4ac6-8bdd-3c0fb7cf53c1","Type":"ContainerDied","Data":"636425a03d3d1b3b67f3827058ba0dfd561926590541327a7b43c47b3dc42826"}
Sep 17 22:07:07.831792 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:07.831759    2560 generic.go:356] "Generic (PLEG): container finished" podID="597d10f8-4378-4c6f-a191-8e132e3a52ef" containerID="9f4ce6f1bc8dc2a24ca9e57f2d13b56a0745de8f4e5142ebed41edeb0ae5cc28" exitCode=0
Sep 17 22:07:07.831898 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:07.831823    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm" event={"ID":"597d10f8-4378-4c6f-a191-8e132e3a52ef","Type":"ContainerDied","Data":"9f4ce6f1bc8dc2a24ca9e57f2d13b56a0745de8f4e5142ebed41edeb0ae5cc28"}
Sep 17 22:07:07.834716 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:07.834603    2560 generic.go:356] "Generic (PLEG): container finished" podID="ca00b930-fc79-4176-8a4e-cb280f838cb3" containerID="f8a90835e88d15350f9aad4d56b5aa394ababf270851497656c6a2a20e1fc3a8" exitCode=0
Sep 17 22:07:07.834716 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:07.834684    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6tvxh" event={"ID":"ca00b930-fc79-4176-8a4e-cb280f838cb3","Type":"ContainerDied","Data":"f8a90835e88d15350f9aad4d56b5aa394ababf270851497656c6a2a20e1fc3a8"}
Sep 17 22:07:14.876525 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:14.876403    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-5854c-predictor-6b4b8df9b6-s96tc" event={"ID":"d65798af-0569-40cc-bba8-57e4c85a4fa1","Type":"ContainerStarted","Data":"bcdecbc3ad4322cac99f4633aaf907d2861103a444f454c721a4b4a2840a457e"}
Sep 17 22:07:22.925927 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:22.925834    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-5854c-predictor-6b4b8df9b6-s96tc" event={"ID":"d65798af-0569-40cc-bba8-57e4c85a4fa1","Type":"ContainerStarted","Data":"c0fd7e323682ae9b3215c75febf969d7de989f49d93b833b5cc606b6ef8dc07b"}
Sep 17 22:07:22.926458 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:22.925947    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-5854c-predictor-6b4b8df9b6-s96tc"
Sep 17 22:07:22.926458 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:22.926019    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-5854c-predictor-6b4b8df9b6-s96tc"
Sep 17 22:07:22.927670 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:22.927629    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-5854c-predictor-6b4b8df9b6-s96tc" podUID="d65798af-0569-40cc-bba8-57e4c85a4fa1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused"
Sep 17 22:07:22.928809 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:22.928776    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr" event={"ID":"398c4373-3943-4ac6-8bdd-3c0fb7cf53c1","Type":"ContainerStarted","Data":"8337d04939ad369b45a7becdf4cd779fa0ea9de2cc258dae6945cbf7cf414c20"}
Sep 17 22:07:22.928924 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:22.928866    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr" event={"ID":"398c4373-3943-4ac6-8bdd-3c0fb7cf53c1","Type":"ContainerStarted","Data":"bb15d2640198df6039973d5b3f13b48acf026d38198dc3a7b47ad76b0a1b3bf2"}
Sep 17 22:07:22.929248 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:22.929223    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr"
Sep 17 22:07:22.931541 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:22.931518    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm" event={"ID":"597d10f8-4378-4c6f-a191-8e132e3a52ef","Type":"ContainerStarted","Data":"c70c167d6bf9a99d80397efd2711be659ba74e0b9704eb88861b053ddd276dd4"}
Sep 17 22:07:22.931666 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:22.931565    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm" event={"ID":"597d10f8-4378-4c6f-a191-8e132e3a52ef","Type":"ContainerStarted","Data":"4fc03f70dda8078f75c8e640531626beff45263eceb04a63fc63d9bc2823fb8c"}
Sep 17 22:07:22.931803 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:22.931782    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm"
Sep 17 22:07:22.947594 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:22.946834    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-5854c-predictor-6b4b8df9b6-s96tc" podStartSLOduration=1.685367864 podStartE2EDuration="21.946812201s" totalImagesPullingTime="20.261444337s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:07:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:07:22.941894386 +0000 UTC m=+575.001666389" watchObservedRunningTime="2026-09-17 22:07:22.946812201 +0000 UTC m=+575.006584213"
Sep 17 22:07:22.959717 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:22.959649    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm" podStartSLOduration=3.397701505 podStartE2EDuration="21.959629386s" totalImagesPullingTime="14.612052387s" totalInitContainerRuntime="3.949875494s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:07:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:07:22.958305393 +0000 UTC m=+575.018077405" watchObservedRunningTime="2026-09-17 22:07:22.959629386 +0000 UTC m=+575.019401401"
Sep 17 22:07:22.977494 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:22.977432    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr" podStartSLOduration=3.097029269 podStartE2EDuration="21.977411127s" totalImagesPullingTime="14.616937118s" totalInitContainerRuntime="4.26344474s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:07:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:07:22.976418889 +0000 UTC m=+575.036190901" watchObservedRunningTime="2026-09-17 22:07:22.977411127 +0000 UTC m=+575.037183140"
Sep 17 22:07:23.938605 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:23.938558    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-5854c-predictor-6b4b8df9b6-s96tc" podUID="d65798af-0569-40cc-bba8-57e4c85a4fa1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused"
Sep 17 22:07:23.939347 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:23.939235    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm"
Sep 17 22:07:23.939347 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:23.939305    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr"
Sep 17 22:07:23.939985 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:23.939950    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm" podUID="597d10f8-4378-4c6f-a191-8e132e3a52ef" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused"
Sep 17 22:07:23.940566 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:23.940537    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr" podUID="398c4373-3943-4ac6-8bdd-3c0fb7cf53c1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.29:8080: connect: connection refused"
Sep 17 22:07:24.944931 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:24.944883    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr" podUID="398c4373-3943-4ac6-8bdd-3c0fb7cf53c1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.29:8080: connect: connection refused"
Sep 17 22:07:24.945412 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:24.945330    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm" podUID="597d10f8-4378-4c6f-a191-8e132e3a52ef" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused"
Sep 17 22:07:28.943400 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:28.943341    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-5854c-predictor-6b4b8df9b6-s96tc"
Sep 17 22:07:28.943892 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:28.943822    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-5854c-predictor-6b4b8df9b6-s96tc" podUID="d65798af-0569-40cc-bba8-57e4c85a4fa1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused"
Sep 17 22:07:29.950722 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:29.950674    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr"
Sep 17 22:07:29.951281 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:29.951250    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm"
Sep 17 22:07:29.951963 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:29.951859    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr" podUID="398c4373-3943-4ac6-8bdd-3c0fb7cf53c1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.29:8080: connect: connection refused"
Sep 17 22:07:29.951963 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:29.951861    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm" podUID="597d10f8-4378-4c6f-a191-8e132e3a52ef" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused"
Sep 17 22:07:37.013215 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:37.013175    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6tvxh" event={"ID":"ca00b930-fc79-4176-8a4e-cb280f838cb3","Type":"ContainerStarted","Data":"37c276d0d4765c784abe6d06aa329b1ffa08c24d4afcdbe0e616dfb79dd60dca"}
Sep 17 22:07:37.013660 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:37.013241    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6tvxh" event={"ID":"ca00b930-fc79-4176-8a4e-cb280f838cb3","Type":"ContainerStarted","Data":"6a0c2546868f60397274cfae5774359c4832bef531e86a272f936a8c6af82274"}
Sep 17 22:07:37.013660 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:37.013429    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6tvxh"
Sep 17 22:07:37.032540 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:37.032495    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6tvxh" podStartSLOduration=3.801536616 podStartE2EDuration="36.032479911s" totalImagesPullingTime="28.118576947s" totalInitContainerRuntime="4.112366348s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:07:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:07:37.029673413 +0000 UTC m=+589.089445426" watchObservedRunningTime="2026-09-17 22:07:37.032479911 +0000 UTC m=+589.092251922"
Sep 17 22:07:38.018034 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:38.017997    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6tvxh"
Sep 17 22:07:38.019430 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:38.019392    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6tvxh" podUID="ca00b930-fc79-4176-8a4e-cb280f838cb3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.28:8080: connect: connection refused"
Sep 17 22:07:38.944569 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:38.944522    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-5854c-predictor-6b4b8df9b6-s96tc" podUID="d65798af-0569-40cc-bba8-57e4c85a4fa1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused"
Sep 17 22:07:39.022528 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:39.022487    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6tvxh" podUID="ca00b930-fc79-4176-8a4e-cb280f838cb3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.28:8080: connect: connection refused"
Sep 17 22:07:39.951675 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:39.951626    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr" podUID="398c4373-3943-4ac6-8bdd-3c0fb7cf53c1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.29:8080: connect: connection refused"
Sep 17 22:07:39.951875 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:39.951798    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm" podUID="597d10f8-4378-4c6f-a191-8e132e3a52ef" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused"
Sep 17 22:07:44.027702 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:44.027673    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6tvxh"
Sep 17 22:07:44.028237 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:44.028209    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6tvxh" podUID="ca00b930-fc79-4176-8a4e-cb280f838cb3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.28:8080: connect: connection refused"
Sep 17 22:07:48.392613 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:48.392582    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-xcr4j_d690701c-bcec-48f2-9978-b6aebbf77447/console-operator/1.log"
Sep 17 22:07:48.393462 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:48.393437    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-xcr4j_d690701c-bcec-48f2-9978-b6aebbf77447/console-operator/1.log"
Sep 17 22:07:48.944342 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:48.944293    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-5854c-predictor-6b4b8df9b6-s96tc" podUID="d65798af-0569-40cc-bba8-57e4c85a4fa1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused"
Sep 17 22:07:49.951908 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:49.951860    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm" podUID="597d10f8-4378-4c6f-a191-8e132e3a52ef" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused"
Sep 17 22:07:49.952453 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:49.951861    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr" podUID="398c4373-3943-4ac6-8bdd-3c0fb7cf53c1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.29:8080: connect: connection refused"
Sep 17 22:07:54.028477 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:54.028434    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6tvxh" podUID="ca00b930-fc79-4176-8a4e-cb280f838cb3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.28:8080: connect: connection refused"
Sep 17 22:07:58.943904 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:58.943854    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-5854c-predictor-6b4b8df9b6-s96tc" podUID="d65798af-0569-40cc-bba8-57e4c85a4fa1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused"
Sep 17 22:07:59.951296 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:59.951244    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr" podUID="398c4373-3943-4ac6-8bdd-3c0fb7cf53c1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.29:8080: connect: connection refused"
Sep 17 22:07:59.951826 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:07:59.951792    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm" podUID="597d10f8-4378-4c6f-a191-8e132e3a52ef" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused"
Sep 17 22:08:04.028596 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:04.028555    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6tvxh" podUID="ca00b930-fc79-4176-8a4e-cb280f838cb3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.28:8080: connect: connection refused"
Sep 17 22:08:08.945272 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:08.945239    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-5854c-predictor-6b4b8df9b6-s96tc"
Sep 17 22:08:09.951621 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:09.951570    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr" podUID="398c4373-3943-4ac6-8bdd-3c0fb7cf53c1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.29:8080: connect: connection refused"
Sep 17 22:08:09.952015 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:09.951723    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm" podUID="597d10f8-4378-4c6f-a191-8e132e3a52ef" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused"
Sep 17 22:08:14.028235 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:14.028147    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6tvxh" podUID="ca00b930-fc79-4176-8a4e-cb280f838cb3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.28:8080: connect: connection refused"
Sep 17 22:08:19.951940 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:19.951895    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm" podUID="597d10f8-4378-4c6f-a191-8e132e3a52ef" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused"
Sep 17 22:08:19.952308 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:19.951901    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr" podUID="398c4373-3943-4ac6-8bdd-3c0fb7cf53c1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.29:8080: connect: connection refused"
Sep 17 22:08:24.028230 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:24.028188    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6tvxh" podUID="ca00b930-fc79-4176-8a4e-cb280f838cb3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.28:8080: connect: connection refused"
Sep 17 22:08:29.951670 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:29.951620    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr" podUID="398c4373-3943-4ac6-8bdd-3c0fb7cf53c1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.29:8080: connect: connection refused"
Sep 17 22:08:29.952910 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:29.951834    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm" podUID="597d10f8-4378-4c6f-a191-8e132e3a52ef" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused"
Sep 17 22:08:34.029048 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:34.029011    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6tvxh" podUID="ca00b930-fc79-4176-8a4e-cb280f838cb3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.28:8080: connect: connection refused"
Sep 17 22:08:35.679568 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:35.679529    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-5854c-predictor-6b4b8df9b6-s96tc"]
Sep 17 22:08:35.680028 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:35.679842    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-5854c-predictor-6b4b8df9b6-s96tc" podUID="d65798af-0569-40cc-bba8-57e4c85a4fa1" containerName="kserve-container" containerID="cri-o://bcdecbc3ad4322cac99f4633aaf907d2861103a444f454c721a4b4a2840a457e" gracePeriod=30
Sep 17 22:08:35.680028 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:35.679872    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-5854c-predictor-6b4b8df9b6-s96tc" podUID="d65798af-0569-40cc-bba8-57e4c85a4fa1" containerName="kube-rbac-proxy" containerID="cri-o://c0fd7e323682ae9b3215c75febf969d7de989f49d93b833b5cc606b6ef8dc07b" gracePeriod=30
Sep 17 22:08:35.808191 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:35.808162    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-8341c-predictor-d7cd9ccf8-djthv"]
Sep 17 22:08:35.810476 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:35.810450    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-8341c-predictor-d7cd9ccf8-djthv"
Sep 17 22:08:35.812757 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:35.812732    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-8341c-predictor-serving-cert\""
Sep 17 22:08:35.812852 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:35.812743    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-8341c-kube-rbac-proxy-sar-config\""
Sep 17 22:08:35.820305 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:35.820281    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-8341c-predictor-d7cd9ccf8-djthv"]
Sep 17 22:08:36.001434 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:35.996728    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-626gx\" (UniqueName: \"kubernetes.io/projected/c3f1d0b1-45ff-4db0-b7ee-112dcd198e94-kube-api-access-626gx\") pod \"success-200-isvc-8341c-predictor-d7cd9ccf8-djthv\" (UID: \"c3f1d0b1-45ff-4db0-b7ee-112dcd198e94\") " pod="kserve-ci-e2e-test/success-200-isvc-8341c-predictor-d7cd9ccf8-djthv"
Sep 17 22:08:36.001434 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:35.996816    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c3f1d0b1-45ff-4db0-b7ee-112dcd198e94-proxy-tls\") pod \"success-200-isvc-8341c-predictor-d7cd9ccf8-djthv\" (UID: \"c3f1d0b1-45ff-4db0-b7ee-112dcd198e94\") " pod="kserve-ci-e2e-test/success-200-isvc-8341c-predictor-d7cd9ccf8-djthv"
Sep 17 22:08:36.001434 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:35.996866    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c3f1d0b1-45ff-4db0-b7ee-112dcd198e94-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-8341c-predictor-d7cd9ccf8-djthv\" (UID: \"c3f1d0b1-45ff-4db0-b7ee-112dcd198e94\") " pod="kserve-ci-e2e-test/success-200-isvc-8341c-predictor-d7cd9ccf8-djthv"
Sep 17 22:08:36.098093 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:36.098050    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-626gx\" (UniqueName: \"kubernetes.io/projected/c3f1d0b1-45ff-4db0-b7ee-112dcd198e94-kube-api-access-626gx\") pod \"success-200-isvc-8341c-predictor-d7cd9ccf8-djthv\" (UID: \"c3f1d0b1-45ff-4db0-b7ee-112dcd198e94\") " pod="kserve-ci-e2e-test/success-200-isvc-8341c-predictor-d7cd9ccf8-djthv"
Sep 17 22:08:36.098261 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:36.098107    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c3f1d0b1-45ff-4db0-b7ee-112dcd198e94-proxy-tls\") pod \"success-200-isvc-8341c-predictor-d7cd9ccf8-djthv\" (UID: \"c3f1d0b1-45ff-4db0-b7ee-112dcd198e94\") " pod="kserve-ci-e2e-test/success-200-isvc-8341c-predictor-d7cd9ccf8-djthv"
Sep 17 22:08:36.098261 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:36.098141    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c3f1d0b1-45ff-4db0-b7ee-112dcd198e94-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-8341c-predictor-d7cd9ccf8-djthv\" (UID: \"c3f1d0b1-45ff-4db0-b7ee-112dcd198e94\") " pod="kserve-ci-e2e-test/success-200-isvc-8341c-predictor-d7cd9ccf8-djthv"
Sep 17 22:08:36.098954 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:36.098934    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c3f1d0b1-45ff-4db0-b7ee-112dcd198e94-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-8341c-predictor-d7cd9ccf8-djthv\" (UID: \"c3f1d0b1-45ff-4db0-b7ee-112dcd198e94\") " pod="kserve-ci-e2e-test/success-200-isvc-8341c-predictor-d7cd9ccf8-djthv"
Sep 17 22:08:36.100688 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:36.100663    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c3f1d0b1-45ff-4db0-b7ee-112dcd198e94-proxy-tls\") pod \"success-200-isvc-8341c-predictor-d7cd9ccf8-djthv\" (UID: \"c3f1d0b1-45ff-4db0-b7ee-112dcd198e94\") " pod="kserve-ci-e2e-test/success-200-isvc-8341c-predictor-d7cd9ccf8-djthv"
Sep 17 22:08:36.105646 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:36.105625    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-626gx\" (UniqueName: \"kubernetes.io/projected/c3f1d0b1-45ff-4db0-b7ee-112dcd198e94-kube-api-access-626gx\") pod \"success-200-isvc-8341c-predictor-d7cd9ccf8-djthv\" (UID: \"c3f1d0b1-45ff-4db0-b7ee-112dcd198e94\") " pod="kserve-ci-e2e-test/success-200-isvc-8341c-predictor-d7cd9ccf8-djthv"
Sep 17 22:08:36.121622 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:36.121597    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-8341c-predictor-d7cd9ccf8-djthv"
Sep 17 22:08:36.283081 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:36.282977    2560 generic.go:356] "Generic (PLEG): container finished" podID="d65798af-0569-40cc-bba8-57e4c85a4fa1" containerID="c0fd7e323682ae9b3215c75febf969d7de989f49d93b833b5cc606b6ef8dc07b" exitCode=2
Sep 17 22:08:36.283081 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:36.283052    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-5854c-predictor-6b4b8df9b6-s96tc" event={"ID":"d65798af-0569-40cc-bba8-57e4c85a4fa1","Type":"ContainerDied","Data":"c0fd7e323682ae9b3215c75febf969d7de989f49d93b833b5cc606b6ef8dc07b"}
Sep 17 22:08:36.391925 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:36.391900    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-8341c-predictor-d7cd9ccf8-djthv"]
Sep 17 22:08:36.393848 ip-10-0-136-66 kubenswrapper[2560]: W0917 22:08:36.393821    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3f1d0b1_45ff_4db0_b7ee_112dcd198e94.slice/crio-ea34ed11a0a87cde66e31bf423b397c04e38ada54aa5b156755da058abaa0771 WatchSource:0}: Error finding container ea34ed11a0a87cde66e31bf423b397c04e38ada54aa5b156755da058abaa0771: Status 404 returned error can't find the container with id ea34ed11a0a87cde66e31bf423b397c04e38ada54aa5b156755da058abaa0771
Sep 17 22:08:37.289518 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:37.289478    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-8341c-predictor-d7cd9ccf8-djthv" event={"ID":"c3f1d0b1-45ff-4db0-b7ee-112dcd198e94","Type":"ContainerStarted","Data":"7d91d1671d99b3738cedd695f4af0aac31c1425f7ca3ebfe71fb8f5c109f0212"}
Sep 17 22:08:37.289887 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:37.289568    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-8341c-predictor-d7cd9ccf8-djthv" event={"ID":"c3f1d0b1-45ff-4db0-b7ee-112dcd198e94","Type":"ContainerStarted","Data":"fac1e8e7da930b936ffe05d6b4baa6dac045b8a8455e2d5bc937d4b9c6ece4f4"}
Sep 17 22:08:37.289887 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:37.289603    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-8341c-predictor-d7cd9ccf8-djthv" event={"ID":"c3f1d0b1-45ff-4db0-b7ee-112dcd198e94","Type":"ContainerStarted","Data":"ea34ed11a0a87cde66e31bf423b397c04e38ada54aa5b156755da058abaa0771"}
Sep 17 22:08:37.289887 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:37.289631    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-8341c-predictor-d7cd9ccf8-djthv"
Sep 17 22:08:37.305647 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:37.305601    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-8341c-predictor-d7cd9ccf8-djthv" podStartSLOduration=2.305585551 podStartE2EDuration="2.305585551s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:08:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:08:37.304659224 +0000 UTC m=+649.364431272" watchObservedRunningTime="2026-09-17 22:08:37.305585551 +0000 UTC m=+649.365357560"
Sep 17 22:08:38.294854 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:38.294823    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-8341c-predictor-d7cd9ccf8-djthv"
Sep 17 22:08:38.296148 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:38.296119    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-8341c-predictor-d7cd9ccf8-djthv" podUID="c3f1d0b1-45ff-4db0-b7ee-112dcd198e94" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.30:8080: connect: connection refused"
Sep 17 22:08:38.939056 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:38.939001    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-5854c-predictor-6b4b8df9b6-s96tc" podUID="d65798af-0569-40cc-bba8-57e4c85a4fa1" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.26:8643/healthz\": dial tcp 10.132.0.26:8643: connect: connection refused"
Sep 17 22:08:38.943970 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:38.943931    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-5854c-predictor-6b4b8df9b6-s96tc" podUID="d65798af-0569-40cc-bba8-57e4c85a4fa1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused"
Sep 17 22:08:39.299737 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:39.299699    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-8341c-predictor-d7cd9ccf8-djthv" podUID="c3f1d0b1-45ff-4db0-b7ee-112dcd198e94" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.30:8080: connect: connection refused"
Sep 17 22:08:39.627764 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:39.627737    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-5854c-predictor-6b4b8df9b6-s96tc"
Sep 17 22:08:39.728614 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:39.728576    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d65798af-0569-40cc-bba8-57e4c85a4fa1-proxy-tls\") pod \"d65798af-0569-40cc-bba8-57e4c85a4fa1\" (UID: \"d65798af-0569-40cc-bba8-57e4c85a4fa1\") "
Sep 17 22:08:39.728801 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:39.728685    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d65798af-0569-40cc-bba8-57e4c85a4fa1-kube-rbac-proxy-sar-config\") pod \"d65798af-0569-40cc-bba8-57e4c85a4fa1\" (UID: \"d65798af-0569-40cc-bba8-57e4c85a4fa1\") "
Sep 17 22:08:39.728801 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:39.728712    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rjwpt\" (UniqueName: \"kubernetes.io/projected/d65798af-0569-40cc-bba8-57e4c85a4fa1-kube-api-access-rjwpt\") pod \"d65798af-0569-40cc-bba8-57e4c85a4fa1\" (UID: \"d65798af-0569-40cc-bba8-57e4c85a4fa1\") "
Sep 17 22:08:39.729044 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:39.729011    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d65798af-0569-40cc-bba8-57e4c85a4fa1-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "d65798af-0569-40cc-bba8-57e4c85a4fa1" (UID: "d65798af-0569-40cc-bba8-57e4c85a4fa1"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 22:08:39.730862 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:39.730840    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d65798af-0569-40cc-bba8-57e4c85a4fa1-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "d65798af-0569-40cc-bba8-57e4c85a4fa1" (UID: "d65798af-0569-40cc-bba8-57e4c85a4fa1"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 22:08:39.730939 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:39.730840    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d65798af-0569-40cc-bba8-57e4c85a4fa1-kube-api-access-rjwpt" (OuterVolumeSpecName: "kube-api-access-rjwpt") pod "d65798af-0569-40cc-bba8-57e4c85a4fa1" (UID: "d65798af-0569-40cc-bba8-57e4c85a4fa1"). InnerVolumeSpecName "kube-api-access-rjwpt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 22:08:39.830149 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:39.830110    2560 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d65798af-0569-40cc-bba8-57e4c85a4fa1-kube-rbac-proxy-sar-config\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\""
Sep 17 22:08:39.830149 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:39.830142    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjwpt\" (UniqueName: \"kubernetes.io/projected/d65798af-0569-40cc-bba8-57e4c85a4fa1-kube-api-access-rjwpt\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\""
Sep 17 22:08:39.830149 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:39.830152    2560 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d65798af-0569-40cc-bba8-57e4c85a4fa1-proxy-tls\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\""
Sep 17 22:08:39.952222 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:39.952118    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm" podUID="597d10f8-4378-4c6f-a191-8e132e3a52ef" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused"
Sep 17 22:08:39.952401 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:39.952120    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr" podUID="398c4373-3943-4ac6-8bdd-3c0fb7cf53c1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.29:8080: connect: connection refused"
Sep 17 22:08:40.305694 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:40.305650    2560 generic.go:356] "Generic (PLEG): container finished" podID="d65798af-0569-40cc-bba8-57e4c85a4fa1" containerID="bcdecbc3ad4322cac99f4633aaf907d2861103a444f454c721a4b4a2840a457e" exitCode=0
Sep 17 22:08:40.306097 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:40.305731    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-5854c-predictor-6b4b8df9b6-s96tc"
Sep 17 22:08:40.306097 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:40.305738    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-5854c-predictor-6b4b8df9b6-s96tc" event={"ID":"d65798af-0569-40cc-bba8-57e4c85a4fa1","Type":"ContainerDied","Data":"bcdecbc3ad4322cac99f4633aaf907d2861103a444f454c721a4b4a2840a457e"}
Sep 17 22:08:40.306097 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:40.305833    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-5854c-predictor-6b4b8df9b6-s96tc" event={"ID":"d65798af-0569-40cc-bba8-57e4c85a4fa1","Type":"ContainerDied","Data":"154e921221a5cca2240d14f1640b91dd5fc8c7da206a34c0e93ea41edada0848"}
Sep 17 22:08:40.306097 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:40.305861    2560 scope.go:117] "RemoveContainer" containerID="c0fd7e323682ae9b3215c75febf969d7de989f49d93b833b5cc606b6ef8dc07b"
Sep 17 22:08:40.314802 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:40.314785    2560 scope.go:117] "RemoveContainer" containerID="bcdecbc3ad4322cac99f4633aaf907d2861103a444f454c721a4b4a2840a457e"
Sep 17 22:08:40.324112 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:40.324081    2560 scope.go:117] "RemoveContainer" containerID="c0fd7e323682ae9b3215c75febf969d7de989f49d93b833b5cc606b6ef8dc07b"
Sep 17 22:08:40.324990 ip-10-0-136-66 kubenswrapper[2560]: E0917 22:08:40.324967    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0fd7e323682ae9b3215c75febf969d7de989f49d93b833b5cc606b6ef8dc07b\": container with ID starting with c0fd7e323682ae9b3215c75febf969d7de989f49d93b833b5cc606b6ef8dc07b not found: ID does not exist" containerID="c0fd7e323682ae9b3215c75febf969d7de989f49d93b833b5cc606b6ef8dc07b"
Sep 17 22:08:40.325101 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:40.325003    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0fd7e323682ae9b3215c75febf969d7de989f49d93b833b5cc606b6ef8dc07b"} err="failed to get container status \"c0fd7e323682ae9b3215c75febf969d7de989f49d93b833b5cc606b6ef8dc07b\": rpc error: code = NotFound desc = could not find container \"c0fd7e323682ae9b3215c75febf969d7de989f49d93b833b5cc606b6ef8dc07b\": container with ID starting with c0fd7e323682ae9b3215c75febf969d7de989f49d93b833b5cc606b6ef8dc07b not found: ID does not exist"
Sep 17 22:08:40.325101 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:40.325030    2560 scope.go:117] "RemoveContainer" containerID="bcdecbc3ad4322cac99f4633aaf907d2861103a444f454c721a4b4a2840a457e"
Sep 17 22:08:40.325327 ip-10-0-136-66 kubenswrapper[2560]: E0917 22:08:40.325309    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bcdecbc3ad4322cac99f4633aaf907d2861103a444f454c721a4b4a2840a457e\": container with ID starting with bcdecbc3ad4322cac99f4633aaf907d2861103a444f454c721a4b4a2840a457e not found: ID does not exist" containerID="bcdecbc3ad4322cac99f4633aaf907d2861103a444f454c721a4b4a2840a457e"
Sep 17 22:08:40.325396 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:40.325336    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcdecbc3ad4322cac99f4633aaf907d2861103a444f454c721a4b4a2840a457e"} err="failed to get container status \"bcdecbc3ad4322cac99f4633aaf907d2861103a444f454c721a4b4a2840a457e\": rpc error: code = NotFound desc = could not find container \"bcdecbc3ad4322cac99f4633aaf907d2861103a444f454c721a4b4a2840a457e\": container with ID starting with bcdecbc3ad4322cac99f4633aaf907d2861103a444f454c721a4b4a2840a457e not found: ID does not exist"
Sep 17 22:08:40.326149 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:40.326126    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-5854c-predictor-6b4b8df9b6-s96tc"]
Sep 17 22:08:40.329719 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:40.329700    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-5854c-predictor-6b4b8df9b6-s96tc"]
Sep 17 22:08:40.453513 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:40.453477    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d65798af-0569-40cc-bba8-57e4c85a4fa1" path="/var/lib/kubelet/pods/d65798af-0569-40cc-bba8-57e4c85a4fa1/volumes"
Sep 17 22:08:43.446597 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:43.446540    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm" podUID="597d10f8-4378-4c6f-a191-8e132e3a52ef" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused"
Sep 17 22:08:44.028567 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:44.028525    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6tvxh" podUID="ca00b930-fc79-4176-8a4e-cb280f838cb3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.28:8080: connect: connection refused"
Sep 17 22:08:44.304534 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:44.304456    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-8341c-predictor-d7cd9ccf8-djthv"
Sep 17 22:08:44.304925 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:44.304892    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-8341c-predictor-d7cd9ccf8-djthv" podUID="c3f1d0b1-45ff-4db0-b7ee-112dcd198e94" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.30:8080: connect: connection refused"
Sep 17 22:08:49.952135 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:49.952104    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr"
Sep 17 22:08:50.446192 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:50.446152    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6tvxh" podUID="ca00b930-fc79-4176-8a4e-cb280f838cb3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.28:8080: connect: connection refused"
Sep 17 22:08:53.447322 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:53.447283    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm"
Sep 17 22:08:54.305360 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:08:54.305306    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-8341c-predictor-d7cd9ccf8-djthv" podUID="c3f1d0b1-45ff-4db0-b7ee-112dcd198e94" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.30:8080: connect: connection refused"
Sep 17 22:09:00.451230 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:00.451200    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6tvxh"
Sep 17 22:09:04.305497 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:04.305449    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-8341c-predictor-d7cd9ccf8-djthv" podUID="c3f1d0b1-45ff-4db0-b7ee-112dcd198e94" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.30:8080: connect: connection refused"
Sep 17 22:09:14.305081 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:14.305039    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-8341c-predictor-d7cd9ccf8-djthv" podUID="c3f1d0b1-45ff-4db0-b7ee-112dcd198e94" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.30:8080: connect: connection refused"
Sep 17 22:09:24.305765 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:24.305733    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-8341c-predictor-d7cd9ccf8-djthv"
Sep 17 22:09:32.012835 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:32.012797    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr"]
Sep 17 22:09:32.013326 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:32.013122    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr" podUID="398c4373-3943-4ac6-8bdd-3c0fb7cf53c1" containerName="kserve-container" containerID="cri-o://bb15d2640198df6039973d5b3f13b48acf026d38198dc3a7b47ad76b0a1b3bf2" gracePeriod=30
Sep 17 22:09:32.013326 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:32.013149    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr" podUID="398c4373-3943-4ac6-8bdd-3c0fb7cf53c1" containerName="kube-rbac-proxy" containerID="cri-o://8337d04939ad369b45a7becdf4cd779fa0ea9de2cc258dae6945cbf7cf414c20" gracePeriod=30
Sep 17 22:09:32.041903 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:32.041869    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm"]
Sep 17 22:09:32.042123 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:32.042095    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm" podUID="597d10f8-4378-4c6f-a191-8e132e3a52ef" containerName="kserve-container" containerID="cri-o://4fc03f70dda8078f75c8e640531626beff45263eceb04a63fc63d9bc2823fb8c" gracePeriod=30
Sep 17 22:09:32.042198 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:32.042166    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm" podUID="597d10f8-4378-4c6f-a191-8e132e3a52ef" containerName="kube-rbac-proxy" containerID="cri-o://c70c167d6bf9a99d80397efd2711be659ba74e0b9704eb88861b053ddd276dd4" gracePeriod=30
Sep 17 22:09:32.081157 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:32.081116    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6tvxh"]
Sep 17 22:09:32.081466 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:32.081438    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6tvxh" podUID="ca00b930-fc79-4176-8a4e-cb280f838cb3" containerName="kserve-container" containerID="cri-o://6a0c2546868f60397274cfae5774359c4832bef531e86a272f936a8c6af82274" gracePeriod=30
Sep 17 22:09:32.081591 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:32.081521    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6tvxh" podUID="ca00b930-fc79-4176-8a4e-cb280f838cb3" containerName="kube-rbac-proxy" containerID="cri-o://37c276d0d4765c784abe6d06aa329b1ffa08c24d4afcdbe0e616dfb79dd60dca" gracePeriod=30
Sep 17 22:09:32.203951 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:32.203921    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-a4672-predictor-6fcf97dc64-k7rn2"]
Sep 17 22:09:32.204275 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:32.204263    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d65798af-0569-40cc-bba8-57e4c85a4fa1" containerName="kserve-container"
Sep 17 22:09:32.204316 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:32.204277    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d65798af-0569-40cc-bba8-57e4c85a4fa1" containerName="kserve-container"
Sep 17 22:09:32.204316 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:32.204291    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d65798af-0569-40cc-bba8-57e4c85a4fa1" containerName="kube-rbac-proxy"
Sep 17 22:09:32.204316 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:32.204296    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d65798af-0569-40cc-bba8-57e4c85a4fa1" containerName="kube-rbac-proxy"
Sep 17 22:09:32.204437 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:32.204370    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d65798af-0569-40cc-bba8-57e4c85a4fa1" containerName="kube-rbac-proxy"
Sep 17 22:09:32.204437 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:32.204381    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d65798af-0569-40cc-bba8-57e4c85a4fa1" containerName="kserve-container"
Sep 17 22:09:32.207424 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:32.207406    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-a4672-predictor-6fcf97dc64-k7rn2"
Sep 17 22:09:32.209959 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:32.209939    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-a4672-kube-rbac-proxy-sar-config\""
Sep 17 22:09:32.210063 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:32.209955    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-a4672-predictor-serving-cert\""
Sep 17 22:09:32.219225 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:32.219196    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-a4672-predictor-6fcf97dc64-k7rn2"]
Sep 17 22:09:32.364845 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:32.364740    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/870b2379-70d9-4935-97e9-e25bf72f09e8-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-a4672-predictor-6fcf97dc64-k7rn2\" (UID: \"870b2379-70d9-4935-97e9-e25bf72f09e8\") " pod="kserve-ci-e2e-test/success-200-isvc-a4672-predictor-6fcf97dc64-k7rn2"
Sep 17 22:09:32.364845 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:32.364823    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/870b2379-70d9-4935-97e9-e25bf72f09e8-proxy-tls\") pod \"success-200-isvc-a4672-predictor-6fcf97dc64-k7rn2\" (UID: \"870b2379-70d9-4935-97e9-e25bf72f09e8\") " pod="kserve-ci-e2e-test/success-200-isvc-a4672-predictor-6fcf97dc64-k7rn2"
Sep 17 22:09:32.364845 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:32.364845    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkczb\" (UniqueName: \"kubernetes.io/projected/870b2379-70d9-4935-97e9-e25bf72f09e8-kube-api-access-tkczb\") pod \"success-200-isvc-a4672-predictor-6fcf97dc64-k7rn2\" (UID: \"870b2379-70d9-4935-97e9-e25bf72f09e8\") " pod="kserve-ci-e2e-test/success-200-isvc-a4672-predictor-6fcf97dc64-k7rn2"
Sep 17 22:09:32.466009 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:32.465972    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/870b2379-70d9-4935-97e9-e25bf72f09e8-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-a4672-predictor-6fcf97dc64-k7rn2\" (UID: \"870b2379-70d9-4935-97e9-e25bf72f09e8\") " pod="kserve-ci-e2e-test/success-200-isvc-a4672-predictor-6fcf97dc64-k7rn2"
Sep 17 22:09:32.466009 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:32.466013    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/870b2379-70d9-4935-97e9-e25bf72f09e8-proxy-tls\") pod \"success-200-isvc-a4672-predictor-6fcf97dc64-k7rn2\" (UID: \"870b2379-70d9-4935-97e9-e25bf72f09e8\") " pod="kserve-ci-e2e-test/success-200-isvc-a4672-predictor-6fcf97dc64-k7rn2"
Sep 17 22:09:32.466218 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:32.466031    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkczb\" (UniqueName: \"kubernetes.io/projected/870b2379-70d9-4935-97e9-e25bf72f09e8-kube-api-access-tkczb\") pod \"success-200-isvc-a4672-predictor-6fcf97dc64-k7rn2\" (UID: \"870b2379-70d9-4935-97e9-e25bf72f09e8\") " pod="kserve-ci-e2e-test/success-200-isvc-a4672-predictor-6fcf97dc64-k7rn2"
Sep 17 22:09:32.466677 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:32.466651    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/870b2379-70d9-4935-97e9-e25bf72f09e8-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-a4672-predictor-6fcf97dc64-k7rn2\" (UID: \"870b2379-70d9-4935-97e9-e25bf72f09e8\") " pod="kserve-ci-e2e-test/success-200-isvc-a4672-predictor-6fcf97dc64-k7rn2"
Sep 17 22:09:32.468626 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:32.468603    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/870b2379-70d9-4935-97e9-e25bf72f09e8-proxy-tls\") pod \"success-200-isvc-a4672-predictor-6fcf97dc64-k7rn2\" (UID: \"870b2379-70d9-4935-97e9-e25bf72f09e8\") " pod="kserve-ci-e2e-test/success-200-isvc-a4672-predictor-6fcf97dc64-k7rn2"
Sep 17 22:09:32.474197 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:32.474173    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkczb\" (UniqueName: \"kubernetes.io/projected/870b2379-70d9-4935-97e9-e25bf72f09e8-kube-api-access-tkczb\") pod \"success-200-isvc-a4672-predictor-6fcf97dc64-k7rn2\" (UID: \"870b2379-70d9-4935-97e9-e25bf72f09e8\") " pod="kserve-ci-e2e-test/success-200-isvc-a4672-predictor-6fcf97dc64-k7rn2"
Sep 17 22:09:32.521000 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:32.520966    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-a4672-predictor-6fcf97dc64-k7rn2"
Sep 17 22:09:32.539975 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:32.539943    2560 generic.go:356] "Generic (PLEG): container finished" podID="398c4373-3943-4ac6-8bdd-3c0fb7cf53c1" containerID="8337d04939ad369b45a7becdf4cd779fa0ea9de2cc258dae6945cbf7cf414c20" exitCode=2
Sep 17 22:09:32.540084 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:32.539979    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr" event={"ID":"398c4373-3943-4ac6-8bdd-3c0fb7cf53c1","Type":"ContainerDied","Data":"8337d04939ad369b45a7becdf4cd779fa0ea9de2cc258dae6945cbf7cf414c20"}
Sep 17 22:09:32.542308 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:32.542276    2560 generic.go:356] "Generic (PLEG): container finished" podID="597d10f8-4378-4c6f-a191-8e132e3a52ef" containerID="c70c167d6bf9a99d80397efd2711be659ba74e0b9704eb88861b053ddd276dd4" exitCode=2
Sep 17 22:09:32.542437 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:32.542334    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm" event={"ID":"597d10f8-4378-4c6f-a191-8e132e3a52ef","Type":"ContainerDied","Data":"c70c167d6bf9a99d80397efd2711be659ba74e0b9704eb88861b053ddd276dd4"}
Sep 17 22:09:32.545241 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:32.545125    2560 generic.go:356] "Generic (PLEG): container finished" podID="ca00b930-fc79-4176-8a4e-cb280f838cb3" containerID="37c276d0d4765c784abe6d06aa329b1ffa08c24d4afcdbe0e616dfb79dd60dca" exitCode=2
Sep 17 22:09:32.545241 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:32.545153    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6tvxh" event={"ID":"ca00b930-fc79-4176-8a4e-cb280f838cb3","Type":"ContainerDied","Data":"37c276d0d4765c784abe6d06aa329b1ffa08c24d4afcdbe0e616dfb79dd60dca"}
Sep 17 22:09:32.791883 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:32.791706    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-a4672-predictor-6fcf97dc64-k7rn2"]
Sep 17 22:09:32.794689 ip-10-0-136-66 kubenswrapper[2560]: W0917 22:09:32.794660    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod870b2379_70d9_4935_97e9_e25bf72f09e8.slice/crio-40c1f6f0b2d9e9fd8ae001117d5279a980b88257ea2f192796ed8053d194258e WatchSource:0}: Error finding container 40c1f6f0b2d9e9fd8ae001117d5279a980b88257ea2f192796ed8053d194258e: Status 404 returned error can't find the container with id 40c1f6f0b2d9e9fd8ae001117d5279a980b88257ea2f192796ed8053d194258e
Sep 17 22:09:33.447416 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:33.447346    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm" podUID="597d10f8-4378-4c6f-a191-8e132e3a52ef" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused"
Sep 17 22:09:33.553589 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:33.553551    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-a4672-predictor-6fcf97dc64-k7rn2" event={"ID":"870b2379-70d9-4935-97e9-e25bf72f09e8","Type":"ContainerStarted","Data":"644b309aab779bdda2d2b67774d78aa134adc3bb063dafc66b2aeef2749c9bd5"}
Sep 17 22:09:33.553779 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:33.553701    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-a4672-predictor-6fcf97dc64-k7rn2"
Sep 17 22:09:33.553852 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:33.553827    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-a4672-predictor-6fcf97dc64-k7rn2"
Sep 17 22:09:33.553892 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:33.553881    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-a4672-predictor-6fcf97dc64-k7rn2" event={"ID":"870b2379-70d9-4935-97e9-e25bf72f09e8","Type":"ContainerStarted","Data":"0764174a4197e7e2cadf58cd0961d83cf5aeaaf6d363901f59a7a33c2fcd2742"}
Sep 17 22:09:33.553927 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:33.553905    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-a4672-predictor-6fcf97dc64-k7rn2" event={"ID":"870b2379-70d9-4935-97e9-e25bf72f09e8","Type":"ContainerStarted","Data":"40c1f6f0b2d9e9fd8ae001117d5279a980b88257ea2f192796ed8053d194258e"}
Sep 17 22:09:33.555006 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:33.554977    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-a4672-predictor-6fcf97dc64-k7rn2" podUID="870b2379-70d9-4935-97e9-e25bf72f09e8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.31:8080: connect: connection refused"
Sep 17 22:09:33.571231 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:33.571188    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-a4672-predictor-6fcf97dc64-k7rn2" podStartSLOduration=1.571172858 podStartE2EDuration="1.571172858s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:09:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:09:33.56971362 +0000 UTC m=+705.629485632" watchObservedRunningTime="2026-09-17 22:09:33.571172858 +0000 UTC m=+705.630944868"
Sep 17 22:09:34.023764 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:34.023714    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6tvxh" podUID="ca00b930-fc79-4176-8a4e-cb280f838cb3" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.28:8643/healthz\": dial tcp 10.132.0.28:8643: connect: connection refused"
Sep 17 22:09:34.557872 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:34.557831    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-a4672-predictor-6fcf97dc64-k7rn2" podUID="870b2379-70d9-4935-97e9-e25bf72f09e8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.31:8080: connect: connection refused"
Sep 17 22:09:34.945402 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:34.945280    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm" podUID="597d10f8-4378-4c6f-a191-8e132e3a52ef" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.27:8643/healthz\": dial tcp 10.132.0.27:8643: connect: connection refused"
Sep 17 22:09:34.945402 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:34.945282    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr" podUID="398c4373-3943-4ac6-8bdd-3c0fb7cf53c1" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.29:8643/healthz\": dial tcp 10.132.0.29:8643: connect: connection refused"
Sep 17 22:09:36.523737 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:36.523712    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6tvxh"
Sep 17 22:09:36.568984 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:36.568946    2560 generic.go:356] "Generic (PLEG): container finished" podID="ca00b930-fc79-4176-8a4e-cb280f838cb3" containerID="6a0c2546868f60397274cfae5774359c4832bef531e86a272f936a8c6af82274" exitCode=0
Sep 17 22:09:36.569150 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:36.568989    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6tvxh" event={"ID":"ca00b930-fc79-4176-8a4e-cb280f838cb3","Type":"ContainerDied","Data":"6a0c2546868f60397274cfae5774359c4832bef531e86a272f936a8c6af82274"}
Sep 17 22:09:36.569150 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:36.568999    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6tvxh"
Sep 17 22:09:36.569150 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:36.569041    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6tvxh" event={"ID":"ca00b930-fc79-4176-8a4e-cb280f838cb3","Type":"ContainerDied","Data":"e6375ac0b3bfe5048d81efa4e904c64a2c0250272d8a86c8899cbcae0d115195"}
Sep 17 22:09:36.569150 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:36.569069    2560 scope.go:117] "RemoveContainer" containerID="37c276d0d4765c784abe6d06aa329b1ffa08c24d4afcdbe0e616dfb79dd60dca"
Sep 17 22:09:36.576892 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:36.576876    2560 scope.go:117] "RemoveContainer" containerID="6a0c2546868f60397274cfae5774359c4832bef531e86a272f936a8c6af82274"
Sep 17 22:09:36.584274 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:36.584251    2560 scope.go:117] "RemoveContainer" containerID="f8a90835e88d15350f9aad4d56b5aa394ababf270851497656c6a2a20e1fc3a8"
Sep 17 22:09:36.591589 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:36.591575    2560 scope.go:117] "RemoveContainer" containerID="37c276d0d4765c784abe6d06aa329b1ffa08c24d4afcdbe0e616dfb79dd60dca"
Sep 17 22:09:36.591851 ip-10-0-136-66 kubenswrapper[2560]: E0917 22:09:36.591830    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37c276d0d4765c784abe6d06aa329b1ffa08c24d4afcdbe0e616dfb79dd60dca\": container with ID starting with 37c276d0d4765c784abe6d06aa329b1ffa08c24d4afcdbe0e616dfb79dd60dca not found: ID does not exist" containerID="37c276d0d4765c784abe6d06aa329b1ffa08c24d4afcdbe0e616dfb79dd60dca"
Sep 17 22:09:36.591905 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:36.591857    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37c276d0d4765c784abe6d06aa329b1ffa08c24d4afcdbe0e616dfb79dd60dca"} err="failed to get container status \"37c276d0d4765c784abe6d06aa329b1ffa08c24d4afcdbe0e616dfb79dd60dca\": rpc error: code = NotFound desc = could not find container \"37c276d0d4765c784abe6d06aa329b1ffa08c24d4afcdbe0e616dfb79dd60dca\": container with ID starting with 37c276d0d4765c784abe6d06aa329b1ffa08c24d4afcdbe0e616dfb79dd60dca not found: ID does not exist"
Sep 17 22:09:36.591905 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:36.591874    2560 scope.go:117] "RemoveContainer" containerID="6a0c2546868f60397274cfae5774359c4832bef531e86a272f936a8c6af82274"
Sep 17 22:09:36.592148 ip-10-0-136-66 kubenswrapper[2560]: E0917 22:09:36.592130    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a0c2546868f60397274cfae5774359c4832bef531e86a272f936a8c6af82274\": container with ID starting with 6a0c2546868f60397274cfae5774359c4832bef531e86a272f936a8c6af82274 not found: ID does not exist" containerID="6a0c2546868f60397274cfae5774359c4832bef531e86a272f936a8c6af82274"
Sep 17 22:09:36.592189 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:36.592163    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a0c2546868f60397274cfae5774359c4832bef531e86a272f936a8c6af82274"} err="failed to get container status \"6a0c2546868f60397274cfae5774359c4832bef531e86a272f936a8c6af82274\": rpc error: code = NotFound desc = could not find container \"6a0c2546868f60397274cfae5774359c4832bef531e86a272f936a8c6af82274\": container with ID starting with 6a0c2546868f60397274cfae5774359c4832bef531e86a272f936a8c6af82274 not found: ID does not exist"
Sep 17 22:09:36.592189 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:36.592184    2560 scope.go:117] "RemoveContainer" containerID="f8a90835e88d15350f9aad4d56b5aa394ababf270851497656c6a2a20e1fc3a8"
Sep 17 22:09:36.592449 ip-10-0-136-66 kubenswrapper[2560]: E0917 22:09:36.592428    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8a90835e88d15350f9aad4d56b5aa394ababf270851497656c6a2a20e1fc3a8\": container with ID starting with f8a90835e88d15350f9aad4d56b5aa394ababf270851497656c6a2a20e1fc3a8 not found: ID does not exist" containerID="f8a90835e88d15350f9aad4d56b5aa394ababf270851497656c6a2a20e1fc3a8"
Sep 17 22:09:36.592506 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:36.592453    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8a90835e88d15350f9aad4d56b5aa394ababf270851497656c6a2a20e1fc3a8"} err="failed to get container status \"f8a90835e88d15350f9aad4d56b5aa394ababf270851497656c6a2a20e1fc3a8\": rpc error: code = NotFound desc = could not find container \"f8a90835e88d15350f9aad4d56b5aa394ababf270851497656c6a2a20e1fc3a8\": container with ID starting with f8a90835e88d15350f9aad4d56b5aa394ababf270851497656c6a2a20e1fc3a8 not found: ID does not exist"
Sep 17 22:09:36.706980 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:36.706888    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ca00b930-fc79-4176-8a4e-cb280f838cb3-kube-rbac-proxy-sar-config\") pod \"ca00b930-fc79-4176-8a4e-cb280f838cb3\" (UID: \"ca00b930-fc79-4176-8a4e-cb280f838cb3\") "
Sep 17 22:09:36.707162 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:36.706994    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ca00b930-fc79-4176-8a4e-cb280f838cb3-proxy-tls\") pod \"ca00b930-fc79-4176-8a4e-cb280f838cb3\" (UID: \"ca00b930-fc79-4176-8a4e-cb280f838cb3\") "
Sep 17 22:09:36.707162 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:36.707021    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ca00b930-fc79-4176-8a4e-cb280f838cb3-kserve-provision-location\") pod \"ca00b930-fc79-4176-8a4e-cb280f838cb3\" (UID: \"ca00b930-fc79-4176-8a4e-cb280f838cb3\") "
Sep 17 22:09:36.707162 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:36.707085    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ca00b930-fc79-4176-8a4e-cb280f838cb3-cabundle-cert\") pod \"ca00b930-fc79-4176-8a4e-cb280f838cb3\" (UID: \"ca00b930-fc79-4176-8a4e-cb280f838cb3\") "
Sep 17 22:09:36.707162 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:36.707113    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-54wdr\" (UniqueName: \"kubernetes.io/projected/ca00b930-fc79-4176-8a4e-cb280f838cb3-kube-api-access-54wdr\") pod \"ca00b930-fc79-4176-8a4e-cb280f838cb3\" (UID: \"ca00b930-fc79-4176-8a4e-cb280f838cb3\") "
Sep 17 22:09:36.707431 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:36.707396    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca00b930-fc79-4176-8a4e-cb280f838cb3-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "ca00b930-fc79-4176-8a4e-cb280f838cb3" (UID: "ca00b930-fc79-4176-8a4e-cb280f838cb3"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 22:09:36.707431 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:36.707418    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca00b930-fc79-4176-8a4e-cb280f838cb3-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "ca00b930-fc79-4176-8a4e-cb280f838cb3" (UID: "ca00b930-fc79-4176-8a4e-cb280f838cb3"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:09:36.707552 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:36.707448    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca00b930-fc79-4176-8a4e-cb280f838cb3-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "ca00b930-fc79-4176-8a4e-cb280f838cb3" (UID: "ca00b930-fc79-4176-8a4e-cb280f838cb3"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 22:09:36.709168 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:36.709144    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca00b930-fc79-4176-8a4e-cb280f838cb3-kube-api-access-54wdr" (OuterVolumeSpecName: "kube-api-access-54wdr") pod "ca00b930-fc79-4176-8a4e-cb280f838cb3" (UID: "ca00b930-fc79-4176-8a4e-cb280f838cb3"). InnerVolumeSpecName "kube-api-access-54wdr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 22:09:36.709276 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:36.709192    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca00b930-fc79-4176-8a4e-cb280f838cb3-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "ca00b930-fc79-4176-8a4e-cb280f838cb3" (UID: "ca00b930-fc79-4176-8a4e-cb280f838cb3"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 22:09:36.807981 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:36.807949    2560 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ca00b930-fc79-4176-8a4e-cb280f838cb3-cabundle-cert\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\""
Sep 17 22:09:36.807981 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:36.807975    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-54wdr\" (UniqueName: \"kubernetes.io/projected/ca00b930-fc79-4176-8a4e-cb280f838cb3-kube-api-access-54wdr\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\""
Sep 17 22:09:36.807981 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:36.807985    2560 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ca00b930-fc79-4176-8a4e-cb280f838cb3-kube-rbac-proxy-sar-config\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\""
Sep 17 22:09:36.808203 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:36.807994    2560 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ca00b930-fc79-4176-8a4e-cb280f838cb3-proxy-tls\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\""
Sep 17 22:09:36.808203 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:36.808003    2560 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ca00b930-fc79-4176-8a4e-cb280f838cb3-kserve-provision-location\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\""
Sep 17 22:09:36.890949 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:36.890917    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6tvxh"]
Sep 17 22:09:36.896760 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:36.896734    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6tvxh"]
Sep 17 22:09:37.283567 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:37.283536    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm"
Sep 17 22:09:37.412218 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:37.412163    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/597d10f8-4378-4c6f-a191-8e132e3a52ef-kube-rbac-proxy-sar-config\") pod \"597d10f8-4378-4c6f-a191-8e132e3a52ef\" (UID: \"597d10f8-4378-4c6f-a191-8e132e3a52ef\") "
Sep 17 22:09:37.412425 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:37.412256    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vztgw\" (UniqueName: \"kubernetes.io/projected/597d10f8-4378-4c6f-a191-8e132e3a52ef-kube-api-access-vztgw\") pod \"597d10f8-4378-4c6f-a191-8e132e3a52ef\" (UID: \"597d10f8-4378-4c6f-a191-8e132e3a52ef\") "
Sep 17 22:09:37.412425 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:37.412319    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/597d10f8-4378-4c6f-a191-8e132e3a52ef-proxy-tls\") pod \"597d10f8-4378-4c6f-a191-8e132e3a52ef\" (UID: \"597d10f8-4378-4c6f-a191-8e132e3a52ef\") "
Sep 17 22:09:37.412425 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:37.412340    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/597d10f8-4378-4c6f-a191-8e132e3a52ef-cabundle-cert\") pod \"597d10f8-4378-4c6f-a191-8e132e3a52ef\" (UID: \"597d10f8-4378-4c6f-a191-8e132e3a52ef\") "
Sep 17 22:09:37.412425 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:37.412390    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/597d10f8-4378-4c6f-a191-8e132e3a52ef-kserve-provision-location\") pod \"597d10f8-4378-4c6f-a191-8e132e3a52ef\" (UID: \"597d10f8-4378-4c6f-a191-8e132e3a52ef\") "
Sep 17 22:09:37.412652 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:37.412548    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/597d10f8-4378-4c6f-a191-8e132e3a52ef-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "597d10f8-4378-4c6f-a191-8e132e3a52ef" (UID: "597d10f8-4378-4c6f-a191-8e132e3a52ef"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 22:09:37.412764 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:37.412740    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/597d10f8-4378-4c6f-a191-8e132e3a52ef-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "597d10f8-4378-4c6f-a191-8e132e3a52ef" (UID: "597d10f8-4378-4c6f-a191-8e132e3a52ef"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 22:09:37.412829 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:37.412781    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/597d10f8-4378-4c6f-a191-8e132e3a52ef-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "597d10f8-4378-4c6f-a191-8e132e3a52ef" (UID: "597d10f8-4378-4c6f-a191-8e132e3a52ef"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:09:37.414396 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:37.414378    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/597d10f8-4378-4c6f-a191-8e132e3a52ef-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "597d10f8-4378-4c6f-a191-8e132e3a52ef" (UID: "597d10f8-4378-4c6f-a191-8e132e3a52ef"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 22:09:37.414495 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:37.414407    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/597d10f8-4378-4c6f-a191-8e132e3a52ef-kube-api-access-vztgw" (OuterVolumeSpecName: "kube-api-access-vztgw") pod "597d10f8-4378-4c6f-a191-8e132e3a52ef" (UID: "597d10f8-4378-4c6f-a191-8e132e3a52ef"). InnerVolumeSpecName "kube-api-access-vztgw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 22:09:37.513159 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:37.513116    2560 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/597d10f8-4378-4c6f-a191-8e132e3a52ef-proxy-tls\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\""
Sep 17 22:09:37.513159 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:37.513149    2560 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/597d10f8-4378-4c6f-a191-8e132e3a52ef-cabundle-cert\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\""
Sep 17 22:09:37.513159 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:37.513159    2560 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/597d10f8-4378-4c6f-a191-8e132e3a52ef-kserve-provision-location\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\""
Sep 17 22:09:37.513159 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:37.513167    2560 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/597d10f8-4378-4c6f-a191-8e132e3a52ef-kube-rbac-proxy-sar-config\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\""
Sep 17 22:09:37.513439 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:37.513176    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vztgw\" (UniqueName: \"kubernetes.io/projected/597d10f8-4378-4c6f-a191-8e132e3a52ef-kube-api-access-vztgw\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\""
Sep 17 22:09:37.575679 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:37.575644    2560 generic.go:356] "Generic (PLEG): container finished" podID="597d10f8-4378-4c6f-a191-8e132e3a52ef" containerID="4fc03f70dda8078f75c8e640531626beff45263eceb04a63fc63d9bc2823fb8c" exitCode=0
Sep 17 22:09:37.576101 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:37.575711    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm"
Sep 17 22:09:37.576101 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:37.575739    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm" event={"ID":"597d10f8-4378-4c6f-a191-8e132e3a52ef","Type":"ContainerDied","Data":"4fc03f70dda8078f75c8e640531626beff45263eceb04a63fc63d9bc2823fb8c"}
Sep 17 22:09:37.576101 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:37.575816    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm" event={"ID":"597d10f8-4378-4c6f-a191-8e132e3a52ef","Type":"ContainerDied","Data":"9f386f0cdf7f87bdca65c550852c89173e0ee4d324c1ee7d5b7a0159bf1d59ca"}
Sep 17 22:09:37.576101 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:37.575857    2560 scope.go:117] "RemoveContainer" containerID="c70c167d6bf9a99d80397efd2711be659ba74e0b9704eb88861b053ddd276dd4"
Sep 17 22:09:37.584489 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:37.584474    2560 scope.go:117] "RemoveContainer" containerID="4fc03f70dda8078f75c8e640531626beff45263eceb04a63fc63d9bc2823fb8c"
Sep 17 22:09:37.592527 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:37.592501    2560 scope.go:117] "RemoveContainer" containerID="9f4ce6f1bc8dc2a24ca9e57f2d13b56a0745de8f4e5142ebed41edeb0ae5cc28"
Sep 17 22:09:37.598235 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:37.598201    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm"]
Sep 17 22:09:37.600413 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:37.600396    2560 scope.go:117] "RemoveContainer" containerID="c70c167d6bf9a99d80397efd2711be659ba74e0b9704eb88861b053ddd276dd4"
Sep 17 22:09:37.600690 ip-10-0-136-66 kubenswrapper[2560]: E0917 22:09:37.600663    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c70c167d6bf9a99d80397efd2711be659ba74e0b9704eb88861b053ddd276dd4\": container with ID starting with c70c167d6bf9a99d80397efd2711be659ba74e0b9704eb88861b053ddd276dd4 not found: ID does not exist" containerID="c70c167d6bf9a99d80397efd2711be659ba74e0b9704eb88861b053ddd276dd4"
Sep 17 22:09:37.600735 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:37.600698    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c70c167d6bf9a99d80397efd2711be659ba74e0b9704eb88861b053ddd276dd4"} err="failed to get container status \"c70c167d6bf9a99d80397efd2711be659ba74e0b9704eb88861b053ddd276dd4\": rpc error: code = NotFound desc = could not find container \"c70c167d6bf9a99d80397efd2711be659ba74e0b9704eb88861b053ddd276dd4\": container with ID starting with c70c167d6bf9a99d80397efd2711be659ba74e0b9704eb88861b053ddd276dd4 not found: ID does not exist"
Sep 17 22:09:37.600735 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:37.600718    2560 scope.go:117] "RemoveContainer" containerID="4fc03f70dda8078f75c8e640531626beff45263eceb04a63fc63d9bc2823fb8c"
Sep 17 22:09:37.600976 ip-10-0-136-66 kubenswrapper[2560]: E0917 22:09:37.600961    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4fc03f70dda8078f75c8e640531626beff45263eceb04a63fc63d9bc2823fb8c\": container with ID starting with 4fc03f70dda8078f75c8e640531626beff45263eceb04a63fc63d9bc2823fb8c not found: ID does not exist" containerID="4fc03f70dda8078f75c8e640531626beff45263eceb04a63fc63d9bc2823fb8c"
Sep 17 22:09:37.601022 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:37.600979    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4fc03f70dda8078f75c8e640531626beff45263eceb04a63fc63d9bc2823fb8c"} err="failed to get container status \"4fc03f70dda8078f75c8e640531626beff45263eceb04a63fc63d9bc2823fb8c\": rpc error: code = NotFound desc = could not find container \"4fc03f70dda8078f75c8e640531626beff45263eceb04a63fc63d9bc2823fb8c\": container with ID starting with 4fc03f70dda8078f75c8e640531626beff45263eceb04a63fc63d9bc2823fb8c not found: ID does not exist"
Sep 17 22:09:37.601022 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:37.600993    2560 scope.go:117] "RemoveContainer" containerID="9f4ce6f1bc8dc2a24ca9e57f2d13b56a0745de8f4e5142ebed41edeb0ae5cc28"
Sep 17 22:09:37.601255 ip-10-0-136-66 kubenswrapper[2560]: E0917 22:09:37.601233    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f4ce6f1bc8dc2a24ca9e57f2d13b56a0745de8f4e5142ebed41edeb0ae5cc28\": container with ID starting with 9f4ce6f1bc8dc2a24ca9e57f2d13b56a0745de8f4e5142ebed41edeb0ae5cc28 not found: ID does not exist" containerID="9f4ce6f1bc8dc2a24ca9e57f2d13b56a0745de8f4e5142ebed41edeb0ae5cc28"
Sep 17 22:09:37.601295 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:37.601254    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f4ce6f1bc8dc2a24ca9e57f2d13b56a0745de8f4e5142ebed41edeb0ae5cc28"} err="failed to get container status \"9f4ce6f1bc8dc2a24ca9e57f2d13b56a0745de8f4e5142ebed41edeb0ae5cc28\": rpc error: code = NotFound desc = could not find container \"9f4ce6f1bc8dc2a24ca9e57f2d13b56a0745de8f4e5142ebed41edeb0ae5cc28\": container with ID starting with 9f4ce6f1bc8dc2a24ca9e57f2d13b56a0745de8f4e5142ebed41edeb0ae5cc28 not found: ID does not exist"
Sep 17 22:09:37.603780 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:37.603758    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-74fc5cfbf9-9c6gm"]
Sep 17 22:09:37.957189 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:37.957165    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr"
Sep 17 22:09:38.116943 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:38.116859    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/398c4373-3943-4ac6-8bdd-3c0fb7cf53c1-cabundle-cert\") pod \"398c4373-3943-4ac6-8bdd-3c0fb7cf53c1\" (UID: \"398c4373-3943-4ac6-8bdd-3c0fb7cf53c1\") "
Sep 17 22:09:38.116943 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:38.116913    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/398c4373-3943-4ac6-8bdd-3c0fb7cf53c1-kube-rbac-proxy-sar-config\") pod \"398c4373-3943-4ac6-8bdd-3c0fb7cf53c1\" (UID: \"398c4373-3943-4ac6-8bdd-3c0fb7cf53c1\") "
Sep 17 22:09:38.116943 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:38.116937    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzgvg\" (UniqueName: \"kubernetes.io/projected/398c4373-3943-4ac6-8bdd-3c0fb7cf53c1-kube-api-access-nzgvg\") pod \"398c4373-3943-4ac6-8bdd-3c0fb7cf53c1\" (UID: \"398c4373-3943-4ac6-8bdd-3c0fb7cf53c1\") "
Sep 17 22:09:38.117202 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:38.116956    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/398c4373-3943-4ac6-8bdd-3c0fb7cf53c1-proxy-tls\") pod \"398c4373-3943-4ac6-8bdd-3c0fb7cf53c1\" (UID: \"398c4373-3943-4ac6-8bdd-3c0fb7cf53c1\") "
Sep 17 22:09:38.117202 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:38.117009    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/398c4373-3943-4ac6-8bdd-3c0fb7cf53c1-kserve-provision-location\") pod \"398c4373-3943-4ac6-8bdd-3c0fb7cf53c1\" (UID: \"398c4373-3943-4ac6-8bdd-3c0fb7cf53c1\") "
Sep 17 22:09:38.117305 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:38.117269    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/398c4373-3943-4ac6-8bdd-3c0fb7cf53c1-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "398c4373-3943-4ac6-8bdd-3c0fb7cf53c1" (UID: "398c4373-3943-4ac6-8bdd-3c0fb7cf53c1"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 22:09:38.117438 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:38.117409    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/398c4373-3943-4ac6-8bdd-3c0fb7cf53c1-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "398c4373-3943-4ac6-8bdd-3c0fb7cf53c1" (UID: "398c4373-3943-4ac6-8bdd-3c0fb7cf53c1"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 22:09:38.117499 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:38.117429    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/398c4373-3943-4ac6-8bdd-3c0fb7cf53c1-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "398c4373-3943-4ac6-8bdd-3c0fb7cf53c1" (UID: "398c4373-3943-4ac6-8bdd-3c0fb7cf53c1"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 22:09:38.119065 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:38.119046    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/398c4373-3943-4ac6-8bdd-3c0fb7cf53c1-kube-api-access-nzgvg" (OuterVolumeSpecName: "kube-api-access-nzgvg") pod "398c4373-3943-4ac6-8bdd-3c0fb7cf53c1" (UID: "398c4373-3943-4ac6-8bdd-3c0fb7cf53c1"). InnerVolumeSpecName "kube-api-access-nzgvg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 22:09:38.119065 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:38.119055    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/398c4373-3943-4ac6-8bdd-3c0fb7cf53c1-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "398c4373-3943-4ac6-8bdd-3c0fb7cf53c1" (UID: "398c4373-3943-4ac6-8bdd-3c0fb7cf53c1"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 22:09:38.218192 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:38.218152    2560 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/398c4373-3943-4ac6-8bdd-3c0fb7cf53c1-kserve-provision-location\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\""
Sep 17 22:09:38.218192 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:38.218184    2560 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/398c4373-3943-4ac6-8bdd-3c0fb7cf53c1-cabundle-cert\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\""
Sep 17 22:09:38.218192 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:38.218194    2560 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/398c4373-3943-4ac6-8bdd-3c0fb7cf53c1-kube-rbac-proxy-sar-config\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\""
Sep 17 22:09:38.218428 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:38.218204    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzgvg\" (UniqueName: \"kubernetes.io/projected/398c4373-3943-4ac6-8bdd-3c0fb7cf53c1-kube-api-access-nzgvg\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\""
Sep 17 22:09:38.218428 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:38.218215    2560 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/398c4373-3943-4ac6-8bdd-3c0fb7cf53c1-proxy-tls\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\""
Sep 17 22:09:38.453466 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:38.453389    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="597d10f8-4378-4c6f-a191-8e132e3a52ef" path="/var/lib/kubelet/pods/597d10f8-4378-4c6f-a191-8e132e3a52ef/volumes"
Sep 17 22:09:38.453881 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:38.453866    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca00b930-fc79-4176-8a4e-cb280f838cb3" path="/var/lib/kubelet/pods/ca00b930-fc79-4176-8a4e-cb280f838cb3/volumes"
Sep 17 22:09:38.582708 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:38.582675    2560 generic.go:356] "Generic (PLEG): container finished" podID="398c4373-3943-4ac6-8bdd-3c0fb7cf53c1" containerID="bb15d2640198df6039973d5b3f13b48acf026d38198dc3a7b47ad76b0a1b3bf2" exitCode=0
Sep 17 22:09:38.583218 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:38.582736    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr"
Sep 17 22:09:38.583218 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:38.582740    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr" event={"ID":"398c4373-3943-4ac6-8bdd-3c0fb7cf53c1","Type":"ContainerDied","Data":"bb15d2640198df6039973d5b3f13b48acf026d38198dc3a7b47ad76b0a1b3bf2"}
Sep 17 22:09:38.583218 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:38.582797    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr" event={"ID":"398c4373-3943-4ac6-8bdd-3c0fb7cf53c1","Type":"ContainerDied","Data":"54ad9c7347cd83e9dee2ed77d05b56b37a641cbbb9e21fb15969eb3f8de573a7"}
Sep 17 22:09:38.583218 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:38.582834    2560 scope.go:117] "RemoveContainer" containerID="8337d04939ad369b45a7becdf4cd779fa0ea9de2cc258dae6945cbf7cf414c20"
Sep 17 22:09:38.592580 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:38.592565    2560 scope.go:117] "RemoveContainer" containerID="bb15d2640198df6039973d5b3f13b48acf026d38198dc3a7b47ad76b0a1b3bf2"
Sep 17 22:09:38.600679 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:38.600653    2560 scope.go:117] "RemoveContainer" containerID="636425a03d3d1b3b67f3827058ba0dfd561926590541327a7b43c47b3dc42826"
Sep 17 22:09:38.601549 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:38.601526    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr"]
Sep 17 22:09:38.605370 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:38.605340    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-76857dd9b4-4fgsr"]
Sep 17 22:09:38.608111 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:38.608093    2560 scope.go:117] "RemoveContainer" containerID="8337d04939ad369b45a7becdf4cd779fa0ea9de2cc258dae6945cbf7cf414c20"
Sep 17 22:09:38.608432 ip-10-0-136-66 kubenswrapper[2560]: E0917 22:09:38.608399    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8337d04939ad369b45a7becdf4cd779fa0ea9de2cc258dae6945cbf7cf414c20\": container with ID starting with 8337d04939ad369b45a7becdf4cd779fa0ea9de2cc258dae6945cbf7cf414c20 not found: ID does not exist" containerID="8337d04939ad369b45a7becdf4cd779fa0ea9de2cc258dae6945cbf7cf414c20"
Sep 17 22:09:38.608497 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:38.608424    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8337d04939ad369b45a7becdf4cd779fa0ea9de2cc258dae6945cbf7cf414c20"} err="failed to get container status \"8337d04939ad369b45a7becdf4cd779fa0ea9de2cc258dae6945cbf7cf414c20\": rpc error: code = NotFound desc = could not find container \"8337d04939ad369b45a7becdf4cd779fa0ea9de2cc258dae6945cbf7cf414c20\": container with ID starting with 8337d04939ad369b45a7becdf4cd779fa0ea9de2cc258dae6945cbf7cf414c20 not found: ID does not exist"
Sep 17 22:09:38.608497 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:38.608443    2560 scope.go:117] "RemoveContainer" containerID="bb15d2640198df6039973d5b3f13b48acf026d38198dc3a7b47ad76b0a1b3bf2"
Sep 17 22:09:38.608700 ip-10-0-136-66 kubenswrapper[2560]: E0917 22:09:38.608682    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb15d2640198df6039973d5b3f13b48acf026d38198dc3a7b47ad76b0a1b3bf2\": container with ID starting with bb15d2640198df6039973d5b3f13b48acf026d38198dc3a7b47ad76b0a1b3bf2 not found: ID does not exist" containerID="bb15d2640198df6039973d5b3f13b48acf026d38198dc3a7b47ad76b0a1b3bf2"
Sep 17 22:09:38.608746 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:38.608708    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb15d2640198df6039973d5b3f13b48acf026d38198dc3a7b47ad76b0a1b3bf2"} err="failed to get container status \"bb15d2640198df6039973d5b3f13b48acf026d38198dc3a7b47ad76b0a1b3bf2\": rpc error: code = NotFound desc = could not find container \"bb15d2640198df6039973d5b3f13b48acf026d38198dc3a7b47ad76b0a1b3bf2\": container with ID starting with bb15d2640198df6039973d5b3f13b48acf026d38198dc3a7b47ad76b0a1b3bf2 not found: ID does not exist"
Sep 17 22:09:38.608746 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:38.608722    2560 scope.go:117] "RemoveContainer" containerID="636425a03d3d1b3b67f3827058ba0dfd561926590541327a7b43c47b3dc42826"
Sep 17 22:09:38.608966 ip-10-0-136-66 kubenswrapper[2560]: E0917 22:09:38.608949    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"636425a03d3d1b3b67f3827058ba0dfd561926590541327a7b43c47b3dc42826\": container with ID starting with 636425a03d3d1b3b67f3827058ba0dfd561926590541327a7b43c47b3dc42826 not found: ID does not exist" containerID="636425a03d3d1b3b67f3827058ba0dfd561926590541327a7b43c47b3dc42826"
Sep 17 22:09:38.609004 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:38.608970    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"636425a03d3d1b3b67f3827058ba0dfd561926590541327a7b43c47b3dc42826"} err="failed to get container status \"636425a03d3d1b3b67f3827058ba0dfd561926590541327a7b43c47b3dc42826\": rpc error: code = NotFound desc = could not find container \"636425a03d3d1b3b67f3827058ba0dfd561926590541327a7b43c47b3dc42826\": container with ID starting with 636425a03d3d1b3b67f3827058ba0dfd561926590541327a7b43c47b3dc42826 not found: ID does not exist"
Sep 17 22:09:39.562219 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:39.562191    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-a4672-predictor-6fcf97dc64-k7rn2"
Sep 17 22:09:39.562685 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:39.562658    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-a4672-predictor-6fcf97dc64-k7rn2" podUID="870b2379-70d9-4935-97e9-e25bf72f09e8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.31:8080: connect: connection refused"
Sep 17 22:09:40.450862 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:40.450829    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="398c4373-3943-4ac6-8bdd-3c0fb7cf53c1" path="/var/lib/kubelet/pods/398c4373-3943-4ac6-8bdd-3c0fb7cf53c1/volumes"
Sep 17 22:09:49.562840 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:49.562797    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-a4672-predictor-6fcf97dc64-k7rn2" podUID="870b2379-70d9-4935-97e9-e25bf72f09e8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.31:8080: connect: connection refused"
Sep 17 22:09:59.563561 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:09:59.563518    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-a4672-predictor-6fcf97dc64-k7rn2" podUID="870b2379-70d9-4935-97e9-e25bf72f09e8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.31:8080: connect: connection refused"
Sep 17 22:10:09.562864 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:10:09.562826    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-a4672-predictor-6fcf97dc64-k7rn2" podUID="870b2379-70d9-4935-97e9-e25bf72f09e8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.31:8080: connect: connection refused"
Sep 17 22:10:19.563504 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:10:19.563474    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-a4672-predictor-6fcf97dc64-k7rn2"
Sep 17 22:12:48.420225 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:12:48.420150    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-xcr4j_d690701c-bcec-48f2-9978-b6aebbf77447/console-operator/1.log"
Sep 17 22:12:48.420714 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:12:48.420394    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-xcr4j_d690701c-bcec-48f2-9978-b6aebbf77447/console-operator/1.log"
Sep 17 22:17:48.454829 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:48.454743    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-xcr4j_d690701c-bcec-48f2-9978-b6aebbf77447/console-operator/1.log"
Sep 17 22:17:48.457241 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:48.455627    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-xcr4j_d690701c-bcec-48f2-9978-b6aebbf77447/console-operator/1.log"
Sep 17 22:17:50.558253 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:50.558222    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-8341c-predictor-d7cd9ccf8-djthv"]
Sep 17 22:17:50.558689 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:50.558472    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-8341c-predictor-d7cd9ccf8-djthv" podUID="c3f1d0b1-45ff-4db0-b7ee-112dcd198e94" containerName="kserve-container" containerID="cri-o://fac1e8e7da930b936ffe05d6b4baa6dac045b8a8455e2d5bc937d4b9c6ece4f4" gracePeriod=30
Sep 17 22:17:50.558689 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:50.558515    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-8341c-predictor-d7cd9ccf8-djthv" podUID="c3f1d0b1-45ff-4db0-b7ee-112dcd198e94" containerName="kube-rbac-proxy" containerID="cri-o://7d91d1671d99b3738cedd695f4af0aac31c1425f7ca3ebfe71fb8f5c109f0212" gracePeriod=30
Sep 17 22:17:50.662637 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:50.662602    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-ab288-predictor-75cb7d4446-nr4z7"]
Sep 17 22:17:50.663105 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:50.663075    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="597d10f8-4378-4c6f-a191-8e132e3a52ef" containerName="kube-rbac-proxy"
Sep 17 22:17:50.663259 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:50.663119    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="597d10f8-4378-4c6f-a191-8e132e3a52ef" containerName="kube-rbac-proxy"
Sep 17 22:17:50.663259 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:50.663141    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="398c4373-3943-4ac6-8bdd-3c0fb7cf53c1" containerName="storage-initializer"
Sep 17 22:17:50.663259 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:50.663150    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="398c4373-3943-4ac6-8bdd-3c0fb7cf53c1" containerName="storage-initializer"
Sep 17 22:17:50.663259 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:50.663207    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca00b930-fc79-4176-8a4e-cb280f838cb3" containerName="kserve-container"
Sep 17 22:17:50.663259 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:50.663216    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca00b930-fc79-4176-8a4e-cb280f838cb3" containerName="kserve-container"
Sep 17 22:17:50.663259 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:50.663234    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca00b930-fc79-4176-8a4e-cb280f838cb3" containerName="storage-initializer"
Sep 17 22:17:50.663259 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:50.663242    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca00b930-fc79-4176-8a4e-cb280f838cb3" containerName="storage-initializer"
Sep 17 22:17:50.663259 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:50.663250    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca00b930-fc79-4176-8a4e-cb280f838cb3" containerName="kube-rbac-proxy"
Sep 17 22:17:50.663259 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:50.663258    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca00b930-fc79-4176-8a4e-cb280f838cb3" containerName="kube-rbac-proxy"
Sep 17 22:17:50.663774 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:50.663275    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="597d10f8-4378-4c6f-a191-8e132e3a52ef" containerName="kserve-container"
Sep 17 22:17:50.663774 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:50.663283    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="597d10f8-4378-4c6f-a191-8e132e3a52ef" containerName="kserve-container"
Sep 17 22:17:50.663774 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:50.663294    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="398c4373-3943-4ac6-8bdd-3c0fb7cf53c1" containerName="kserve-container"
Sep 17 22:17:50.663774 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:50.663303    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="398c4373-3943-4ac6-8bdd-3c0fb7cf53c1" containerName="kserve-container"
Sep 17 22:17:50.663774 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:50.663312    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="597d10f8-4378-4c6f-a191-8e132e3a52ef" containerName="storage-initializer"
Sep 17 22:17:50.663774 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:50.663320    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="597d10f8-4378-4c6f-a191-8e132e3a52ef" containerName="storage-initializer"
Sep 17 22:17:50.663774 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:50.663333    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="398c4373-3943-4ac6-8bdd-3c0fb7cf53c1" containerName="kube-rbac-proxy"
Sep 17 22:17:50.663774 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:50.663343    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="398c4373-3943-4ac6-8bdd-3c0fb7cf53c1" containerName="kube-rbac-proxy"
Sep 17 22:17:50.663774 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:50.663489    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca00b930-fc79-4176-8a4e-cb280f838cb3" containerName="kserve-container"
Sep 17 22:17:50.663774 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:50.663502    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="597d10f8-4378-4c6f-a191-8e132e3a52ef" containerName="kube-rbac-proxy"
Sep 17 22:17:50.663774 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:50.663513    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="597d10f8-4378-4c6f-a191-8e132e3a52ef" containerName="kserve-container"
Sep 17 22:17:50.663774 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:50.663522    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="398c4373-3943-4ac6-8bdd-3c0fb7cf53c1" containerName="kserve-container"
Sep 17 22:17:50.663774 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:50.663531    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca00b930-fc79-4176-8a4e-cb280f838cb3" containerName="kube-rbac-proxy"
Sep 17 22:17:50.663774 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:50.663540    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="398c4373-3943-4ac6-8bdd-3c0fb7cf53c1" containerName="kube-rbac-proxy"
Sep 17 22:17:50.667118 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:50.667095    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-ab288-predictor-75cb7d4446-nr4z7"
Sep 17 22:17:50.670013 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:50.669988    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-ab288-predictor-serving-cert\""
Sep 17 22:17:50.670136 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:50.669998    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-ab288-kube-rbac-proxy-sar-config\""
Sep 17 22:17:50.674554 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:50.674530    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-ab288-predictor-75cb7d4446-nr4z7"]
Sep 17 22:17:50.700123 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:50.700093    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c556aa8a-4811-4f20-9676-a06a92284f8f-proxy-tls\") pod \"success-200-isvc-ab288-predictor-75cb7d4446-nr4z7\" (UID: \"c556aa8a-4811-4f20-9676-a06a92284f8f\") " pod="kserve-ci-e2e-test/success-200-isvc-ab288-predictor-75cb7d4446-nr4z7"
Sep 17 22:17:50.700243 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:50.700139    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9w5n6\" (UniqueName: \"kubernetes.io/projected/c556aa8a-4811-4f20-9676-a06a92284f8f-kube-api-access-9w5n6\") pod \"success-200-isvc-ab288-predictor-75cb7d4446-nr4z7\" (UID: \"c556aa8a-4811-4f20-9676-a06a92284f8f\") " pod="kserve-ci-e2e-test/success-200-isvc-ab288-predictor-75cb7d4446-nr4z7"
Sep 17 22:17:50.700243 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:50.700163    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c556aa8a-4811-4f20-9676-a06a92284f8f-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-ab288-predictor-75cb7d4446-nr4z7\" (UID: \"c556aa8a-4811-4f20-9676-a06a92284f8f\") " pod="kserve-ci-e2e-test/success-200-isvc-ab288-predictor-75cb7d4446-nr4z7"
Sep 17 22:17:50.801487 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:50.801455    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9w5n6\" (UniqueName: \"kubernetes.io/projected/c556aa8a-4811-4f20-9676-a06a92284f8f-kube-api-access-9w5n6\") pod \"success-200-isvc-ab288-predictor-75cb7d4446-nr4z7\" (UID: \"c556aa8a-4811-4f20-9676-a06a92284f8f\") " pod="kserve-ci-e2e-test/success-200-isvc-ab288-predictor-75cb7d4446-nr4z7"
Sep 17 22:17:50.801645 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:50.801492    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c556aa8a-4811-4f20-9676-a06a92284f8f-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-ab288-predictor-75cb7d4446-nr4z7\" (UID: \"c556aa8a-4811-4f20-9676-a06a92284f8f\") " pod="kserve-ci-e2e-test/success-200-isvc-ab288-predictor-75cb7d4446-nr4z7"
Sep 17 22:17:50.801645 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:50.801541    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c556aa8a-4811-4f20-9676-a06a92284f8f-proxy-tls\") pod \"success-200-isvc-ab288-predictor-75cb7d4446-nr4z7\" (UID: \"c556aa8a-4811-4f20-9676-a06a92284f8f\") " pod="kserve-ci-e2e-test/success-200-isvc-ab288-predictor-75cb7d4446-nr4z7"
Sep 17 22:17:50.802281 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:50.802258    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c556aa8a-4811-4f20-9676-a06a92284f8f-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-ab288-predictor-75cb7d4446-nr4z7\" (UID: \"c556aa8a-4811-4f20-9676-a06a92284f8f\") " pod="kserve-ci-e2e-test/success-200-isvc-ab288-predictor-75cb7d4446-nr4z7"
Sep 17 22:17:50.804150 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:50.804123    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c556aa8a-4811-4f20-9676-a06a92284f8f-proxy-tls\") pod \"success-200-isvc-ab288-predictor-75cb7d4446-nr4z7\" (UID: \"c556aa8a-4811-4f20-9676-a06a92284f8f\") " pod="kserve-ci-e2e-test/success-200-isvc-ab288-predictor-75cb7d4446-nr4z7"
Sep 17 22:17:50.811941 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:50.811887    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9w5n6\" (UniqueName: \"kubernetes.io/projected/c556aa8a-4811-4f20-9676-a06a92284f8f-kube-api-access-9w5n6\") pod \"success-200-isvc-ab288-predictor-75cb7d4446-nr4z7\" (UID: \"c556aa8a-4811-4f20-9676-a06a92284f8f\") " pod="kserve-ci-e2e-test/success-200-isvc-ab288-predictor-75cb7d4446-nr4z7"
Sep 17 22:17:50.979763 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:50.979727    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-ab288-predictor-75cb7d4446-nr4z7"
Sep 17 22:17:51.257162 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:51.257137    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-ab288-predictor-75cb7d4446-nr4z7"]
Sep 17 22:17:51.259023 ip-10-0-136-66 kubenswrapper[2560]: W0917 22:17:51.258998    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc556aa8a_4811_4f20_9676_a06a92284f8f.slice/crio-b2466ca018055e0ee303fb80464ddc420679bb7309d035241e936cca58991288 WatchSource:0}: Error finding container b2466ca018055e0ee303fb80464ddc420679bb7309d035241e936cca58991288: Status 404 returned error can't find the container with id b2466ca018055e0ee303fb80464ddc420679bb7309d035241e936cca58991288
Sep 17 22:17:51.541989 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:51.541902    2560 generic.go:356] "Generic (PLEG): container finished" podID="c3f1d0b1-45ff-4db0-b7ee-112dcd198e94" containerID="7d91d1671d99b3738cedd695f4af0aac31c1425f7ca3ebfe71fb8f5c109f0212" exitCode=2
Sep 17 22:17:51.541989 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:51.541980    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-8341c-predictor-d7cd9ccf8-djthv" event={"ID":"c3f1d0b1-45ff-4db0-b7ee-112dcd198e94","Type":"ContainerDied","Data":"7d91d1671d99b3738cedd695f4af0aac31c1425f7ca3ebfe71fb8f5c109f0212"}
Sep 17 22:17:51.543870 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:51.543816    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-ab288-predictor-75cb7d4446-nr4z7" event={"ID":"c556aa8a-4811-4f20-9676-a06a92284f8f","Type":"ContainerStarted","Data":"c3ecdd6e3ed3a3e25730371f6985f0ac614dc0082795da580ac98ff423e9a2c4"}
Sep 17 22:17:51.543870 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:51.543880    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-ab288-predictor-75cb7d4446-nr4z7"
Sep 17 22:17:51.544080 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:51.544026    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-ab288-predictor-75cb7d4446-nr4z7"
Sep 17 22:17:51.544080 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:51.544070    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-ab288-predictor-75cb7d4446-nr4z7" event={"ID":"c556aa8a-4811-4f20-9676-a06a92284f8f","Type":"ContainerStarted","Data":"f43dda9679481840aa79d167c68b92d83a62fb02fc4282e91ae197a235f2b7de"}
Sep 17 22:17:51.544186 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:51.544100    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-ab288-predictor-75cb7d4446-nr4z7" event={"ID":"c556aa8a-4811-4f20-9676-a06a92284f8f","Type":"ContainerStarted","Data":"b2466ca018055e0ee303fb80464ddc420679bb7309d035241e936cca58991288"}
Sep 17 22:17:51.545295 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:51.545264    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-ab288-predictor-75cb7d4446-nr4z7" podUID="c556aa8a-4811-4f20-9676-a06a92284f8f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.32:8080: connect: connection refused"
Sep 17 22:17:51.562976 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:51.562926    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-ab288-predictor-75cb7d4446-nr4z7" podStartSLOduration=1.5629122560000002 podStartE2EDuration="1.562912256s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:17:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:17:51.561813288 +0000 UTC m=+1203.621585299" watchObservedRunningTime="2026-09-17 22:17:51.562912256 +0000 UTC m=+1203.622684322"
Sep 17 22:17:52.548884 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:52.548831    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-ab288-predictor-75cb7d4446-nr4z7" podUID="c556aa8a-4811-4f20-9676-a06a92284f8f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.32:8080: connect: connection refused"
Sep 17 22:17:53.499976 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:53.499951    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-8341c-predictor-d7cd9ccf8-djthv"
Sep 17 22:17:53.553762 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:53.553728    2560 generic.go:356] "Generic (PLEG): container finished" podID="c3f1d0b1-45ff-4db0-b7ee-112dcd198e94" containerID="fac1e8e7da930b936ffe05d6b4baa6dac045b8a8455e2d5bc937d4b9c6ece4f4" exitCode=0
Sep 17 22:17:53.553897 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:53.553770    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-8341c-predictor-d7cd9ccf8-djthv"
Sep 17 22:17:53.553897 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:53.553805    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-8341c-predictor-d7cd9ccf8-djthv" event={"ID":"c3f1d0b1-45ff-4db0-b7ee-112dcd198e94","Type":"ContainerDied","Data":"fac1e8e7da930b936ffe05d6b4baa6dac045b8a8455e2d5bc937d4b9c6ece4f4"}
Sep 17 22:17:53.553897 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:53.553870    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-8341c-predictor-d7cd9ccf8-djthv" event={"ID":"c3f1d0b1-45ff-4db0-b7ee-112dcd198e94","Type":"ContainerDied","Data":"ea34ed11a0a87cde66e31bf423b397c04e38ada54aa5b156755da058abaa0771"}
Sep 17 22:17:53.554017 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:53.553908    2560 scope.go:117] "RemoveContainer" containerID="7d91d1671d99b3738cedd695f4af0aac31c1425f7ca3ebfe71fb8f5c109f0212"
Sep 17 22:17:53.561607 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:53.561592    2560 scope.go:117] "RemoveContainer" containerID="fac1e8e7da930b936ffe05d6b4baa6dac045b8a8455e2d5bc937d4b9c6ece4f4"
Sep 17 22:17:53.570543 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:53.570523    2560 scope.go:117] "RemoveContainer" containerID="7d91d1671d99b3738cedd695f4af0aac31c1425f7ca3ebfe71fb8f5c109f0212"
Sep 17 22:17:53.570813 ip-10-0-136-66 kubenswrapper[2560]: E0917 22:17:53.570796    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d91d1671d99b3738cedd695f4af0aac31c1425f7ca3ebfe71fb8f5c109f0212\": container with ID starting with 7d91d1671d99b3738cedd695f4af0aac31c1425f7ca3ebfe71fb8f5c109f0212 not found: ID does not exist" containerID="7d91d1671d99b3738cedd695f4af0aac31c1425f7ca3ebfe71fb8f5c109f0212"
Sep 17 22:17:53.570873 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:53.570818    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d91d1671d99b3738cedd695f4af0aac31c1425f7ca3ebfe71fb8f5c109f0212"} err="failed to get container status \"7d91d1671d99b3738cedd695f4af0aac31c1425f7ca3ebfe71fb8f5c109f0212\": rpc error: code = NotFound desc = could not find container \"7d91d1671d99b3738cedd695f4af0aac31c1425f7ca3ebfe71fb8f5c109f0212\": container with ID starting with 7d91d1671d99b3738cedd695f4af0aac31c1425f7ca3ebfe71fb8f5c109f0212 not found: ID does not exist"
Sep 17 22:17:53.570873 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:53.570833    2560 scope.go:117] "RemoveContainer" containerID="fac1e8e7da930b936ffe05d6b4baa6dac045b8a8455e2d5bc937d4b9c6ece4f4"
Sep 17 22:17:53.571108 ip-10-0-136-66 kubenswrapper[2560]: E0917 22:17:53.571081    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fac1e8e7da930b936ffe05d6b4baa6dac045b8a8455e2d5bc937d4b9c6ece4f4\": container with ID starting with fac1e8e7da930b936ffe05d6b4baa6dac045b8a8455e2d5bc937d4b9c6ece4f4 not found: ID does not exist" containerID="fac1e8e7da930b936ffe05d6b4baa6dac045b8a8455e2d5bc937d4b9c6ece4f4"
Sep 17 22:17:53.571159 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:53.571116    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fac1e8e7da930b936ffe05d6b4baa6dac045b8a8455e2d5bc937d4b9c6ece4f4"} err="failed to get container status \"fac1e8e7da930b936ffe05d6b4baa6dac045b8a8455e2d5bc937d4b9c6ece4f4\": rpc error: code = NotFound desc = could not find container \"fac1e8e7da930b936ffe05d6b4baa6dac045b8a8455e2d5bc937d4b9c6ece4f4\": container with ID starting with fac1e8e7da930b936ffe05d6b4baa6dac045b8a8455e2d5bc937d4b9c6ece4f4 not found: ID does not exist"
Sep 17 22:17:53.621963 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:53.621915    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-626gx\" (UniqueName: \"kubernetes.io/projected/c3f1d0b1-45ff-4db0-b7ee-112dcd198e94-kube-api-access-626gx\") pod \"c3f1d0b1-45ff-4db0-b7ee-112dcd198e94\" (UID: \"c3f1d0b1-45ff-4db0-b7ee-112dcd198e94\") "
Sep 17 22:17:53.622038 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:53.621963    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c3f1d0b1-45ff-4db0-b7ee-112dcd198e94-kube-rbac-proxy-sar-config\") pod \"c3f1d0b1-45ff-4db0-b7ee-112dcd198e94\" (UID: \"c3f1d0b1-45ff-4db0-b7ee-112dcd198e94\") "
Sep 17 22:17:53.622038 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:53.621999    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c3f1d0b1-45ff-4db0-b7ee-112dcd198e94-proxy-tls\") pod \"c3f1d0b1-45ff-4db0-b7ee-112dcd198e94\" (UID: \"c3f1d0b1-45ff-4db0-b7ee-112dcd198e94\") "
Sep 17 22:17:53.622306 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:53.622279    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3f1d0b1-45ff-4db0-b7ee-112dcd198e94-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "c3f1d0b1-45ff-4db0-b7ee-112dcd198e94" (UID: "c3f1d0b1-45ff-4db0-b7ee-112dcd198e94"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 22:17:53.623806 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:53.623780    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3f1d0b1-45ff-4db0-b7ee-112dcd198e94-kube-api-access-626gx" (OuterVolumeSpecName: "kube-api-access-626gx") pod "c3f1d0b1-45ff-4db0-b7ee-112dcd198e94" (UID: "c3f1d0b1-45ff-4db0-b7ee-112dcd198e94"). InnerVolumeSpecName "kube-api-access-626gx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 22:17:53.623990 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:53.623960    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3f1d0b1-45ff-4db0-b7ee-112dcd198e94-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "c3f1d0b1-45ff-4db0-b7ee-112dcd198e94" (UID: "c3f1d0b1-45ff-4db0-b7ee-112dcd198e94"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 22:17:53.723111 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:53.723080    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-626gx\" (UniqueName: \"kubernetes.io/projected/c3f1d0b1-45ff-4db0-b7ee-112dcd198e94-kube-api-access-626gx\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\""
Sep 17 22:17:53.723111 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:53.723109    2560 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c3f1d0b1-45ff-4db0-b7ee-112dcd198e94-kube-rbac-proxy-sar-config\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\""
Sep 17 22:17:53.723256 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:53.723119    2560 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c3f1d0b1-45ff-4db0-b7ee-112dcd198e94-proxy-tls\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\""
Sep 17 22:17:53.876165 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:53.876101    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-8341c-predictor-d7cd9ccf8-djthv"]
Sep 17 22:17:53.879725 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:53.879703    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-8341c-predictor-d7cd9ccf8-djthv"]
Sep 17 22:17:54.451534 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:54.451505    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3f1d0b1-45ff-4db0-b7ee-112dcd198e94" path="/var/lib/kubelet/pods/c3f1d0b1-45ff-4db0-b7ee-112dcd198e94/volumes"
Sep 17 22:17:57.553488 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:57.553457    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-ab288-predictor-75cb7d4446-nr4z7"
Sep 17 22:17:57.554023 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:17:57.553992    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-ab288-predictor-75cb7d4446-nr4z7" podUID="c556aa8a-4811-4f20-9676-a06a92284f8f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.32:8080: connect: connection refused"
Sep 17 22:18:07.554082 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:18:07.554042    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-ab288-predictor-75cb7d4446-nr4z7" podUID="c556aa8a-4811-4f20-9676-a06a92284f8f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.32:8080: connect: connection refused"
Sep 17 22:18:17.554950 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:18:17.554902    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-ab288-predictor-75cb7d4446-nr4z7" podUID="c556aa8a-4811-4f20-9676-a06a92284f8f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.32:8080: connect: connection refused"
Sep 17 22:18:27.554720 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:18:27.554676    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-ab288-predictor-75cb7d4446-nr4z7" podUID="c556aa8a-4811-4f20-9676-a06a92284f8f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.32:8080: connect: connection refused"
Sep 17 22:18:37.555384 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:18:37.555334    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-ab288-predictor-75cb7d4446-nr4z7"
Sep 17 22:18:46.783866 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:18:46.783788    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-a4672-predictor-6fcf97dc64-k7rn2"]
Sep 17 22:18:46.784218 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:18:46.784082    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-a4672-predictor-6fcf97dc64-k7rn2" podUID="870b2379-70d9-4935-97e9-e25bf72f09e8" containerName="kserve-container" containerID="cri-o://0764174a4197e7e2cadf58cd0961d83cf5aeaaf6d363901f59a7a33c2fcd2742" gracePeriod=30
Sep 17 22:18:46.784218 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:18:46.784175    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-a4672-predictor-6fcf97dc64-k7rn2" podUID="870b2379-70d9-4935-97e9-e25bf72f09e8" containerName="kube-rbac-proxy" containerID="cri-o://644b309aab779bdda2d2b67774d78aa134adc3bb063dafc66b2aeef2749c9bd5" gracePeriod=30
Sep 17 22:18:46.891921 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:18:46.891888    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-1fd26-predictor-5c84d64b46-x6f4k"]
Sep 17 22:18:46.892388 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:18:46.892368    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3f1d0b1-45ff-4db0-b7ee-112dcd198e94" containerName="kube-rbac-proxy"
Sep 17 22:18:46.892445 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:18:46.892392    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3f1d0b1-45ff-4db0-b7ee-112dcd198e94" containerName="kube-rbac-proxy"
Sep 17 22:18:46.892445 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:18:46.892435    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3f1d0b1-45ff-4db0-b7ee-112dcd198e94" containerName="kserve-container"
Sep 17 22:18:46.892445 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:18:46.892443    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3f1d0b1-45ff-4db0-b7ee-112dcd198e94" containerName="kserve-container"
Sep 17 22:18:46.892539 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:18:46.892517    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3f1d0b1-45ff-4db0-b7ee-112dcd198e94" containerName="kube-rbac-proxy"
Sep 17 22:18:46.892539 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:18:46.892530    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3f1d0b1-45ff-4db0-b7ee-112dcd198e94" containerName="kserve-container"
Sep 17 22:18:46.895610 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:18:46.895589    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-1fd26-predictor-5c84d64b46-x6f4k"
Sep 17 22:18:46.898083 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:18:46.898068    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-1fd26-kube-rbac-proxy-sar-config\""
Sep 17 22:18:46.898165 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:18:46.898080    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-1fd26-predictor-serving-cert\""
Sep 17 22:18:46.904459 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:18:46.904438    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-1fd26-predictor-5c84d64b46-x6f4k"]
Sep 17 22:18:46.952228 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:18:46.952189    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/183ba9cb-826f-474a-84ac-b982e10b9a2b-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-1fd26-predictor-5c84d64b46-x6f4k\" (UID: \"183ba9cb-826f-474a-84ac-b982e10b9a2b\") " pod="kserve-ci-e2e-test/success-200-isvc-1fd26-predictor-5c84d64b46-x6f4k"
Sep 17 22:18:46.952405 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:18:46.952276    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ssh7\" (UniqueName: \"kubernetes.io/projected/183ba9cb-826f-474a-84ac-b982e10b9a2b-kube-api-access-8ssh7\") pod \"success-200-isvc-1fd26-predictor-5c84d64b46-x6f4k\" (UID: \"183ba9cb-826f-474a-84ac-b982e10b9a2b\") " pod="kserve-ci-e2e-test/success-200-isvc-1fd26-predictor-5c84d64b46-x6f4k"
Sep 17 22:18:46.952405 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:18:46.952339    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/183ba9cb-826f-474a-84ac-b982e10b9a2b-proxy-tls\") pod \"success-200-isvc-1fd26-predictor-5c84d64b46-x6f4k\" (UID: \"183ba9cb-826f-474a-84ac-b982e10b9a2b\") " pod="kserve-ci-e2e-test/success-200-isvc-1fd26-predictor-5c84d64b46-x6f4k"
Sep 17 22:18:47.053521 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:18:47.053440    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/183ba9cb-826f-474a-84ac-b982e10b9a2b-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-1fd26-predictor-5c84d64b46-x6f4k\" (UID: \"183ba9cb-826f-474a-84ac-b982e10b9a2b\") " pod="kserve-ci-e2e-test/success-200-isvc-1fd26-predictor-5c84d64b46-x6f4k"
Sep 17 22:18:47.053521 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:18:47.053497    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ssh7\" (UniqueName: \"kubernetes.io/projected/183ba9cb-826f-474a-84ac-b982e10b9a2b-kube-api-access-8ssh7\") pod \"success-200-isvc-1fd26-predictor-5c84d64b46-x6f4k\" (UID: \"183ba9cb-826f-474a-84ac-b982e10b9a2b\") " pod="kserve-ci-e2e-test/success-200-isvc-1fd26-predictor-5c84d64b46-x6f4k"
Sep 17 22:18:47.053722 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:18:47.053547    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/183ba9cb-826f-474a-84ac-b982e10b9a2b-proxy-tls\") pod \"success-200-isvc-1fd26-predictor-5c84d64b46-x6f4k\" (UID: \"183ba9cb-826f-474a-84ac-b982e10b9a2b\") " pod="kserve-ci-e2e-test/success-200-isvc-1fd26-predictor-5c84d64b46-x6f4k"
Sep 17 22:18:47.053722 ip-10-0-136-66 kubenswrapper[2560]: E0917 22:18:47.053658    2560 secret.go:189] Couldn't get secret kserve-ci-e2e-test/success-200-isvc-1fd26-predictor-serving-cert: secret "success-200-isvc-1fd26-predictor-serving-cert" not found
Sep 17 22:18:47.053722 ip-10-0-136-66 kubenswrapper[2560]: E0917 22:18:47.053716    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/183ba9cb-826f-474a-84ac-b982e10b9a2b-proxy-tls podName:183ba9cb-826f-474a-84ac-b982e10b9a2b nodeName:}" failed. No retries permitted until 2026-09-17 22:18:47.553701154 +0000 UTC m=+1259.613473144 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/183ba9cb-826f-474a-84ac-b982e10b9a2b-proxy-tls") pod "success-200-isvc-1fd26-predictor-5c84d64b46-x6f4k" (UID: "183ba9cb-826f-474a-84ac-b982e10b9a2b") : secret "success-200-isvc-1fd26-predictor-serving-cert" not found
Sep 17 22:18:47.054148 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:18:47.054129    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/183ba9cb-826f-474a-84ac-b982e10b9a2b-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-1fd26-predictor-5c84d64b46-x6f4k\" (UID: \"183ba9cb-826f-474a-84ac-b982e10b9a2b\") " pod="kserve-ci-e2e-test/success-200-isvc-1fd26-predictor-5c84d64b46-x6f4k"
Sep 17 22:18:47.063888 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:18:47.063863    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ssh7\" (UniqueName: \"kubernetes.io/projected/183ba9cb-826f-474a-84ac-b982e10b9a2b-kube-api-access-8ssh7\") pod \"success-200-isvc-1fd26-predictor-5c84d64b46-x6f4k\" (UID: \"183ba9cb-826f-474a-84ac-b982e10b9a2b\") " pod="kserve-ci-e2e-test/success-200-isvc-1fd26-predictor-5c84d64b46-x6f4k"
Sep 17 22:18:47.558623 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:18:47.558590    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/183ba9cb-826f-474a-84ac-b982e10b9a2b-proxy-tls\") pod \"success-200-isvc-1fd26-predictor-5c84d64b46-x6f4k\" (UID: \"183ba9cb-826f-474a-84ac-b982e10b9a2b\") " pod="kserve-ci-e2e-test/success-200-isvc-1fd26-predictor-5c84d64b46-x6f4k"
Sep 17 22:18:47.560902 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:18:47.560882    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/183ba9cb-826f-474a-84ac-b982e10b9a2b-proxy-tls\") pod \"success-200-isvc-1fd26-predictor-5c84d64b46-x6f4k\" (UID: \"183ba9cb-826f-474a-84ac-b982e10b9a2b\") " pod="kserve-ci-e2e-test/success-200-isvc-1fd26-predictor-5c84d64b46-x6f4k"
Sep 17 22:18:47.774225 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:18:47.774193    2560 generic.go:356] "Generic (PLEG): container finished" podID="870b2379-70d9-4935-97e9-e25bf72f09e8" containerID="644b309aab779bdda2d2b67774d78aa134adc3bb063dafc66b2aeef2749c9bd5" exitCode=2
Sep 17 22:18:47.774401 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:18:47.774254    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-a4672-predictor-6fcf97dc64-k7rn2" event={"ID":"870b2379-70d9-4935-97e9-e25bf72f09e8","Type":"ContainerDied","Data":"644b309aab779bdda2d2b67774d78aa134adc3bb063dafc66b2aeef2749c9bd5"}
Sep 17 22:18:47.806546 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:18:47.806518    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-1fd26-predictor-5c84d64b46-x6f4k"
Sep 17 22:18:48.074570 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:18:48.074543    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-1fd26-predictor-5c84d64b46-x6f4k"]
Sep 17 22:18:48.076764 ip-10-0-136-66 kubenswrapper[2560]: W0917 22:18:48.076739    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod183ba9cb_826f_474a_84ac_b982e10b9a2b.slice/crio-e63dc629d0173f4593db58c4712ccec86704124b2ba0e3d7c1fc81b105dcbec6 WatchSource:0}: Error finding container e63dc629d0173f4593db58c4712ccec86704124b2ba0e3d7c1fc81b105dcbec6: Status 404 returned error can't find the container with id e63dc629d0173f4593db58c4712ccec86704124b2ba0e3d7c1fc81b105dcbec6
Sep 17 22:18:48.780182 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:18:48.780095    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-1fd26-predictor-5c84d64b46-x6f4k" event={"ID":"183ba9cb-826f-474a-84ac-b982e10b9a2b","Type":"ContainerStarted","Data":"9a8b853e94157f24b1d66304e4a367a5589b8a1175654ba6f8c40efe58efce71"}
Sep 17 22:18:48.780182 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:18:48.780164    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-1fd26-predictor-5c84d64b46-x6f4k" event={"ID":"183ba9cb-826f-474a-84ac-b982e10b9a2b","Type":"ContainerStarted","Data":"5907e122c62d6d29c8e78222a30cbbae63a1a322d983fef30773629a6892f503"}
Sep 17 22:18:48.780370 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:18:48.780197    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-1fd26-predictor-5c84d64b46-x6f4k" event={"ID":"183ba9cb-826f-474a-84ac-b982e10b9a2b","Type":"ContainerStarted","Data":"e63dc629d0173f4593db58c4712ccec86704124b2ba0e3d7c1fc81b105dcbec6"}
Sep 17 22:18:48.780370 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:18:48.780239    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-1fd26-predictor-5c84d64b46-x6f4k"
Sep 17 22:18:48.797225 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:18:48.797182    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-1fd26-predictor-5c84d64b46-x6f4k" podStartSLOduration=2.79716349 podStartE2EDuration="2.79716349s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:18:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:18:48.796823035 +0000 UTC m=+1260.856595045" watchObservedRunningTime="2026-09-17 22:18:48.79716349 +0000 UTC m=+1260.856935502"
Sep 17 22:18:49.558675 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:18:49.558633    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-a4672-predictor-6fcf97dc64-k7rn2" podUID="870b2379-70d9-4935-97e9-e25bf72f09e8" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.31:8643/healthz\": dial tcp 10.132.0.31:8643: connect: connection refused"
Sep 17 22:18:49.563025 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:18:49.562998    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-a4672-predictor-6fcf97dc64-k7rn2" podUID="870b2379-70d9-4935-97e9-e25bf72f09e8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.31:8080: connect: connection refused"
Sep 17 22:18:49.787211 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:18:49.787181    2560 generic.go:356] "Generic (PLEG): container finished" podID="870b2379-70d9-4935-97e9-e25bf72f09e8" containerID="0764174a4197e7e2cadf58cd0961d83cf5aeaaf6d363901f59a7a33c2fcd2742" exitCode=0
Sep 17 22:18:49.787390 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:18:49.787249    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-a4672-predictor-6fcf97dc64-k7rn2" event={"ID":"870b2379-70d9-4935-97e9-e25bf72f09e8","Type":"ContainerDied","Data":"0764174a4197e7e2cadf58cd0961d83cf5aeaaf6d363901f59a7a33c2fcd2742"}
Sep 17 22:18:49.787496 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:18:49.787477    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-1fd26-predictor-5c84d64b46-x6f4k"
Sep 17 22:18:49.788454 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:18:49.788415    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1fd26-predictor-5c84d64b46-x6f4k" podUID="183ba9cb-826f-474a-84ac-b982e10b9a2b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.33:8080: connect: connection refused"
Sep 17 22:18:49.832834 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:18:49.832815    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-a4672-predictor-6fcf97dc64-k7rn2"
Sep 17 22:18:49.878179 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:18:49.878156    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tkczb\" (UniqueName: \"kubernetes.io/projected/870b2379-70d9-4935-97e9-e25bf72f09e8-kube-api-access-tkczb\") pod \"870b2379-70d9-4935-97e9-e25bf72f09e8\" (UID: \"870b2379-70d9-4935-97e9-e25bf72f09e8\") "
Sep 17 22:18:49.878309 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:18:49.878204    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/870b2379-70d9-4935-97e9-e25bf72f09e8-proxy-tls\") pod \"870b2379-70d9-4935-97e9-e25bf72f09e8\" (UID: \"870b2379-70d9-4935-97e9-e25bf72f09e8\") "
Sep 17 22:18:49.878309 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:18:49.878244    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/870b2379-70d9-4935-97e9-e25bf72f09e8-kube-rbac-proxy-sar-config\") pod \"870b2379-70d9-4935-97e9-e25bf72f09e8\" (UID: \"870b2379-70d9-4935-97e9-e25bf72f09e8\") "
Sep 17 22:18:49.878699 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:18:49.878668    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/870b2379-70d9-4935-97e9-e25bf72f09e8-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "870b2379-70d9-4935-97e9-e25bf72f09e8" (UID: "870b2379-70d9-4935-97e9-e25bf72f09e8"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 22:18:49.880144 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:18:49.880115    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/870b2379-70d9-4935-97e9-e25bf72f09e8-kube-api-access-tkczb" (OuterVolumeSpecName: "kube-api-access-tkczb") pod "870b2379-70d9-4935-97e9-e25bf72f09e8" (UID: "870b2379-70d9-4935-97e9-e25bf72f09e8"). InnerVolumeSpecName "kube-api-access-tkczb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 22:18:49.880244 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:18:49.880188    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/870b2379-70d9-4935-97e9-e25bf72f09e8-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "870b2379-70d9-4935-97e9-e25bf72f09e8" (UID: "870b2379-70d9-4935-97e9-e25bf72f09e8"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 22:18:49.979257 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:18:49.979221    2560 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/870b2379-70d9-4935-97e9-e25bf72f09e8-kube-rbac-proxy-sar-config\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\""
Sep 17 22:18:49.979257 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:18:49.979254    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tkczb\" (UniqueName: \"kubernetes.io/projected/870b2379-70d9-4935-97e9-e25bf72f09e8-kube-api-access-tkczb\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\""
Sep 17 22:18:49.979257 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:18:49.979265    2560 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/870b2379-70d9-4935-97e9-e25bf72f09e8-proxy-tls\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\""
Sep 17 22:18:50.797499 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:18:50.797464    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-a4672-predictor-6fcf97dc64-k7rn2"
Sep 17 22:18:50.797499 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:18:50.797486    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-a4672-predictor-6fcf97dc64-k7rn2" event={"ID":"870b2379-70d9-4935-97e9-e25bf72f09e8","Type":"ContainerDied","Data":"40c1f6f0b2d9e9fd8ae001117d5279a980b88257ea2f192796ed8053d194258e"}
Sep 17 22:18:50.797947 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:18:50.797597    2560 scope.go:117] "RemoveContainer" containerID="644b309aab779bdda2d2b67774d78aa134adc3bb063dafc66b2aeef2749c9bd5"
Sep 17 22:18:50.798221 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:18:50.798182    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1fd26-predictor-5c84d64b46-x6f4k" podUID="183ba9cb-826f-474a-84ac-b982e10b9a2b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.33:8080: connect: connection refused"
Sep 17 22:18:50.805670 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:18:50.805654    2560 scope.go:117] "RemoveContainer" containerID="0764174a4197e7e2cadf58cd0961d83cf5aeaaf6d363901f59a7a33c2fcd2742"
Sep 17 22:18:50.816615 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:18:50.816594    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-a4672-predictor-6fcf97dc64-k7rn2"]
Sep 17 22:18:50.822134 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:18:50.822114    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-a4672-predictor-6fcf97dc64-k7rn2"]
Sep 17 22:18:52.451514 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:18:52.451482    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="870b2379-70d9-4935-97e9-e25bf72f09e8" path="/var/lib/kubelet/pods/870b2379-70d9-4935-97e9-e25bf72f09e8/volumes"
Sep 17 22:18:55.803598 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:18:55.803567    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-1fd26-predictor-5c84d64b46-x6f4k"
Sep 17 22:18:55.804098 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:18:55.804070    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1fd26-predictor-5c84d64b46-x6f4k" podUID="183ba9cb-826f-474a-84ac-b982e10b9a2b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.33:8080: connect: connection refused"
Sep 17 22:19:00.836299 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:00.836259    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-ab288-predictor-75cb7d4446-nr4z7"]
Sep 17 22:19:00.836832 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:00.836560    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-ab288-predictor-75cb7d4446-nr4z7" podUID="c556aa8a-4811-4f20-9676-a06a92284f8f" containerName="kserve-container" containerID="cri-o://f43dda9679481840aa79d167c68b92d83a62fb02fc4282e91ae197a235f2b7de" gracePeriod=30
Sep 17 22:19:00.836832 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:00.836607    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-ab288-predictor-75cb7d4446-nr4z7" podUID="c556aa8a-4811-4f20-9676-a06a92284f8f" containerName="kube-rbac-proxy" containerID="cri-o://c3ecdd6e3ed3a3e25730371f6985f0ac614dc0082795da580ac98ff423e9a2c4" gracePeriod=30
Sep 17 22:19:00.919977 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:00.919943    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-1a2f0-predictor-7b65f5c676-tz8bd"]
Sep 17 22:19:00.920273 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:00.920261    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="870b2379-70d9-4935-97e9-e25bf72f09e8" containerName="kube-rbac-proxy"
Sep 17 22:19:00.920320 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:00.920274    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="870b2379-70d9-4935-97e9-e25bf72f09e8" containerName="kube-rbac-proxy"
Sep 17 22:19:00.920320 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:00.920294    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="870b2379-70d9-4935-97e9-e25bf72f09e8" containerName="kserve-container"
Sep 17 22:19:00.920320 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:00.920300    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="870b2379-70d9-4935-97e9-e25bf72f09e8" containerName="kserve-container"
Sep 17 22:19:00.920432 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:00.920375    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="870b2379-70d9-4935-97e9-e25bf72f09e8" containerName="kserve-container"
Sep 17 22:19:00.920432 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:00.920386    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="870b2379-70d9-4935-97e9-e25bf72f09e8" containerName="kube-rbac-proxy"
Sep 17 22:19:00.924916 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:00.924897    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-1a2f0-predictor-7b65f5c676-tz8bd"
Sep 17 22:19:00.927558 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:00.927534    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-1a2f0-predictor-serving-cert\""
Sep 17 22:19:00.927647 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:00.927562    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-1a2f0-kube-rbac-proxy-sar-config\""
Sep 17 22:19:00.932013 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:00.931843    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-1a2f0-predictor-7b65f5c676-tz8bd"]
Sep 17 22:19:00.958254 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:00.958213    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fc0af6ad-44a9-466a-b568-5ea7fb7f1f01-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-1a2f0-predictor-7b65f5c676-tz8bd\" (UID: \"fc0af6ad-44a9-466a-b568-5ea7fb7f1f01\") " pod="kserve-ci-e2e-test/success-200-isvc-1a2f0-predictor-7b65f5c676-tz8bd"
Sep 17 22:19:00.958405 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:00.958319    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fc0af6ad-44a9-466a-b568-5ea7fb7f1f01-proxy-tls\") pod \"success-200-isvc-1a2f0-predictor-7b65f5c676-tz8bd\" (UID: \"fc0af6ad-44a9-466a-b568-5ea7fb7f1f01\") " pod="kserve-ci-e2e-test/success-200-isvc-1a2f0-predictor-7b65f5c676-tz8bd"
Sep 17 22:19:00.958475 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:00.958403    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pswr\" (UniqueName: \"kubernetes.io/projected/fc0af6ad-44a9-466a-b568-5ea7fb7f1f01-kube-api-access-7pswr\") pod \"success-200-isvc-1a2f0-predictor-7b65f5c676-tz8bd\" (UID: \"fc0af6ad-44a9-466a-b568-5ea7fb7f1f01\") " pod="kserve-ci-e2e-test/success-200-isvc-1a2f0-predictor-7b65f5c676-tz8bd"
Sep 17 22:19:01.058934 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:01.058897    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fc0af6ad-44a9-466a-b568-5ea7fb7f1f01-proxy-tls\") pod \"success-200-isvc-1a2f0-predictor-7b65f5c676-tz8bd\" (UID: \"fc0af6ad-44a9-466a-b568-5ea7fb7f1f01\") " pod="kserve-ci-e2e-test/success-200-isvc-1a2f0-predictor-7b65f5c676-tz8bd"
Sep 17 22:19:01.058934 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:01.058936    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pswr\" (UniqueName: \"kubernetes.io/projected/fc0af6ad-44a9-466a-b568-5ea7fb7f1f01-kube-api-access-7pswr\") pod \"success-200-isvc-1a2f0-predictor-7b65f5c676-tz8bd\" (UID: \"fc0af6ad-44a9-466a-b568-5ea7fb7f1f01\") " pod="kserve-ci-e2e-test/success-200-isvc-1a2f0-predictor-7b65f5c676-tz8bd"
Sep 17 22:19:01.059151 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:01.058991    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fc0af6ad-44a9-466a-b568-5ea7fb7f1f01-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-1a2f0-predictor-7b65f5c676-tz8bd\" (UID: \"fc0af6ad-44a9-466a-b568-5ea7fb7f1f01\") " pod="kserve-ci-e2e-test/success-200-isvc-1a2f0-predictor-7b65f5c676-tz8bd"
Sep 17 22:19:01.059703 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:01.059684    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fc0af6ad-44a9-466a-b568-5ea7fb7f1f01-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-1a2f0-predictor-7b65f5c676-tz8bd\" (UID: \"fc0af6ad-44a9-466a-b568-5ea7fb7f1f01\") " pod="kserve-ci-e2e-test/success-200-isvc-1a2f0-predictor-7b65f5c676-tz8bd"
Sep 17 22:19:01.061513 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:01.061476    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fc0af6ad-44a9-466a-b568-5ea7fb7f1f01-proxy-tls\") pod \"success-200-isvc-1a2f0-predictor-7b65f5c676-tz8bd\" (UID: \"fc0af6ad-44a9-466a-b568-5ea7fb7f1f01\") " pod="kserve-ci-e2e-test/success-200-isvc-1a2f0-predictor-7b65f5c676-tz8bd"
Sep 17 22:19:01.076080 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:01.076059    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pswr\" (UniqueName: \"kubernetes.io/projected/fc0af6ad-44a9-466a-b568-5ea7fb7f1f01-kube-api-access-7pswr\") pod \"success-200-isvc-1a2f0-predictor-7b65f5c676-tz8bd\" (UID: \"fc0af6ad-44a9-466a-b568-5ea7fb7f1f01\") " pod="kserve-ci-e2e-test/success-200-isvc-1a2f0-predictor-7b65f5c676-tz8bd"
Sep 17 22:19:01.235740 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:01.235715    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-1a2f0-predictor-7b65f5c676-tz8bd"
Sep 17 22:19:01.506924 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:01.506852    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-1a2f0-predictor-7b65f5c676-tz8bd"]
Sep 17 22:19:01.510664 ip-10-0-136-66 kubenswrapper[2560]: W0917 22:19:01.510638    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc0af6ad_44a9_466a_b568_5ea7fb7f1f01.slice/crio-398782f72a69571e314914c229a01c73413d1cbf4df8e52dfa4a74d6d000b5d8 WatchSource:0}: Error finding container 398782f72a69571e314914c229a01c73413d1cbf4df8e52dfa4a74d6d000b5d8: Status 404 returned error can't find the container with id 398782f72a69571e314914c229a01c73413d1cbf4df8e52dfa4a74d6d000b5d8
Sep 17 22:19:01.847365 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:01.846104    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-1a2f0-predictor-7b65f5c676-tz8bd" event={"ID":"fc0af6ad-44a9-466a-b568-5ea7fb7f1f01","Type":"ContainerStarted","Data":"f2b8c712ee2ceed9ff78596dec30224e7001e1b892b9c5195b3ef059ccd05947"}
Sep 17 22:19:01.847365 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:01.846183    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-1a2f0-predictor-7b65f5c676-tz8bd" event={"ID":"fc0af6ad-44a9-466a-b568-5ea7fb7f1f01","Type":"ContainerStarted","Data":"f66ec64cd4e0f20c3addba116f558ec46b0b3ce9dde3b5b342777181d2dded58"}
Sep 17 22:19:01.847365 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:01.846215    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-1a2f0-predictor-7b65f5c676-tz8bd" event={"ID":"fc0af6ad-44a9-466a-b568-5ea7fb7f1f01","Type":"ContainerStarted","Data":"398782f72a69571e314914c229a01c73413d1cbf4df8e52dfa4a74d6d000b5d8"}
Sep 17 22:19:01.847365 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:01.847191    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-1a2f0-predictor-7b65f5c676-tz8bd"
Sep 17 22:19:01.847365 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:01.847247    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-1a2f0-predictor-7b65f5c676-tz8bd"
Sep 17 22:19:01.848610 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:01.848446    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1a2f0-predictor-7b65f5c676-tz8bd" podUID="fc0af6ad-44a9-466a-b568-5ea7fb7f1f01" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.34:8080: connect: connection refused"
Sep 17 22:19:01.849839 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:01.849810    2560 generic.go:356] "Generic (PLEG): container finished" podID="c556aa8a-4811-4f20-9676-a06a92284f8f" containerID="c3ecdd6e3ed3a3e25730371f6985f0ac614dc0082795da580ac98ff423e9a2c4" exitCode=2
Sep 17 22:19:01.849937 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:01.849846    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-ab288-predictor-75cb7d4446-nr4z7" event={"ID":"c556aa8a-4811-4f20-9676-a06a92284f8f","Type":"ContainerDied","Data":"c3ecdd6e3ed3a3e25730371f6985f0ac614dc0082795da580ac98ff423e9a2c4"}
Sep 17 22:19:02.549178 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:02.549130    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-ab288-predictor-75cb7d4446-nr4z7" podUID="c556aa8a-4811-4f20-9676-a06a92284f8f" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.32:8643/healthz\": dial tcp 10.132.0.32:8643: connect: connection refused"
Sep 17 22:19:02.854706 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:02.854612    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1a2f0-predictor-7b65f5c676-tz8bd" podUID="fc0af6ad-44a9-466a-b568-5ea7fb7f1f01" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.34:8080: connect: connection refused"
Sep 17 22:19:03.858477 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:03.858424    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1a2f0-predictor-7b65f5c676-tz8bd" podUID="fc0af6ad-44a9-466a-b568-5ea7fb7f1f01" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.34:8080: connect: connection refused"
Sep 17 22:19:04.180856 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:04.180827    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-ab288-predictor-75cb7d4446-nr4z7"
Sep 17 22:19:04.199057 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:04.198998    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-1a2f0-predictor-7b65f5c676-tz8bd" podStartSLOduration=4.198976149 podStartE2EDuration="4.198976149s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:19:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:19:01.867489377 +0000 UTC m=+1273.927261388" watchObservedRunningTime="2026-09-17 22:19:04.198976149 +0000 UTC m=+1276.258748163"
Sep 17 22:19:04.287900 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:04.287868    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c556aa8a-4811-4f20-9676-a06a92284f8f-proxy-tls\") pod \"c556aa8a-4811-4f20-9676-a06a92284f8f\" (UID: \"c556aa8a-4811-4f20-9676-a06a92284f8f\") "
Sep 17 22:19:04.288034 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:04.287912    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9w5n6\" (UniqueName: \"kubernetes.io/projected/c556aa8a-4811-4f20-9676-a06a92284f8f-kube-api-access-9w5n6\") pod \"c556aa8a-4811-4f20-9676-a06a92284f8f\" (UID: \"c556aa8a-4811-4f20-9676-a06a92284f8f\") "
Sep 17 22:19:04.288034 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:04.287936    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c556aa8a-4811-4f20-9676-a06a92284f8f-kube-rbac-proxy-sar-config\") pod \"c556aa8a-4811-4f20-9676-a06a92284f8f\" (UID: \"c556aa8a-4811-4f20-9676-a06a92284f8f\") "
Sep 17 22:19:04.288327 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:04.288295    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c556aa8a-4811-4f20-9676-a06a92284f8f-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "c556aa8a-4811-4f20-9676-a06a92284f8f" (UID: "c556aa8a-4811-4f20-9676-a06a92284f8f"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 22:19:04.289933 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:04.289910    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c556aa8a-4811-4f20-9676-a06a92284f8f-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "c556aa8a-4811-4f20-9676-a06a92284f8f" (UID: "c556aa8a-4811-4f20-9676-a06a92284f8f"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 22:19:04.290019 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:04.289948    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c556aa8a-4811-4f20-9676-a06a92284f8f-kube-api-access-9w5n6" (OuterVolumeSpecName: "kube-api-access-9w5n6") pod "c556aa8a-4811-4f20-9676-a06a92284f8f" (UID: "c556aa8a-4811-4f20-9676-a06a92284f8f"). InnerVolumeSpecName "kube-api-access-9w5n6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 22:19:04.388745 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:04.388706    2560 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c556aa8a-4811-4f20-9676-a06a92284f8f-proxy-tls\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\""
Sep 17 22:19:04.388745 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:04.388747    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9w5n6\" (UniqueName: \"kubernetes.io/projected/c556aa8a-4811-4f20-9676-a06a92284f8f-kube-api-access-9w5n6\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\""
Sep 17 22:19:04.388922 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:04.388763    2560 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c556aa8a-4811-4f20-9676-a06a92284f8f-kube-rbac-proxy-sar-config\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\""
Sep 17 22:19:04.863397 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:04.863366    2560 generic.go:356] "Generic (PLEG): container finished" podID="c556aa8a-4811-4f20-9676-a06a92284f8f" containerID="f43dda9679481840aa79d167c68b92d83a62fb02fc4282e91ae197a235f2b7de" exitCode=0
Sep 17 22:19:04.863779 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:04.863418    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-ab288-predictor-75cb7d4446-nr4z7"
Sep 17 22:19:04.863779 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:04.863430    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-ab288-predictor-75cb7d4446-nr4z7" event={"ID":"c556aa8a-4811-4f20-9676-a06a92284f8f","Type":"ContainerDied","Data":"f43dda9679481840aa79d167c68b92d83a62fb02fc4282e91ae197a235f2b7de"}
Sep 17 22:19:04.863779 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:04.863481    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-ab288-predictor-75cb7d4446-nr4z7" event={"ID":"c556aa8a-4811-4f20-9676-a06a92284f8f","Type":"ContainerDied","Data":"b2466ca018055e0ee303fb80464ddc420679bb7309d035241e936cca58991288"}
Sep 17 22:19:04.863779 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:04.863505    2560 scope.go:117] "RemoveContainer" containerID="c3ecdd6e3ed3a3e25730371f6985f0ac614dc0082795da580ac98ff423e9a2c4"
Sep 17 22:19:04.871534 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:04.871522    2560 scope.go:117] "RemoveContainer" containerID="f43dda9679481840aa79d167c68b92d83a62fb02fc4282e91ae197a235f2b7de"
Sep 17 22:19:04.879112 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:04.879077    2560 scope.go:117] "RemoveContainer" containerID="c3ecdd6e3ed3a3e25730371f6985f0ac614dc0082795da580ac98ff423e9a2c4"
Sep 17 22:19:04.879481 ip-10-0-136-66 kubenswrapper[2560]: E0917 22:19:04.879394    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3ecdd6e3ed3a3e25730371f6985f0ac614dc0082795da580ac98ff423e9a2c4\": container with ID starting with c3ecdd6e3ed3a3e25730371f6985f0ac614dc0082795da580ac98ff423e9a2c4 not found: ID does not exist" containerID="c3ecdd6e3ed3a3e25730371f6985f0ac614dc0082795da580ac98ff423e9a2c4"
Sep 17 22:19:04.879481 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:04.879431    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3ecdd6e3ed3a3e25730371f6985f0ac614dc0082795da580ac98ff423e9a2c4"} err="failed to get container status \"c3ecdd6e3ed3a3e25730371f6985f0ac614dc0082795da580ac98ff423e9a2c4\": rpc error: code = NotFound desc = could not find container \"c3ecdd6e3ed3a3e25730371f6985f0ac614dc0082795da580ac98ff423e9a2c4\": container with ID starting with c3ecdd6e3ed3a3e25730371f6985f0ac614dc0082795da580ac98ff423e9a2c4 not found: ID does not exist"
Sep 17 22:19:04.879481 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:04.879457    2560 scope.go:117] "RemoveContainer" containerID="f43dda9679481840aa79d167c68b92d83a62fb02fc4282e91ae197a235f2b7de"
Sep 17 22:19:04.879789 ip-10-0-136-66 kubenswrapper[2560]: E0917 22:19:04.879769    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f43dda9679481840aa79d167c68b92d83a62fb02fc4282e91ae197a235f2b7de\": container with ID starting with f43dda9679481840aa79d167c68b92d83a62fb02fc4282e91ae197a235f2b7de not found: ID does not exist" containerID="f43dda9679481840aa79d167c68b92d83a62fb02fc4282e91ae197a235f2b7de"
Sep 17 22:19:04.879833 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:04.879798    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f43dda9679481840aa79d167c68b92d83a62fb02fc4282e91ae197a235f2b7de"} err="failed to get container status \"f43dda9679481840aa79d167c68b92d83a62fb02fc4282e91ae197a235f2b7de\": rpc error: code = NotFound desc = could not find container \"f43dda9679481840aa79d167c68b92d83a62fb02fc4282e91ae197a235f2b7de\": container with ID starting with f43dda9679481840aa79d167c68b92d83a62fb02fc4282e91ae197a235f2b7de not found: ID does not exist"
Sep 17 22:19:04.880422 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:04.880404    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-ab288-predictor-75cb7d4446-nr4z7"]
Sep 17 22:19:04.885420 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:04.885400    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-ab288-predictor-75cb7d4446-nr4z7"]
Sep 17 22:19:05.804277 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:05.804240    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1fd26-predictor-5c84d64b46-x6f4k" podUID="183ba9cb-826f-474a-84ac-b982e10b9a2b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.33:8080: connect: connection refused"
Sep 17 22:19:06.452641 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:06.452605    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c556aa8a-4811-4f20-9676-a06a92284f8f" path="/var/lib/kubelet/pods/c556aa8a-4811-4f20-9676-a06a92284f8f/volumes"
Sep 17 22:19:08.868276 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:08.868247    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-1a2f0-predictor-7b65f5c676-tz8bd"
Sep 17 22:19:08.868870 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:08.868841    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1a2f0-predictor-7b65f5c676-tz8bd" podUID="fc0af6ad-44a9-466a-b568-5ea7fb7f1f01" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.34:8080: connect: connection refused"
Sep 17 22:19:15.804754 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:15.804709    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1fd26-predictor-5c84d64b46-x6f4k" podUID="183ba9cb-826f-474a-84ac-b982e10b9a2b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.33:8080: connect: connection refused"
Sep 17 22:19:18.869339 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:18.869299    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1a2f0-predictor-7b65f5c676-tz8bd" podUID="fc0af6ad-44a9-466a-b568-5ea7fb7f1f01" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.34:8080: connect: connection refused"
Sep 17 22:19:25.804434 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:25.804393    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1fd26-predictor-5c84d64b46-x6f4k" podUID="183ba9cb-826f-474a-84ac-b982e10b9a2b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.33:8080: connect: connection refused"
Sep 17 22:19:28.868980 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:28.868939    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1a2f0-predictor-7b65f5c676-tz8bd" podUID="fc0af6ad-44a9-466a-b568-5ea7fb7f1f01" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.34:8080: connect: connection refused"
Sep 17 22:19:35.805501 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:35.805470    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-1fd26-predictor-5c84d64b46-x6f4k"
Sep 17 22:19:38.869069 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:38.869031    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1a2f0-predictor-7b65f5c676-tz8bd" podUID="fc0af6ad-44a9-466a-b568-5ea7fb7f1f01" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.34:8080: connect: connection refused"
Sep 17 22:19:48.869282 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:48.869192    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-1a2f0-predictor-7b65f5c676-tz8bd"
Sep 17 22:19:57.031738 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:57.031701    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-1fd26-predictor-5c84d64b46-x6f4k"]
Sep 17 22:19:57.032292 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:57.031998    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-1fd26-predictor-5c84d64b46-x6f4k" podUID="183ba9cb-826f-474a-84ac-b982e10b9a2b" containerName="kserve-container" containerID="cri-o://5907e122c62d6d29c8e78222a30cbbae63a1a322d983fef30773629a6892f503" gracePeriod=30
Sep 17 22:19:57.032292 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:57.032041    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-1fd26-predictor-5c84d64b46-x6f4k" podUID="183ba9cb-826f-474a-84ac-b982e10b9a2b" containerName="kube-rbac-proxy" containerID="cri-o://9a8b853e94157f24b1d66304e4a367a5589b8a1175654ba6f8c40efe58efce71" gracePeriod=30
Sep 17 22:19:57.153596 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:57.153566    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-6bcee-predictor-78b7578bc8-k8cwm"]
Sep 17 22:19:57.153908 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:57.153894    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c556aa8a-4811-4f20-9676-a06a92284f8f" containerName="kube-rbac-proxy"
Sep 17 22:19:57.153951 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:57.153911    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c556aa8a-4811-4f20-9676-a06a92284f8f" containerName="kube-rbac-proxy"
Sep 17 22:19:57.153951 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:57.153928    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c556aa8a-4811-4f20-9676-a06a92284f8f" containerName="kserve-container"
Sep 17 22:19:57.153951 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:57.153933    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c556aa8a-4811-4f20-9676-a06a92284f8f" containerName="kserve-container"
Sep 17 22:19:57.154046 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:57.153995    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c556aa8a-4811-4f20-9676-a06a92284f8f" containerName="kserve-container"
Sep 17 22:19:57.154046 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:57.154005    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c556aa8a-4811-4f20-9676-a06a92284f8f" containerName="kube-rbac-proxy"
Sep 17 22:19:57.157079 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:57.157060    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-6bcee-predictor-78b7578bc8-k8cwm"
Sep 17 22:19:57.159442 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:57.159420    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-6bcee-predictor-serving-cert\""
Sep 17 22:19:57.159442 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:57.159428    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-6bcee-kube-rbac-proxy-sar-config\""
Sep 17 22:19:57.165335 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:57.165315    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-6bcee-predictor-78b7578bc8-k8cwm"]
Sep 17 22:19:57.292123 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:57.292049    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/af6faec4-3b13-421a-a4d4-a38270593a27-proxy-tls\") pod \"success-200-isvc-6bcee-predictor-78b7578bc8-k8cwm\" (UID: \"af6faec4-3b13-421a-a4d4-a38270593a27\") " pod="kserve-ci-e2e-test/success-200-isvc-6bcee-predictor-78b7578bc8-k8cwm"
Sep 17 22:19:57.292123 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:57.292101    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/af6faec4-3b13-421a-a4d4-a38270593a27-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-6bcee-predictor-78b7578bc8-k8cwm\" (UID: \"af6faec4-3b13-421a-a4d4-a38270593a27\") " pod="kserve-ci-e2e-test/success-200-isvc-6bcee-predictor-78b7578bc8-k8cwm"
Sep 17 22:19:57.292123 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:57.292120    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz42f\" (UniqueName: \"kubernetes.io/projected/af6faec4-3b13-421a-a4d4-a38270593a27-kube-api-access-xz42f\") pod \"success-200-isvc-6bcee-predictor-78b7578bc8-k8cwm\" (UID: \"af6faec4-3b13-421a-a4d4-a38270593a27\") " pod="kserve-ci-e2e-test/success-200-isvc-6bcee-predictor-78b7578bc8-k8cwm"
Sep 17 22:19:57.392885 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:57.392843    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/af6faec4-3b13-421a-a4d4-a38270593a27-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-6bcee-predictor-78b7578bc8-k8cwm\" (UID: \"af6faec4-3b13-421a-a4d4-a38270593a27\") " pod="kserve-ci-e2e-test/success-200-isvc-6bcee-predictor-78b7578bc8-k8cwm"
Sep 17 22:19:57.392885 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:57.392884    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xz42f\" (UniqueName: \"kubernetes.io/projected/af6faec4-3b13-421a-a4d4-a38270593a27-kube-api-access-xz42f\") pod \"success-200-isvc-6bcee-predictor-78b7578bc8-k8cwm\" (UID: \"af6faec4-3b13-421a-a4d4-a38270593a27\") " pod="kserve-ci-e2e-test/success-200-isvc-6bcee-predictor-78b7578bc8-k8cwm"
Sep 17 22:19:57.393154 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:57.392939    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/af6faec4-3b13-421a-a4d4-a38270593a27-proxy-tls\") pod \"success-200-isvc-6bcee-predictor-78b7578bc8-k8cwm\" (UID: \"af6faec4-3b13-421a-a4d4-a38270593a27\") " pod="kserve-ci-e2e-test/success-200-isvc-6bcee-predictor-78b7578bc8-k8cwm"
Sep 17 22:19:57.393607 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:57.393581    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/af6faec4-3b13-421a-a4d4-a38270593a27-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-6bcee-predictor-78b7578bc8-k8cwm\" (UID: \"af6faec4-3b13-421a-a4d4-a38270593a27\") " pod="kserve-ci-e2e-test/success-200-isvc-6bcee-predictor-78b7578bc8-k8cwm"
Sep 17 22:19:57.395378 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:57.395343    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/af6faec4-3b13-421a-a4d4-a38270593a27-proxy-tls\") pod \"success-200-isvc-6bcee-predictor-78b7578bc8-k8cwm\" (UID: \"af6faec4-3b13-421a-a4d4-a38270593a27\") " pod="kserve-ci-e2e-test/success-200-isvc-6bcee-predictor-78b7578bc8-k8cwm"
Sep 17 22:19:57.399763 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:57.399743    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz42f\" (UniqueName: \"kubernetes.io/projected/af6faec4-3b13-421a-a4d4-a38270593a27-kube-api-access-xz42f\") pod \"success-200-isvc-6bcee-predictor-78b7578bc8-k8cwm\" (UID: \"af6faec4-3b13-421a-a4d4-a38270593a27\") " pod="kserve-ci-e2e-test/success-200-isvc-6bcee-predictor-78b7578bc8-k8cwm"
Sep 17 22:19:57.467734 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:57.467708    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-6bcee-predictor-78b7578bc8-k8cwm"
Sep 17 22:19:57.734612 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:57.734581    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-6bcee-predictor-78b7578bc8-k8cwm"]
Sep 17 22:19:57.737065 ip-10-0-136-66 kubenswrapper[2560]: W0917 22:19:57.737038    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf6faec4_3b13_421a_a4d4_a38270593a27.slice/crio-913f68f2247e54d95e9827709a8ed30e58782a52ae0174f120a6790f6b94135c WatchSource:0}: Error finding container 913f68f2247e54d95e9827709a8ed30e58782a52ae0174f120a6790f6b94135c: Status 404 returned error can't find the container with id 913f68f2247e54d95e9827709a8ed30e58782a52ae0174f120a6790f6b94135c
Sep 17 22:19:58.090515 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:58.090423    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-6bcee-predictor-78b7578bc8-k8cwm" event={"ID":"af6faec4-3b13-421a-a4d4-a38270593a27","Type":"ContainerStarted","Data":"4f0cea047e40ee01d48963a4c7ab3b9dbf7f103f744491616a485f31c6276adf"}
Sep 17 22:19:58.090515 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:58.090486    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-6bcee-predictor-78b7578bc8-k8cwm" event={"ID":"af6faec4-3b13-421a-a4d4-a38270593a27","Type":"ContainerStarted","Data":"ce2a607f6249e50598d9ad66e7c9e6b841fac9a0ad67e0c81f250f437eaac77a"}
Sep 17 22:19:58.090959 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:58.090636    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-6bcee-predictor-78b7578bc8-k8cwm"
Sep 17 22:19:58.090959 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:58.090712    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-6bcee-predictor-78b7578bc8-k8cwm" event={"ID":"af6faec4-3b13-421a-a4d4-a38270593a27","Type":"ContainerStarted","Data":"913f68f2247e54d95e9827709a8ed30e58782a52ae0174f120a6790f6b94135c"}
Sep 17 22:19:58.092392 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:58.092369    2560 generic.go:356] "Generic (PLEG): container finished" podID="183ba9cb-826f-474a-84ac-b982e10b9a2b" containerID="9a8b853e94157f24b1d66304e4a367a5589b8a1175654ba6f8c40efe58efce71" exitCode=2
Sep 17 22:19:58.092514 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:58.092398    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-1fd26-predictor-5c84d64b46-x6f4k" event={"ID":"183ba9cb-826f-474a-84ac-b982e10b9a2b","Type":"ContainerDied","Data":"9a8b853e94157f24b1d66304e4a367a5589b8a1175654ba6f8c40efe58efce71"}
Sep 17 22:19:58.107164 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:58.107121    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-6bcee-predictor-78b7578bc8-k8cwm" podStartSLOduration=1.1071064449999999 podStartE2EDuration="1.107106445s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:19:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:19:58.105698643 +0000 UTC m=+1330.165470651" watchObservedRunningTime="2026-09-17 22:19:58.107106445 +0000 UTC m=+1330.166878454"
Sep 17 22:19:59.096575 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:59.096543    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-6bcee-predictor-78b7578bc8-k8cwm"
Sep 17 22:19:59.097636 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:19:59.097608    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-6bcee-predictor-78b7578bc8-k8cwm" podUID="af6faec4-3b13-421a-a4d4-a38270593a27" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.35:8080: connect: connection refused"
Sep 17 22:20:00.100883 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:20:00.100841    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-6bcee-predictor-78b7578bc8-k8cwm" podUID="af6faec4-3b13-421a-a4d4-a38270593a27" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.35:8080: connect: connection refused"
Sep 17 22:20:00.799126 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:20:00.799078    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-1fd26-predictor-5c84d64b46-x6f4k" podUID="183ba9cb-826f-474a-84ac-b982e10b9a2b" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.33:8643/healthz\": dial tcp 10.132.0.33:8643: connect: connection refused"
Sep 17 22:20:03.116070 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:20:03.116032    2560 generic.go:356] "Generic (PLEG): container finished" podID="183ba9cb-826f-474a-84ac-b982e10b9a2b" containerID="5907e122c62d6d29c8e78222a30cbbae63a1a322d983fef30773629a6892f503" exitCode=0
Sep 17 22:20:03.116070 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:20:03.116072    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-1fd26-predictor-5c84d64b46-x6f4k" event={"ID":"183ba9cb-826f-474a-84ac-b982e10b9a2b","Type":"ContainerDied","Data":"5907e122c62d6d29c8e78222a30cbbae63a1a322d983fef30773629a6892f503"}
Sep 17 22:20:03.168191 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:20:03.168168    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-1fd26-predictor-5c84d64b46-x6f4k"
Sep 17 22:20:03.237452 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:20:03.237427    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/183ba9cb-826f-474a-84ac-b982e10b9a2b-kube-rbac-proxy-sar-config\") pod \"183ba9cb-826f-474a-84ac-b982e10b9a2b\" (UID: \"183ba9cb-826f-474a-84ac-b982e10b9a2b\") "
Sep 17 22:20:03.237594 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:20:03.237470    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/183ba9cb-826f-474a-84ac-b982e10b9a2b-proxy-tls\") pod \"183ba9cb-826f-474a-84ac-b982e10b9a2b\" (UID: \"183ba9cb-826f-474a-84ac-b982e10b9a2b\") "
Sep 17 22:20:03.237594 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:20:03.237545    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ssh7\" (UniqueName: \"kubernetes.io/projected/183ba9cb-826f-474a-84ac-b982e10b9a2b-kube-api-access-8ssh7\") pod \"183ba9cb-826f-474a-84ac-b982e10b9a2b\" (UID: \"183ba9cb-826f-474a-84ac-b982e10b9a2b\") "
Sep 17 22:20:03.237849 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:20:03.237823    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/183ba9cb-826f-474a-84ac-b982e10b9a2b-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "183ba9cb-826f-474a-84ac-b982e10b9a2b" (UID: "183ba9cb-826f-474a-84ac-b982e10b9a2b"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 22:20:03.239618 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:20:03.239590    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/183ba9cb-826f-474a-84ac-b982e10b9a2b-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "183ba9cb-826f-474a-84ac-b982e10b9a2b" (UID: "183ba9cb-826f-474a-84ac-b982e10b9a2b"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 22:20:03.239730 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:20:03.239648    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/183ba9cb-826f-474a-84ac-b982e10b9a2b-kube-api-access-8ssh7" (OuterVolumeSpecName: "kube-api-access-8ssh7") pod "183ba9cb-826f-474a-84ac-b982e10b9a2b" (UID: "183ba9cb-826f-474a-84ac-b982e10b9a2b"). InnerVolumeSpecName "kube-api-access-8ssh7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 22:20:03.339084 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:20:03.339057    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8ssh7\" (UniqueName: \"kubernetes.io/projected/183ba9cb-826f-474a-84ac-b982e10b9a2b-kube-api-access-8ssh7\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\""
Sep 17 22:20:03.339084 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:20:03.339081    2560 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/183ba9cb-826f-474a-84ac-b982e10b9a2b-kube-rbac-proxy-sar-config\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\""
Sep 17 22:20:03.339240 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:20:03.339099    2560 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/183ba9cb-826f-474a-84ac-b982e10b9a2b-proxy-tls\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\""
Sep 17 22:20:04.121807 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:20:04.121779    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-1fd26-predictor-5c84d64b46-x6f4k"
Sep 17 22:20:04.122200 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:20:04.121786    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-1fd26-predictor-5c84d64b46-x6f4k" event={"ID":"183ba9cb-826f-474a-84ac-b982e10b9a2b","Type":"ContainerDied","Data":"e63dc629d0173f4593db58c4712ccec86704124b2ba0e3d7c1fc81b105dcbec6"}
Sep 17 22:20:04.122200 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:20:04.121913    2560 scope.go:117] "RemoveContainer" containerID="9a8b853e94157f24b1d66304e4a367a5589b8a1175654ba6f8c40efe58efce71"
Sep 17 22:20:04.130360 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:20:04.130330    2560 scope.go:117] "RemoveContainer" containerID="5907e122c62d6d29c8e78222a30cbbae63a1a322d983fef30773629a6892f503"
Sep 17 22:20:04.142182 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:20:04.142161    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-1fd26-predictor-5c84d64b46-x6f4k"]
Sep 17 22:20:04.145323 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:20:04.145303    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-1fd26-predictor-5c84d64b46-x6f4k"]
Sep 17 22:20:04.450700 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:20:04.450619    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="183ba9cb-826f-474a-84ac-b982e10b9a2b" path="/var/lib/kubelet/pods/183ba9cb-826f-474a-84ac-b982e10b9a2b/volumes"
Sep 17 22:20:05.105462 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:20:05.105431    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-6bcee-predictor-78b7578bc8-k8cwm"
Sep 17 22:20:05.105897 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:20:05.105872    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-6bcee-predictor-78b7578bc8-k8cwm" podUID="af6faec4-3b13-421a-a4d4-a38270593a27" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.35:8080: connect: connection refused"
Sep 17 22:20:15.106287 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:20:15.106206    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-6bcee-predictor-78b7578bc8-k8cwm" podUID="af6faec4-3b13-421a-a4d4-a38270593a27" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.35:8080: connect: connection refused"
Sep 17 22:20:25.106779 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:20:25.106738    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-6bcee-predictor-78b7578bc8-k8cwm" podUID="af6faec4-3b13-421a-a4d4-a38270593a27" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.35:8080: connect: connection refused"
Sep 17 22:20:35.106704 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:20:35.106664    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-6bcee-predictor-78b7578bc8-k8cwm" podUID="af6faec4-3b13-421a-a4d4-a38270593a27" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.35:8080: connect: connection refused"
Sep 17 22:20:45.106509 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:20:45.106477    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-6bcee-predictor-78b7578bc8-k8cwm"
Sep 17 22:22:48.478788 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:22:48.478759    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-xcr4j_d690701c-bcec-48f2-9978-b6aebbf77447/console-operator/1.log"
Sep 17 22:22:48.481168 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:22:48.480944    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-xcr4j_d690701c-bcec-48f2-9978-b6aebbf77447/console-operator/1.log"
Sep 17 22:27:48.503807 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:27:48.503706    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-xcr4j_d690701c-bcec-48f2-9978-b6aebbf77447/console-operator/1.log"
Sep 17 22:27:48.511435 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:27:48.506053    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-xcr4j_d690701c-bcec-48f2-9978-b6aebbf77447/console-operator/1.log"
Sep 17 22:28:15.746328 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:28:15.746293    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-1a2f0-predictor-7b65f5c676-tz8bd"]
Sep 17 22:28:15.746812 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:28:15.746623    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-1a2f0-predictor-7b65f5c676-tz8bd" podUID="fc0af6ad-44a9-466a-b568-5ea7fb7f1f01" containerName="kserve-container" containerID="cri-o://f66ec64cd4e0f20c3addba116f558ec46b0b3ce9dde3b5b342777181d2dded58" gracePeriod=30
Sep 17 22:28:15.746812 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:28:15.746639    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-1a2f0-predictor-7b65f5c676-tz8bd" podUID="fc0af6ad-44a9-466a-b568-5ea7fb7f1f01" containerName="kube-rbac-proxy" containerID="cri-o://f2b8c712ee2ceed9ff78596dec30224e7001e1b892b9c5195b3ef059ccd05947" gracePeriod=30
Sep 17 22:28:15.882086 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:28:15.882055    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-a2de1-predictor-599dfd59cd-ptxbh"]
Sep 17 22:28:15.882416 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:28:15.882403    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="183ba9cb-826f-474a-84ac-b982e10b9a2b" containerName="kserve-container"
Sep 17 22:28:15.882464 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:28:15.882419    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="183ba9cb-826f-474a-84ac-b982e10b9a2b" containerName="kserve-container"
Sep 17 22:28:15.882464 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:28:15.882430    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="183ba9cb-826f-474a-84ac-b982e10b9a2b" containerName="kube-rbac-proxy"
Sep 17 22:28:15.882464 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:28:15.882435    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="183ba9cb-826f-474a-84ac-b982e10b9a2b" containerName="kube-rbac-proxy"
Sep 17 22:28:15.882552 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:28:15.882487    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="183ba9cb-826f-474a-84ac-b982e10b9a2b" containerName="kserve-container"
Sep 17 22:28:15.882552 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:28:15.882495    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="183ba9cb-826f-474a-84ac-b982e10b9a2b" containerName="kube-rbac-proxy"
Sep 17 22:28:15.884774 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:28:15.884758    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-a2de1-predictor-599dfd59cd-ptxbh"
Sep 17 22:28:15.887381 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:28:15.887344    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-a2de1-kube-rbac-proxy-sar-config\""
Sep 17 22:28:15.887513 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:28:15.887378    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-a2de1-predictor-serving-cert\""
Sep 17 22:28:15.894087 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:28:15.894058    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-a2de1-predictor-599dfd59cd-ptxbh"]
Sep 17 22:28:15.929402 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:28:15.929372    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e2ccfb18-d52d-4a21-832a-e4a7cc59de75-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-a2de1-predictor-599dfd59cd-ptxbh\" (UID: \"e2ccfb18-d52d-4a21-832a-e4a7cc59de75\") " pod="kserve-ci-e2e-test/success-200-isvc-a2de1-predictor-599dfd59cd-ptxbh"
Sep 17 22:28:15.929544 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:28:15.929418    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t24p9\" (UniqueName: \"kubernetes.io/projected/e2ccfb18-d52d-4a21-832a-e4a7cc59de75-kube-api-access-t24p9\") pod \"success-200-isvc-a2de1-predictor-599dfd59cd-ptxbh\" (UID: \"e2ccfb18-d52d-4a21-832a-e4a7cc59de75\") " pod="kserve-ci-e2e-test/success-200-isvc-a2de1-predictor-599dfd59cd-ptxbh"
Sep 17 22:28:15.929544 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:28:15.929449    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e2ccfb18-d52d-4a21-832a-e4a7cc59de75-proxy-tls\") pod \"success-200-isvc-a2de1-predictor-599dfd59cd-ptxbh\" (UID: \"e2ccfb18-d52d-4a21-832a-e4a7cc59de75\") " pod="kserve-ci-e2e-test/success-200-isvc-a2de1-predictor-599dfd59cd-ptxbh"
Sep 17 22:28:16.030390 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:28:16.030296    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e2ccfb18-d52d-4a21-832a-e4a7cc59de75-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-a2de1-predictor-599dfd59cd-ptxbh\" (UID: \"e2ccfb18-d52d-4a21-832a-e4a7cc59de75\") " pod="kserve-ci-e2e-test/success-200-isvc-a2de1-predictor-599dfd59cd-ptxbh"
Sep 17 22:28:16.030390 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:28:16.030332    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t24p9\" (UniqueName: \"kubernetes.io/projected/e2ccfb18-d52d-4a21-832a-e4a7cc59de75-kube-api-access-t24p9\") pod \"success-200-isvc-a2de1-predictor-599dfd59cd-ptxbh\" (UID: \"e2ccfb18-d52d-4a21-832a-e4a7cc59de75\") " pod="kserve-ci-e2e-test/success-200-isvc-a2de1-predictor-599dfd59cd-ptxbh"
Sep 17 22:28:16.030390 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:28:16.030376    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e2ccfb18-d52d-4a21-832a-e4a7cc59de75-proxy-tls\") pod \"success-200-isvc-a2de1-predictor-599dfd59cd-ptxbh\" (UID: \"e2ccfb18-d52d-4a21-832a-e4a7cc59de75\") " pod="kserve-ci-e2e-test/success-200-isvc-a2de1-predictor-599dfd59cd-ptxbh"
Sep 17 22:28:16.030640 ip-10-0-136-66 kubenswrapper[2560]: E0917 22:28:16.030468    2560 secret.go:189] Couldn't get secret kserve-ci-e2e-test/success-200-isvc-a2de1-predictor-serving-cert: secret "success-200-isvc-a2de1-predictor-serving-cert" not found
Sep 17 22:28:16.030640 ip-10-0-136-66 kubenswrapper[2560]: E0917 22:28:16.030539    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2ccfb18-d52d-4a21-832a-e4a7cc59de75-proxy-tls podName:e2ccfb18-d52d-4a21-832a-e4a7cc59de75 nodeName:}" failed. No retries permitted until 2026-09-17 22:28:16.530519508 +0000 UTC m=+1828.590291517 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/e2ccfb18-d52d-4a21-832a-e4a7cc59de75-proxy-tls") pod "success-200-isvc-a2de1-predictor-599dfd59cd-ptxbh" (UID: "e2ccfb18-d52d-4a21-832a-e4a7cc59de75") : secret "success-200-isvc-a2de1-predictor-serving-cert" not found
Sep 17 22:28:16.031025 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:28:16.031001    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e2ccfb18-d52d-4a21-832a-e4a7cc59de75-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-a2de1-predictor-599dfd59cd-ptxbh\" (UID: \"e2ccfb18-d52d-4a21-832a-e4a7cc59de75\") " pod="kserve-ci-e2e-test/success-200-isvc-a2de1-predictor-599dfd59cd-ptxbh"
Sep 17 22:28:16.034615 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:28:16.034590    2560 generic.go:356] "Generic (PLEG): container finished" podID="fc0af6ad-44a9-466a-b568-5ea7fb7f1f01" containerID="f2b8c712ee2ceed9ff78596dec30224e7001e1b892b9c5195b3ef059ccd05947" exitCode=2
Sep 17 22:28:16.034738 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:28:16.034668    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-1a2f0-predictor-7b65f5c676-tz8bd" event={"ID":"fc0af6ad-44a9-466a-b568-5ea7fb7f1f01","Type":"ContainerDied","Data":"f2b8c712ee2ceed9ff78596dec30224e7001e1b892b9c5195b3ef059ccd05947"}
Sep 17 22:28:16.038863 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:28:16.038842    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t24p9\" (UniqueName: \"kubernetes.io/projected/e2ccfb18-d52d-4a21-832a-e4a7cc59de75-kube-api-access-t24p9\") pod \"success-200-isvc-a2de1-predictor-599dfd59cd-ptxbh\" (UID: \"e2ccfb18-d52d-4a21-832a-e4a7cc59de75\") " pod="kserve-ci-e2e-test/success-200-isvc-a2de1-predictor-599dfd59cd-ptxbh"
Sep 17 22:28:16.535686 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:28:16.535651    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e2ccfb18-d52d-4a21-832a-e4a7cc59de75-proxy-tls\") pod \"success-200-isvc-a2de1-predictor-599dfd59cd-ptxbh\" (UID: \"e2ccfb18-d52d-4a21-832a-e4a7cc59de75\") " pod="kserve-ci-e2e-test/success-200-isvc-a2de1-predictor-599dfd59cd-ptxbh"
Sep 17 22:28:16.538009 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:28:16.537989    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e2ccfb18-d52d-4a21-832a-e4a7cc59de75-proxy-tls\") pod \"success-200-isvc-a2de1-predictor-599dfd59cd-ptxbh\" (UID: \"e2ccfb18-d52d-4a21-832a-e4a7cc59de75\") " pod="kserve-ci-e2e-test/success-200-isvc-a2de1-predictor-599dfd59cd-ptxbh"
Sep 17 22:28:16.796618 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:28:16.796537    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-a2de1-predictor-599dfd59cd-ptxbh"
Sep 17 22:28:17.069164 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:28:17.069024    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-a2de1-predictor-599dfd59cd-ptxbh"]
Sep 17 22:28:17.071898 ip-10-0-136-66 kubenswrapper[2560]: W0917 22:28:17.071862    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2ccfb18_d52d_4a21_832a_e4a7cc59de75.slice/crio-29fe2ca8d7cd46691980d1a12a4d794a24eb97b4fb689202347f0bfbdee63086 WatchSource:0}: Error finding container 29fe2ca8d7cd46691980d1a12a4d794a24eb97b4fb689202347f0bfbdee63086: Status 404 returned error can't find the container with id 29fe2ca8d7cd46691980d1a12a4d794a24eb97b4fb689202347f0bfbdee63086
Sep 17 22:28:18.044825 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:28:18.044781    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-a2de1-predictor-599dfd59cd-ptxbh" event={"ID":"e2ccfb18-d52d-4a21-832a-e4a7cc59de75","Type":"ContainerStarted","Data":"acbb448f15321035659653a0169d1676a3e9daa045f0a426d50a33fa17cfb71f"}
Sep 17 22:28:18.045285 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:28:18.044849    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-a2de1-predictor-599dfd59cd-ptxbh" event={"ID":"e2ccfb18-d52d-4a21-832a-e4a7cc59de75","Type":"ContainerStarted","Data":"f6675d242f138b29ec08569f510c5f96596c64beab25e4bdb571af38e8034a86"}
Sep 17 22:28:18.045285 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:28:18.044878    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-a2de1-predictor-599dfd59cd-ptxbh" event={"ID":"e2ccfb18-d52d-4a21-832a-e4a7cc59de75","Type":"ContainerStarted","Data":"29fe2ca8d7cd46691980d1a12a4d794a24eb97b4fb689202347f0bfbdee63086"}
Sep 17 22:28:18.045285 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:28:18.044946    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-a2de1-predictor-599dfd59cd-ptxbh"
Sep 17 22:28:18.062082 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:28:18.062038    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-a2de1-predictor-599dfd59cd-ptxbh" podStartSLOduration=3.062022853 podStartE2EDuration="3.062022853s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:28:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:28:18.060157012 +0000 UTC m=+1830.119929023" watchObservedRunningTime="2026-09-17 22:28:18.062022853 +0000 UTC m=+1830.121794864"
Sep 17 22:28:18.796548 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:28:18.796528    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-1a2f0-predictor-7b65f5c676-tz8bd"
Sep 17 22:28:18.853672 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:28:18.853604    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7pswr\" (UniqueName: \"kubernetes.io/projected/fc0af6ad-44a9-466a-b568-5ea7fb7f1f01-kube-api-access-7pswr\") pod \"fc0af6ad-44a9-466a-b568-5ea7fb7f1f01\" (UID: \"fc0af6ad-44a9-466a-b568-5ea7fb7f1f01\") "
Sep 17 22:28:18.853672 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:28:18.853649    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fc0af6ad-44a9-466a-b568-5ea7fb7f1f01-proxy-tls\") pod \"fc0af6ad-44a9-466a-b568-5ea7fb7f1f01\" (UID: \"fc0af6ad-44a9-466a-b568-5ea7fb7f1f01\") "
Sep 17 22:28:18.853861 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:28:18.853680    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fc0af6ad-44a9-466a-b568-5ea7fb7f1f01-kube-rbac-proxy-sar-config\") pod \"fc0af6ad-44a9-466a-b568-5ea7fb7f1f01\" (UID: \"fc0af6ad-44a9-466a-b568-5ea7fb7f1f01\") "
Sep 17 22:28:18.854059 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:28:18.854031    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc0af6ad-44a9-466a-b568-5ea7fb7f1f01-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "fc0af6ad-44a9-466a-b568-5ea7fb7f1f01" (UID: "fc0af6ad-44a9-466a-b568-5ea7fb7f1f01"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 22:28:18.855735 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:28:18.855693    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc0af6ad-44a9-466a-b568-5ea7fb7f1f01-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "fc0af6ad-44a9-466a-b568-5ea7fb7f1f01" (UID: "fc0af6ad-44a9-466a-b568-5ea7fb7f1f01"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 22:28:18.855871 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:28:18.855851    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc0af6ad-44a9-466a-b568-5ea7fb7f1f01-kube-api-access-7pswr" (OuterVolumeSpecName: "kube-api-access-7pswr") pod "fc0af6ad-44a9-466a-b568-5ea7fb7f1f01" (UID: "fc0af6ad-44a9-466a-b568-5ea7fb7f1f01"). InnerVolumeSpecName "kube-api-access-7pswr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 22:28:18.954436 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:28:18.954404    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7pswr\" (UniqueName: \"kubernetes.io/projected/fc0af6ad-44a9-466a-b568-5ea7fb7f1f01-kube-api-access-7pswr\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\""
Sep 17 22:28:18.954436 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:28:18.954430    2560 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fc0af6ad-44a9-466a-b568-5ea7fb7f1f01-proxy-tls\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\""
Sep 17 22:28:18.954436 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:28:18.954442    2560 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fc0af6ad-44a9-466a-b568-5ea7fb7f1f01-kube-rbac-proxy-sar-config\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\""
Sep 17 22:28:19.050804 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:28:19.050770    2560 generic.go:356] "Generic (PLEG): container finished" podID="fc0af6ad-44a9-466a-b568-5ea7fb7f1f01" containerID="f66ec64cd4e0f20c3addba116f558ec46b0b3ce9dde3b5b342777181d2dded58" exitCode=0
Sep 17 22:28:19.051196 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:28:19.050824    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-1a2f0-predictor-7b65f5c676-tz8bd"
Sep 17 22:28:19.051196 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:28:19.050859    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-1a2f0-predictor-7b65f5c676-tz8bd" event={"ID":"fc0af6ad-44a9-466a-b568-5ea7fb7f1f01","Type":"ContainerDied","Data":"f66ec64cd4e0f20c3addba116f558ec46b0b3ce9dde3b5b342777181d2dded58"}
Sep 17 22:28:19.051196 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:28:19.050923    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-1a2f0-predictor-7b65f5c676-tz8bd" event={"ID":"fc0af6ad-44a9-466a-b568-5ea7fb7f1f01","Type":"ContainerDied","Data":"398782f72a69571e314914c229a01c73413d1cbf4df8e52dfa4a74d6d000b5d8"}
Sep 17 22:28:19.051196 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:28:19.050951    2560 scope.go:117] "RemoveContainer" containerID="f2b8c712ee2ceed9ff78596dec30224e7001e1b892b9c5195b3ef059ccd05947"
Sep 17 22:28:19.051483 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:28:19.051461    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-a2de1-predictor-599dfd59cd-ptxbh"
Sep 17 22:28:19.052938 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:28:19.052915    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-a2de1-predictor-599dfd59cd-ptxbh" podUID="e2ccfb18-d52d-4a21-832a-e4a7cc59de75" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.36:8080: connect: connection refused"
Sep 17 22:28:19.060509 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:28:19.060492    2560 scope.go:117] "RemoveContainer" containerID="f66ec64cd4e0f20c3addba116f558ec46b0b3ce9dde3b5b342777181d2dded58"
Sep 17 22:28:19.067621 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:28:19.067601    2560 scope.go:117] "RemoveContainer" containerID="f2b8c712ee2ceed9ff78596dec30224e7001e1b892b9c5195b3ef059ccd05947"
Sep 17 22:28:19.067896 ip-10-0-136-66 kubenswrapper[2560]: E0917 22:28:19.067878    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2b8c712ee2ceed9ff78596dec30224e7001e1b892b9c5195b3ef059ccd05947\": container with ID starting with f2b8c712ee2ceed9ff78596dec30224e7001e1b892b9c5195b3ef059ccd05947 not found: ID does not exist" containerID="f2b8c712ee2ceed9ff78596dec30224e7001e1b892b9c5195b3ef059ccd05947"
Sep 17 22:28:19.067970 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:28:19.067902    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2b8c712ee2ceed9ff78596dec30224e7001e1b892b9c5195b3ef059ccd05947"} err="failed to get container status \"f2b8c712ee2ceed9ff78596dec30224e7001e1b892b9c5195b3ef059ccd05947\": rpc error: code = NotFound desc = could not find container \"f2b8c712ee2ceed9ff78596dec30224e7001e1b892b9c5195b3ef059ccd05947\": container with ID starting with f2b8c712ee2ceed9ff78596dec30224e7001e1b892b9c5195b3ef059ccd05947 not found: ID does not exist"
Sep 17 22:28:19.067970 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:28:19.067918    2560 scope.go:117] "RemoveContainer" containerID="f66ec64cd4e0f20c3addba116f558ec46b0b3ce9dde3b5b342777181d2dded58"
Sep 17 22:28:19.068140 ip-10-0-136-66 kubenswrapper[2560]: E0917 22:28:19.068124    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f66ec64cd4e0f20c3addba116f558ec46b0b3ce9dde3b5b342777181d2dded58\": container with ID starting with f66ec64cd4e0f20c3addba116f558ec46b0b3ce9dde3b5b342777181d2dded58 not found: ID does not exist" containerID="f66ec64cd4e0f20c3addba116f558ec46b0b3ce9dde3b5b342777181d2dded58"
Sep 17 22:28:19.068181 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:28:19.068144    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f66ec64cd4e0f20c3addba116f558ec46b0b3ce9dde3b5b342777181d2dded58"} err="failed to get container status \"f66ec64cd4e0f20c3addba116f558ec46b0b3ce9dde3b5b342777181d2dded58\": rpc error: code = NotFound desc = could not find container \"f66ec64cd4e0f20c3addba116f558ec46b0b3ce9dde3b5b342777181d2dded58\": container with ID starting with f66ec64cd4e0f20c3addba116f558ec46b0b3ce9dde3b5b342777181d2dded58 not found: ID does not exist"
Sep 17 22:28:19.072671 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:28:19.072650    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-1a2f0-predictor-7b65f5c676-tz8bd"]
Sep 17 22:28:19.076133 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:28:19.076114    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-1a2f0-predictor-7b65f5c676-tz8bd"]
Sep 17 22:28:20.056674 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:28:20.056634    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-a2de1-predictor-599dfd59cd-ptxbh" podUID="e2ccfb18-d52d-4a21-832a-e4a7cc59de75" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.36:8080: connect: connection refused"
Sep 17 22:28:20.451573 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:28:20.451477    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc0af6ad-44a9-466a-b568-5ea7fb7f1f01" path="/var/lib/kubelet/pods/fc0af6ad-44a9-466a-b568-5ea7fb7f1f01/volumes"
Sep 17 22:28:25.061554 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:28:25.061522    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-a2de1-predictor-599dfd59cd-ptxbh"
Sep 17 22:28:25.062182 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:28:25.062153    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-a2de1-predictor-599dfd59cd-ptxbh" podUID="e2ccfb18-d52d-4a21-832a-e4a7cc59de75" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.36:8080: connect: connection refused"
Sep 17 22:28:35.062517 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:28:35.062479    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-a2de1-predictor-599dfd59cd-ptxbh" podUID="e2ccfb18-d52d-4a21-832a-e4a7cc59de75" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.36:8080: connect: connection refused"
Sep 17 22:28:45.062252 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:28:45.062213    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-a2de1-predictor-599dfd59cd-ptxbh" podUID="e2ccfb18-d52d-4a21-832a-e4a7cc59de75" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.36:8080: connect: connection refused"
Sep 17 22:28:55.062543 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:28:55.062501    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-a2de1-predictor-599dfd59cd-ptxbh" podUID="e2ccfb18-d52d-4a21-832a-e4a7cc59de75" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.36:8080: connect: connection refused"
Sep 17 22:29:05.063200 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:05.063164    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-a2de1-predictor-599dfd59cd-ptxbh"
Sep 17 22:29:11.850659 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:11.850584    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-6bcee-predictor-78b7578bc8-k8cwm"]
Sep 17 22:29:11.851135 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:11.850795    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-6bcee-predictor-78b7578bc8-k8cwm" podUID="af6faec4-3b13-421a-a4d4-a38270593a27" containerName="kserve-container" containerID="cri-o://ce2a607f6249e50598d9ad66e7c9e6b841fac9a0ad67e0c81f250f437eaac77a" gracePeriod=30
Sep 17 22:29:11.851135 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:11.850817    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-6bcee-predictor-78b7578bc8-k8cwm" podUID="af6faec4-3b13-421a-a4d4-a38270593a27" containerName="kube-rbac-proxy" containerID="cri-o://4f0cea047e40ee01d48963a4c7ab3b9dbf7f103f744491616a485f31c6276adf" gracePeriod=30
Sep 17 22:29:11.960253 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:11.960220    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-94ae3-predictor-b77869d56-22fk6"]
Sep 17 22:29:11.960557 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:11.960544    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc0af6ad-44a9-466a-b568-5ea7fb7f1f01" containerName="kserve-container"
Sep 17 22:29:11.960605 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:11.960558    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc0af6ad-44a9-466a-b568-5ea7fb7f1f01" containerName="kserve-container"
Sep 17 22:29:11.960605 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:11.960578    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc0af6ad-44a9-466a-b568-5ea7fb7f1f01" containerName="kube-rbac-proxy"
Sep 17 22:29:11.960605 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:11.960584    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc0af6ad-44a9-466a-b568-5ea7fb7f1f01" containerName="kube-rbac-proxy"
Sep 17 22:29:11.960701 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:11.960639    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc0af6ad-44a9-466a-b568-5ea7fb7f1f01" containerName="kube-rbac-proxy"
Sep 17 22:29:11.960701 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:11.960649    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc0af6ad-44a9-466a-b568-5ea7fb7f1f01" containerName="kserve-container"
Sep 17 22:29:11.964050 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:11.964033    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-94ae3-predictor-b77869d56-22fk6"
Sep 17 22:29:11.966428 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:11.966402    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-94ae3-predictor-serving-cert\""
Sep 17 22:29:11.966537 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:11.966444    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-94ae3-kube-rbac-proxy-sar-config\""
Sep 17 22:29:11.971655 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:11.971637    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-94ae3-predictor-b77869d56-22fk6"]
Sep 17 22:29:12.057415 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:12.057380    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/dc9b45c8-5cfc-4acc-8f61-ca724ab0c170-proxy-tls\") pod \"success-200-isvc-94ae3-predictor-b77869d56-22fk6\" (UID: \"dc9b45c8-5cfc-4acc-8f61-ca724ab0c170\") " pod="kserve-ci-e2e-test/success-200-isvc-94ae3-predictor-b77869d56-22fk6"
Sep 17 22:29:12.057584 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:12.057454    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4rs2\" (UniqueName: \"kubernetes.io/projected/dc9b45c8-5cfc-4acc-8f61-ca724ab0c170-kube-api-access-q4rs2\") pod \"success-200-isvc-94ae3-predictor-b77869d56-22fk6\" (UID: \"dc9b45c8-5cfc-4acc-8f61-ca724ab0c170\") " pod="kserve-ci-e2e-test/success-200-isvc-94ae3-predictor-b77869d56-22fk6"
Sep 17 22:29:12.057584 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:12.057496    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/dc9b45c8-5cfc-4acc-8f61-ca724ab0c170-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-94ae3-predictor-b77869d56-22fk6\" (UID: \"dc9b45c8-5cfc-4acc-8f61-ca724ab0c170\") " pod="kserve-ci-e2e-test/success-200-isvc-94ae3-predictor-b77869d56-22fk6"
Sep 17 22:29:12.157897 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:12.157818    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/dc9b45c8-5cfc-4acc-8f61-ca724ab0c170-proxy-tls\") pod \"success-200-isvc-94ae3-predictor-b77869d56-22fk6\" (UID: \"dc9b45c8-5cfc-4acc-8f61-ca724ab0c170\") " pod="kserve-ci-e2e-test/success-200-isvc-94ae3-predictor-b77869d56-22fk6"
Sep 17 22:29:12.157897 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:12.157855    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4rs2\" (UniqueName: \"kubernetes.io/projected/dc9b45c8-5cfc-4acc-8f61-ca724ab0c170-kube-api-access-q4rs2\") pod \"success-200-isvc-94ae3-predictor-b77869d56-22fk6\" (UID: \"dc9b45c8-5cfc-4acc-8f61-ca724ab0c170\") " pod="kserve-ci-e2e-test/success-200-isvc-94ae3-predictor-b77869d56-22fk6"
Sep 17 22:29:12.157897 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:12.157875    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/dc9b45c8-5cfc-4acc-8f61-ca724ab0c170-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-94ae3-predictor-b77869d56-22fk6\" (UID: \"dc9b45c8-5cfc-4acc-8f61-ca724ab0c170\") " pod="kserve-ci-e2e-test/success-200-isvc-94ae3-predictor-b77869d56-22fk6"
Sep 17 22:29:12.158523 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:12.158504    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/dc9b45c8-5cfc-4acc-8f61-ca724ab0c170-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-94ae3-predictor-b77869d56-22fk6\" (UID: \"dc9b45c8-5cfc-4acc-8f61-ca724ab0c170\") " pod="kserve-ci-e2e-test/success-200-isvc-94ae3-predictor-b77869d56-22fk6"
Sep 17 22:29:12.160433 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:12.160410    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/dc9b45c8-5cfc-4acc-8f61-ca724ab0c170-proxy-tls\") pod \"success-200-isvc-94ae3-predictor-b77869d56-22fk6\" (UID: \"dc9b45c8-5cfc-4acc-8f61-ca724ab0c170\") " pod="kserve-ci-e2e-test/success-200-isvc-94ae3-predictor-b77869d56-22fk6"
Sep 17 22:29:12.168011 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:12.167981    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4rs2\" (UniqueName: \"kubernetes.io/projected/dc9b45c8-5cfc-4acc-8f61-ca724ab0c170-kube-api-access-q4rs2\") pod \"success-200-isvc-94ae3-predictor-b77869d56-22fk6\" (UID: \"dc9b45c8-5cfc-4acc-8f61-ca724ab0c170\") " pod="kserve-ci-e2e-test/success-200-isvc-94ae3-predictor-b77869d56-22fk6"
Sep 17 22:29:12.264066 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:12.264032    2560 generic.go:356] "Generic (PLEG): container finished" podID="af6faec4-3b13-421a-a4d4-a38270593a27" containerID="4f0cea047e40ee01d48963a4c7ab3b9dbf7f103f744491616a485f31c6276adf" exitCode=2
Sep 17 22:29:12.264195 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:12.264073    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-6bcee-predictor-78b7578bc8-k8cwm" event={"ID":"af6faec4-3b13-421a-a4d4-a38270593a27","Type":"ContainerDied","Data":"4f0cea047e40ee01d48963a4c7ab3b9dbf7f103f744491616a485f31c6276adf"}
Sep 17 22:29:12.275242 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:12.275220    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-94ae3-predictor-b77869d56-22fk6"
Sep 17 22:29:12.544597 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:12.544573    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-94ae3-predictor-b77869d56-22fk6"]
Sep 17 22:29:12.546934 ip-10-0-136-66 kubenswrapper[2560]: W0917 22:29:12.546907    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc9b45c8_5cfc_4acc_8f61_ca724ab0c170.slice/crio-5cb8be2df0bc4acf5a6f0a2e94aa856c21ba8e09447ddaefc32892ce8ea18154 WatchSource:0}: Error finding container 5cb8be2df0bc4acf5a6f0a2e94aa856c21ba8e09447ddaefc32892ce8ea18154: Status 404 returned error can't find the container with id 5cb8be2df0bc4acf5a6f0a2e94aa856c21ba8e09447ddaefc32892ce8ea18154
Sep 17 22:29:13.269954 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:13.269916    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-94ae3-predictor-b77869d56-22fk6" event={"ID":"dc9b45c8-5cfc-4acc-8f61-ca724ab0c170","Type":"ContainerStarted","Data":"412036a084cd12bc31d27e374d8fe67e593de78daa36a888d382bfd8dfcb09b7"}
Sep 17 22:29:13.270379 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:13.269976    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-94ae3-predictor-b77869d56-22fk6" event={"ID":"dc9b45c8-5cfc-4acc-8f61-ca724ab0c170","Type":"ContainerStarted","Data":"9b93bdcce5f33325a769685022cd7771b695e9c419760329d45bd83fd6ea72a4"}
Sep 17 22:29:13.270379 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:13.269998    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-94ae3-predictor-b77869d56-22fk6" event={"ID":"dc9b45c8-5cfc-4acc-8f61-ca724ab0c170","Type":"ContainerStarted","Data":"5cb8be2df0bc4acf5a6f0a2e94aa856c21ba8e09447ddaefc32892ce8ea18154"}
Sep 17 22:29:13.270379 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:13.270037    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-94ae3-predictor-b77869d56-22fk6"
Sep 17 22:29:13.286018 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:13.285973    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-94ae3-predictor-b77869d56-22fk6" podStartSLOduration=2.285956912 podStartE2EDuration="2.285956912s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:29:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:29:13.285593646 +0000 UTC m=+1885.345365669" watchObservedRunningTime="2026-09-17 22:29:13.285956912 +0000 UTC m=+1885.345728925"
Sep 17 22:29:14.274619 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:14.274586    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-94ae3-predictor-b77869d56-22fk6"
Sep 17 22:29:14.275939 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:14.275914    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-94ae3-predictor-b77869d56-22fk6" podUID="dc9b45c8-5cfc-4acc-8f61-ca724ab0c170" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.37:8080: connect: connection refused"
Sep 17 22:29:14.792050 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:14.792024    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-6bcee-predictor-78b7578bc8-k8cwm"
Sep 17 22:29:14.879939 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:14.879908    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/af6faec4-3b13-421a-a4d4-a38270593a27-proxy-tls\") pod \"af6faec4-3b13-421a-a4d4-a38270593a27\" (UID: \"af6faec4-3b13-421a-a4d4-a38270593a27\") "
Sep 17 22:29:14.880065 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:14.879976    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xz42f\" (UniqueName: \"kubernetes.io/projected/af6faec4-3b13-421a-a4d4-a38270593a27-kube-api-access-xz42f\") pod \"af6faec4-3b13-421a-a4d4-a38270593a27\" (UID: \"af6faec4-3b13-421a-a4d4-a38270593a27\") "
Sep 17 22:29:14.880065 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:14.880047    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/af6faec4-3b13-421a-a4d4-a38270593a27-kube-rbac-proxy-sar-config\") pod \"af6faec4-3b13-421a-a4d4-a38270593a27\" (UID: \"af6faec4-3b13-421a-a4d4-a38270593a27\") "
Sep 17 22:29:14.880405 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:14.880383    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af6faec4-3b13-421a-a4d4-a38270593a27-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "af6faec4-3b13-421a-a4d4-a38270593a27" (UID: "af6faec4-3b13-421a-a4d4-a38270593a27"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 22:29:14.881968 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:14.881945    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af6faec4-3b13-421a-a4d4-a38270593a27-kube-api-access-xz42f" (OuterVolumeSpecName: "kube-api-access-xz42f") pod "af6faec4-3b13-421a-a4d4-a38270593a27" (UID: "af6faec4-3b13-421a-a4d4-a38270593a27"). InnerVolumeSpecName "kube-api-access-xz42f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 22:29:14.882056 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:14.881949    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af6faec4-3b13-421a-a4d4-a38270593a27-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "af6faec4-3b13-421a-a4d4-a38270593a27" (UID: "af6faec4-3b13-421a-a4d4-a38270593a27"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 22:29:14.981487 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:14.981468    2560 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/af6faec4-3b13-421a-a4d4-a38270593a27-kube-rbac-proxy-sar-config\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\""
Sep 17 22:29:14.981580 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:14.981488    2560 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/af6faec4-3b13-421a-a4d4-a38270593a27-proxy-tls\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\""
Sep 17 22:29:14.981580 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:14.981498    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xz42f\" (UniqueName: \"kubernetes.io/projected/af6faec4-3b13-421a-a4d4-a38270593a27-kube-api-access-xz42f\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\""
Sep 17 22:29:15.280866 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:15.280775    2560 generic.go:356] "Generic (PLEG): container finished" podID="af6faec4-3b13-421a-a4d4-a38270593a27" containerID="ce2a607f6249e50598d9ad66e7c9e6b841fac9a0ad67e0c81f250f437eaac77a" exitCode=0
Sep 17 22:29:15.280866 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:15.280842    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-6bcee-predictor-78b7578bc8-k8cwm"
Sep 17 22:29:15.281304 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:15.280861    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-6bcee-predictor-78b7578bc8-k8cwm" event={"ID":"af6faec4-3b13-421a-a4d4-a38270593a27","Type":"ContainerDied","Data":"ce2a607f6249e50598d9ad66e7c9e6b841fac9a0ad67e0c81f250f437eaac77a"}
Sep 17 22:29:15.281304 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:15.280959    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-6bcee-predictor-78b7578bc8-k8cwm" event={"ID":"af6faec4-3b13-421a-a4d4-a38270593a27","Type":"ContainerDied","Data":"913f68f2247e54d95e9827709a8ed30e58782a52ae0174f120a6790f6b94135c"}
Sep 17 22:29:15.281304 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:15.280990    2560 scope.go:117] "RemoveContainer" containerID="4f0cea047e40ee01d48963a4c7ab3b9dbf7f103f744491616a485f31c6276adf"
Sep 17 22:29:15.281495 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:15.281303    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-94ae3-predictor-b77869d56-22fk6" podUID="dc9b45c8-5cfc-4acc-8f61-ca724ab0c170" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.37:8080: connect: connection refused"
Sep 17 22:29:15.289747 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:15.289731    2560 scope.go:117] "RemoveContainer" containerID="ce2a607f6249e50598d9ad66e7c9e6b841fac9a0ad67e0c81f250f437eaac77a"
Sep 17 22:29:15.296892 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:15.296875    2560 scope.go:117] "RemoveContainer" containerID="4f0cea047e40ee01d48963a4c7ab3b9dbf7f103f744491616a485f31c6276adf"
Sep 17 22:29:15.297165 ip-10-0-136-66 kubenswrapper[2560]: E0917 22:29:15.297147    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f0cea047e40ee01d48963a4c7ab3b9dbf7f103f744491616a485f31c6276adf\": container with ID starting with 4f0cea047e40ee01d48963a4c7ab3b9dbf7f103f744491616a485f31c6276adf not found: ID does not exist" containerID="4f0cea047e40ee01d48963a4c7ab3b9dbf7f103f744491616a485f31c6276adf"
Sep 17 22:29:15.297212 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:15.297173    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f0cea047e40ee01d48963a4c7ab3b9dbf7f103f744491616a485f31c6276adf"} err="failed to get container status \"4f0cea047e40ee01d48963a4c7ab3b9dbf7f103f744491616a485f31c6276adf\": rpc error: code = NotFound desc = could not find container \"4f0cea047e40ee01d48963a4c7ab3b9dbf7f103f744491616a485f31c6276adf\": container with ID starting with 4f0cea047e40ee01d48963a4c7ab3b9dbf7f103f744491616a485f31c6276adf not found: ID does not exist"
Sep 17 22:29:15.297212 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:15.297190    2560 scope.go:117] "RemoveContainer" containerID="ce2a607f6249e50598d9ad66e7c9e6b841fac9a0ad67e0c81f250f437eaac77a"
Sep 17 22:29:15.297501 ip-10-0-136-66 kubenswrapper[2560]: E0917 22:29:15.297483    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce2a607f6249e50598d9ad66e7c9e6b841fac9a0ad67e0c81f250f437eaac77a\": container with ID starting with ce2a607f6249e50598d9ad66e7c9e6b841fac9a0ad67e0c81f250f437eaac77a not found: ID does not exist" containerID="ce2a607f6249e50598d9ad66e7c9e6b841fac9a0ad67e0c81f250f437eaac77a"
Sep 17 22:29:15.297567 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:15.297506    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce2a607f6249e50598d9ad66e7c9e6b841fac9a0ad67e0c81f250f437eaac77a"} err="failed to get container status \"ce2a607f6249e50598d9ad66e7c9e6b841fac9a0ad67e0c81f250f437eaac77a\": rpc error: code = NotFound desc = could not find container \"ce2a607f6249e50598d9ad66e7c9e6b841fac9a0ad67e0c81f250f437eaac77a\": container with ID starting with ce2a607f6249e50598d9ad66e7c9e6b841fac9a0ad67e0c81f250f437eaac77a not found: ID does not exist"
Sep 17 22:29:15.301126 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:15.301105    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-6bcee-predictor-78b7578bc8-k8cwm"]
Sep 17 22:29:15.305187 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:15.305167    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-6bcee-predictor-78b7578bc8-k8cwm"]
Sep 17 22:29:16.451278 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:16.451241    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af6faec4-3b13-421a-a4d4-a38270593a27" path="/var/lib/kubelet/pods/af6faec4-3b13-421a-a4d4-a38270593a27/volumes"
Sep 17 22:29:20.285997 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:20.285968    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-94ae3-predictor-b77869d56-22fk6"
Sep 17 22:29:20.286499 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:20.286369    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-94ae3-predictor-b77869d56-22fk6" podUID="dc9b45c8-5cfc-4acc-8f61-ca724ab0c170" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.37:8080: connect: connection refused"
Sep 17 22:29:26.041010 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:26.040975    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-a2de1-predictor-599dfd59cd-ptxbh"]
Sep 17 22:29:26.041497 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:26.041294    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-a2de1-predictor-599dfd59cd-ptxbh" podUID="e2ccfb18-d52d-4a21-832a-e4a7cc59de75" containerName="kserve-container" containerID="cri-o://f6675d242f138b29ec08569f510c5f96596c64beab25e4bdb571af38e8034a86" gracePeriod=30
Sep 17 22:29:26.041497 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:26.041406    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-a2de1-predictor-599dfd59cd-ptxbh" podUID="e2ccfb18-d52d-4a21-832a-e4a7cc59de75" containerName="kube-rbac-proxy" containerID="cri-o://acbb448f15321035659653a0169d1676a3e9daa045f0a426d50a33fa17cfb71f" gracePeriod=30
Sep 17 22:29:26.157301 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:26.157265    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-0bca3-predictor-57dc9d489d-tv42j"]
Sep 17 22:29:26.157623 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:26.157610    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af6faec4-3b13-421a-a4d4-a38270593a27" containerName="kserve-container"
Sep 17 22:29:26.157670 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:26.157625    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="af6faec4-3b13-421a-a4d4-a38270593a27" containerName="kserve-container"
Sep 17 22:29:26.157670 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:26.157646    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af6faec4-3b13-421a-a4d4-a38270593a27" containerName="kube-rbac-proxy"
Sep 17 22:29:26.157670 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:26.157654    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="af6faec4-3b13-421a-a4d4-a38270593a27" containerName="kube-rbac-proxy"
Sep 17 22:29:26.157767 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:26.157715    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="af6faec4-3b13-421a-a4d4-a38270593a27" containerName="kube-rbac-proxy"
Sep 17 22:29:26.157767 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:26.157725    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="af6faec4-3b13-421a-a4d4-a38270593a27" containerName="kserve-container"
Sep 17 22:29:26.160658 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:26.160641    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-0bca3-predictor-57dc9d489d-tv42j"
Sep 17 22:29:26.163126 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:26.163102    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-0bca3-predictor-serving-cert\""
Sep 17 22:29:26.163237 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:26.163102    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"success-200-isvc-0bca3-kube-rbac-proxy-sar-config\""
Sep 17 22:29:26.170752 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:26.170730    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-0bca3-predictor-57dc9d489d-tv42j"]
Sep 17 22:29:26.263954 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:26.263917    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fcc48e5c-2818-441f-9c85-450982d7146e-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-0bca3-predictor-57dc9d489d-tv42j\" (UID: \"fcc48e5c-2818-441f-9c85-450982d7146e\") " pod="kserve-ci-e2e-test/success-200-isvc-0bca3-predictor-57dc9d489d-tv42j"
Sep 17 22:29:26.264126 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:26.264024    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6l29\" (UniqueName: \"kubernetes.io/projected/fcc48e5c-2818-441f-9c85-450982d7146e-kube-api-access-r6l29\") pod \"success-200-isvc-0bca3-predictor-57dc9d489d-tv42j\" (UID: \"fcc48e5c-2818-441f-9c85-450982d7146e\") " pod="kserve-ci-e2e-test/success-200-isvc-0bca3-predictor-57dc9d489d-tv42j"
Sep 17 22:29:26.264126 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:26.264066    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fcc48e5c-2818-441f-9c85-450982d7146e-proxy-tls\") pod \"success-200-isvc-0bca3-predictor-57dc9d489d-tv42j\" (UID: \"fcc48e5c-2818-441f-9c85-450982d7146e\") " pod="kserve-ci-e2e-test/success-200-isvc-0bca3-predictor-57dc9d489d-tv42j"
Sep 17 22:29:26.327638 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:26.327554    2560 generic.go:356] "Generic (PLEG): container finished" podID="e2ccfb18-d52d-4a21-832a-e4a7cc59de75" containerID="acbb448f15321035659653a0169d1676a3e9daa045f0a426d50a33fa17cfb71f" exitCode=2
Sep 17 22:29:26.327638 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:26.327598    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-a2de1-predictor-599dfd59cd-ptxbh" event={"ID":"e2ccfb18-d52d-4a21-832a-e4a7cc59de75","Type":"ContainerDied","Data":"acbb448f15321035659653a0169d1676a3e9daa045f0a426d50a33fa17cfb71f"}
Sep 17 22:29:26.365221 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:26.365190    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6l29\" (UniqueName: \"kubernetes.io/projected/fcc48e5c-2818-441f-9c85-450982d7146e-kube-api-access-r6l29\") pod \"success-200-isvc-0bca3-predictor-57dc9d489d-tv42j\" (UID: \"fcc48e5c-2818-441f-9c85-450982d7146e\") " pod="kserve-ci-e2e-test/success-200-isvc-0bca3-predictor-57dc9d489d-tv42j"
Sep 17 22:29:26.365221 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:26.365224    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fcc48e5c-2818-441f-9c85-450982d7146e-proxy-tls\") pod \"success-200-isvc-0bca3-predictor-57dc9d489d-tv42j\" (UID: \"fcc48e5c-2818-441f-9c85-450982d7146e\") " pod="kserve-ci-e2e-test/success-200-isvc-0bca3-predictor-57dc9d489d-tv42j"
Sep 17 22:29:26.365481 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:26.365254    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fcc48e5c-2818-441f-9c85-450982d7146e-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-0bca3-predictor-57dc9d489d-tv42j\" (UID: \"fcc48e5c-2818-441f-9c85-450982d7146e\") " pod="kserve-ci-e2e-test/success-200-isvc-0bca3-predictor-57dc9d489d-tv42j"
Sep 17 22:29:26.365845 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:26.365825    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fcc48e5c-2818-441f-9c85-450982d7146e-kube-rbac-proxy-sar-config\") pod \"success-200-isvc-0bca3-predictor-57dc9d489d-tv42j\" (UID: \"fcc48e5c-2818-441f-9c85-450982d7146e\") " pod="kserve-ci-e2e-test/success-200-isvc-0bca3-predictor-57dc9d489d-tv42j"
Sep 17 22:29:26.367747 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:26.367726    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fcc48e5c-2818-441f-9c85-450982d7146e-proxy-tls\") pod \"success-200-isvc-0bca3-predictor-57dc9d489d-tv42j\" (UID: \"fcc48e5c-2818-441f-9c85-450982d7146e\") " pod="kserve-ci-e2e-test/success-200-isvc-0bca3-predictor-57dc9d489d-tv42j"
Sep 17 22:29:26.373663 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:26.373630    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6l29\" (UniqueName: \"kubernetes.io/projected/fcc48e5c-2818-441f-9c85-450982d7146e-kube-api-access-r6l29\") pod \"success-200-isvc-0bca3-predictor-57dc9d489d-tv42j\" (UID: \"fcc48e5c-2818-441f-9c85-450982d7146e\") " pod="kserve-ci-e2e-test/success-200-isvc-0bca3-predictor-57dc9d489d-tv42j"
Sep 17 22:29:26.471278 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:26.471250    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-0bca3-predictor-57dc9d489d-tv42j"
Sep 17 22:29:26.742473 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:26.742451    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-0bca3-predictor-57dc9d489d-tv42j"]
Sep 17 22:29:26.744247 ip-10-0-136-66 kubenswrapper[2560]: W0917 22:29:26.744215    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcc48e5c_2818_441f_9c85_450982d7146e.slice/crio-cb2440068fed68b12f4e45ea60b2a0f0bb171ea2801bfaeb73b7e5b7e0e11af8 WatchSource:0}: Error finding container cb2440068fed68b12f4e45ea60b2a0f0bb171ea2801bfaeb73b7e5b7e0e11af8: Status 404 returned error can't find the container with id cb2440068fed68b12f4e45ea60b2a0f0bb171ea2801bfaeb73b7e5b7e0e11af8
Sep 17 22:29:27.333084 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:27.333053    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-0bca3-predictor-57dc9d489d-tv42j" event={"ID":"fcc48e5c-2818-441f-9c85-450982d7146e","Type":"ContainerStarted","Data":"287ba890a85504e5beaae2f748f546e255b37e0253df4e18e66a954b70572164"}
Sep 17 22:29:27.333495 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:27.333105    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-0bca3-predictor-57dc9d489d-tv42j" event={"ID":"fcc48e5c-2818-441f-9c85-450982d7146e","Type":"ContainerStarted","Data":"9f0777f44d8d94fbd7c8d6f83a7b635ba5e42dc5870215868cd735f622bdc7f5"}
Sep 17 22:29:27.333495 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:27.333127    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-0bca3-predictor-57dc9d489d-tv42j" event={"ID":"fcc48e5c-2818-441f-9c85-450982d7146e","Type":"ContainerStarted","Data":"cb2440068fed68b12f4e45ea60b2a0f0bb171ea2801bfaeb73b7e5b7e0e11af8"}
Sep 17 22:29:27.333495 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:27.333151    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-0bca3-predictor-57dc9d489d-tv42j"
Sep 17 22:29:27.351790 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:27.351730    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/success-200-isvc-0bca3-predictor-57dc9d489d-tv42j" podStartSLOduration=1.351709709 podStartE2EDuration="1.351709709s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:29:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:29:27.348197784 +0000 UTC m=+1899.407969797" watchObservedRunningTime="2026-09-17 22:29:27.351709709 +0000 UTC m=+1899.411481721"
Sep 17 22:29:28.342553 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:28.342520    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/success-200-isvc-0bca3-predictor-57dc9d489d-tv42j"
Sep 17 22:29:28.344207 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:28.344173    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-0bca3-predictor-57dc9d489d-tv42j" podUID="fcc48e5c-2818-441f-9c85-450982d7146e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.38:8080: connect: connection refused"
Sep 17 22:29:29.092629 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:29.092601    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-a2de1-predictor-599dfd59cd-ptxbh"
Sep 17 22:29:29.186343 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:29.186310    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e2ccfb18-d52d-4a21-832a-e4a7cc59de75-proxy-tls\") pod \"e2ccfb18-d52d-4a21-832a-e4a7cc59de75\" (UID: \"e2ccfb18-d52d-4a21-832a-e4a7cc59de75\") "
Sep 17 22:29:29.186525 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:29.186375    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t24p9\" (UniqueName: \"kubernetes.io/projected/e2ccfb18-d52d-4a21-832a-e4a7cc59de75-kube-api-access-t24p9\") pod \"e2ccfb18-d52d-4a21-832a-e4a7cc59de75\" (UID: \"e2ccfb18-d52d-4a21-832a-e4a7cc59de75\") "
Sep 17 22:29:29.186525 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:29.186416    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e2ccfb18-d52d-4a21-832a-e4a7cc59de75-kube-rbac-proxy-sar-config\") pod \"e2ccfb18-d52d-4a21-832a-e4a7cc59de75\" (UID: \"e2ccfb18-d52d-4a21-832a-e4a7cc59de75\") "
Sep 17 22:29:29.186806 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:29.186776    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2ccfb18-d52d-4a21-832a-e4a7cc59de75-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "e2ccfb18-d52d-4a21-832a-e4a7cc59de75" (UID: "e2ccfb18-d52d-4a21-832a-e4a7cc59de75"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 22:29:29.188433 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:29.188402    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2ccfb18-d52d-4a21-832a-e4a7cc59de75-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "e2ccfb18-d52d-4a21-832a-e4a7cc59de75" (UID: "e2ccfb18-d52d-4a21-832a-e4a7cc59de75"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 22:29:29.188526 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:29.188499    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2ccfb18-d52d-4a21-832a-e4a7cc59de75-kube-api-access-t24p9" (OuterVolumeSpecName: "kube-api-access-t24p9") pod "e2ccfb18-d52d-4a21-832a-e4a7cc59de75" (UID: "e2ccfb18-d52d-4a21-832a-e4a7cc59de75"). InnerVolumeSpecName "kube-api-access-t24p9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 22:29:29.287563 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:29.287528    2560 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e2ccfb18-d52d-4a21-832a-e4a7cc59de75-proxy-tls\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\""
Sep 17 22:29:29.287563 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:29.287558    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t24p9\" (UniqueName: \"kubernetes.io/projected/e2ccfb18-d52d-4a21-832a-e4a7cc59de75-kube-api-access-t24p9\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\""
Sep 17 22:29:29.287563 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:29.287568    2560 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e2ccfb18-d52d-4a21-832a-e4a7cc59de75-kube-rbac-proxy-sar-config\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\""
Sep 17 22:29:29.348735 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:29.348695    2560 generic.go:356] "Generic (PLEG): container finished" podID="e2ccfb18-d52d-4a21-832a-e4a7cc59de75" containerID="f6675d242f138b29ec08569f510c5f96596c64beab25e4bdb571af38e8034a86" exitCode=0
Sep 17 22:29:29.349186 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:29.348764    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-a2de1-predictor-599dfd59cd-ptxbh"
Sep 17 22:29:29.349186 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:29.348768    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-a2de1-predictor-599dfd59cd-ptxbh" event={"ID":"e2ccfb18-d52d-4a21-832a-e4a7cc59de75","Type":"ContainerDied","Data":"f6675d242f138b29ec08569f510c5f96596c64beab25e4bdb571af38e8034a86"}
Sep 17 22:29:29.349186 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:29.348824    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-a2de1-predictor-599dfd59cd-ptxbh" event={"ID":"e2ccfb18-d52d-4a21-832a-e4a7cc59de75","Type":"ContainerDied","Data":"29fe2ca8d7cd46691980d1a12a4d794a24eb97b4fb689202347f0bfbdee63086"}
Sep 17 22:29:29.349186 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:29.348851    2560 scope.go:117] "RemoveContainer" containerID="acbb448f15321035659653a0169d1676a3e9daa045f0a426d50a33fa17cfb71f"
Sep 17 22:29:29.349465 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:29.349329    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-0bca3-predictor-57dc9d489d-tv42j" podUID="fcc48e5c-2818-441f-9c85-450982d7146e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.38:8080: connect: connection refused"
Sep 17 22:29:29.360008 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:29.359465    2560 scope.go:117] "RemoveContainer" containerID="f6675d242f138b29ec08569f510c5f96596c64beab25e4bdb571af38e8034a86"
Sep 17 22:29:29.367234 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:29.367218    2560 scope.go:117] "RemoveContainer" containerID="acbb448f15321035659653a0169d1676a3e9daa045f0a426d50a33fa17cfb71f"
Sep 17 22:29:29.367501 ip-10-0-136-66 kubenswrapper[2560]: E0917 22:29:29.367486    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"acbb448f15321035659653a0169d1676a3e9daa045f0a426d50a33fa17cfb71f\": container with ID starting with acbb448f15321035659653a0169d1676a3e9daa045f0a426d50a33fa17cfb71f not found: ID does not exist" containerID="acbb448f15321035659653a0169d1676a3e9daa045f0a426d50a33fa17cfb71f"
Sep 17 22:29:29.367562 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:29.367509    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acbb448f15321035659653a0169d1676a3e9daa045f0a426d50a33fa17cfb71f"} err="failed to get container status \"acbb448f15321035659653a0169d1676a3e9daa045f0a426d50a33fa17cfb71f\": rpc error: code = NotFound desc = could not find container \"acbb448f15321035659653a0169d1676a3e9daa045f0a426d50a33fa17cfb71f\": container with ID starting with acbb448f15321035659653a0169d1676a3e9daa045f0a426d50a33fa17cfb71f not found: ID does not exist"
Sep 17 22:29:29.367562 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:29.367524    2560 scope.go:117] "RemoveContainer" containerID="f6675d242f138b29ec08569f510c5f96596c64beab25e4bdb571af38e8034a86"
Sep 17 22:29:29.367757 ip-10-0-136-66 kubenswrapper[2560]: E0917 22:29:29.367723    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6675d242f138b29ec08569f510c5f96596c64beab25e4bdb571af38e8034a86\": container with ID starting with f6675d242f138b29ec08569f510c5f96596c64beab25e4bdb571af38e8034a86 not found: ID does not exist" containerID="f6675d242f138b29ec08569f510c5f96596c64beab25e4bdb571af38e8034a86"
Sep 17 22:29:29.367802 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:29.367764    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6675d242f138b29ec08569f510c5f96596c64beab25e4bdb571af38e8034a86"} err="failed to get container status \"f6675d242f138b29ec08569f510c5f96596c64beab25e4bdb571af38e8034a86\": rpc error: code = NotFound desc = could not find container \"f6675d242f138b29ec08569f510c5f96596c64beab25e4bdb571af38e8034a86\": container with ID starting with f6675d242f138b29ec08569f510c5f96596c64beab25e4bdb571af38e8034a86 not found: ID does not exist"
Sep 17 22:29:29.369860 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:29.369840    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-a2de1-predictor-599dfd59cd-ptxbh"]
Sep 17 22:29:29.373433 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:29.373410    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-a2de1-predictor-599dfd59cd-ptxbh"]
Sep 17 22:29:30.287343 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:30.287306    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-94ae3-predictor-b77869d56-22fk6" podUID="dc9b45c8-5cfc-4acc-8f61-ca724ab0c170" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.37:8080: connect: connection refused"
Sep 17 22:29:30.451814 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:30.451780    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2ccfb18-d52d-4a21-832a-e4a7cc59de75" path="/var/lib/kubelet/pods/e2ccfb18-d52d-4a21-832a-e4a7cc59de75/volumes"
Sep 17 22:29:34.354234 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:34.354205    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-0bca3-predictor-57dc9d489d-tv42j"
Sep 17 22:29:34.354766 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:34.354734    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-0bca3-predictor-57dc9d489d-tv42j" podUID="fcc48e5c-2818-441f-9c85-450982d7146e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.38:8080: connect: connection refused"
Sep 17 22:29:40.286817 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:40.286776    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-94ae3-predictor-b77869d56-22fk6" podUID="dc9b45c8-5cfc-4acc-8f61-ca724ab0c170" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.37:8080: connect: connection refused"
Sep 17 22:29:44.355653 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:44.355614    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-0bca3-predictor-57dc9d489d-tv42j" podUID="fcc48e5c-2818-441f-9c85-450982d7146e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.38:8080: connect: connection refused"
Sep 17 22:29:50.286497 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:50.286450    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-94ae3-predictor-b77869d56-22fk6" podUID="dc9b45c8-5cfc-4acc-8f61-ca724ab0c170" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.37:8080: connect: connection refused"
Sep 17 22:29:54.354788 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:29:54.354747    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-0bca3-predictor-57dc9d489d-tv42j" podUID="fcc48e5c-2818-441f-9c85-450982d7146e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.38:8080: connect: connection refused"
Sep 17 22:30:00.287526 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:30:00.287496    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-94ae3-predictor-b77869d56-22fk6"
Sep 17 22:30:04.355541 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:30:04.355502    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/success-200-isvc-0bca3-predictor-57dc9d489d-tv42j" podUID="fcc48e5c-2818-441f-9c85-450982d7146e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.38:8080: connect: connection refused"
Sep 17 22:30:14.355506 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:30:14.355472    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/success-200-isvc-0bca3-predictor-57dc9d489d-tv42j"
Sep 17 22:32:48.529031 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:32:48.528912    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-xcr4j_d690701c-bcec-48f2-9978-b6aebbf77447/console-operator/1.log"
Sep 17 22:32:48.532144 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:32:48.531578    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-xcr4j_d690701c-bcec-48f2-9978-b6aebbf77447/console-operator/1.log"
Sep 17 22:37:48.554644 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:37:48.554536    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-xcr4j_d690701c-bcec-48f2-9978-b6aebbf77447/console-operator/1.log"
Sep 17 22:37:48.557819 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:37:48.557804    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-xcr4j_d690701c-bcec-48f2-9978-b6aebbf77447/console-operator/1.log"
Sep 17 22:38:40.837766 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:38:40.837688    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-0bca3-predictor-57dc9d489d-tv42j"]
Sep 17 22:38:40.838247 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:38:40.837908    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-0bca3-predictor-57dc9d489d-tv42j" podUID="fcc48e5c-2818-441f-9c85-450982d7146e" containerName="kserve-container" containerID="cri-o://9f0777f44d8d94fbd7c8d6f83a7b635ba5e42dc5870215868cd735f622bdc7f5" gracePeriod=30
Sep 17 22:38:40.838247 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:38:40.837936    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-0bca3-predictor-57dc9d489d-tv42j" podUID="fcc48e5c-2818-441f-9c85-450982d7146e" containerName="kube-rbac-proxy" containerID="cri-o://287ba890a85504e5beaae2f748f546e255b37e0253df4e18e66a954b70572164" gracePeriod=30
Sep 17 22:38:41.498937 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:38:41.498884    2560 generic.go:356] "Generic (PLEG): container finished" podID="fcc48e5c-2818-441f-9c85-450982d7146e" containerID="287ba890a85504e5beaae2f748f546e255b37e0253df4e18e66a954b70572164" exitCode=2
Sep 17 22:38:41.499114 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:38:41.498957    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-0bca3-predictor-57dc9d489d-tv42j" event={"ID":"fcc48e5c-2818-441f-9c85-450982d7146e","Type":"ContainerDied","Data":"287ba890a85504e5beaae2f748f546e255b37e0253df4e18e66a954b70572164"}
Sep 17 22:38:43.781522 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:38:43.781494    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-0bca3-predictor-57dc9d489d-tv42j"
Sep 17 22:38:43.873280 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:38:43.873215    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r6l29\" (UniqueName: \"kubernetes.io/projected/fcc48e5c-2818-441f-9c85-450982d7146e-kube-api-access-r6l29\") pod \"fcc48e5c-2818-441f-9c85-450982d7146e\" (UID: \"fcc48e5c-2818-441f-9c85-450982d7146e\") "
Sep 17 22:38:43.873427 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:38:43.873286    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fcc48e5c-2818-441f-9c85-450982d7146e-proxy-tls\") pod \"fcc48e5c-2818-441f-9c85-450982d7146e\" (UID: \"fcc48e5c-2818-441f-9c85-450982d7146e\") "
Sep 17 22:38:43.873427 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:38:43.873329    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fcc48e5c-2818-441f-9c85-450982d7146e-kube-rbac-proxy-sar-config\") pod \"fcc48e5c-2818-441f-9c85-450982d7146e\" (UID: \"fcc48e5c-2818-441f-9c85-450982d7146e\") "
Sep 17 22:38:43.873724 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:38:43.873697    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fcc48e5c-2818-441f-9c85-450982d7146e-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "fcc48e5c-2818-441f-9c85-450982d7146e" (UID: "fcc48e5c-2818-441f-9c85-450982d7146e"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 22:38:43.875214 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:38:43.875193    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fcc48e5c-2818-441f-9c85-450982d7146e-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "fcc48e5c-2818-441f-9c85-450982d7146e" (UID: "fcc48e5c-2818-441f-9c85-450982d7146e"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 22:38:43.875307 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:38:43.875213    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcc48e5c-2818-441f-9c85-450982d7146e-kube-api-access-r6l29" (OuterVolumeSpecName: "kube-api-access-r6l29") pod "fcc48e5c-2818-441f-9c85-450982d7146e" (UID: "fcc48e5c-2818-441f-9c85-450982d7146e"). InnerVolumeSpecName "kube-api-access-r6l29". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 22:38:43.973768 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:38:43.973741    2560 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fcc48e5c-2818-441f-9c85-450982d7146e-proxy-tls\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\""
Sep 17 22:38:43.973768 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:38:43.973765    2560 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fcc48e5c-2818-441f-9c85-450982d7146e-kube-rbac-proxy-sar-config\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\""
Sep 17 22:38:43.973894 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:38:43.973774    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r6l29\" (UniqueName: \"kubernetes.io/projected/fcc48e5c-2818-441f-9c85-450982d7146e-kube-api-access-r6l29\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\""
Sep 17 22:38:44.510944 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:38:44.510912    2560 generic.go:356] "Generic (PLEG): container finished" podID="fcc48e5c-2818-441f-9c85-450982d7146e" containerID="9f0777f44d8d94fbd7c8d6f83a7b635ba5e42dc5870215868cd735f622bdc7f5" exitCode=0
Sep 17 22:38:44.511060 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:38:44.510965    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-0bca3-predictor-57dc9d489d-tv42j"
Sep 17 22:38:44.511060 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:38:44.510998    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-0bca3-predictor-57dc9d489d-tv42j" event={"ID":"fcc48e5c-2818-441f-9c85-450982d7146e","Type":"ContainerDied","Data":"9f0777f44d8d94fbd7c8d6f83a7b635ba5e42dc5870215868cd735f622bdc7f5"}
Sep 17 22:38:44.511138 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:38:44.511070    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-0bca3-predictor-57dc9d489d-tv42j" event={"ID":"fcc48e5c-2818-441f-9c85-450982d7146e","Type":"ContainerDied","Data":"cb2440068fed68b12f4e45ea60b2a0f0bb171ea2801bfaeb73b7e5b7e0e11af8"}
Sep 17 22:38:44.511138 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:38:44.511110    2560 scope.go:117] "RemoveContainer" containerID="287ba890a85504e5beaae2f748f546e255b37e0253df4e18e66a954b70572164"
Sep 17 22:38:44.519205 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:38:44.519171    2560 scope.go:117] "RemoveContainer" containerID="9f0777f44d8d94fbd7c8d6f83a7b635ba5e42dc5870215868cd735f622bdc7f5"
Sep 17 22:38:44.526276 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:38:44.526256    2560 scope.go:117] "RemoveContainer" containerID="287ba890a85504e5beaae2f748f546e255b37e0253df4e18e66a954b70572164"
Sep 17 22:38:44.526559 ip-10-0-136-66 kubenswrapper[2560]: E0917 22:38:44.526540    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"287ba890a85504e5beaae2f748f546e255b37e0253df4e18e66a954b70572164\": container with ID starting with 287ba890a85504e5beaae2f748f546e255b37e0253df4e18e66a954b70572164 not found: ID does not exist" containerID="287ba890a85504e5beaae2f748f546e255b37e0253df4e18e66a954b70572164"
Sep 17 22:38:44.526641 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:38:44.526571    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"287ba890a85504e5beaae2f748f546e255b37e0253df4e18e66a954b70572164"} err="failed to get container status \"287ba890a85504e5beaae2f748f546e255b37e0253df4e18e66a954b70572164\": rpc error: code = NotFound desc = could not find container \"287ba890a85504e5beaae2f748f546e255b37e0253df4e18e66a954b70572164\": container with ID starting with 287ba890a85504e5beaae2f748f546e255b37e0253df4e18e66a954b70572164 not found: ID does not exist"
Sep 17 22:38:44.526641 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:38:44.526594    2560 scope.go:117] "RemoveContainer" containerID="9f0777f44d8d94fbd7c8d6f83a7b635ba5e42dc5870215868cd735f622bdc7f5"
Sep 17 22:38:44.526868 ip-10-0-136-66 kubenswrapper[2560]: E0917 22:38:44.526848    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f0777f44d8d94fbd7c8d6f83a7b635ba5e42dc5870215868cd735f622bdc7f5\": container with ID starting with 9f0777f44d8d94fbd7c8d6f83a7b635ba5e42dc5870215868cd735f622bdc7f5 not found: ID does not exist" containerID="9f0777f44d8d94fbd7c8d6f83a7b635ba5e42dc5870215868cd735f622bdc7f5"
Sep 17 22:38:44.527024 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:38:44.526875    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f0777f44d8d94fbd7c8d6f83a7b635ba5e42dc5870215868cd735f622bdc7f5"} err="failed to get container status \"9f0777f44d8d94fbd7c8d6f83a7b635ba5e42dc5870215868cd735f622bdc7f5\": rpc error: code = NotFound desc = could not find container \"9f0777f44d8d94fbd7c8d6f83a7b635ba5e42dc5870215868cd735f622bdc7f5\": container with ID starting with 9f0777f44d8d94fbd7c8d6f83a7b635ba5e42dc5870215868cd735f622bdc7f5 not found: ID does not exist"
Sep 17 22:38:44.527587 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:38:44.527563    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-0bca3-predictor-57dc9d489d-tv42j"]
Sep 17 22:38:44.529088 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:38:44.529070    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-0bca3-predictor-57dc9d489d-tv42j"]
Sep 17 22:38:46.451219 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:38:46.451185    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fcc48e5c-2818-441f-9c85-450982d7146e" path="/var/lib/kubelet/pods/fcc48e5c-2818-441f-9c85-450982d7146e/volumes"
Sep 17 22:42:48.579268 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:42:48.579171    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-xcr4j_d690701c-bcec-48f2-9978-b6aebbf77447/console-operator/1.log"
Sep 17 22:42:48.583705 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:42:48.583683    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-xcr4j_d690701c-bcec-48f2-9978-b6aebbf77447/console-operator/1.log"
Sep 17 22:46:31.404817 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:46:31.404782    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-94ae3-predictor-b77869d56-22fk6"]
Sep 17 22:46:31.405455 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:46:31.405061    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-94ae3-predictor-b77869d56-22fk6" podUID="dc9b45c8-5cfc-4acc-8f61-ca724ab0c170" containerName="kserve-container" containerID="cri-o://9b93bdcce5f33325a769685022cd7771b695e9c419760329d45bd83fd6ea72a4" gracePeriod=30
Sep 17 22:46:31.405455 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:46:31.405232    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/success-200-isvc-94ae3-predictor-b77869d56-22fk6" podUID="dc9b45c8-5cfc-4acc-8f61-ca724ab0c170" containerName="kube-rbac-proxy" containerID="cri-o://412036a084cd12bc31d27e374d8fe67e593de78daa36a888d382bfd8dfcb09b7" gracePeriod=30
Sep 17 22:46:32.304897 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:46:32.304861    2560 generic.go:356] "Generic (PLEG): container finished" podID="dc9b45c8-5cfc-4acc-8f61-ca724ab0c170" containerID="412036a084cd12bc31d27e374d8fe67e593de78daa36a888d382bfd8dfcb09b7" exitCode=2
Sep 17 22:46:32.305087 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:46:32.304937    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-94ae3-predictor-b77869d56-22fk6" event={"ID":"dc9b45c8-5cfc-4acc-8f61-ca724ab0c170","Type":"ContainerDied","Data":"412036a084cd12bc31d27e374d8fe67e593de78daa36a888d382bfd8dfcb09b7"}
Sep 17 22:46:34.058005 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:46:34.057979    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-94ae3-predictor-b77869d56-22fk6"
Sep 17 22:46:34.151530 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:46:34.151444    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/dc9b45c8-5cfc-4acc-8f61-ca724ab0c170-kube-rbac-proxy-sar-config\") pod \"dc9b45c8-5cfc-4acc-8f61-ca724ab0c170\" (UID: \"dc9b45c8-5cfc-4acc-8f61-ca724ab0c170\") "
Sep 17 22:46:34.151530 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:46:34.151480    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q4rs2\" (UniqueName: \"kubernetes.io/projected/dc9b45c8-5cfc-4acc-8f61-ca724ab0c170-kube-api-access-q4rs2\") pod \"dc9b45c8-5cfc-4acc-8f61-ca724ab0c170\" (UID: \"dc9b45c8-5cfc-4acc-8f61-ca724ab0c170\") "
Sep 17 22:46:34.151530 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:46:34.151511    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/dc9b45c8-5cfc-4acc-8f61-ca724ab0c170-proxy-tls\") pod \"dc9b45c8-5cfc-4acc-8f61-ca724ab0c170\" (UID: \"dc9b45c8-5cfc-4acc-8f61-ca724ab0c170\") "
Sep 17 22:46:34.151832 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:46:34.151805    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc9b45c8-5cfc-4acc-8f61-ca724ab0c170-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "dc9b45c8-5cfc-4acc-8f61-ca724ab0c170" (UID: "dc9b45c8-5cfc-4acc-8f61-ca724ab0c170"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 22:46:34.153600 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:46:34.153576    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc9b45c8-5cfc-4acc-8f61-ca724ab0c170-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "dc9b45c8-5cfc-4acc-8f61-ca724ab0c170" (UID: "dc9b45c8-5cfc-4acc-8f61-ca724ab0c170"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 22:46:34.153696 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:46:34.153679    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc9b45c8-5cfc-4acc-8f61-ca724ab0c170-kube-api-access-q4rs2" (OuterVolumeSpecName: "kube-api-access-q4rs2") pod "dc9b45c8-5cfc-4acc-8f61-ca724ab0c170" (UID: "dc9b45c8-5cfc-4acc-8f61-ca724ab0c170"). InnerVolumeSpecName "kube-api-access-q4rs2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 22:46:34.252146 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:46:34.252114    2560 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/dc9b45c8-5cfc-4acc-8f61-ca724ab0c170-kube-rbac-proxy-sar-config\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\""
Sep 17 22:46:34.252146 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:46:34.252140    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q4rs2\" (UniqueName: \"kubernetes.io/projected/dc9b45c8-5cfc-4acc-8f61-ca724ab0c170-kube-api-access-q4rs2\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\""
Sep 17 22:46:34.252146 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:46:34.252150    2560 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/dc9b45c8-5cfc-4acc-8f61-ca724ab0c170-proxy-tls\") on node \"ip-10-0-136-66.ec2.internal\" DevicePath \"\""
Sep 17 22:46:34.314074 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:46:34.314039    2560 generic.go:356] "Generic (PLEG): container finished" podID="dc9b45c8-5cfc-4acc-8f61-ca724ab0c170" containerID="9b93bdcce5f33325a769685022cd7771b695e9c419760329d45bd83fd6ea72a4" exitCode=0
Sep 17 22:46:34.314206 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:46:34.314097    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/success-200-isvc-94ae3-predictor-b77869d56-22fk6"
Sep 17 22:46:34.314206 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:46:34.314130    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-94ae3-predictor-b77869d56-22fk6" event={"ID":"dc9b45c8-5cfc-4acc-8f61-ca724ab0c170","Type":"ContainerDied","Data":"9b93bdcce5f33325a769685022cd7771b695e9c419760329d45bd83fd6ea72a4"}
Sep 17 22:46:34.314206 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:46:34.314189    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/success-200-isvc-94ae3-predictor-b77869d56-22fk6" event={"ID":"dc9b45c8-5cfc-4acc-8f61-ca724ab0c170","Type":"ContainerDied","Data":"5cb8be2df0bc4acf5a6f0a2e94aa856c21ba8e09447ddaefc32892ce8ea18154"}
Sep 17 22:46:34.314312 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:46:34.314221    2560 scope.go:117] "RemoveContainer" containerID="412036a084cd12bc31d27e374d8fe67e593de78daa36a888d382bfd8dfcb09b7"
Sep 17 22:46:34.323045 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:46:34.323025    2560 scope.go:117] "RemoveContainer" containerID="9b93bdcce5f33325a769685022cd7771b695e9c419760329d45bd83fd6ea72a4"
Sep 17 22:46:34.330415 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:46:34.330396    2560 scope.go:117] "RemoveContainer" containerID="412036a084cd12bc31d27e374d8fe67e593de78daa36a888d382bfd8dfcb09b7"
Sep 17 22:46:34.330663 ip-10-0-136-66 kubenswrapper[2560]: E0917 22:46:34.330648    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"412036a084cd12bc31d27e374d8fe67e593de78daa36a888d382bfd8dfcb09b7\": container with ID starting with 412036a084cd12bc31d27e374d8fe67e593de78daa36a888d382bfd8dfcb09b7 not found: ID does not exist" containerID="412036a084cd12bc31d27e374d8fe67e593de78daa36a888d382bfd8dfcb09b7"
Sep 17 22:46:34.330713 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:46:34.330672    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"412036a084cd12bc31d27e374d8fe67e593de78daa36a888d382bfd8dfcb09b7"} err="failed to get container status \"412036a084cd12bc31d27e374d8fe67e593de78daa36a888d382bfd8dfcb09b7\": rpc error: code = NotFound desc = could not find container \"412036a084cd12bc31d27e374d8fe67e593de78daa36a888d382bfd8dfcb09b7\": container with ID starting with 412036a084cd12bc31d27e374d8fe67e593de78daa36a888d382bfd8dfcb09b7 not found: ID does not exist"
Sep 17 22:46:34.330713 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:46:34.330688    2560 scope.go:117] "RemoveContainer" containerID="9b93bdcce5f33325a769685022cd7771b695e9c419760329d45bd83fd6ea72a4"
Sep 17 22:46:34.330939 ip-10-0-136-66 kubenswrapper[2560]: E0917 22:46:34.330918    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b93bdcce5f33325a769685022cd7771b695e9c419760329d45bd83fd6ea72a4\": container with ID starting with 9b93bdcce5f33325a769685022cd7771b695e9c419760329d45bd83fd6ea72a4 not found: ID does not exist" containerID="9b93bdcce5f33325a769685022cd7771b695e9c419760329d45bd83fd6ea72a4"
Sep 17 22:46:34.330999 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:46:34.330951    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b93bdcce5f33325a769685022cd7771b695e9c419760329d45bd83fd6ea72a4"} err="failed to get container status \"9b93bdcce5f33325a769685022cd7771b695e9c419760329d45bd83fd6ea72a4\": rpc error: code = NotFound desc = could not find container \"9b93bdcce5f33325a769685022cd7771b695e9c419760329d45bd83fd6ea72a4\": container with ID starting with 9b93bdcce5f33325a769685022cd7771b695e9c419760329d45bd83fd6ea72a4 not found: ID does not exist"
Sep 17 22:46:34.335310 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:46:34.335287    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-94ae3-predictor-b77869d56-22fk6"]
Sep 17 22:46:34.338997 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:46:34.338977    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/success-200-isvc-94ae3-predictor-b77869d56-22fk6"]
Sep 17 22:46:34.450648 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:46:34.450569    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc9b45c8-5cfc-4acc-8f61-ca724ab0c170" path="/var/lib/kubelet/pods/dc9b45c8-5cfc-4acc-8f61-ca724ab0c170/volumes"
Sep 17 22:47:03.483479 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:03.483438    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-b796f/must-gather-c4g7p"]
Sep 17 22:47:03.483996 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:03.483742    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2ccfb18-d52d-4a21-832a-e4a7cc59de75" containerName="kserve-container"
Sep 17 22:47:03.483996 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:03.483757    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2ccfb18-d52d-4a21-832a-e4a7cc59de75" containerName="kserve-container"
Sep 17 22:47:03.483996 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:03.483768    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc9b45c8-5cfc-4acc-8f61-ca724ab0c170" containerName="kube-rbac-proxy"
Sep 17 22:47:03.483996 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:03.483778    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc9b45c8-5cfc-4acc-8f61-ca724ab0c170" containerName="kube-rbac-proxy"
Sep 17 22:47:03.483996 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:03.483784    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcc48e5c-2818-441f-9c85-450982d7146e" containerName="kube-rbac-proxy"
Sep 17 22:47:03.483996 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:03.483791    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcc48e5c-2818-441f-9c85-450982d7146e" containerName="kube-rbac-proxy"
Sep 17 22:47:03.483996 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:03.483798    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc9b45c8-5cfc-4acc-8f61-ca724ab0c170" containerName="kserve-container"
Sep 17 22:47:03.483996 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:03.483803    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc9b45c8-5cfc-4acc-8f61-ca724ab0c170" containerName="kserve-container"
Sep 17 22:47:03.483996 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:03.483812    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcc48e5c-2818-441f-9c85-450982d7146e" containerName="kserve-container"
Sep 17 22:47:03.483996 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:03.483817    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcc48e5c-2818-441f-9c85-450982d7146e" containerName="kserve-container"
Sep 17 22:47:03.483996 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:03.483829    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2ccfb18-d52d-4a21-832a-e4a7cc59de75" containerName="kube-rbac-proxy"
Sep 17 22:47:03.483996 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:03.483834    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2ccfb18-d52d-4a21-832a-e4a7cc59de75" containerName="kube-rbac-proxy"
Sep 17 22:47:03.483996 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:03.483880    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="fcc48e5c-2818-441f-9c85-450982d7146e" containerName="kube-rbac-proxy"
Sep 17 22:47:03.483996 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:03.483888    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc9b45c8-5cfc-4acc-8f61-ca724ab0c170" containerName="kube-rbac-proxy"
Sep 17 22:47:03.483996 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:03.483893    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="fcc48e5c-2818-441f-9c85-450982d7146e" containerName="kserve-container"
Sep 17 22:47:03.483996 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:03.483900    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2ccfb18-d52d-4a21-832a-e4a7cc59de75" containerName="kserve-container"
Sep 17 22:47:03.483996 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:03.483906    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2ccfb18-d52d-4a21-832a-e4a7cc59de75" containerName="kube-rbac-proxy"
Sep 17 22:47:03.483996 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:03.483911    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc9b45c8-5cfc-4acc-8f61-ca724ab0c170" containerName="kserve-container"
Sep 17 22:47:03.486838 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:03.486820    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b796f/must-gather-c4g7p"
Sep 17 22:47:03.489511 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:03.489489    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-b796f\"/\"openshift-service-ca.crt\""
Sep 17 22:47:03.489619 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:03.489525    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-b796f\"/\"kube-root-ca.crt\""
Sep 17 22:47:03.490512 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:03.490491    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-b796f\"/\"default-dockercfg-qblds\""
Sep 17 22:47:03.494491 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:03.494469    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b796f/must-gather-c4g7p"]
Sep 17 22:47:03.567409 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:03.567371    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/77ab58e3-ce22-4216-9241-34f7d8c04382-must-gather-output\") pod \"must-gather-c4g7p\" (UID: \"77ab58e3-ce22-4216-9241-34f7d8c04382\") " pod="openshift-must-gather-b796f/must-gather-c4g7p"
Sep 17 22:47:03.567587 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:03.567425    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgrk6\" (UniqueName: \"kubernetes.io/projected/77ab58e3-ce22-4216-9241-34f7d8c04382-kube-api-access-hgrk6\") pod \"must-gather-c4g7p\" (UID: \"77ab58e3-ce22-4216-9241-34f7d8c04382\") " pod="openshift-must-gather-b796f/must-gather-c4g7p"
Sep 17 22:47:03.667942 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:03.667911    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/77ab58e3-ce22-4216-9241-34f7d8c04382-must-gather-output\") pod \"must-gather-c4g7p\" (UID: \"77ab58e3-ce22-4216-9241-34f7d8c04382\") " pod="openshift-must-gather-b796f/must-gather-c4g7p"
Sep 17 22:47:03.668149 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:03.667963    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgrk6\" (UniqueName: \"kubernetes.io/projected/77ab58e3-ce22-4216-9241-34f7d8c04382-kube-api-access-hgrk6\") pod \"must-gather-c4g7p\" (UID: \"77ab58e3-ce22-4216-9241-34f7d8c04382\") " pod="openshift-must-gather-b796f/must-gather-c4g7p"
Sep 17 22:47:03.668255 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:03.668233    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/77ab58e3-ce22-4216-9241-34f7d8c04382-must-gather-output\") pod \"must-gather-c4g7p\" (UID: \"77ab58e3-ce22-4216-9241-34f7d8c04382\") " pod="openshift-must-gather-b796f/must-gather-c4g7p"
Sep 17 22:47:03.675487 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:03.675469    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgrk6\" (UniqueName: \"kubernetes.io/projected/77ab58e3-ce22-4216-9241-34f7d8c04382-kube-api-access-hgrk6\") pod \"must-gather-c4g7p\" (UID: \"77ab58e3-ce22-4216-9241-34f7d8c04382\") " pod="openshift-must-gather-b796f/must-gather-c4g7p"
Sep 17 22:47:03.807276 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:03.807199    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b796f/must-gather-c4g7p"
Sep 17 22:47:04.073155 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:04.073079    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b796f/must-gather-c4g7p"]
Sep 17 22:47:04.075342 ip-10-0-136-66 kubenswrapper[2560]: W0917 22:47:04.075312    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod77ab58e3_ce22_4216_9241_34f7d8c04382.slice/crio-3c2ca1e41bece9c0f2b135f1e38e13ea01861567ffc2fab16db0670beff55523 WatchSource:0}: Error finding container 3c2ca1e41bece9c0f2b135f1e38e13ea01861567ffc2fab16db0670beff55523: Status 404 returned error can't find the container with id 3c2ca1e41bece9c0f2b135f1e38e13ea01861567ffc2fab16db0670beff55523
Sep 17 22:47:04.077142 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:04.077124    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 22:47:04.429487 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:04.429405    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b796f/must-gather-c4g7p" event={"ID":"77ab58e3-ce22-4216-9241-34f7d8c04382","Type":"ContainerStarted","Data":"3c2ca1e41bece9c0f2b135f1e38e13ea01861567ffc2fab16db0670beff55523"}
Sep 17 22:47:05.435328 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:05.435287    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b796f/must-gather-c4g7p" event={"ID":"77ab58e3-ce22-4216-9241-34f7d8c04382","Type":"ContainerStarted","Data":"9fca575de7b1098b4aac2d4cc0e5e5a6a0cdf6a4cce6a0d88cdfcc0c9815a9ee"}
Sep 17 22:47:05.435708 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:05.435367    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b796f/must-gather-c4g7p" event={"ID":"77ab58e3-ce22-4216-9241-34f7d8c04382","Type":"ContainerStarted","Data":"0bb8ea815ec679ccd94f5fef96d756538926ebc2e983b0d8ed024893f62fe587"}
Sep 17 22:47:05.451316 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:05.451267    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-b796f/must-gather-c4g7p" podStartSLOduration=1.779983753 podStartE2EDuration="2.451252724s" totalImagesPullingTime="671.268971ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:47:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:47:05.449831156 +0000 UTC m=+2957.509603169" watchObservedRunningTime="2026-09-17 22:47:05.451252724 +0000 UTC m=+2957.511024761"
Sep 17 22:47:06.061298 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:06.061266    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-br6wh_2c0000a6-1b43-479b-a06b-06eb5db40c2d/global-pull-secret-syncer/0.log"
Sep 17 22:47:06.207488 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:06.207447    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-tprjw_6505672f-86e4-439d-88c0-8b8ac9bcb987/konnectivity-agent/0.log"
Sep 17 22:47:06.299511 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:06.299485    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-66.ec2.internal_7cb3cec29cc11ab20979146634290fc1/haproxy/0.log"
Sep 17 22:47:10.703522 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:10.703440    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-847b8bd8d7-5svbx_93344afa-73c8-4d4e-8d6f-47e08e79c050/cluster-monitoring-operator/0.log"
Sep 17 22:47:10.922140 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:10.922112    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c29sg_2296adbd-b902-481f-b1ac-1c8d12ceee82/node-exporter/0.log"
Sep 17 22:47:10.945922 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:10.945898    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c29sg_2296adbd-b902-481f-b1ac-1c8d12ceee82/kube-rbac-proxy/0.log"
Sep 17 22:47:10.971515 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:10.971382    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c29sg_2296adbd-b902-481f-b1ac-1c8d12ceee82/init-textfile/0.log"
Sep 17 22:47:11.353973 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:11.353903    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-f88797c9-sc8js_390b6528-d7c4-4381-9c0f-d3ff1d4e75da/telemeter-client/0.log"
Sep 17 22:47:11.376332 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:11.376295    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-f88797c9-sc8js_390b6528-d7c4-4381-9c0f-d3ff1d4e75da/reload/0.log"
Sep 17 22:47:11.399457 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:11.399431    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-f88797c9-sc8js_390b6528-d7c4-4381-9c0f-d3ff1d4e75da/kube-rbac-proxy/0.log"
Sep 17 22:47:12.794143 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:12.794111    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6446c8d75d-2jjzd_0718c57f-12b7-4062-b53c-777792631aec/networking-console-plugin/0.log"
Sep 17 22:47:13.282388 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:13.282342    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-xcr4j_d690701c-bcec-48f2-9978-b6aebbf77447/console-operator/1.log"
Sep 17 22:47:13.293162 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:13.293130    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-xcr4j_d690701c-bcec-48f2-9978-b6aebbf77447/console-operator/2.log"
Sep 17 22:47:14.181721 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:14.181693    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5c4db8bdf9-85f68_6c3ce3c4-e0e9-4ca5-9932-be6418a30c00/volume-data-source-validator/0.log"
Sep 17 22:47:14.404802 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:14.404769    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-b796f/perf-node-gather-daemonset-jtbrh"]
Sep 17 22:47:14.409132 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:14.409106    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b796f/perf-node-gather-daemonset-jtbrh"
Sep 17 22:47:14.418738 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:14.418694    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b796f/perf-node-gather-daemonset-jtbrh"]
Sep 17 22:47:14.568709 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:14.568670    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3e3fb497-c41b-468b-9e7a-03dd4165ee3b-sys\") pod \"perf-node-gather-daemonset-jtbrh\" (UID: \"3e3fb497-c41b-468b-9e7a-03dd4165ee3b\") " pod="openshift-must-gather-b796f/perf-node-gather-daemonset-jtbrh"
Sep 17 22:47:14.568899 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:14.568718    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzdjp\" (UniqueName: \"kubernetes.io/projected/3e3fb497-c41b-468b-9e7a-03dd4165ee3b-kube-api-access-zzdjp\") pod \"perf-node-gather-daemonset-jtbrh\" (UID: \"3e3fb497-c41b-468b-9e7a-03dd4165ee3b\") " pod="openshift-must-gather-b796f/perf-node-gather-daemonset-jtbrh"
Sep 17 22:47:14.568899 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:14.568758    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3e3fb497-c41b-468b-9e7a-03dd4165ee3b-lib-modules\") pod \"perf-node-gather-daemonset-jtbrh\" (UID: \"3e3fb497-c41b-468b-9e7a-03dd4165ee3b\") " pod="openshift-must-gather-b796f/perf-node-gather-daemonset-jtbrh"
Sep 17 22:47:14.568899 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:14.568808    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3e3fb497-c41b-468b-9e7a-03dd4165ee3b-podres\") pod \"perf-node-gather-daemonset-jtbrh\" (UID: \"3e3fb497-c41b-468b-9e7a-03dd4165ee3b\") " pod="openshift-must-gather-b796f/perf-node-gather-daemonset-jtbrh"
Sep 17 22:47:14.568899 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:14.568837    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3e3fb497-c41b-468b-9e7a-03dd4165ee3b-proc\") pod \"perf-node-gather-daemonset-jtbrh\" (UID: \"3e3fb497-c41b-468b-9e7a-03dd4165ee3b\") " pod="openshift-must-gather-b796f/perf-node-gather-daemonset-jtbrh"
Sep 17 22:47:14.670106 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:14.670071    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzdjp\" (UniqueName: \"kubernetes.io/projected/3e3fb497-c41b-468b-9e7a-03dd4165ee3b-kube-api-access-zzdjp\") pod \"perf-node-gather-daemonset-jtbrh\" (UID: \"3e3fb497-c41b-468b-9e7a-03dd4165ee3b\") " pod="openshift-must-gather-b796f/perf-node-gather-daemonset-jtbrh"
Sep 17 22:47:14.670290 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:14.670145    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3e3fb497-c41b-468b-9e7a-03dd4165ee3b-lib-modules\") pod \"perf-node-gather-daemonset-jtbrh\" (UID: \"3e3fb497-c41b-468b-9e7a-03dd4165ee3b\") " pod="openshift-must-gather-b796f/perf-node-gather-daemonset-jtbrh"
Sep 17 22:47:14.670290 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:14.670180    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3e3fb497-c41b-468b-9e7a-03dd4165ee3b-podres\") pod \"perf-node-gather-daemonset-jtbrh\" (UID: \"3e3fb497-c41b-468b-9e7a-03dd4165ee3b\") " pod="openshift-must-gather-b796f/perf-node-gather-daemonset-jtbrh"
Sep 17 22:47:14.670290 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:14.670201    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3e3fb497-c41b-468b-9e7a-03dd4165ee3b-proc\") pod \"perf-node-gather-daemonset-jtbrh\" (UID: \"3e3fb497-c41b-468b-9e7a-03dd4165ee3b\") " pod="openshift-must-gather-b796f/perf-node-gather-daemonset-jtbrh"
Sep 17 22:47:14.670290 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:14.670253    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3e3fb497-c41b-468b-9e7a-03dd4165ee3b-sys\") pod \"perf-node-gather-daemonset-jtbrh\" (UID: \"3e3fb497-c41b-468b-9e7a-03dd4165ee3b\") " pod="openshift-must-gather-b796f/perf-node-gather-daemonset-jtbrh"
Sep 17 22:47:14.670547 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:14.670315    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3e3fb497-c41b-468b-9e7a-03dd4165ee3b-sys\") pod \"perf-node-gather-daemonset-jtbrh\" (UID: \"3e3fb497-c41b-468b-9e7a-03dd4165ee3b\") " pod="openshift-must-gather-b796f/perf-node-gather-daemonset-jtbrh"
Sep 17 22:47:14.670547 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:14.670318    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3e3fb497-c41b-468b-9e7a-03dd4165ee3b-podres\") pod \"perf-node-gather-daemonset-jtbrh\" (UID: \"3e3fb497-c41b-468b-9e7a-03dd4165ee3b\") " pod="openshift-must-gather-b796f/perf-node-gather-daemonset-jtbrh"
Sep 17 22:47:14.670547 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:14.670378    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3e3fb497-c41b-468b-9e7a-03dd4165ee3b-proc\") pod \"perf-node-gather-daemonset-jtbrh\" (UID: \"3e3fb497-c41b-468b-9e7a-03dd4165ee3b\") " pod="openshift-must-gather-b796f/perf-node-gather-daemonset-jtbrh"
Sep 17 22:47:14.670547 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:14.670467    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3e3fb497-c41b-468b-9e7a-03dd4165ee3b-lib-modules\") pod \"perf-node-gather-daemonset-jtbrh\" (UID: \"3e3fb497-c41b-468b-9e7a-03dd4165ee3b\") " pod="openshift-must-gather-b796f/perf-node-gather-daemonset-jtbrh"
Sep 17 22:47:14.677977 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:14.677955    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzdjp\" (UniqueName: \"kubernetes.io/projected/3e3fb497-c41b-468b-9e7a-03dd4165ee3b-kube-api-access-zzdjp\") pod \"perf-node-gather-daemonset-jtbrh\" (UID: \"3e3fb497-c41b-468b-9e7a-03dd4165ee3b\") " pod="openshift-must-gather-b796f/perf-node-gather-daemonset-jtbrh"
Sep 17 22:47:14.721308 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:14.721269    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b796f/perf-node-gather-daemonset-jtbrh"
Sep 17 22:47:14.993098 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:14.993069    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4nccz_2127c519-5059-47bc-b905-2ac3bee41b8d/dns/0.log"
Sep 17 22:47:15.005857 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:15.005832    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b796f/perf-node-gather-daemonset-jtbrh"]
Sep 17 22:47:15.008122 ip-10-0-136-66 kubenswrapper[2560]: W0917 22:47:15.008084    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3e3fb497_c41b_468b_9e7a_03dd4165ee3b.slice/crio-2513f0e61044756f9aa39fb70c698c4419706403223773f6df4c298bcb5a96e4 WatchSource:0}: Error finding container 2513f0e61044756f9aa39fb70c698c4419706403223773f6df4c298bcb5a96e4: Status 404 returned error can't find the container with id 2513f0e61044756f9aa39fb70c698c4419706403223773f6df4c298bcb5a96e4
Sep 17 22:47:15.014454 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:15.014249    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4nccz_2127c519-5059-47bc-b905-2ac3bee41b8d/kube-rbac-proxy/0.log"
Sep 17 22:47:15.151069 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:15.151043    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hllvl_7ac7682e-e943-4684-9c1b-eee2c58acbf1/dns-node-resolver/0.log"
Sep 17 22:47:15.495061 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:15.495019    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b796f/perf-node-gather-daemonset-jtbrh" event={"ID":"3e3fb497-c41b-468b-9e7a-03dd4165ee3b","Type":"ContainerStarted","Data":"4ef86146bb6471e80994e84bbc4176b43498115a06a774e96bf42ad380fb4c22"}
Sep 17 22:47:15.495578 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:15.495091    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b796f/perf-node-gather-daemonset-jtbrh" event={"ID":"3e3fb497-c41b-468b-9e7a-03dd4165ee3b","Type":"ContainerStarted","Data":"2513f0e61044756f9aa39fb70c698c4419706403223773f6df4c298bcb5a96e4"}
Sep 17 22:47:15.495578 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:15.495124    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-b796f/perf-node-gather-daemonset-jtbrh"
Sep 17 22:47:15.648518 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:15.648491    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-z4bjm_845f08e5-f5c6-430c-befa-727ab76b3a00/node-ca/0.log"
Sep 17 22:47:16.360988 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:16.360949    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5dcb767b8d-7lbgr_b4aec7ce-0e26-4c9c-b89f-e4b827ff9f86/router/0.log"
Sep 17 22:47:16.711188 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:16.711108    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zxdvm_f0b6f107-f369-47b8-852b-ca599f331d5c/serve-healthcheck-canary/0.log"
Sep 17 22:47:17.047761 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:17.047730    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-6f9c644dd9-6qz86_74040bed-ca22-4af1-a397-223d527bceb7/insights-operator/0.log"
Sep 17 22:47:17.049470 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:17.049446    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-6f9c644dd9-6qz86_74040bed-ca22-4af1-a397-223d527bceb7/insights-operator/1.log"
Sep 17 22:47:17.072193 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:17.072172    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6kzh8_985c7fb9-46f9-49aa-b6b8-07fd3597ba51/kube-rbac-proxy/0.log"
Sep 17 22:47:17.091114 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:17.091091    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6kzh8_985c7fb9-46f9-49aa-b6b8-07fd3597ba51/exporter/0.log"
Sep 17 22:47:17.108607 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:17.108578    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6kzh8_985c7fb9-46f9-49aa-b6b8-07fd3597ba51/extractor/0.log"
Sep 17 22:47:19.474284 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:19.474256    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-79b679679b-bkdhf_cf4e775b-bb8d-44a5-9010-24958cf2f264/manager/0.log"
Sep 17 22:47:19.511991 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:19.511964    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-645f9c8fd6-z7jp4_e310cd03-3d77-4e42-a0f6-c359f558ac91/manager/0.log"
Sep 17 22:47:19.649527 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:19.649493    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-22r2n_89d3b046-e8f4-4881-9292-a4d9db5321c3/s3-init/0.log"
Sep 17 22:47:19.663538 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:19.663508    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-22r2n_89d3b046-e8f4-4881-9292-a4d9db5321c3/download-hf-model/0.log"
Sep 17 22:47:21.507982 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:21.507954    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-b796f/perf-node-gather-daemonset-jtbrh"
Sep 17 22:47:21.524757 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:21.524714    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-b796f/perf-node-gather-daemonset-jtbrh" podStartSLOduration=7.524699089 podStartE2EDuration="7.524699089s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 22:47:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:47:15.511886167 +0000 UTC m=+2967.571658194" watchObservedRunningTime="2026-09-17 22:47:21.524699089 +0000 UTC m=+2973.584471141"
Sep 17 22:47:23.745504 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:23.745463    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55889f7b47-j9ctg_c2767d1f-5347-4d4e-8f72-c29ac89b09ef/kube-storage-version-migrator-operator/1.log"
Sep 17 22:47:23.747019 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:23.746995    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55889f7b47-j9ctg_c2767d1f-5347-4d4e-8f72-c29ac89b09ef/kube-storage-version-migrator-operator/0.log"
Sep 17 22:47:24.916222 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:24.916190    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nn2xs_00fb2a0f-d0d6-4d8d-8884-04fc3cd6aea4/kube-multus-additional-cni-plugins/0.log"
Sep 17 22:47:24.937928 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:24.937903    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nn2xs_00fb2a0f-d0d6-4d8d-8884-04fc3cd6aea4/egress-router-binary-copy/0.log"
Sep 17 22:47:24.955862 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:24.955839    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nn2xs_00fb2a0f-d0d6-4d8d-8884-04fc3cd6aea4/cni-plugins/0.log"
Sep 17 22:47:24.972802 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:24.972769    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nn2xs_00fb2a0f-d0d6-4d8d-8884-04fc3cd6aea4/bond-cni-plugin/0.log"
Sep 17 22:47:24.990008 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:24.989982    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nn2xs_00fb2a0f-d0d6-4d8d-8884-04fc3cd6aea4/routeoverride-cni/0.log"
Sep 17 22:47:25.006994 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:25.006967    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nn2xs_00fb2a0f-d0d6-4d8d-8884-04fc3cd6aea4/whereabouts-cni-bincopy/0.log"
Sep 17 22:47:25.024849 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:25.024821    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nn2xs_00fb2a0f-d0d6-4d8d-8884-04fc3cd6aea4/whereabouts-cni/0.log"
Sep 17 22:47:25.095326 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:25.095296    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-scs8m_42972d7a-57ce-429f-b1f4-cd2333a5c3ee/kube-multus/0.log"
Sep 17 22:47:25.116152 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:25.116117    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-j58cx_8dedff64-89fd-41e2-83e7-e5bdf85f3470/network-metrics-daemon/0.log"
Sep 17 22:47:25.136432 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:25.136397    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-j58cx_8dedff64-89fd-41e2-83e7-e5bdf85f3470/kube-rbac-proxy/0.log"
Sep 17 22:47:26.253099 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:26.253068    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-llwgv_5cbc96f5-dc5a-46ab-b739-db19685500ac/ovn-controller/0.log"
Sep 17 22:47:26.266800 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:26.266772    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-llwgv_5cbc96f5-dc5a-46ab-b739-db19685500ac/ovn-acl-logging/0.log"
Sep 17 22:47:26.289155 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:26.289132    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-llwgv_5cbc96f5-dc5a-46ab-b739-db19685500ac/kube-rbac-proxy-node/0.log"
Sep 17 22:47:26.306499 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:26.306480    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-llwgv_5cbc96f5-dc5a-46ab-b739-db19685500ac/kube-rbac-proxy-ovn-metrics/0.log"
Sep 17 22:47:26.320978 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:26.320958    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-llwgv_5cbc96f5-dc5a-46ab-b739-db19685500ac/northd/0.log"
Sep 17 22:47:26.338921 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:26.338896    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-llwgv_5cbc96f5-dc5a-46ab-b739-db19685500ac/nbdb/0.log"
Sep 17 22:47:26.359691 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:26.359671    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-llwgv_5cbc96f5-dc5a-46ab-b739-db19685500ac/sbdb/0.log"
Sep 17 22:47:26.418019 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:26.417993    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-llwgv_5cbc96f5-dc5a-46ab-b739-db19685500ac/ovnkube-controller/0.log"
Sep 17 22:47:27.329631 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:27.329595    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7cbc45fddc-fgp46_059b6280-9215-4207-9aaa-570643410245/check-endpoints/0.log"
Sep 17 22:47:27.392776 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:27.392753    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-zdznt_4a6387b2-b54c-44e0-909d-589e73c07248/network-check-target-container/0.log"
Sep 17 22:47:28.259988 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:28.259958    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-lff7k_09abe478-d8e5-4f5b-bec5-59b113bd11fa/iptables-alerter/0.log"
Sep 17 22:47:28.912894 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:28.912857    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-q8mts_93887b82-e82e-4df0-9821-51c194c31721/tuned/0.log"
Sep 17 22:47:30.491118 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:30.491086    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-685d7d68b5-s2pc2_e5738b3d-740b-4e0c-b1e4-9805f8621f85/cluster-samples-operator/0.log"
Sep 17 22:47:30.508463 ip-10-0-136-66 kubenswrapper[2560]: I0917 22:47:30.508438    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-685d7d68b5-s2pc2_e5738b3d-740b-4e0c-b1e4-9805f8621f85/cluster-samples-operator-watch/0.log"