Sep 17 15:54:40.959756 ip-10-0-128-191 systemd[1]: Starting Kubernetes Kubelet...
Sep 17 15:54:44.291996 ip-10-0-128-191 kubenswrapper[2584]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 15:54:44.291996 ip-10-0-128-191 kubenswrapper[2584]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 17 15:54:44.291996 ip-10-0-128-191 kubenswrapper[2584]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 15:54:44.291996 ip-10-0-128-191 kubenswrapper[2584]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 17 15:54:44.291996 ip-10-0-128-191 kubenswrapper[2584]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 15:54:44.292653 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.292059    2584 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 17 15:54:44.294802 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294786    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 15:54:44.294802 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294801    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 15:54:44.294868 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294806    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 15:54:44.294868 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294810    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 15:54:44.294868 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294813    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 15:54:44.294868 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294816    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 15:54:44.294868 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294819    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 15:54:44.294868 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294821    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 15:54:44.294868 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294825    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 15:54:44.294868 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294829    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 15:54:44.294868 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294831    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 15:54:44.294868 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294834    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 15:54:44.294868 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294836    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 15:54:44.294868 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294839    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 15:54:44.294868 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294841    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 15:54:44.294868 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294843    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 15:54:44.294868 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294846    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 15:54:44.294868 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294848    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 15:54:44.294868 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294855    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 15:54:44.294868 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294858    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 15:54:44.294868 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294860    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 15:54:44.295325 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294863    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 15:54:44.295325 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294865    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 15:54:44.295325 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294868    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 15:54:44.295325 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294870    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 15:54:44.295325 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294873    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 15:54:44.295325 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294876    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 15:54:44.295325 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294879    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 15:54:44.295325 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294881    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 15:54:44.295325 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294884    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 15:54:44.295325 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294886    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 15:54:44.295325 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294890    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 15:54:44.295325 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294892    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 15:54:44.295325 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294895    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 15:54:44.295325 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294897    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 15:54:44.295325 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294900    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 15:54:44.295325 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294902    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 15:54:44.295325 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294904    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 15:54:44.295325 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294906    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 15:54:44.295325 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294909    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 15:54:44.295325 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294911    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 15:54:44.295846 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294914    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 15:54:44.295846 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294916    2584 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 15:54:44.295846 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294919    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 15:54:44.295846 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294921    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 15:54:44.295846 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294923    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 15:54:44.295846 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294925    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 15:54:44.295846 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294928    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 15:54:44.295846 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294930    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 15:54:44.295846 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294932    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 15:54:44.295846 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294940    2584 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 15:54:44.295846 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294943    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 15:54:44.295846 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294945    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 15:54:44.295846 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294947    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 15:54:44.295846 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294951    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 15:54:44.295846 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294953    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 15:54:44.295846 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294956    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 15:54:44.295846 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294958    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 15:54:44.295846 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294961    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 15:54:44.295846 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294963    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 15:54:44.295846 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294965    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 15:54:44.296320 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294968    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 15:54:44.296320 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294971    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 15:54:44.296320 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294973    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 15:54:44.296320 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294979    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 15:54:44.296320 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294981    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 15:54:44.296320 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294983    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 15:54:44.296320 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294986    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 15:54:44.296320 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294988    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 15:54:44.296320 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294990    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 15:54:44.296320 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294993    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 15:54:44.296320 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294995    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 15:54:44.296320 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.294997    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 15:54:44.296320 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.295000    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 15:54:44.296320 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.295002    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 15:54:44.296320 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.295004    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 15:54:44.296320 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.295009    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 15:54:44.296320 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.295013    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 15:54:44.296320 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.295015    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 15:54:44.296320 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.295018    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 15:54:44.296795 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.295021    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 15:54:44.296795 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.295023    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 15:54:44.296795 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.295026    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 15:54:44.296795 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.295034    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 15:54:44.296795 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.295037    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 15:54:44.296795 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.295040    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 15:54:44.296795 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.295043    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 15:54:44.296795 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.295045    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 15:54:44.296795 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.295048    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 15:54:44.296795 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.295050    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 15:54:44.296795 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.295052    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 15:54:44.296795 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.295054    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 15:54:44.296795 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.295057    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 15:54:44.296795 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.295059    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 15:54:44.296795 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.295061    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 15:54:44.296795 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.295064    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 15:54:44.296795 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.295066    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 15:54:44.296795 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.295069    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 15:54:44.296795 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.295071    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 15:54:44.296795 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296396    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 15:54:44.297299 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296403    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 15:54:44.297299 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296406    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 15:54:44.297299 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296409    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 15:54:44.297299 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296412    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 15:54:44.297299 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296415    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 15:54:44.297299 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296417    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 15:54:44.297299 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296420    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 15:54:44.297299 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296422    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 15:54:44.297299 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296425    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 15:54:44.297299 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296427    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 15:54:44.297299 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296430    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 15:54:44.297299 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296433    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 15:54:44.297299 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296435    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 15:54:44.297299 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296438    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 15:54:44.297299 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296440    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 15:54:44.297299 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296443    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 15:54:44.297299 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296452    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 15:54:44.297299 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296454    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 15:54:44.297299 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296458    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 15:54:44.297807 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296460    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 15:54:44.297807 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296463    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 15:54:44.297807 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296465    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 15:54:44.297807 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296468    2584 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 15:54:44.297807 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296470    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 15:54:44.297807 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296473    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 15:54:44.297807 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296475    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 15:54:44.297807 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296478    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 15:54:44.297807 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296480    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 15:54:44.297807 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296483    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 15:54:44.297807 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296485    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 15:54:44.297807 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296487    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 15:54:44.297807 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296510    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 15:54:44.297807 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296514    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 15:54:44.297807 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296518    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 15:54:44.297807 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296521    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 15:54:44.297807 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296523    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 15:54:44.297807 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296526    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 15:54:44.297807 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296528    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 15:54:44.297807 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296530    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 15:54:44.298288 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296533    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 15:54:44.298288 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296536    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 15:54:44.298288 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296538    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 15:54:44.298288 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296541    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 15:54:44.298288 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296543    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 15:54:44.298288 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296546    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 15:54:44.298288 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296549    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 15:54:44.298288 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296552    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 15:54:44.298288 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296555    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 15:54:44.298288 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296557    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 15:54:44.298288 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296560    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 15:54:44.298288 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296563    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 15:54:44.298288 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296566    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 15:54:44.298288 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296568    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 15:54:44.298288 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296571    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 15:54:44.298288 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296573    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 15:54:44.298288 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296576    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 15:54:44.298288 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296578    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 15:54:44.298288 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296581    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 15:54:44.298288 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296583    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 15:54:44.298795 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296586    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 15:54:44.298795 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296588    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 15:54:44.298795 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296590    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 15:54:44.298795 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296593    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 15:54:44.298795 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296595    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 15:54:44.298795 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296598    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 15:54:44.298795 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296600    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 15:54:44.298795 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296603    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 15:54:44.298795 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296605    2584 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 15:54:44.298795 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296607    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 15:54:44.298795 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296610    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 15:54:44.298795 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296612    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 15:54:44.298795 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296614    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 15:54:44.298795 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296617    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 15:54:44.298795 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296619    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 15:54:44.298795 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296621    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 15:54:44.298795 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296624    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 15:54:44.298795 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296626    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 15:54:44.298795 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296630    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 15:54:44.299245 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296634    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 15:54:44.299245 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296637    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 15:54:44.299245 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296640    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 15:54:44.299245 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296643    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 15:54:44.299245 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296646    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 15:54:44.299245 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296649    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 15:54:44.299245 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296651    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 15:54:44.299245 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296654    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 15:54:44.299245 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296657    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 15:54:44.299245 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296661    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 15:54:44.299245 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296664    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 15:54:44.299245 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296667    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 15:54:44.299245 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296671    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 15:54:44.299245 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296673    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 15:54:44.299245 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296676    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 15:54:44.299245 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296678    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 15:54:44.299245 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296680    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 15:54:44.299245 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296683    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 15:54:44.299245 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296685    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 15:54:44.299763 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.296687    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 15:54:44.299763 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297475    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 15:54:44.299763 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297481    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 15:54:44.299763 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297484    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 15:54:44.299763 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297486    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 15:54:44.299763 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297503    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 15:54:44.299763 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297506    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 15:54:44.299763 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297509    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 15:54:44.299763 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297513    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 15:54:44.299763 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297516    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 15:54:44.299763 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297519    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 15:54:44.299763 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297522    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 15:54:44.299763 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297525    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 15:54:44.299763 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297528    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 15:54:44.299763 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297530    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 15:54:44.299763 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297533    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 15:54:44.299763 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297536    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 15:54:44.299763 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297539    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 15:54:44.299763 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297542    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 15:54:44.300221 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297546    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 15:54:44.300221 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297549    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 15:54:44.300221 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297552    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 15:54:44.300221 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297555    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 15:54:44.300221 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297558    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 15:54:44.300221 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297560    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 15:54:44.300221 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297563    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 15:54:44.300221 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297565    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 15:54:44.300221 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297567    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 15:54:44.300221 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297570    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 15:54:44.300221 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297572    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 15:54:44.300221 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297575    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 15:54:44.300221 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297577    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 15:54:44.300221 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297579    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 15:54:44.300221 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297582    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 15:54:44.300221 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297584    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 15:54:44.300221 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297586    2584 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 15:54:44.300221 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297588    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 15:54:44.300221 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297591    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 15:54:44.300710 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297593    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 15:54:44.300710 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297595    2584 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 15:54:44.300710 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297598    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 15:54:44.300710 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297600    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 15:54:44.300710 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297603    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 15:54:44.300710 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297605    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 15:54:44.300710 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297608    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 15:54:44.300710 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297610    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 15:54:44.300710 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297612    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 15:54:44.300710 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297615    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 15:54:44.300710 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297618    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 15:54:44.300710 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297620    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 15:54:44.300710 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297623    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 15:54:44.300710 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297626    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 15:54:44.300710 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297628    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 15:54:44.300710 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297631    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 15:54:44.300710 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297633    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 15:54:44.300710 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297636    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 15:54:44.300710 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297638    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 15:54:44.300710 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297640    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 15:54:44.301177 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297644    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 15:54:44.301177 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297648    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 15:54:44.301177 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297650    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 15:54:44.301177 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297652    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 15:54:44.301177 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297655    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 15:54:44.301177 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297658    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 15:54:44.301177 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297660    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 15:54:44.301177 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297663    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 15:54:44.301177 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297665    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 15:54:44.301177 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297667    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 15:54:44.301177 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297670    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 15:54:44.301177 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297672    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 15:54:44.301177 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297675    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 15:54:44.301177 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297677    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 15:54:44.301177 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297679    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 15:54:44.301177 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297682    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 15:54:44.301177 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297685    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 15:54:44.301177 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297687    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 15:54:44.301177 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297690    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 15:54:44.301626 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297692    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 15:54:44.301626 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297694    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 15:54:44.301626 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297697    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 15:54:44.301626 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297699    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 15:54:44.301626 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297701    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 15:54:44.301626 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297704    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 15:54:44.301626 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297706    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 15:54:44.301626 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297709    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 15:54:44.301626 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297711    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 15:54:44.301626 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297713    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 15:54:44.301626 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297716    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 15:54:44.301626 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297718    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 15:54:44.301626 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297720    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 15:54:44.301626 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297723    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 15:54:44.301626 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297725    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 15:54:44.301626 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297727    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 15:54:44.301626 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297730    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 15:54:44.301626 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297732    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 15:54:44.301626 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297734    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 15:54:44.301626 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297737    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 15:54:44.302116 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297739    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 15:54:44.302116 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297741    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 15:54:44.302116 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.297743    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 15:54:44.302116 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.297803    2584 flags.go:64] FLAG: --address="0.0.0.0"
Sep 17 15:54:44.302116 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.297836    2584 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 17 15:54:44.302116 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.297850    2584 flags.go:64] FLAG: --anonymous-auth="true"
Sep 17 15:54:44.302116 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.297854    2584 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 17 15:54:44.302116 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.297858    2584 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 17 15:54:44.302116 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.297861    2584 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 17 15:54:44.302116 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.297864    2584 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 17 15:54:44.302116 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.297869    2584 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 17 15:54:44.302116 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.297871    2584 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 17 15:54:44.302116 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.297874    2584 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 17 15:54:44.302116 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.297877    2584 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 17 15:54:44.302116 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.297880    2584 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 17 15:54:44.302116 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.297883    2584 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 17 15:54:44.302116 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.297886    2584 flags.go:64] FLAG: --cgroup-root=""
Sep 17 15:54:44.302116 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.297888    2584 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 17 15:54:44.302116 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.297891    2584 flags.go:64] FLAG: --client-ca-file=""
Sep 17 15:54:44.302116 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.297894    2584 flags.go:64] FLAG: --cloud-provider="external"
Sep 17 15:54:44.302116 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.297897    2584 flags.go:64] FLAG: --cluster-dns="[]"
Sep 17 15:54:44.302116 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.297901    2584 flags.go:64] FLAG: --cluster-domain=""
Sep 17 15:54:44.302116 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.297903    2584 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 17 15:54:44.302116 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.297906    2584 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 17 15:54:44.302700 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.297909    2584 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 17 15:54:44.302700 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.297912    2584 flags.go:64] FLAG: --container-log-max-files="5"
Sep 17 15:54:44.302700 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.297915    2584 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 17 15:54:44.302700 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.297917    2584 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 17 15:54:44.302700 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.297921    2584 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 17 15:54:44.302700 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.297926    2584 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 17 15:54:44.302700 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.297929    2584 flags.go:64] FLAG: --contention-profiling="false"
Sep 17 15:54:44.302700 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.297932    2584 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 17 15:54:44.302700 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.297934    2584 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 17 15:54:44.302700 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.297937    2584 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 17 15:54:44.302700 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.297940    2584 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 17 15:54:44.302700 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.297943    2584 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 17 15:54:44.302700 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.297946    2584 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 17 15:54:44.302700 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.297949    2584 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 17 15:54:44.302700 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.297951    2584 flags.go:64] FLAG: --enable-load-reader="false"
Sep 17 15:54:44.302700 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.297954    2584 flags.go:64] FLAG: --enable-server="true"
Sep 17 15:54:44.302700 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.297957    2584 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 17 15:54:44.302700 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.297961    2584 flags.go:64] FLAG: --event-burst="100"
Sep 17 15:54:44.302700 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.297964    2584 flags.go:64] FLAG: --event-qps="50"
Sep 17 15:54:44.302700 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.297966    2584 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 17 15:54:44.302700 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.297969    2584 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 17 15:54:44.302700 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.297972    2584 flags.go:64] FLAG: --eviction-hard=""
Sep 17 15:54:44.302700 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.297975    2584 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 17 15:54:44.302700 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.297978    2584 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 17 15:54:44.303280 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.297981    2584 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 17 15:54:44.303280 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.297983    2584 flags.go:64] FLAG: --eviction-soft=""
Sep 17 15:54:44.303280 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.297986    2584 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 17 15:54:44.303280 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.297988    2584 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 17 15:54:44.303280 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.297991    2584 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 17 15:54:44.303280 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.297994    2584 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 17 15:54:44.303280 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.297997    2584 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 17 15:54:44.303280 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298000    2584 flags.go:64] FLAG: --fail-swap-on="true"
Sep 17 15:54:44.303280 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298002    2584 flags.go:64] FLAG: --feature-gates=""
Sep 17 15:54:44.303280 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298005    2584 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 17 15:54:44.303280 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298008    2584 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 17 15:54:44.303280 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298011    2584 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 17 15:54:44.303280 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298013    2584 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 17 15:54:44.303280 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298017    2584 flags.go:64] FLAG: --healthz-port="10248"
Sep 17 15:54:44.303280 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298020    2584 flags.go:64] FLAG: --help="false"
Sep 17 15:54:44.303280 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298023    2584 flags.go:64] FLAG: --hostname-override="ip-10-0-128-191.ec2.internal"
Sep 17 15:54:44.303280 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298025    2584 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 17 15:54:44.303280 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298028    2584 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 17 15:54:44.303280 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298031    2584 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 17 15:54:44.303280 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298034    2584 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 17 15:54:44.303280 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298037    2584 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 17 15:54:44.303280 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298040    2584 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 17 15:54:44.303280 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298042    2584 flags.go:64] FLAG: --image-service-endpoint=""
Sep 17 15:54:44.303849 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298045    2584 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 17 15:54:44.303849 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298047    2584 flags.go:64] FLAG: --kube-api-burst="100"
Sep 17 15:54:44.303849 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298050    2584 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 17 15:54:44.303849 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298053    2584 flags.go:64] FLAG: --kube-api-qps="50"
Sep 17 15:54:44.303849 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298057    2584 flags.go:64] FLAG: --kube-reserved=""
Sep 17 15:54:44.303849 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298060    2584 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 17 15:54:44.303849 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298063    2584 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 17 15:54:44.303849 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298066    2584 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 17 15:54:44.303849 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298068    2584 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 17 15:54:44.303849 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298071    2584 flags.go:64] FLAG: --lock-file=""
Sep 17 15:54:44.303849 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298074    2584 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 17 15:54:44.303849 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298077    2584 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 17 15:54:44.303849 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298080    2584 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 17 15:54:44.303849 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298085    2584 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 17 15:54:44.303849 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298090    2584 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 17 15:54:44.303849 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298093    2584 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 17 15:54:44.303849 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298096    2584 flags.go:64] FLAG: --logging-format="text"
Sep 17 15:54:44.303849 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298098    2584 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 17 15:54:44.303849 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298102    2584 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 17 15:54:44.303849 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298104    2584 flags.go:64] FLAG: --manifest-url=""
Sep 17 15:54:44.303849 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298107    2584 flags.go:64] FLAG: --manifest-url-header=""
Sep 17 15:54:44.303849 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298111    2584 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 17 15:54:44.303849 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298114    2584 flags.go:64] FLAG: --max-open-files="1000000"
Sep 17 15:54:44.303849 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298118    2584 flags.go:64] FLAG: --max-pods="110"
Sep 17 15:54:44.303849 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298121    2584 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 17 15:54:44.304459 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298124    2584 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 17 15:54:44.304459 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298127    2584 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 17 15:54:44.304459 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298129    2584 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 17 15:54:44.304459 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298132    2584 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 17 15:54:44.304459 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298135    2584 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 17 15:54:44.304459 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298138    2584 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 17 15:54:44.304459 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298145    2584 flags.go:64] FLAG: --node-status-max-images="50"
Sep 17 15:54:44.304459 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298148    2584 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 17 15:54:44.304459 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298150    2584 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 17 15:54:44.304459 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298153    2584 flags.go:64] FLAG: --pod-cidr=""
Sep 17 15:54:44.304459 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298157    2584 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc"
Sep 17 15:54:44.304459 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298162    2584 flags.go:64] FLAG: --pod-manifest-path=""
Sep 17 15:54:44.304459 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298165    2584 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 17 15:54:44.304459 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298168    2584 flags.go:64] FLAG: --pods-per-core="0"
Sep 17 15:54:44.304459 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298171    2584 flags.go:64] FLAG: --port="10250"
Sep 17 15:54:44.304459 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298174    2584 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 17 15:54:44.304459 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298176    2584 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01581eef30d9eb669"
Sep 17 15:54:44.304459 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298179    2584 flags.go:64] FLAG: --qos-reserved=""
Sep 17 15:54:44.304459 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298182    2584 flags.go:64] FLAG: --read-only-port="10255"
Sep 17 15:54:44.304459 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298185    2584 flags.go:64] FLAG: --register-node="true"
Sep 17 15:54:44.304459 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298187    2584 flags.go:64] FLAG: --register-with-taints=""
Sep 17 15:54:44.304459 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298191    2584 flags.go:64] FLAG: --registry-burst="10"
Sep 17 15:54:44.304459 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298194    2584 flags.go:64] FLAG: --registry-qps="5"
Sep 17 15:54:44.304459 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298197    2584 flags.go:64] FLAG: --reserved-cpus=""
Sep 17 15:54:44.305067 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298199    2584 flags.go:64] FLAG: --reserved-memory=""
Sep 17 15:54:44.305067 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298202    2584 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 17 15:54:44.305067 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298205    2584 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 17 15:54:44.305067 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298220    2584 flags.go:64] FLAG: --rotate-certificates="false"
Sep 17 15:54:44.305067 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298223    2584 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 17 15:54:44.305067 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298228    2584 flags.go:64] FLAG: --runonce="false"
Sep 17 15:54:44.305067 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298231    2584 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 17 15:54:44.305067 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298234    2584 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 17 15:54:44.305067 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298237    2584 flags.go:64] FLAG: --seccomp-default="false"
Sep 17 15:54:44.305067 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298240    2584 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 17 15:54:44.305067 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298243    2584 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 17 15:54:44.305067 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298246    2584 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 17 15:54:44.305067 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298249    2584 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 17 15:54:44.305067 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298252    2584 flags.go:64] FLAG: --storage-driver-password="root"
Sep 17 15:54:44.305067 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298254    2584 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 17 15:54:44.305067 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298257    2584 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 17 15:54:44.305067 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298260    2584 flags.go:64] FLAG: --storage-driver-user="root"
Sep 17 15:54:44.305067 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298262    2584 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 17 15:54:44.305067 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298265    2584 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 17 15:54:44.305067 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298269    2584 flags.go:64] FLAG: --system-cgroups=""
Sep 17 15:54:44.305067 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298272    2584 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 17 15:54:44.305067 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298277    2584 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 17 15:54:44.305067 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298280    2584 flags.go:64] FLAG: --tls-cert-file=""
Sep 17 15:54:44.305067 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298282    2584 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 17 15:54:44.305067 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298289    2584 flags.go:64] FLAG: --tls-min-version=""
Sep 17 15:54:44.306034 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298291    2584 flags.go:64] FLAG: --tls-private-key-file=""
Sep 17 15:54:44.306034 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298294    2584 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 17 15:54:44.306034 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298297    2584 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 17 15:54:44.306034 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298300    2584 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 17 15:54:44.306034 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298302    2584 flags.go:64] FLAG: --v="2"
Sep 17 15:54:44.306034 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298306    2584 flags.go:64] FLAG: --version="false"
Sep 17 15:54:44.306034 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298310    2584 flags.go:64] FLAG: --vmodule=""
Sep 17 15:54:44.306034 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298314    2584 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 17 15:54:44.306034 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.298317    2584 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 17 15:54:44.306034 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298442    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 15:54:44.306034 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298446    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 15:54:44.306034 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298449    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 15:54:44.306034 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298454    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 15:54:44.306034 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298457    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 15:54:44.306034 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298460    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 15:54:44.306034 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298463    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 15:54:44.306034 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298465    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 15:54:44.306034 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298468    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 15:54:44.306034 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298471    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 15:54:44.306034 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298473    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 15:54:44.306034 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298476    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 15:54:44.306034 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298478    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 15:54:44.306645 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298481    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 15:54:44.306645 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298484    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 15:54:44.306645 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298486    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 15:54:44.306645 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298503    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 15:54:44.306645 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298510    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 15:54:44.306645 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298514    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 15:54:44.306645 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298518    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 15:54:44.306645 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298522    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 15:54:44.306645 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298525    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 15:54:44.306645 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298528    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 15:54:44.306645 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298531    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 15:54:44.306645 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298534    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 15:54:44.306645 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298537    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 15:54:44.306645 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298539    2584 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 15:54:44.306645 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298542    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 15:54:44.306645 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298545    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 15:54:44.306645 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298548    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 15:54:44.306645 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298551    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 15:54:44.306645 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298554    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 15:54:44.307106 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298556    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 15:54:44.307106 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298559    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 15:54:44.307106 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298561    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 15:54:44.307106 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298565    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 15:54:44.307106 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298568    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 15:54:44.307106 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298571    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 15:54:44.307106 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298573    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 15:54:44.307106 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298576    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 15:54:44.307106 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298578    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 15:54:44.307106 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298581    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 15:54:44.307106 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298583    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 15:54:44.307106 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298586    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 15:54:44.307106 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298589    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 15:54:44.307106 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298591    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 15:54:44.307106 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298593    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 15:54:44.307106 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298596    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 15:54:44.307106 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298598    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 15:54:44.307106 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298602    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 15:54:44.307106 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298605    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 15:54:44.307106 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298607    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 15:54:44.307608 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298610    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 15:54:44.307608 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298612    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 15:54:44.307608 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298615    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 15:54:44.307608 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298617    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 15:54:44.307608 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298619    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 15:54:44.307608 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298622    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 15:54:44.307608 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298624    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 15:54:44.307608 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298627    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 15:54:44.307608 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298629    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 15:54:44.307608 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298631    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 15:54:44.307608 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298634    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 15:54:44.307608 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298637    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 15:54:44.307608 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298639    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 15:54:44.307608 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298642    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 15:54:44.307608 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298645    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 15:54:44.307608 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298649    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 15:54:44.307608 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298651    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 15:54:44.307608 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298654    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 15:54:44.307608 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298656    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 15:54:44.307608 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298658    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 15:54:44.308082 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298661    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 15:54:44.308082 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298663    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 15:54:44.308082 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298666    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 15:54:44.308082 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298668    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 15:54:44.308082 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298671    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 15:54:44.308082 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298673    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 15:54:44.308082 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298675    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 15:54:44.308082 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298678    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 15:54:44.308082 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298680    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 15:54:44.308082 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298684    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 15:54:44.308082 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298686    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 15:54:44.308082 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298689    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 15:54:44.308082 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298691    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 15:54:44.308082 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298694    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 15:54:44.308082 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298696    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 15:54:44.308082 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298699    2584 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 15:54:44.308082 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298701    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 15:54:44.308082 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298705    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 15:54:44.308082 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298708    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 15:54:44.308552 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298711    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 15:54:44.308552 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298713    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 15:54:44.308552 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298716    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 15:54:44.308552 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298719    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 15:54:44.308552 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298721    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 15:54:44.308552 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298724    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 15:54:44.308552 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298726    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 15:54:44.308552 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.298729    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 15:54:44.308552 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.299145    2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 15:54:44.308552 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.306927    2584 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 17 15:54:44.308552 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.306942    2584 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 17 15:54:44.308552 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.306961    2584 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 17 15:54:44.308552 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.306967    2584 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 17 15:54:44.308552 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307022    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 15:54:44.308894 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307026    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 15:54:44.308894 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307030    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 15:54:44.308894 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307033    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 15:54:44.308894 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307036    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 15:54:44.308894 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307039    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 15:54:44.308894 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307041    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 15:54:44.308894 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307044    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 15:54:44.308894 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307046    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 15:54:44.308894 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307049    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 15:54:44.308894 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307051    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 15:54:44.308894 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307053    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 15:54:44.308894 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307056    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 15:54:44.308894 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307058    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 15:54:44.308894 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307061    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 15:54:44.308894 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307063    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 15:54:44.308894 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307065    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 15:54:44.308894 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307068    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 15:54:44.308894 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307071    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 15:54:44.308894 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307074    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 15:54:44.308894 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307076    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 15:54:44.309360 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307079    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 15:54:44.309360 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307081    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 15:54:44.309360 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307084    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 15:54:44.309360 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307086    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 15:54:44.309360 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307090    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 15:54:44.309360 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307093    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 15:54:44.309360 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307096    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 15:54:44.309360 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307099    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 15:54:44.309360 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307103    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 15:54:44.309360 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307105    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 15:54:44.309360 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307108    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 15:54:44.309360 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307111    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 15:54:44.309360 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307114    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 15:54:44.309360 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307117    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 15:54:44.309360 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307120    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 15:54:44.309360 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307123    2584 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 15:54:44.309360 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307125    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 15:54:44.309360 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307127    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 15:54:44.309360 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307130    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 15:54:44.309892 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307132    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 15:54:44.309892 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307135    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 15:54:44.309892 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307137    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 15:54:44.309892 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307140    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 15:54:44.309892 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307143    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 15:54:44.309892 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307147    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 15:54:44.309892 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307149    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 15:54:44.309892 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307152    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 15:54:44.309892 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307155    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 15:54:44.309892 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307157    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 15:54:44.309892 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307159    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 15:54:44.309892 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307162    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 15:54:44.309892 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307165    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 15:54:44.309892 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307168    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 15:54:44.309892 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307171    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 15:54:44.309892 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307174    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 15:54:44.309892 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307176    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 15:54:44.309892 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307179    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 15:54:44.309892 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307182    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 15:54:44.310347 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307184    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 15:54:44.310347 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307187    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 15:54:44.310347 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307191    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 15:54:44.310347 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307193    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 15:54:44.310347 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307196    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 15:54:44.310347 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307198    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 15:54:44.310347 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307201    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 15:54:44.310347 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307203    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 15:54:44.310347 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307205    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 15:54:44.310347 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307208    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 15:54:44.310347 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307210    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 15:54:44.310347 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307213    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 15:54:44.310347 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307215    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 15:54:44.310347 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307218    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 15:54:44.310347 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307220    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 15:54:44.310347 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307223    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 15:54:44.310347 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307225    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 15:54:44.310347 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307227    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 15:54:44.310347 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307230    2584 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 15:54:44.310347 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307232    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 15:54:44.310856 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307235    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 15:54:44.310856 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307237    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 15:54:44.310856 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307240    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 15:54:44.310856 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307242    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 15:54:44.310856 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307244    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 15:54:44.310856 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307247    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 15:54:44.310856 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307250    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 15:54:44.310856 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307252    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 15:54:44.310856 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307254    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 15:54:44.310856 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307256    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 15:54:44.310856 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307259    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 15:54:44.310856 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307261    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 15:54:44.310856 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307263    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 15:54:44.310856 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307266    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 15:54:44.310856 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307268    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 15:54:44.310856 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307271    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 15:54:44.310856 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307273    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 15:54:44.310856 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307275    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 15:54:44.310856 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307278    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 15:54:44.310856 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307280    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 15:54:44.311320 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.307285    2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 15:54:44.311320 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307391    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 15:54:44.311320 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307396    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 15:54:44.311320 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307399    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 15:54:44.311320 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307402    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 15:54:44.311320 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307404    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 15:54:44.311320 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307406    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 15:54:44.311320 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307409    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 15:54:44.311320 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307412    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 15:54:44.311320 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307414    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 15:54:44.311320 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307417    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 15:54:44.311320 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307419    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 15:54:44.311320 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307422    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 15:54:44.311320 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307425    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 15:54:44.311320 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307427    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 15:54:44.311732 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307430    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 15:54:44.311732 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307432    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 15:54:44.311732 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307436    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 15:54:44.311732 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307438    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 15:54:44.311732 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307441    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 15:54:44.311732 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307443    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 15:54:44.311732 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307446    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 15:54:44.311732 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307449    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 15:54:44.311732 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307452    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 15:54:44.311732 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307454    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 15:54:44.311732 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307456    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 15:54:44.311732 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307459    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 15:54:44.311732 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307461    2584 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 15:54:44.311732 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307464    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 15:54:44.311732 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307466    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 15:54:44.311732 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307468    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 15:54:44.311732 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307471    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 15:54:44.311732 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307473    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 15:54:44.311732 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307475    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 15:54:44.311732 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307478    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 15:54:44.312189 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307480    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 15:54:44.312189 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307484    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 15:54:44.312189 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307487    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 15:54:44.312189 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307508    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 15:54:44.312189 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307512    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 15:54:44.312189 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307515    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 15:54:44.312189 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307517    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 15:54:44.312189 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307519    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 15:54:44.312189 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307522    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 15:54:44.312189 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307524    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 15:54:44.312189 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307527    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 15:54:44.312189 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307530    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 15:54:44.312189 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307533    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 15:54:44.312189 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307535    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 15:54:44.312189 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307538    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 15:54:44.312189 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307540    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 15:54:44.312189 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307543    2584 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 15:54:44.312189 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307546    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 15:54:44.312189 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307549    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 15:54:44.312681 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307551    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 15:54:44.312681 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307554    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 15:54:44.312681 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307556    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 15:54:44.312681 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307559    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 15:54:44.312681 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307562    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 15:54:44.312681 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307564    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 15:54:44.312681 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307566    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 15:54:44.312681 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307569    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 15:54:44.312681 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307571    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 15:54:44.312681 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307574    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 15:54:44.312681 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307576    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 15:54:44.312681 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307578    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 15:54:44.312681 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307581    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 15:54:44.312681 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307584    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 15:54:44.312681 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307586    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 15:54:44.312681 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307589    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 15:54:44.312681 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307592    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 15:54:44.312681 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307595    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 15:54:44.312681 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307598    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 15:54:44.313149 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307601    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 15:54:44.313149 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307604    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 15:54:44.313149 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307606    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 15:54:44.313149 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307609    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 15:54:44.313149 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307611    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 15:54:44.313149 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307614    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 15:54:44.313149 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307617    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 15:54:44.313149 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307620    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 15:54:44.313149 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307622    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 15:54:44.313149 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307625    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 15:54:44.313149 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307627    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 15:54:44.313149 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307629    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 15:54:44.313149 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307632    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 15:54:44.313149 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307634    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 15:54:44.313149 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307636    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 15:54:44.313149 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307638    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 15:54:44.313149 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307641    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 15:54:44.313149 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307643    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 15:54:44.313149 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307646    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 15:54:44.313149 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307648    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 15:54:44.313684 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307650    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 15:54:44.313684 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307653    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 15:54:44.313684 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307655    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 15:54:44.313684 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307657    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 15:54:44.313684 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307660    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 15:54:44.313684 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307662    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 15:54:44.313684 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:44.307664    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 15:54:44.313684 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.307669    2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 15:54:44.313684 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.307771    2584 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 17 15:54:44.313684 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.309617    2584 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 17 15:54:44.313684 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.310517    2584 server.go:1019] "Starting client certificate rotation"
Sep 17 15:54:44.313684 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.310610    2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 17 15:54:44.313684 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.310638    2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 17 15:54:44.314001 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.312692    2584 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 17 15:54:44.314334 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.314316    2584 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 17 15:54:44.320994 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.320979    2584 log.go:25] "Validated CRI v1 runtime API"
Sep 17 15:54:44.322517 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.322487    2584 log.go:25] "Validated CRI v1 image API"
Sep 17 15:54:44.323279 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.323265    2584 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 17 15:54:44.325473 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.325451    2584 fs.go:135] Filesystem UUIDs: map[3481c8c5-caff-452c-89e6-1f621b117a3a:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 da91b6b8-8bc4-445e-85c0-d2dd2c821901:/dev/nvme0n1p3]
Sep 17 15:54:44.325586 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.325473    2584 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 17 15:54:44.331276 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.331167    2584 manager.go:216] Machine: {Timestamp:2026-09-17 15:54:44.329797546 +0000 UTC m=+1.943729082 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3197062 MemoryCapacity:32812163072 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec27a52bfd4ac85671c7f76ba1138f52 SystemUUID:ec27a52b-fd4a-c856-71c7-f76ba1138f52 BootID:b28cb50a-94ca-4dff-8a64-e17da18eccda Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:eb:fa:af:19 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:eb:fa:af:19 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d2:fb:22:62:ca:8c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812163072 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 17 15:54:44.331276 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.331274    2584 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 17 15:54:44.331379 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.331341    2584 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 17 15:54:44.332980 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.332952    2584 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 17 15:54:44.333134 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.332990    2584 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-191.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 17 15:54:44.334169 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.334158    2584 topology_manager.go:138] "Creating topology manager with none policy"
Sep 17 15:54:44.334169 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.334170    2584 container_manager_linux.go:309] "Creating device plugin manager"
Sep 17 15:54:44.334226 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.334181    2584 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 17 15:54:44.334226 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.334193    2584 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 17 15:54:44.334281 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.334253    2584 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 17 15:54:44.336769 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.336757    2584 state_mem.go:36] "Initialized new in-memory state store"
Sep 17 15:54:44.336911 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.336901    2584 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 17 15:54:44.336947 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.336941    2584 kubelet.go:486] "Attempting to sync node with API server"
Sep 17 15:54:44.336994 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.336959    2584 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 17 15:54:44.336994 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.336975    2584 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 17 15:54:44.336994 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.336984    2584 kubelet.go:398] "Adding apiserver pod source"
Sep 17 15:54:44.337113 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.336997    2584 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 17 15:54:44.337470 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.337452    2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 17 15:54:44.337554 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.337487    2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 17 15:54:44.341867 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.341849    2584 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1"
Sep 17 15:54:44.343849 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.343834    2584 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 17 15:54:44.343926 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.343872    2584 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 17 15:54:44.344941 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.344925    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 17 15:54:44.345007 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.344949    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 17 15:54:44.345007 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.344956    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 17 15:54:44.345007 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.344961    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 17 15:54:44.345007 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.344969    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 17 15:54:44.345007 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.344974    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 17 15:54:44.345007 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.344986    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 17 15:54:44.345007 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.344991    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 17 15:54:44.345007 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.344998    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 17 15:54:44.345007 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.345007    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 17 15:54:44.345236 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.345016    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 17 15:54:44.345236 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.345021    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 17 15:54:44.345236 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.345047    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 17 15:54:44.345236 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.345054    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 17 15:54:44.348857 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.348843    2584 server.go:1268] "Started kubelet"
Sep 17 15:54:44.348933 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.348908    2584 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 17 15:54:44.348990 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.348925    2584 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 17 15:54:44.349036 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.348989    2584 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 17 15:54:44.349218 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.349203    2584 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-191.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 17 15:54:44.349319 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:44.349300    2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 17 15:54:44.349614 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:44.349591    2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-191.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 17 15:54:44.349701 ip-10-0-128-191 systemd[1]: Started Kubernetes Kubelet.
Sep 17 15:54:44.350092 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.349991    2584 server.go:310] "Adding debug handlers to kubelet server"
Sep 17 15:54:44.352620 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.352604    2584 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 17 15:54:44.353000 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.352978    2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 17 15:54:44.354169 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:44.354143    2584 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 17 15:54:44.356480 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.356466    2584 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 17 15:54:44.356551 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.356479    2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 17 15:54:44.356597 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:44.356582    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-191.ec2.internal\" not found"
Sep 17 15:54:44.357186 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.357167    2584 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 17 15:54:44.357186 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.357187    2584 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 17 15:54:44.357324 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.357172    2584 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 17 15:54:44.357408 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.357392    2584 factory.go:55] Registering systemd factory
Sep 17 15:54:44.357408 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.357410    2584 factory.go:223] Registration of the systemd container factory successfully
Sep 17 15:54:44.357719 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.357704    2584 factory.go:153] Registering CRI-O factory
Sep 17 15:54:44.357797 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.357722    2584 factory.go:223] Registration of the crio container factory successfully
Sep 17 15:54:44.357797 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.357786    2584 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 17 15:54:44.357868 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.357805    2584 factory.go:103] Registering Raw factory
Sep 17 15:54:44.357868 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.357821    2584 manager.go:1196] Started watching for new ooms in manager
Sep 17 15:54:44.357989 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.357972    2584 reconstruct.go:97] "Volume reconstruction finished"
Sep 17 15:54:44.357989 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.357985    2584 reconciler.go:29] "Reconciler: start to sync state"
Sep 17 15:54:44.358245 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.358230    2584 manager.go:349] Starting recovery of all containers
Sep 17 15:54:44.360209 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:44.360189    2584 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 17 15:54:44.360294 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:44.360243    2584 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-191.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 17 15:54:44.385488 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.385474    2584 manager.go:354] Recovery completed
Sep 17 15:54:44.388086 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:44.386989    2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-191.ec2.internal.18d626ba7e2a2441  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-191.ec2.internal,UID:ip-10-0-128-191.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-191.ec2.internal,},FirstTimestamp:2026-09-17 15:54:44.348814401 +0000 UTC m=+1.962745902,LastTimestamp:2026-09-17 15:54:44.348814401 +0000 UTC m=+1.962745902,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-191.ec2.internal,}"
Sep 17 15:54:44.389603 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.389592    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 15:54:44.391155 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.391136    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-191.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 15:54:44.391213 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.391170    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-191.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 15:54:44.391213 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.391182    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-191.ec2.internal" event="NodeHasSufficientPID"
Sep 17 15:54:44.392018 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.392003    2584 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 17 15:54:44.392138 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.392122    2584 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 17 15:54:44.392213 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.392143    2584 state_mem.go:36] "Initialized new in-memory state store"
Sep 17 15:54:44.392213 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.392022    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 15:54:44.392997 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.392978    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-191.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 15:54:44.393058 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.393011    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-191.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 15:54:44.393058 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.393024    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-191.ec2.internal" event="NodeHasSufficientPID"
Sep 17 15:54:44.393317 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.393301    2584 policy_none.go:49] "None policy: Start"
Sep 17 15:54:44.393387 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.393322    2584 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 17 15:54:44.393387 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.393333    2584 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 17 15:54:44.394145 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.394133    2584 policy_none.go:47] "Start"
Sep 17 15:54:44.404849 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:44.404703    2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-191.ec2.internal.18d626ba80b0390c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-191.ec2.internal,UID:ip-10-0-128-191.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-191.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-191.ec2.internal,},FirstTimestamp:2026-09-17 15:54:44.39115598 +0000 UTC m=+2.005087481,LastTimestamp:2026-09-17 15:54:44.39115598 +0000 UTC m=+2.005087481,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-191.ec2.internal,}"
Sep 17 15:54:44.416538 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:44.416464    2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-191.ec2.internal.18d626ba80b08b1e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-191.ec2.internal,UID:ip-10-0-128-191.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-191.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-191.ec2.internal,},FirstTimestamp:2026-09-17 15:54:44.39117699 +0000 UTC m=+2.005108491,LastTimestamp:2026-09-17 15:54:44.39117699 +0000 UTC m=+2.005108491,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-191.ec2.internal,}"
Sep 17 15:54:44.423939 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.423918    2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pd2x4"
Sep 17 15:54:44.428601 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.428588    2584 manager.go:337] "Starting Device Plugin manager"
Sep 17 15:54:44.428669 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:44.428618    2584 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 17 15:54:44.428669 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.428629    2584 server.go:87] "Starting device plugin registration server"
Sep 17 15:54:44.428875 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.428860    2584 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 17 15:54:44.428968 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.428886    2584 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 17 15:54:44.429236 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.429024    2584 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 17 15:54:44.429236 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.429087    2584 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 17 15:54:44.429236 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.429093    2584 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 17 15:54:44.430999 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:44.430926    2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-191.ec2.internal.18d626ba80b0c6d5  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-191.ec2.internal,UID:ip-10-0-128-191.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-191.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-191.ec2.internal,},FirstTimestamp:2026-09-17 15:54:44.391192277 +0000 UTC m=+2.005123777,LastTimestamp:2026-09-17 15:54:44.391192277 +0000 UTC m=+2.005123777,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-191.ec2.internal,}"
Sep 17 15:54:44.431108 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:44.431008    2584 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 17 15:54:44.431108 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:44.431053    2584 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-191.ec2.internal\" not found"
Sep 17 15:54:44.432951 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.432921    2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pd2x4"
Sep 17 15:54:44.509531 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.509509    2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 17 15:54:44.510768 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.510754    2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 17 15:54:44.510826 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.510797    2584 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 17 15:54:44.510826 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.510816    2584 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 17 15:54:44.510896 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:44.510855    2584 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 17 15:54:44.513212 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.513192    2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 15:54:44.529761 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.529745    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 15:54:44.530420 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.530406    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-191.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 15:54:44.530471 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.530431    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-191.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 15:54:44.530471 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.530441    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-191.ec2.internal" event="NodeHasSufficientPID"
Sep 17 15:54:44.530471 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.530458    2584 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-191.ec2.internal"
Sep 17 15:54:44.546176 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.546144    2584 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-191.ec2.internal"
Sep 17 15:54:44.546176 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:44.546160    2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-191.ec2.internal\": node \"ip-10-0-128-191.ec2.internal\" not found"
Sep 17 15:54:44.582424 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:44.582406    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-191.ec2.internal\" not found"
Sep 17 15:54:44.611113 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.611096    2584 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-191.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-191.ec2.internal"]
Sep 17 15:54:44.611161 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.611148    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 15:54:44.612011 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.611997    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-191.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 15:54:44.612061 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.612021    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-191.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 15:54:44.612061 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.612031    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-191.ec2.internal" event="NodeHasSufficientPID"
Sep 17 15:54:44.614033 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.614022    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 15:54:44.614137 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.614126    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-191.ec2.internal"
Sep 17 15:54:44.614173 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.614149    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 15:54:44.614804 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.614778    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-191.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 15:54:44.614894 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.614817    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-191.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 15:54:44.614894 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.614830    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-191.ec2.internal" event="NodeHasSufficientPID"
Sep 17 15:54:44.614894 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.614778    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-191.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 15:54:44.614894 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.614894    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-191.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 15:54:44.615055 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.614908    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-191.ec2.internal" event="NodeHasSufficientPID"
Sep 17 15:54:44.617057 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.617045    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-191.ec2.internal"
Sep 17 15:54:44.617097 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.617065    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 15:54:44.621990 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.621974    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-191.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 15:54:44.622064 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.622003    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-191.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 15:54:44.622064 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.622016    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-191.ec2.internal" event="NodeHasSufficientPID"
Sep 17 15:54:44.628987 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:44.628973    2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-191.ec2.internal\" not found" node="ip-10-0-128-191.ec2.internal"
Sep 17 15:54:44.634431 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:44.634417    2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-191.ec2.internal\" not found" node="ip-10-0-128-191.ec2.internal"
Sep 17 15:54:44.659401 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.659382    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dc8c9739f6c89ebc2ed109ba6e1e7b17-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-191.ec2.internal\" (UID: \"dc8c9739f6c89ebc2ed109ba6e1e7b17\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-191.ec2.internal"
Sep 17 15:54:44.659470 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.659403    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dc8c9739f6c89ebc2ed109ba6e1e7b17-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-191.ec2.internal\" (UID: \"dc8c9739f6c89ebc2ed109ba6e1e7b17\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-191.ec2.internal"
Sep 17 15:54:44.659470 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.659419    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/311e9dffa75dc15b9f976eb249bd6092-config\") pod \"kube-apiserver-proxy-ip-10-0-128-191.ec2.internal\" (UID: \"311e9dffa75dc15b9f976eb249bd6092\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-191.ec2.internal"
Sep 17 15:54:44.683116 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:44.683099    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-191.ec2.internal\" not found"
Sep 17 15:54:44.759837 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.759817    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dc8c9739f6c89ebc2ed109ba6e1e7b17-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-191.ec2.internal\" (UID: \"dc8c9739f6c89ebc2ed109ba6e1e7b17\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-191.ec2.internal"
Sep 17 15:54:44.759899 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.759826    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dc8c9739f6c89ebc2ed109ba6e1e7b17-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-191.ec2.internal\" (UID: \"dc8c9739f6c89ebc2ed109ba6e1e7b17\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-191.ec2.internal"
Sep 17 15:54:44.759899 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.759861    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dc8c9739f6c89ebc2ed109ba6e1e7b17-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-191.ec2.internal\" (UID: \"dc8c9739f6c89ebc2ed109ba6e1e7b17\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-191.ec2.internal"
Sep 17 15:54:44.759899 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.759891    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/311e9dffa75dc15b9f976eb249bd6092-config\") pod \"kube-apiserver-proxy-ip-10-0-128-191.ec2.internal\" (UID: \"311e9dffa75dc15b9f976eb249bd6092\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-191.ec2.internal"
Sep 17 15:54:44.760001 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.759877    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/311e9dffa75dc15b9f976eb249bd6092-config\") pod \"kube-apiserver-proxy-ip-10-0-128-191.ec2.internal\" (UID: \"311e9dffa75dc15b9f976eb249bd6092\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-191.ec2.internal"
Sep 17 15:54:44.760001 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.759915    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dc8c9739f6c89ebc2ed109ba6e1e7b17-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-191.ec2.internal\" (UID: \"dc8c9739f6c89ebc2ed109ba6e1e7b17\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-191.ec2.internal"
Sep 17 15:54:44.783145 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:44.783127    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-191.ec2.internal\" not found"
Sep 17 15:54:44.883823 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:44.883785    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-191.ec2.internal\" not found"
Sep 17 15:54:44.932001 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.931980    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-191.ec2.internal"
Sep 17 15:54:44.937972 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:44.937808    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-191.ec2.internal"
Sep 17 15:54:44.984009 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:44.983989    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-191.ec2.internal\" not found"
Sep 17 15:54:45.084550 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:45.084529    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-191.ec2.internal\" not found"
Sep 17 15:54:45.185057 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:45.185017    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-191.ec2.internal\" not found"
Sep 17 15:54:45.190629 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.190612    2584 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 15:54:45.257542 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.257525    2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-191.ec2.internal"
Sep 17 15:54:45.308380 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.308365    2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 17 15:54:45.310046 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.310034    2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-191.ec2.internal"
Sep 17 15:54:45.310142 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.310131    2584 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 17 15:54:45.310237 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:45.310212    2584 kubelet.go:3250] "Failed creating a mirror pod" err="Post \"https://aa0f78bc89c1f4895bf995b5c967ba5a-f15fd51bbbd69a03.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/kube-system/pods\": read tcp 10.0.128.191:50704->44.195.250.89:6443: use of closed network connection" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-191.ec2.internal"
Sep 17 15:54:45.310237 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.310220    2584 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 17 15:54:45.310315 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.310230    2584 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 17 15:54:45.337750 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.337731    2584 apiserver.go:52] "Watching apiserver"
Sep 17 15:54:45.356703 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.356682    2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 17 15:54:45.360552 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.360533    2584 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 17 15:54:45.360883 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.360863    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-gg77s","kube-system/konnectivity-agent-zlcqk","openshift-dns/node-resolver-x4mhf","openshift-multus/multus-fpptq","openshift-network-operator/iptables-alerter-hp2s4","openshift-ovn-kubernetes/ovnkube-node-z8nmw","kube-system/global-pull-secret-syncer-7xl8l","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xjhfp","openshift-cluster-node-tuning-operator/tuned-77lh9","openshift-image-registry/node-ca-9f2dg","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-191.ec2.internal","openshift-multus/multus-additional-cni-plugins-bjftc","openshift-multus/network-metrics-daemon-nldm2"]
Sep 17 15:54:45.363101 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.363081    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9f2dg"
Sep 17 15:54:45.364954 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.364935    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fpptq"
Sep 17 15:54:45.366761 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.366747    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hp2s4"
Sep 17 15:54:45.368806 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.368779    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:54:45.368898 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.368854    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 17 15:54:45.369173 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.369135    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-lv2l7\""
Sep 17 15:54:45.369346 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.369332    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 17 15:54:45.369614 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.369602    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 17 15:54:45.370963 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.370948    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xjhfp"
Sep 17 15:54:45.372964 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.372950    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-77lh9"
Sep 17 15:54:45.374986 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.374971    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gg77s"
Sep 17 15:54:45.375051 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:45.375023    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gg77s" podUID="34abf0a1-5178-487d-93af-577b29705d96"
Sep 17 15:54:45.377404 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.377376    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bjftc"
Sep 17 15:54:45.379580 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.379562    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zlcqk"
Sep 17 15:54:45.381763 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.381745    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-x4mhf"
Sep 17 15:54:45.384732 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.384717    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7xl8l"
Sep 17 15:54:45.384825 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:45.384769    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7xl8l" podUID="46630785-5a7e-496b-86fe-d32e237c8c1b"
Sep 17 15:54:45.384939 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.384925    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-f898t\""
Sep 17 15:54:45.387075 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.387057    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nldm2"
Sep 17 15:54:45.387170 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:45.387120    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nldm2" podUID="b550e969-e4dd-4602-8d26-4a6275359d68"
Sep 17 15:54:45.387839 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.387823    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 17 15:54:45.388793 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.388776    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 17 15:54:45.389127 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.389114    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 17 15:54:45.389160 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.389119    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 17 15:54:45.393082 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.393065    2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 17 15:54:45.395706 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.395647    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 17 15:54:45.395706 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.395647    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 17 15:54:45.395861 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.395729    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 17 15:54:45.396000 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.395975    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 17 15:54:45.396087 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.396071    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-djljt\""
Sep 17 15:54:45.396187 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.396171    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 17 15:54:45.396265 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.396252    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5vlgb\""
Sep 17 15:54:45.396378 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.396365    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2kgcg\""
Sep 17 15:54:45.401028 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.400860    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 17 15:54:45.401028 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.400884    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 17 15:54:45.401028 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.400923    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-46b8l\""
Sep 17 15:54:45.401028 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.400939    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 17 15:54:45.401028 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.400978    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 17 15:54:45.401617 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.401597    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-v4lv2\""
Sep 17 15:54:45.401709 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.401680    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 17 15:54:45.401766 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.400884    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 17 15:54:45.401855 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.400858    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 17 15:54:45.402543 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.402526    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rb7vs\""
Sep 17 15:54:45.404240 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.402657    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 17 15:54:45.404240 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.402835    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 17 15:54:45.404240 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.402896    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 17 15:54:45.404240 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.403248    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 17 15:54:45.404240 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.403440    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 17 15:54:45.404240 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.403840    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 17 15:54:45.404240 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.404081    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 17 15:54:45.404539 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.404266    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 17 15:54:45.404539 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.404347    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wjkhn\""
Sep 17 15:54:45.436830 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.436768    2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-16 15:49:44 +0000 UTC" deadline="2028-03-13 13:49:42.855492425 +0000 UTC"
Sep 17 15:54:45.436830 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.436803    2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13029h54m57.418691864s"
Sep 17 15:54:45.458518 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.458483    2584 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 17 15:54:45.463776 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.463760    2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-nlcp8"
Sep 17 15:54:45.463859 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.463777    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/df579004-3b28-44fd-ac97-05faf9b54dad-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bjftc\" (UID: \"df579004-3b28-44fd-ac97-05faf9b54dad\") " pod="openshift-multus/multus-additional-cni-plugins-bjftc"
Sep 17 15:54:45.463859 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.463804    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ffe5f446-e608-459a-90f3-de1bcccba341-system-cni-dir\") pod \"multus-fpptq\" (UID: \"ffe5f446-e608-459a-90f3-de1bcccba341\") " pod="openshift-multus/multus-fpptq"
Sep 17 15:54:45.463859 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.463830    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d28f991c-888d-4396-8c52-e7dcb503799c-host-slash\") pod \"iptables-alerter-hp2s4\" (UID: \"d28f991c-888d-4396-8c52-e7dcb503799c\") " pod="openshift-network-operator/iptables-alerter-hp2s4"
Sep 17 15:54:45.463859 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.463852    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b550e969-e4dd-4602-8d26-4a6275359d68-metrics-certs\") pod \"network-metrics-daemon-nldm2\" (UID: \"b550e969-e4dd-4602-8d26-4a6275359d68\") " pod="openshift-multus/network-metrics-daemon-nldm2"
Sep 17 15:54:45.464052 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.463895    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5d4dd8b6-ef54-48cd-82d5-0a91da88af5a-etc-sysctl-d\") pod \"tuned-77lh9\" (UID: \"5d4dd8b6-ef54-48cd-82d5-0a91da88af5a\") " pod="openshift-cluster-node-tuning-operator/tuned-77lh9"
Sep 17 15:54:45.464052 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.463919    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5d4dd8b6-ef54-48cd-82d5-0a91da88af5a-tmp\") pod \"tuned-77lh9\" (UID: \"5d4dd8b6-ef54-48cd-82d5-0a91da88af5a\") " pod="openshift-cluster-node-tuning-operator/tuned-77lh9"
Sep 17 15:54:45.464052 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.463945    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/df579004-3b28-44fd-ac97-05faf9b54dad-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bjftc\" (UID: \"df579004-3b28-44fd-ac97-05faf9b54dad\") " pod="openshift-multus/multus-additional-cni-plugins-bjftc"
Sep 17 15:54:45.464052 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.463969    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d7d3c798-4b01-4814-8e5c-c200c69dca8f-serviceca\") pod \"node-ca-9f2dg\" (UID: \"d7d3c798-4b01-4814-8e5c-c200c69dca8f\") " pod="openshift-image-registry/node-ca-9f2dg"
Sep 17 15:54:45.464052 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.463993    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4g82j\" (UniqueName: \"kubernetes.io/projected/b550e969-e4dd-4602-8d26-4a6275359d68-kube-api-access-4g82j\") pod \"network-metrics-daemon-nldm2\" (UID: \"b550e969-e4dd-4602-8d26-4a6275359d68\") " pod="openshift-multus/network-metrics-daemon-nldm2"
Sep 17 15:54:45.464052 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.464020    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z65p7\" (UniqueName: \"kubernetes.io/projected/34abf0a1-5178-487d-93af-577b29705d96-kube-api-access-z65p7\") pod \"network-check-target-gg77s\" (UID: \"34abf0a1-5178-487d-93af-577b29705d96\") " pod="openshift-network-diagnostics/network-check-target-gg77s"
Sep 17 15:54:45.464052 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.464043    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ffe5f446-e608-459a-90f3-de1bcccba341-multus-conf-dir\") pod \"multus-fpptq\" (UID: \"ffe5f446-e608-459a-90f3-de1bcccba341\") " pod="openshift-multus/multus-fpptq"
Sep 17 15:54:45.464385 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.464068    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d28f991c-888d-4396-8c52-e7dcb503799c-iptables-alerter-script\") pod \"iptables-alerter-hp2s4\" (UID: \"d28f991c-888d-4396-8c52-e7dcb503799c\") " pod="openshift-network-operator/iptables-alerter-hp2s4"
Sep 17 15:54:45.464385 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.464092    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pk8l8\" (UniqueName: \"kubernetes.io/projected/d28f991c-888d-4396-8c52-e7dcb503799c-kube-api-access-pk8l8\") pod \"iptables-alerter-hp2s4\" (UID: \"d28f991c-888d-4396-8c52-e7dcb503799c\") " pod="openshift-network-operator/iptables-alerter-hp2s4"
Sep 17 15:54:45.464385 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.464114    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9e359937-2c4a-45c6-92b6-3c82ee32c922-agent-certs\") pod \"konnectivity-agent-zlcqk\" (UID: \"9e359937-2c4a-45c6-92b6-3c82ee32c922\") " pod="kube-system/konnectivity-agent-zlcqk"
Sep 17 15:54:45.464385 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.464137    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5d4dd8b6-ef54-48cd-82d5-0a91da88af5a-lib-modules\") pod \"tuned-77lh9\" (UID: \"5d4dd8b6-ef54-48cd-82d5-0a91da88af5a\") " pod="openshift-cluster-node-tuning-operator/tuned-77lh9"
Sep 17 15:54:45.464385 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.464159    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4vp7\" (UniqueName: \"kubernetes.io/projected/d7d3c798-4b01-4814-8e5c-c200c69dca8f-kube-api-access-v4vp7\") pod \"node-ca-9f2dg\" (UID: \"d7d3c798-4b01-4814-8e5c-c200c69dca8f\") " pod="openshift-image-registry/node-ca-9f2dg"
Sep 17 15:54:45.464385 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.464195    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ffe5f446-e608-459a-90f3-de1bcccba341-host-var-lib-cni-bin\") pod \"multus-fpptq\" (UID: \"ffe5f446-e608-459a-90f3-de1bcccba341\") " pod="openshift-multus/multus-fpptq"
Sep 17 15:54:45.464385 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.464218    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ffe5f446-e608-459a-90f3-de1bcccba341-host-var-lib-cni-multus\") pod \"multus-fpptq\" (UID: \"ffe5f446-e608-459a-90f3-de1bcccba341\") " pod="openshift-multus/multus-fpptq"
Sep 17 15:54:45.464385 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.464262    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/54d8c06c-72e7-4b77-b3b2-6698b7653944-host-slash\") pod \"ovnkube-node-z8nmw\" (UID: \"54d8c06c-72e7-4b77-b3b2-6698b7653944\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:54:45.464385 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.464284    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/54d8c06c-72e7-4b77-b3b2-6698b7653944-host-run-netns\") pod \"ovnkube-node-z8nmw\" (UID: \"54d8c06c-72e7-4b77-b3b2-6698b7653944\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:54:45.464385 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.464301    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54d8c06c-72e7-4b77-b3b2-6698b7653944-host-run-ovn-kubernetes\") pod \"ovnkube-node-z8nmw\" (UID: \"54d8c06c-72e7-4b77-b3b2-6698b7653944\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:54:45.464385 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.464317    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5d4dd8b6-ef54-48cd-82d5-0a91da88af5a-etc-sysctl-conf\") pod \"tuned-77lh9\" (UID: \"5d4dd8b6-ef54-48cd-82d5-0a91da88af5a\") " pod="openshift-cluster-node-tuning-operator/tuned-77lh9"
Sep 17 15:54:45.464385 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.464332    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5d4dd8b6-ef54-48cd-82d5-0a91da88af5a-etc-tuned\") pod \"tuned-77lh9\" (UID: \"5d4dd8b6-ef54-48cd-82d5-0a91da88af5a\") " pod="openshift-cluster-node-tuning-operator/tuned-77lh9"
Sep 17 15:54:45.464385 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.464347    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/54d8c06c-72e7-4b77-b3b2-6698b7653944-log-socket\") pod \"ovnkube-node-z8nmw\" (UID: \"54d8c06c-72e7-4b77-b3b2-6698b7653944\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:54:45.464385 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.464364    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/54d8c06c-72e7-4b77-b3b2-6698b7653944-ovn-node-metrics-cert\") pod \"ovnkube-node-z8nmw\" (UID: \"54d8c06c-72e7-4b77-b3b2-6698b7653944\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:54:45.464385 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.464378    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5d4dd8b6-ef54-48cd-82d5-0a91da88af5a-sys\") pod \"tuned-77lh9\" (UID: \"5d4dd8b6-ef54-48cd-82d5-0a91da88af5a\") " pod="openshift-cluster-node-tuning-operator/tuned-77lh9"
Sep 17 15:54:45.464385 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.464390    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b9fd9b22-055f-4540-92c9-6c75c0c14fe3-hosts-file\") pod \"node-resolver-x4mhf\" (UID: \"b9fd9b22-055f-4540-92c9-6c75c0c14fe3\") " pod="openshift-dns/node-resolver-x4mhf"
Sep 17 15:54:45.464971 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.464403    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/54d8c06c-72e7-4b77-b3b2-6698b7653944-host-kubelet\") pod \"ovnkube-node-z8nmw\" (UID: \"54d8c06c-72e7-4b77-b3b2-6698b7653944\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:54:45.464971 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.464436    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/54d8c06c-72e7-4b77-b3b2-6698b7653944-etc-openvswitch\") pod \"ovnkube-node-z8nmw\" (UID: \"54d8c06c-72e7-4b77-b3b2-6698b7653944\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:54:45.464971 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.464467    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/54d8c06c-72e7-4b77-b3b2-6698b7653944-host-cni-bin\") pod \"ovnkube-node-z8nmw\" (UID: \"54d8c06c-72e7-4b77-b3b2-6698b7653944\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:54:45.464971 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.464513    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ffe5f446-e608-459a-90f3-de1bcccba341-hostroot\") pod \"multus-fpptq\" (UID: \"ffe5f446-e608-459a-90f3-de1bcccba341\") " pod="openshift-multus/multus-fpptq"
Sep 17 15:54:45.464971 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.464552    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ffe5f446-e608-459a-90f3-de1bcccba341-multus-daemon-config\") pod \"multus-fpptq\" (UID: \"ffe5f446-e608-459a-90f3-de1bcccba341\") " pod="openshift-multus/multus-fpptq"
Sep 17 15:54:45.464971 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.464574    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zh69p\" (UniqueName: \"kubernetes.io/projected/ffe5f446-e608-459a-90f3-de1bcccba341-kube-api-access-zh69p\") pod \"multus-fpptq\" (UID: \"ffe5f446-e608-459a-90f3-de1bcccba341\") " pod="openshift-multus/multus-fpptq"
Sep 17 15:54:45.464971 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.464601    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5d4dd8b6-ef54-48cd-82d5-0a91da88af5a-etc-sysconfig\") pod \"tuned-77lh9\" (UID: \"5d4dd8b6-ef54-48cd-82d5-0a91da88af5a\") " pod="openshift-cluster-node-tuning-operator/tuned-77lh9"
Sep 17 15:54:45.464971 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.464627    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5d4dd8b6-ef54-48cd-82d5-0a91da88af5a-run\") pod \"tuned-77lh9\" (UID: \"5d4dd8b6-ef54-48cd-82d5-0a91da88af5a\") " pod="openshift-cluster-node-tuning-operator/tuned-77lh9"
Sep 17 15:54:45.464971 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.464645    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kgbq\" (UniqueName: \"kubernetes.io/projected/5d4dd8b6-ef54-48cd-82d5-0a91da88af5a-kube-api-access-2kgbq\") pod \"tuned-77lh9\" (UID: \"5d4dd8b6-ef54-48cd-82d5-0a91da88af5a\") " pod="openshift-cluster-node-tuning-operator/tuned-77lh9"
Sep 17 15:54:45.464971 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.464665    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88xtl\" (UniqueName: \"kubernetes.io/projected/df579004-3b28-44fd-ac97-05faf9b54dad-kube-api-access-88xtl\") pod \"multus-additional-cni-plugins-bjftc\" (UID: \"df579004-3b28-44fd-ac97-05faf9b54dad\") " pod="openshift-multus/multus-additional-cni-plugins-bjftc"
Sep 17 15:54:45.464971 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.464685    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nt4h2\" (UniqueName: \"kubernetes.io/projected/54d8c06c-72e7-4b77-b3b2-6698b7653944-kube-api-access-nt4h2\") pod \"ovnkube-node-z8nmw\" (UID: \"54d8c06c-72e7-4b77-b3b2-6698b7653944\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:54:45.464971 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.464700    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/df579004-3b28-44fd-ac97-05faf9b54dad-cni-binary-copy\") pod \"multus-additional-cni-plugins-bjftc\" (UID: \"df579004-3b28-44fd-ac97-05faf9b54dad\") " pod="openshift-multus/multus-additional-cni-plugins-bjftc"
Sep 17 15:54:45.464971 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.464717    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ffe5f446-e608-459a-90f3-de1bcccba341-host-var-lib-kubelet\") pod \"multus-fpptq\" (UID: \"ffe5f446-e608-459a-90f3-de1bcccba341\") " pod="openshift-multus/multus-fpptq"
Sep 17 15:54:45.464971 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.464736    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9e359937-2c4a-45c6-92b6-3c82ee32c922-konnectivity-ca\") pod \"konnectivity-agent-zlcqk\" (UID: \"9e359937-2c4a-45c6-92b6-3c82ee32c922\") " pod="kube-system/konnectivity-agent-zlcqk"
Sep 17 15:54:45.464971 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.464750    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9fd9b22-055f-4540-92c9-6c75c0c14fe3-tmp-dir\") pod \"node-resolver-x4mhf\" (UID: \"b9fd9b22-055f-4540-92c9-6c75c0c14fe3\") " pod="openshift-dns/node-resolver-x4mhf"
Sep 17 15:54:45.464971 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.464768    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ffe5f446-e608-459a-90f3-de1bcccba341-host-run-netns\") pod \"multus-fpptq\" (UID: \"ffe5f446-e608-459a-90f3-de1bcccba341\") " pod="openshift-multus/multus-fpptq"
Sep 17 15:54:45.465621 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.464781    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ffe5f446-e608-459a-90f3-de1bcccba341-host-run-multus-certs\") pod \"multus-fpptq\" (UID: \"ffe5f446-e608-459a-90f3-de1bcccba341\") " pod="openshift-multus/multus-fpptq"
Sep 17 15:54:45.465621 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.464795    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/54d8c06c-72e7-4b77-b3b2-6698b7653944-run-systemd\") pod \"ovnkube-node-z8nmw\" (UID: \"54d8c06c-72e7-4b77-b3b2-6698b7653944\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:54:45.465621 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.464824    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5d4dd8b6-ef54-48cd-82d5-0a91da88af5a-etc-modprobe-d\") pod \"tuned-77lh9\" (UID: \"5d4dd8b6-ef54-48cd-82d5-0a91da88af5a\") " pod="openshift-cluster-node-tuning-operator/tuned-77lh9"
Sep 17 15:54:45.465621 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.464842    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ffe5f446-e608-459a-90f3-de1bcccba341-host-run-k8s-cni-cncf-io\") pod \"multus-fpptq\" (UID: \"ffe5f446-e608-459a-90f3-de1bcccba341\") " pod="openshift-multus/multus-fpptq"
Sep 17 15:54:45.465621 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.464855    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/54d8c06c-72e7-4b77-b3b2-6698b7653944-var-lib-openvswitch\") pod \"ovnkube-node-z8nmw\" (UID: \"54d8c06c-72e7-4b77-b3b2-6698b7653944\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:54:45.465621 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.464869    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/54d8c06c-72e7-4b77-b3b2-6698b7653944-node-log\") pod \"ovnkube-node-z8nmw\" (UID: \"54d8c06c-72e7-4b77-b3b2-6698b7653944\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:54:45.465621 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.464882    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/800c58de-09f2-471c-a4c6-eaa0ed41ad9b-etc-selinux\") pod \"aws-ebs-csi-driver-node-xjhfp\" (UID: \"800c58de-09f2-471c-a4c6-eaa0ed41ad9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xjhfp"
Sep 17 15:54:45.465621 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.464894    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/800c58de-09f2-471c-a4c6-eaa0ed41ad9b-sys-fs\") pod \"aws-ebs-csi-driver-node-xjhfp\" (UID: \"800c58de-09f2-471c-a4c6-eaa0ed41ad9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xjhfp"
Sep 17 15:54:45.465621 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.464907    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d4dd8b6-ef54-48cd-82d5-0a91da88af5a-etc-kubernetes\") pod \"tuned-77lh9\" (UID: \"5d4dd8b6-ef54-48cd-82d5-0a91da88af5a\") " pod="openshift-cluster-node-tuning-operator/tuned-77lh9"
Sep 17 15:54:45.465621 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.464918    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5d4dd8b6-ef54-48cd-82d5-0a91da88af5a-host\") pod \"tuned-77lh9\" (UID: \"5d4dd8b6-ef54-48cd-82d5-0a91da88af5a\") " pod="openshift-cluster-node-tuning-operator/tuned-77lh9"
Sep 17 15:54:45.465621 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.464936    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/46630785-5a7e-496b-86fe-d32e237c8c1b-dbus\") pod \"global-pull-secret-syncer-7xl8l\" (UID: \"46630785-5a7e-496b-86fe-d32e237c8c1b\") " pod="kube-system/global-pull-secret-syncer-7xl8l"
Sep 17 15:54:45.465621 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.464949    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ffe5f446-e608-459a-90f3-de1bcccba341-cni-binary-copy\") pod \"multus-fpptq\" (UID: \"ffe5f446-e608-459a-90f3-de1bcccba341\") " pod="openshift-multus/multus-fpptq"
Sep 17 15:54:45.465621 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.464962    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/df579004-3b28-44fd-ac97-05faf9b54dad-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bjftc\" (UID: \"df579004-3b28-44fd-ac97-05faf9b54dad\") " pod="openshift-multus/multus-additional-cni-plugins-bjftc"
Sep 17 15:54:45.465621 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.464982    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7bp5\" (UniqueName: \"kubernetes.io/projected/b9fd9b22-055f-4540-92c9-6c75c0c14fe3-kube-api-access-k7bp5\") pod \"node-resolver-x4mhf\" (UID: \"b9fd9b22-055f-4540-92c9-6c75c0c14fe3\") " pod="openshift-dns/node-resolver-x4mhf"
Sep 17 15:54:45.465621 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.464993    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d7d3c798-4b01-4814-8e5c-c200c69dca8f-host\") pod \"node-ca-9f2dg\" (UID: \"d7d3c798-4b01-4814-8e5c-c200c69dca8f\") " pod="openshift-image-registry/node-ca-9f2dg"
Sep 17 15:54:45.465621 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.465007    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ffe5f446-e608-459a-90f3-de1bcccba341-multus-cni-dir\") pod \"multus-fpptq\" (UID: \"ffe5f446-e608-459a-90f3-de1bcccba341\") " pod="openshift-multus/multus-fpptq"
Sep 17 15:54:45.465621 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.465019    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ffe5f446-e608-459a-90f3-de1bcccba341-cnibin\") pod \"multus-fpptq\" (UID: \"ffe5f446-e608-459a-90f3-de1bcccba341\") " pod="openshift-multus/multus-fpptq"
Sep 17 15:54:45.466055 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.465032    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ffe5f446-e608-459a-90f3-de1bcccba341-multus-socket-dir-parent\") pod \"multus-fpptq\" (UID: \"ffe5f446-e608-459a-90f3-de1bcccba341\") " pod="openshift-multus/multus-fpptq"
Sep 17 15:54:45.466055 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.465050    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ffe5f446-e608-459a-90f3-de1bcccba341-etc-kubernetes\") pod \"multus-fpptq\" (UID: \"ffe5f446-e608-459a-90f3-de1bcccba341\") " pod="openshift-multus/multus-fpptq"
Sep 17 15:54:45.466055 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.465073    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/54d8c06c-72e7-4b77-b3b2-6698b7653944-systemd-units\") pod \"ovnkube-node-z8nmw\" (UID: \"54d8c06c-72e7-4b77-b3b2-6698b7653944\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:54:45.466055 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.465087    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/800c58de-09f2-471c-a4c6-eaa0ed41ad9b-device-dir\") pod \"aws-ebs-csi-driver-node-xjhfp\" (UID: \"800c58de-09f2-471c-a4c6-eaa0ed41ad9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xjhfp"
Sep 17 15:54:45.466055 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.465100    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/df579004-3b28-44fd-ac97-05faf9b54dad-system-cni-dir\") pod \"multus-additional-cni-plugins-bjftc\" (UID: \"df579004-3b28-44fd-ac97-05faf9b54dad\") " pod="openshift-multus/multus-additional-cni-plugins-bjftc"
Sep 17 15:54:45.466055 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.465113    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5d4dd8b6-ef54-48cd-82d5-0a91da88af5a-etc-systemd\") pod \"tuned-77lh9\" (UID: \"5d4dd8b6-ef54-48cd-82d5-0a91da88af5a\") " pod="openshift-cluster-node-tuning-operator/tuned-77lh9"
Sep 17 15:54:45.466055 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.465143    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d4dd8b6-ef54-48cd-82d5-0a91da88af5a-var-lib-kubelet\") pod \"tuned-77lh9\" (UID: \"5d4dd8b6-ef54-48cd-82d5-0a91da88af5a\") " pod="openshift-cluster-node-tuning-operator/tuned-77lh9"
Sep 17 15:54:45.466055 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.465172    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/df579004-3b28-44fd-ac97-05faf9b54dad-cnibin\") pod \"multus-additional-cni-plugins-bjftc\" (UID: \"df579004-3b28-44fd-ac97-05faf9b54dad\") " pod="openshift-multus/multus-additional-cni-plugins-bjftc"
Sep 17 15:54:45.466055 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.465194    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/800c58de-09f2-471c-a4c6-eaa0ed41ad9b-registration-dir\") pod \"aws-ebs-csi-driver-node-xjhfp\" (UID: \"800c58de-09f2-471c-a4c6-eaa0ed41ad9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xjhfp"
Sep 17 15:54:45.466055 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.465217    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/54d8c06c-72e7-4b77-b3b2-6698b7653944-ovnkube-script-lib\") pod \"ovnkube-node-z8nmw\" (UID: \"54d8c06c-72e7-4b77-b3b2-6698b7653944\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:54:45.466055 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.465245    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/800c58de-09f2-471c-a4c6-eaa0ed41ad9b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xjhfp\" (UID: \"800c58de-09f2-471c-a4c6-eaa0ed41ad9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xjhfp"
Sep 17 15:54:45.466055 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.465276    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/800c58de-09f2-471c-a4c6-eaa0ed41ad9b-socket-dir\") pod \"aws-ebs-csi-driver-node-xjhfp\" (UID: \"800c58de-09f2-471c-a4c6-eaa0ed41ad9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xjhfp"
Sep 17 15:54:45.466055 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.465298    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sw652\" (UniqueName: \"kubernetes.io/projected/800c58de-09f2-471c-a4c6-eaa0ed41ad9b-kube-api-access-sw652\") pod \"aws-ebs-csi-driver-node-xjhfp\" (UID: \"800c58de-09f2-471c-a4c6-eaa0ed41ad9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xjhfp"
Sep 17 15:54:45.466055 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.465320    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/54d8c06c-72e7-4b77-b3b2-6698b7653944-run-openvswitch\") pod \"ovnkube-node-z8nmw\" (UID: \"54d8c06c-72e7-4b77-b3b2-6698b7653944\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:54:45.466055 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.465341    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/54d8c06c-72e7-4b77-b3b2-6698b7653944-run-ovn\") pod \"ovnkube-node-z8nmw\" (UID: \"54d8c06c-72e7-4b77-b3b2-6698b7653944\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:54:45.466055 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.465363    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/54d8c06c-72e7-4b77-b3b2-6698b7653944-host-cni-netd\") pod \"ovnkube-node-z8nmw\" (UID: \"54d8c06c-72e7-4b77-b3b2-6698b7653944\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:54:45.466519 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.465392    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54d8c06c-72e7-4b77-b3b2-6698b7653944-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z8nmw\" (UID: \"54d8c06c-72e7-4b77-b3b2-6698b7653944\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:54:45.466519 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.465420    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/54d8c06c-72e7-4b77-b3b2-6698b7653944-ovnkube-config\") pod \"ovnkube-node-z8nmw\" (UID: \"54d8c06c-72e7-4b77-b3b2-6698b7653944\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:54:45.466519 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.465444    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/54d8c06c-72e7-4b77-b3b2-6698b7653944-env-overrides\") pod \"ovnkube-node-z8nmw\" (UID: \"54d8c06c-72e7-4b77-b3b2-6698b7653944\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:54:45.466519 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.465467    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/46630785-5a7e-496b-86fe-d32e237c8c1b-kubelet-config\") pod \"global-pull-secret-syncer-7xl8l\" (UID: \"46630785-5a7e-496b-86fe-d32e237c8c1b\") " pod="kube-system/global-pull-secret-syncer-7xl8l"
Sep 17 15:54:45.466519 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.465530    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/46630785-5a7e-496b-86fe-d32e237c8c1b-original-pull-secret\") pod \"global-pull-secret-syncer-7xl8l\" (UID: \"46630785-5a7e-496b-86fe-d32e237c8c1b\") " pod="kube-system/global-pull-secret-syncer-7xl8l"
Sep 17 15:54:45.478646 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.478630    2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-nlcp8"
Sep 17 15:54:45.512596 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:45.512563    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod311e9dffa75dc15b9f976eb249bd6092.slice/crio-46055ed7e0be2e8949174b5fecbecd55d0e09052427585166ab894e8e806fe9d WatchSource:0}: Error finding container 46055ed7e0be2e8949174b5fecbecd55d0e09052427585166ab894e8e806fe9d: Status 404 returned error can't find the container with id 46055ed7e0be2e8949174b5fecbecd55d0e09052427585166ab894e8e806fe9d
Sep 17 15:54:45.514329 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:45.513597    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc8c9739f6c89ebc2ed109ba6e1e7b17.slice/crio-35796b2f44dd017defaa00e7e2f72c70519c46b9ef7e582a53e4c8db3e845dfa WatchSource:0}: Error finding container 35796b2f44dd017defaa00e7e2f72c70519c46b9ef7e582a53e4c8db3e845dfa: Status 404 returned error can't find the container with id 35796b2f44dd017defaa00e7e2f72c70519c46b9ef7e582a53e4c8db3e845dfa
Sep 17 15:54:45.518772 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.518757    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 15:54:45.565958 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.565939    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9fd9b22-055f-4540-92c9-6c75c0c14fe3-tmp-dir\") pod \"node-resolver-x4mhf\" (UID: \"b9fd9b22-055f-4540-92c9-6c75c0c14fe3\") " pod="openshift-dns/node-resolver-x4mhf"
Sep 17 15:54:45.566056 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.565964    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ffe5f446-e608-459a-90f3-de1bcccba341-host-run-netns\") pod \"multus-fpptq\" (UID: \"ffe5f446-e608-459a-90f3-de1bcccba341\") " pod="openshift-multus/multus-fpptq"
Sep 17 15:54:45.566056 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.565979    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ffe5f446-e608-459a-90f3-de1bcccba341-host-run-multus-certs\") pod \"multus-fpptq\" (UID: \"ffe5f446-e608-459a-90f3-de1bcccba341\") " pod="openshift-multus/multus-fpptq"
Sep 17 15:54:45.566056 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.565996    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/54d8c06c-72e7-4b77-b3b2-6698b7653944-run-systemd\") pod \"ovnkube-node-z8nmw\" (UID: \"54d8c06c-72e7-4b77-b3b2-6698b7653944\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:54:45.566056 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.566027    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5d4dd8b6-ef54-48cd-82d5-0a91da88af5a-etc-modprobe-d\") pod \"tuned-77lh9\" (UID: \"5d4dd8b6-ef54-48cd-82d5-0a91da88af5a\") " pod="openshift-cluster-node-tuning-operator/tuned-77lh9"
Sep 17 15:54:45.566056 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.566046    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ffe5f446-e608-459a-90f3-de1bcccba341-host-run-netns\") pod \"multus-fpptq\" (UID: \"ffe5f446-e608-459a-90f3-de1bcccba341\") " pod="openshift-multus/multus-fpptq"
Sep 17 15:54:45.566056 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.566054    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ffe5f446-e608-459a-90f3-de1bcccba341-host-run-k8s-cni-cncf-io\") pod \"multus-fpptq\" (UID: \"ffe5f446-e608-459a-90f3-de1bcccba341\") " pod="openshift-multus/multus-fpptq"
Sep 17 15:54:45.566330 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.566067    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ffe5f446-e608-459a-90f3-de1bcccba341-host-run-multus-certs\") pod \"multus-fpptq\" (UID: \"ffe5f446-e608-459a-90f3-de1bcccba341\") " pod="openshift-multus/multus-fpptq"
Sep 17 15:54:45.566330 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.566082    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/54d8c06c-72e7-4b77-b3b2-6698b7653944-run-systemd\") pod \"ovnkube-node-z8nmw\" (UID: \"54d8c06c-72e7-4b77-b3b2-6698b7653944\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:54:45.566330 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.566092    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ffe5f446-e608-459a-90f3-de1bcccba341-host-run-k8s-cni-cncf-io\") pod \"multus-fpptq\" (UID: \"ffe5f446-e608-459a-90f3-de1bcccba341\") " pod="openshift-multus/multus-fpptq"
Sep 17 15:54:45.566330 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.566109    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/54d8c06c-72e7-4b77-b3b2-6698b7653944-var-lib-openvswitch\") pod \"ovnkube-node-z8nmw\" (UID: \"54d8c06c-72e7-4b77-b3b2-6698b7653944\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:54:45.566330 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.566135    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/54d8c06c-72e7-4b77-b3b2-6698b7653944-node-log\") pod \"ovnkube-node-z8nmw\" (UID: \"54d8c06c-72e7-4b77-b3b2-6698b7653944\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:54:45.566330 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.566149    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/54d8c06c-72e7-4b77-b3b2-6698b7653944-var-lib-openvswitch\") pod \"ovnkube-node-z8nmw\" (UID: \"54d8c06c-72e7-4b77-b3b2-6698b7653944\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:54:45.566330 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.566151    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5d4dd8b6-ef54-48cd-82d5-0a91da88af5a-etc-modprobe-d\") pod \"tuned-77lh9\" (UID: \"5d4dd8b6-ef54-48cd-82d5-0a91da88af5a\") " pod="openshift-cluster-node-tuning-operator/tuned-77lh9"
Sep 17 15:54:45.566330 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.566160    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/800c58de-09f2-471c-a4c6-eaa0ed41ad9b-etc-selinux\") pod \"aws-ebs-csi-driver-node-xjhfp\" (UID: \"800c58de-09f2-471c-a4c6-eaa0ed41ad9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xjhfp"
Sep 17 15:54:45.566330 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.566173    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/54d8c06c-72e7-4b77-b3b2-6698b7653944-node-log\") pod \"ovnkube-node-z8nmw\" (UID: \"54d8c06c-72e7-4b77-b3b2-6698b7653944\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:54:45.566330 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.566182    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/800c58de-09f2-471c-a4c6-eaa0ed41ad9b-sys-fs\") pod \"aws-ebs-csi-driver-node-xjhfp\" (UID: \"800c58de-09f2-471c-a4c6-eaa0ed41ad9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xjhfp"
Sep 17 15:54:45.566330 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.566227    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/800c58de-09f2-471c-a4c6-eaa0ed41ad9b-etc-selinux\") pod \"aws-ebs-csi-driver-node-xjhfp\" (UID: \"800c58de-09f2-471c-a4c6-eaa0ed41ad9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xjhfp"
Sep 17 15:54:45.566330 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.566208    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d4dd8b6-ef54-48cd-82d5-0a91da88af5a-etc-kubernetes\") pod \"tuned-77lh9\" (UID: \"5d4dd8b6-ef54-48cd-82d5-0a91da88af5a\") " pod="openshift-cluster-node-tuning-operator/tuned-77lh9"
Sep 17 15:54:45.566330 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.566255    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5d4dd8b6-ef54-48cd-82d5-0a91da88af5a-host\") pod \"tuned-77lh9\" (UID: \"5d4dd8b6-ef54-48cd-82d5-0a91da88af5a\") " pod="openshift-cluster-node-tuning-operator/tuned-77lh9"
Sep 17 15:54:45.566330 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.566253    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9fd9b22-055f-4540-92c9-6c75c0c14fe3-tmp-dir\") pod \"node-resolver-x4mhf\" (UID: \"b9fd9b22-055f-4540-92c9-6c75c0c14fe3\") " pod="openshift-dns/node-resolver-x4mhf"
Sep 17 15:54:45.566330 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.566269    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/46630785-5a7e-496b-86fe-d32e237c8c1b-dbus\") pod \"global-pull-secret-syncer-7xl8l\" (UID: \"46630785-5a7e-496b-86fe-d32e237c8c1b\") " pod="kube-system/global-pull-secret-syncer-7xl8l"
Sep 17 15:54:45.566330 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.566264    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/800c58de-09f2-471c-a4c6-eaa0ed41ad9b-sys-fs\") pod \"aws-ebs-csi-driver-node-xjhfp\" (UID: \"800c58de-09f2-471c-a4c6-eaa0ed41ad9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xjhfp"
Sep 17 15:54:45.566330 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.566291    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ffe5f446-e608-459a-90f3-de1bcccba341-cni-binary-copy\") pod \"multus-fpptq\" (UID: \"ffe5f446-e608-459a-90f3-de1bcccba341\") " pod="openshift-multus/multus-fpptq"
Sep 17 15:54:45.566330 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.566306    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/df579004-3b28-44fd-ac97-05faf9b54dad-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bjftc\" (UID: \"df579004-3b28-44fd-ac97-05faf9b54dad\") " pod="openshift-multus/multus-additional-cni-plugins-bjftc"
Sep 17 15:54:45.567193 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.566277    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d4dd8b6-ef54-48cd-82d5-0a91da88af5a-etc-kubernetes\") pod \"tuned-77lh9\" (UID: \"5d4dd8b6-ef54-48cd-82d5-0a91da88af5a\") " pod="openshift-cluster-node-tuning-operator/tuned-77lh9"
Sep 17 15:54:45.567193 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.566319    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7bp5\" (UniqueName: \"kubernetes.io/projected/b9fd9b22-055f-4540-92c9-6c75c0c14fe3-kube-api-access-k7bp5\") pod \"node-resolver-x4mhf\" (UID: \"b9fd9b22-055f-4540-92c9-6c75c0c14fe3\") " pod="openshift-dns/node-resolver-x4mhf"
Sep 17 15:54:45.567193 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.566305    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5d4dd8b6-ef54-48cd-82d5-0a91da88af5a-host\") pod \"tuned-77lh9\" (UID: \"5d4dd8b6-ef54-48cd-82d5-0a91da88af5a\") " pod="openshift-cluster-node-tuning-operator/tuned-77lh9"
Sep 17 15:54:45.567193 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.566354    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d7d3c798-4b01-4814-8e5c-c200c69dca8f-host\") pod \"node-ca-9f2dg\" (UID: \"d7d3c798-4b01-4814-8e5c-c200c69dca8f\") " pod="openshift-image-registry/node-ca-9f2dg"
Sep 17 15:54:45.567193 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.566387    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ffe5f446-e608-459a-90f3-de1bcccba341-multus-cni-dir\") pod \"multus-fpptq\" (UID: \"ffe5f446-e608-459a-90f3-de1bcccba341\") " pod="openshift-multus/multus-fpptq"
Sep 17 15:54:45.567193 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.566410    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ffe5f446-e608-459a-90f3-de1bcccba341-cnibin\") pod \"multus-fpptq\" (UID: \"ffe5f446-e608-459a-90f3-de1bcccba341\") " pod="openshift-multus/multus-fpptq"
Sep 17 15:54:45.567193 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.566424    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d7d3c798-4b01-4814-8e5c-c200c69dca8f-host\") pod \"node-ca-9f2dg\" (UID: \"d7d3c798-4b01-4814-8e5c-c200c69dca8f\") " pod="openshift-image-registry/node-ca-9f2dg"
Sep 17 15:54:45.567193 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.566431    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ffe5f446-e608-459a-90f3-de1bcccba341-multus-socket-dir-parent\") pod \"multus-fpptq\" (UID: \"ffe5f446-e608-459a-90f3-de1bcccba341\") " pod="openshift-multus/multus-fpptq"
Sep 17 15:54:45.567193 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.566463    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/df579004-3b28-44fd-ac97-05faf9b54dad-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bjftc\" (UID: \"df579004-3b28-44fd-ac97-05faf9b54dad\") " pod="openshift-multus/multus-additional-cni-plugins-bjftc"
Sep 17 15:54:45.567193 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.566471    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/46630785-5a7e-496b-86fe-d32e237c8c1b-dbus\") pod \"global-pull-secret-syncer-7xl8l\" (UID: \"46630785-5a7e-496b-86fe-d32e237c8c1b\") " pod="kube-system/global-pull-secret-syncer-7xl8l"
Sep 17 15:54:45.567193 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.566475    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ffe5f446-e608-459a-90f3-de1bcccba341-cnibin\") pod \"multus-fpptq\" (UID: \"ffe5f446-e608-459a-90f3-de1bcccba341\") " pod="openshift-multus/multus-fpptq"
Sep 17 15:54:45.567193 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.566487    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ffe5f446-e608-459a-90f3-de1bcccba341-multus-socket-dir-parent\") pod \"multus-fpptq\" (UID: \"ffe5f446-e608-459a-90f3-de1bcccba341\") " pod="openshift-multus/multus-fpptq"
Sep 17 15:54:45.567193 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.566531    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ffe5f446-e608-459a-90f3-de1bcccba341-multus-cni-dir\") pod \"multus-fpptq\" (UID: \"ffe5f446-e608-459a-90f3-de1bcccba341\") " pod="openshift-multus/multus-fpptq"
Sep 17 15:54:45.567193 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.566525    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ffe5f446-e608-459a-90f3-de1bcccba341-etc-kubernetes\") pod \"multus-fpptq\" (UID: \"ffe5f446-e608-459a-90f3-de1bcccba341\") " pod="openshift-multus/multus-fpptq"
Sep 17 15:54:45.567193 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.566583    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/54d8c06c-72e7-4b77-b3b2-6698b7653944-systemd-units\") pod \"ovnkube-node-z8nmw\" (UID: \"54d8c06c-72e7-4b77-b3b2-6698b7653944\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:54:45.567193 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.566606    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ffe5f446-e608-459a-90f3-de1bcccba341-etc-kubernetes\") pod \"multus-fpptq\" (UID: \"ffe5f446-e608-459a-90f3-de1bcccba341\") " pod="openshift-multus/multus-fpptq"
Sep 17 15:54:45.567193 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.566605    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/800c58de-09f2-471c-a4c6-eaa0ed41ad9b-device-dir\") pod \"aws-ebs-csi-driver-node-xjhfp\" (UID: \"800c58de-09f2-471c-a4c6-eaa0ed41ad9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xjhfp"
Sep 17 15:54:45.567193 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.566641    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/df579004-3b28-44fd-ac97-05faf9b54dad-system-cni-dir\") pod \"multus-additional-cni-plugins-bjftc\" (UID: \"df579004-3b28-44fd-ac97-05faf9b54dad\") " pod="openshift-multus/multus-additional-cni-plugins-bjftc"
Sep 17 15:54:45.568007 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.566610    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/54d8c06c-72e7-4b77-b3b2-6698b7653944-systemd-units\") pod \"ovnkube-node-z8nmw\" (UID: \"54d8c06c-72e7-4b77-b3b2-6698b7653944\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:54:45.568007 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.566655    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5d4dd8b6-ef54-48cd-82d5-0a91da88af5a-etc-systemd\") pod \"tuned-77lh9\" (UID: \"5d4dd8b6-ef54-48cd-82d5-0a91da88af5a\") " pod="openshift-cluster-node-tuning-operator/tuned-77lh9"
Sep 17 15:54:45.568007 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.566660    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/800c58de-09f2-471c-a4c6-eaa0ed41ad9b-device-dir\") pod \"aws-ebs-csi-driver-node-xjhfp\" (UID: \"800c58de-09f2-471c-a4c6-eaa0ed41ad9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xjhfp"
Sep 17 15:54:45.568007 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.566671    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d4dd8b6-ef54-48cd-82d5-0a91da88af5a-var-lib-kubelet\") pod \"tuned-77lh9\" (UID: \"5d4dd8b6-ef54-48cd-82d5-0a91da88af5a\") " pod="openshift-cluster-node-tuning-operator/tuned-77lh9"
Sep 17 15:54:45.568007 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.566695    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/df579004-3b28-44fd-ac97-05faf9b54dad-cnibin\") pod \"multus-additional-cni-plugins-bjftc\" (UID: \"df579004-3b28-44fd-ac97-05faf9b54dad\") " pod="openshift-multus/multus-additional-cni-plugins-bjftc"
Sep 17 15:54:45.568007 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.566696    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/df579004-3b28-44fd-ac97-05faf9b54dad-system-cni-dir\") pod \"multus-additional-cni-plugins-bjftc\" (UID: \"df579004-3b28-44fd-ac97-05faf9b54dad\") " pod="openshift-multus/multus-additional-cni-plugins-bjftc"
Sep 17 15:54:45.568007 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.566710    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/800c58de-09f2-471c-a4c6-eaa0ed41ad9b-registration-dir\") pod \"aws-ebs-csi-driver-node-xjhfp\" (UID: \"800c58de-09f2-471c-a4c6-eaa0ed41ad9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xjhfp"
Sep 17 15:54:45.568007 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.566700    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5d4dd8b6-ef54-48cd-82d5-0a91da88af5a-etc-systemd\") pod \"tuned-77lh9\" (UID: \"5d4dd8b6-ef54-48cd-82d5-0a91da88af5a\") " pod="openshift-cluster-node-tuning-operator/tuned-77lh9"
Sep 17 15:54:45.568007 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.566744    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/df579004-3b28-44fd-ac97-05faf9b54dad-cnibin\") pod \"multus-additional-cni-plugins-bjftc\" (UID: \"df579004-3b28-44fd-ac97-05faf9b54dad\") " pod="openshift-multus/multus-additional-cni-plugins-bjftc"
Sep 17 15:54:45.568007 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.566746    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d4dd8b6-ef54-48cd-82d5-0a91da88af5a-var-lib-kubelet\") pod \"tuned-77lh9\" (UID: \"5d4dd8b6-ef54-48cd-82d5-0a91da88af5a\") " pod="openshift-cluster-node-tuning-operator/tuned-77lh9"
Sep 17 15:54:45.568007 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.566756    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/54d8c06c-72e7-4b77-b3b2-6698b7653944-ovnkube-script-lib\") pod \"ovnkube-node-z8nmw\" (UID: \"54d8c06c-72e7-4b77-b3b2-6698b7653944\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:54:45.568007 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.566782    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/800c58de-09f2-471c-a4c6-eaa0ed41ad9b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xjhfp\" (UID: \"800c58de-09f2-471c-a4c6-eaa0ed41ad9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xjhfp"
Sep 17 15:54:45.568007 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.566802    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/800c58de-09f2-471c-a4c6-eaa0ed41ad9b-socket-dir\") pod \"aws-ebs-csi-driver-node-xjhfp\" (UID: \"800c58de-09f2-471c-a4c6-eaa0ed41ad9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xjhfp"
Sep 17 15:54:45.568007 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.566818    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sw652\" (UniqueName: \"kubernetes.io/projected/800c58de-09f2-471c-a4c6-eaa0ed41ad9b-kube-api-access-sw652\") pod \"aws-ebs-csi-driver-node-xjhfp\" (UID: \"800c58de-09f2-471c-a4c6-eaa0ed41ad9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xjhfp"
Sep 17 15:54:45.568007 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.566820    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/800c58de-09f2-471c-a4c6-eaa0ed41ad9b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xjhfp\" (UID: \"800c58de-09f2-471c-a4c6-eaa0ed41ad9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xjhfp"
Sep 17 15:54:45.568007 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.566831    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/54d8c06c-72e7-4b77-b3b2-6698b7653944-run-openvswitch\") pod \"ovnkube-node-z8nmw\" (UID: \"54d8c06c-72e7-4b77-b3b2-6698b7653944\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:54:45.568007 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.566781    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/800c58de-09f2-471c-a4c6-eaa0ed41ad9b-registration-dir\") pod \"aws-ebs-csi-driver-node-xjhfp\" (UID: \"800c58de-09f2-471c-a4c6-eaa0ed41ad9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xjhfp"
Sep 17 15:54:45.568930 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.566867    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/54d8c06c-72e7-4b77-b3b2-6698b7653944-run-openvswitch\") pod \"ovnkube-node-z8nmw\" (UID: \"54d8c06c-72e7-4b77-b3b2-6698b7653944\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:54:45.568930 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.566907    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/800c58de-09f2-471c-a4c6-eaa0ed41ad9b-socket-dir\") pod \"aws-ebs-csi-driver-node-xjhfp\" (UID: \"800c58de-09f2-471c-a4c6-eaa0ed41ad9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xjhfp"
Sep 17 15:54:45.568930 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.566945    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/54d8c06c-72e7-4b77-b3b2-6698b7653944-run-ovn\") pod \"ovnkube-node-z8nmw\" (UID: \"54d8c06c-72e7-4b77-b3b2-6698b7653944\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:54:45.568930 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.566967    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/54d8c06c-72e7-4b77-b3b2-6698b7653944-host-cni-netd\") pod \"ovnkube-node-z8nmw\" (UID: \"54d8c06c-72e7-4b77-b3b2-6698b7653944\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:54:45.568930 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.566983    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54d8c06c-72e7-4b77-b3b2-6698b7653944-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z8nmw\" (UID: \"54d8c06c-72e7-4b77-b3b2-6698b7653944\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:54:45.568930 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.567012    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/54d8c06c-72e7-4b77-b3b2-6698b7653944-ovnkube-config\") pod \"ovnkube-node-z8nmw\" (UID: \"54d8c06c-72e7-4b77-b3b2-6698b7653944\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:54:45.568930 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.567021    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/54d8c06c-72e7-4b77-b3b2-6698b7653944-run-ovn\") pod \"ovnkube-node-z8nmw\" (UID: \"54d8c06c-72e7-4b77-b3b2-6698b7653944\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:54:45.568930 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.566945    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ffe5f446-e608-459a-90f3-de1bcccba341-cni-binary-copy\") pod \"multus-fpptq\" (UID: \"ffe5f446-e608-459a-90f3-de1bcccba341\") " pod="openshift-multus/multus-fpptq"
Sep 17 15:54:45.568930 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.567037    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/54d8c06c-72e7-4b77-b3b2-6698b7653944-env-overrides\") pod \"ovnkube-node-z8nmw\" (UID: \"54d8c06c-72e7-4b77-b3b2-6698b7653944\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:54:45.568930 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.567042    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/54d8c06c-72e7-4b77-b3b2-6698b7653944-host-cni-netd\") pod \"ovnkube-node-z8nmw\" (UID: \"54d8c06c-72e7-4b77-b3b2-6698b7653944\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:54:45.568930 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.567041    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54d8c06c-72e7-4b77-b3b2-6698b7653944-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z8nmw\" (UID: \"54d8c06c-72e7-4b77-b3b2-6698b7653944\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:54:45.568930 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.567060    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/46630785-5a7e-496b-86fe-d32e237c8c1b-kubelet-config\") pod \"global-pull-secret-syncer-7xl8l\" (UID: \"46630785-5a7e-496b-86fe-d32e237c8c1b\") " pod="kube-system/global-pull-secret-syncer-7xl8l"
Sep 17 15:54:45.568930 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.567091    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/46630785-5a7e-496b-86fe-d32e237c8c1b-original-pull-secret\") pod \"global-pull-secret-syncer-7xl8l\" (UID: \"46630785-5a7e-496b-86fe-d32e237c8c1b\") " pod="kube-system/global-pull-secret-syncer-7xl8l"
Sep 17 15:54:45.568930 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.567111    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/46630785-5a7e-496b-86fe-d32e237c8c1b-kubelet-config\") pod \"global-pull-secret-syncer-7xl8l\" (UID: \"46630785-5a7e-496b-86fe-d32e237c8c1b\") " pod="kube-system/global-pull-secret-syncer-7xl8l"
Sep 17 15:54:45.568930 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.567120    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/df579004-3b28-44fd-ac97-05faf9b54dad-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bjftc\" (UID: \"df579004-3b28-44fd-ac97-05faf9b54dad\") " pod="openshift-multus/multus-additional-cni-plugins-bjftc"
Sep 17 15:54:45.568930 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.567143    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ffe5f446-e608-459a-90f3-de1bcccba341-system-cni-dir\") pod \"multus-fpptq\" (UID: \"ffe5f446-e608-459a-90f3-de1bcccba341\") " pod="openshift-multus/multus-fpptq"
Sep 17 15:54:45.568930 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:45.567182    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 15:54:45.568930 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.567193    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ffe5f446-e608-459a-90f3-de1bcccba341-system-cni-dir\") pod \"multus-fpptq\" (UID: \"ffe5f446-e608-459a-90f3-de1bcccba341\") " pod="openshift-multus/multus-fpptq"
Sep 17 15:54:45.569743 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:45.567248    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46630785-5a7e-496b-86fe-d32e237c8c1b-original-pull-secret podName:46630785-5a7e-496b-86fe-d32e237c8c1b nodeName:}" failed. No retries permitted until 2026-09-17 15:54:46.067229406 +0000 UTC m=+3.681160916 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/46630785-5a7e-496b-86fe-d32e237c8c1b-original-pull-secret") pod "global-pull-secret-syncer-7xl8l" (UID: "46630785-5a7e-496b-86fe-d32e237c8c1b") : object "kube-system"/"original-pull-secret" not registered
Sep 17 15:54:45.569743 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.567287    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d28f991c-888d-4396-8c52-e7dcb503799c-host-slash\") pod \"iptables-alerter-hp2s4\" (UID: \"d28f991c-888d-4396-8c52-e7dcb503799c\") " pod="openshift-network-operator/iptables-alerter-hp2s4"
Sep 17 15:54:45.569743 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.567322    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d28f991c-888d-4396-8c52-e7dcb503799c-host-slash\") pod \"iptables-alerter-hp2s4\" (UID: \"d28f991c-888d-4396-8c52-e7dcb503799c\") " pod="openshift-network-operator/iptables-alerter-hp2s4"
Sep 17 15:54:45.569743 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.567288    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/54d8c06c-72e7-4b77-b3b2-6698b7653944-ovnkube-script-lib\") pod \"ovnkube-node-z8nmw\" (UID: \"54d8c06c-72e7-4b77-b3b2-6698b7653944\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:54:45.569743 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.567322    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b550e969-e4dd-4602-8d26-4a6275359d68-metrics-certs\") pod \"network-metrics-daemon-nldm2\" (UID: \"b550e969-e4dd-4602-8d26-4a6275359d68\") " pod="openshift-multus/network-metrics-daemon-nldm2"
Sep 17 15:54:45.569743 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.567385    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5d4dd8b6-ef54-48cd-82d5-0a91da88af5a-etc-sysctl-d\") pod \"tuned-77lh9\" (UID: \"5d4dd8b6-ef54-48cd-82d5-0a91da88af5a\") " pod="openshift-cluster-node-tuning-operator/tuned-77lh9"
Sep 17 15:54:45.569743 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:45.567391    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 15:54:45.569743 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.567407    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5d4dd8b6-ef54-48cd-82d5-0a91da88af5a-tmp\") pod \"tuned-77lh9\" (UID: \"5d4dd8b6-ef54-48cd-82d5-0a91da88af5a\") " pod="openshift-cluster-node-tuning-operator/tuned-77lh9"
Sep 17 15:54:45.569743 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:45.567430    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b550e969-e4dd-4602-8d26-4a6275359d68-metrics-certs podName:b550e969-e4dd-4602-8d26-4a6275359d68 nodeName:}" failed. No retries permitted until 2026-09-17 15:54:46.067418763 +0000 UTC m=+3.681350278 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b550e969-e4dd-4602-8d26-4a6275359d68-metrics-certs") pod "network-metrics-daemon-nldm2" (UID: "b550e969-e4dd-4602-8d26-4a6275359d68") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 15:54:45.569743 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.567449    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/df579004-3b28-44fd-ac97-05faf9b54dad-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bjftc\" (UID: \"df579004-3b28-44fd-ac97-05faf9b54dad\") " pod="openshift-multus/multus-additional-cni-plugins-bjftc"
Sep 17 15:54:45.569743 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.567476    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d7d3c798-4b01-4814-8e5c-c200c69dca8f-serviceca\") pod \"node-ca-9f2dg\" (UID: \"d7d3c798-4b01-4814-8e5c-c200c69dca8f\") " pod="openshift-image-registry/node-ca-9f2dg"
Sep 17 15:54:45.569743 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.567509    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/54d8c06c-72e7-4b77-b3b2-6698b7653944-env-overrides\") pod \"ovnkube-node-z8nmw\" (UID: \"54d8c06c-72e7-4b77-b3b2-6698b7653944\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:54:45.569743 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.567517    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4g82j\" (UniqueName: \"kubernetes.io/projected/b550e969-e4dd-4602-8d26-4a6275359d68-kube-api-access-4g82j\") pod \"network-metrics-daemon-nldm2\" (UID: \"b550e969-e4dd-4602-8d26-4a6275359d68\") " pod="openshift-multus/network-metrics-daemon-nldm2"
Sep 17 15:54:45.569743 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.567548    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z65p7\" (UniqueName: \"kubernetes.io/projected/34abf0a1-5178-487d-93af-577b29705d96-kube-api-access-z65p7\") pod \"network-check-target-gg77s\" (UID: \"34abf0a1-5178-487d-93af-577b29705d96\") " pod="openshift-network-diagnostics/network-check-target-gg77s"
Sep 17 15:54:45.569743 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.567621    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ffe5f446-e608-459a-90f3-de1bcccba341-multus-conf-dir\") pod \"multus-fpptq\" (UID: \"ffe5f446-e608-459a-90f3-de1bcccba341\") " pod="openshift-multus/multus-fpptq"
Sep 17 15:54:45.569743 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.567628    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5d4dd8b6-ef54-48cd-82d5-0a91da88af5a-etc-sysctl-d\") pod \"tuned-77lh9\" (UID: \"5d4dd8b6-ef54-48cd-82d5-0a91da88af5a\") " pod="openshift-cluster-node-tuning-operator/tuned-77lh9"
Sep 17 15:54:45.570584 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.567651    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/54d8c06c-72e7-4b77-b3b2-6698b7653944-ovnkube-config\") pod \"ovnkube-node-z8nmw\" (UID: \"54d8c06c-72e7-4b77-b3b2-6698b7653944\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:54:45.570584 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.567646    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d28f991c-888d-4396-8c52-e7dcb503799c-iptables-alerter-script\") pod \"iptables-alerter-hp2s4\" (UID: \"d28f991c-888d-4396-8c52-e7dcb503799c\") " pod="openshift-network-operator/iptables-alerter-hp2s4"
Sep 17 15:54:45.570584 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.567684    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pk8l8\" (UniqueName: \"kubernetes.io/projected/d28f991c-888d-4396-8c52-e7dcb503799c-kube-api-access-pk8l8\") pod \"iptables-alerter-hp2s4\" (UID: \"d28f991c-888d-4396-8c52-e7dcb503799c\") " pod="openshift-network-operator/iptables-alerter-hp2s4"
Sep 17 15:54:45.570584 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.567727    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/df579004-3b28-44fd-ac97-05faf9b54dad-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bjftc\" (UID: \"df579004-3b28-44fd-ac97-05faf9b54dad\") " pod="openshift-multus/multus-additional-cni-plugins-bjftc"
Sep 17 15:54:45.570584 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.567733    2584 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 17 15:54:45.570584 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.567731    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ffe5f446-e608-459a-90f3-de1bcccba341-multus-conf-dir\") pod \"multus-fpptq\" (UID: \"ffe5f446-e608-459a-90f3-de1bcccba341\") " pod="openshift-multus/multus-fpptq"
Sep 17 15:54:45.570584 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.567730    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9e359937-2c4a-45c6-92b6-3c82ee32c922-agent-certs\") pod \"konnectivity-agent-zlcqk\" (UID: \"9e359937-2c4a-45c6-92b6-3c82ee32c922\") " pod="kube-system/konnectivity-agent-zlcqk"
Sep 17 15:54:45.570584 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.567817    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5d4dd8b6-ef54-48cd-82d5-0a91da88af5a-lib-modules\") pod \"tuned-77lh9\" (UID: \"5d4dd8b6-ef54-48cd-82d5-0a91da88af5a\") " pod="openshift-cluster-node-tuning-operator/tuned-77lh9"
Sep 17 15:54:45.570584 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.567840    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4vp7\" (UniqueName: \"kubernetes.io/projected/d7d3c798-4b01-4814-8e5c-c200c69dca8f-kube-api-access-v4vp7\") pod \"node-ca-9f2dg\" (UID: \"d7d3c798-4b01-4814-8e5c-c200c69dca8f\") " pod="openshift-image-registry/node-ca-9f2dg"
Sep 17 15:54:45.570584 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.567862    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ffe5f446-e608-459a-90f3-de1bcccba341-host-var-lib-cni-bin\") pod \"multus-fpptq\" (UID: \"ffe5f446-e608-459a-90f3-de1bcccba341\") " pod="openshift-multus/multus-fpptq"
Sep 17 15:54:45.570584 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.567894    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ffe5f446-e608-459a-90f3-de1bcccba341-host-var-lib-cni-multus\") pod \"multus-fpptq\" (UID: \"ffe5f446-e608-459a-90f3-de1bcccba341\") " pod="openshift-multus/multus-fpptq"
Sep 17 15:54:45.570584 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.567919    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/54d8c06c-72e7-4b77-b3b2-6698b7653944-host-slash\") pod \"ovnkube-node-z8nmw\" (UID: \"54d8c06c-72e7-4b77-b3b2-6698b7653944\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:54:45.570584 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.567943    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/54d8c06c-72e7-4b77-b3b2-6698b7653944-host-run-netns\") pod \"ovnkube-node-z8nmw\" (UID: \"54d8c06c-72e7-4b77-b3b2-6698b7653944\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:54:45.570584 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.567989    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54d8c06c-72e7-4b77-b3b2-6698b7653944-host-run-ovn-kubernetes\") pod \"ovnkube-node-z8nmw\" (UID: \"54d8c06c-72e7-4b77-b3b2-6698b7653944\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:54:45.570584 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.568016    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ffe5f446-e608-459a-90f3-de1bcccba341-host-var-lib-cni-multus\") pod \"multus-fpptq\" (UID: \"ffe5f446-e608-459a-90f3-de1bcccba341\") " pod="openshift-multus/multus-fpptq"
Sep 17 15:54:45.570584 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.568033    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d7d3c798-4b01-4814-8e5c-c200c69dca8f-serviceca\") pod \"node-ca-9f2dg\" (UID: \"d7d3c798-4b01-4814-8e5c-c200c69dca8f\") " pod="openshift-image-registry/node-ca-9f2dg"
Sep 17 15:54:45.570584 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.568062    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ffe5f446-e608-459a-90f3-de1bcccba341-host-var-lib-cni-bin\") pod \"multus-fpptq\" (UID: \"ffe5f446-e608-459a-90f3-de1bcccba341\") " pod="openshift-multus/multus-fpptq"
Sep 17 15:54:45.570584 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.568068    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5d4dd8b6-ef54-48cd-82d5-0a91da88af5a-etc-sysctl-conf\") pod \"tuned-77lh9\" (UID: \"5d4dd8b6-ef54-48cd-82d5-0a91da88af5a\") " pod="openshift-cluster-node-tuning-operator/tuned-77lh9"
Sep 17 15:54:45.571212 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.568098    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54d8c06c-72e7-4b77-b3b2-6698b7653944-host-run-ovn-kubernetes\") pod \"ovnkube-node-z8nmw\" (UID: \"54d8c06c-72e7-4b77-b3b2-6698b7653944\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:54:45.571212 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.568107    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/54d8c06c-72e7-4b77-b3b2-6698b7653944-host-run-netns\") pod \"ovnkube-node-z8nmw\" (UID: \"54d8c06c-72e7-4b77-b3b2-6698b7653944\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:54:45.571212 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.568102    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5d4dd8b6-ef54-48cd-82d5-0a91da88af5a-etc-tuned\") pod \"tuned-77lh9\" (UID: \"5d4dd8b6-ef54-48cd-82d5-0a91da88af5a\") " pod="openshift-cluster-node-tuning-operator/tuned-77lh9"
Sep 17 15:54:45.571212 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.568169    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/54d8c06c-72e7-4b77-b3b2-6698b7653944-log-socket\") pod \"ovnkube-node-z8nmw\" (UID: \"54d8c06c-72e7-4b77-b3b2-6698b7653944\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:54:45.571212 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.568199    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/54d8c06c-72e7-4b77-b3b2-6698b7653944-ovn-node-metrics-cert\") pod \"ovnkube-node-z8nmw\" (UID: \"54d8c06c-72e7-4b77-b3b2-6698b7653944\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:54:45.571212 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.568209    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5d4dd8b6-ef54-48cd-82d5-0a91da88af5a-etc-sysctl-conf\") pod \"tuned-77lh9\" (UID: \"5d4dd8b6-ef54-48cd-82d5-0a91da88af5a\") " pod="openshift-cluster-node-tuning-operator/tuned-77lh9"
Sep 17 15:54:45.571212 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.568230    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5d4dd8b6-ef54-48cd-82d5-0a91da88af5a-sys\") pod \"tuned-77lh9\" (UID: \"5d4dd8b6-ef54-48cd-82d5-0a91da88af5a\") " pod="openshift-cluster-node-tuning-operator/tuned-77lh9"
Sep 17 15:54:45.571212 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.568265    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/54d8c06c-72e7-4b77-b3b2-6698b7653944-log-socket\") pod \"ovnkube-node-z8nmw\" (UID: \"54d8c06c-72e7-4b77-b3b2-6698b7653944\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:54:45.571212 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.568136    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/54d8c06c-72e7-4b77-b3b2-6698b7653944-host-slash\") pod \"ovnkube-node-z8nmw\" (UID: \"54d8c06c-72e7-4b77-b3b2-6698b7653944\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:54:45.571212 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.568283    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b9fd9b22-055f-4540-92c9-6c75c0c14fe3-hosts-file\") pod \"node-resolver-x4mhf\" (UID: \"b9fd9b22-055f-4540-92c9-6c75c0c14fe3\") " pod="openshift-dns/node-resolver-x4mhf"
Sep 17 15:54:45.571212 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.568136    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5d4dd8b6-ef54-48cd-82d5-0a91da88af5a-lib-modules\") pod \"tuned-77lh9\" (UID: \"5d4dd8b6-ef54-48cd-82d5-0a91da88af5a\") " pod="openshift-cluster-node-tuning-operator/tuned-77lh9"
Sep 17 15:54:45.571212 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.568313    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/54d8c06c-72e7-4b77-b3b2-6698b7653944-host-kubelet\") pod \"ovnkube-node-z8nmw\" (UID: \"54d8c06c-72e7-4b77-b3b2-6698b7653944\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:54:45.571212 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.568340    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/54d8c06c-72e7-4b77-b3b2-6698b7653944-etc-openvswitch\") pod \"ovnkube-node-z8nmw\" (UID: \"54d8c06c-72e7-4b77-b3b2-6698b7653944\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:54:45.571212 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.568368    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/54d8c06c-72e7-4b77-b3b2-6698b7653944-host-cni-bin\") pod \"ovnkube-node-z8nmw\" (UID: \"54d8c06c-72e7-4b77-b3b2-6698b7653944\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:54:45.571212 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.568379    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5d4dd8b6-ef54-48cd-82d5-0a91da88af5a-sys\") pod \"tuned-77lh9\" (UID: \"5d4dd8b6-ef54-48cd-82d5-0a91da88af5a\") " pod="openshift-cluster-node-tuning-operator/tuned-77lh9"
Sep 17 15:54:45.571212 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.568392    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ffe5f446-e608-459a-90f3-de1bcccba341-hostroot\") pod \"multus-fpptq\" (UID: \"ffe5f446-e608-459a-90f3-de1bcccba341\") " pod="openshift-multus/multus-fpptq"
Sep 17 15:54:45.571212 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.568394    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/df579004-3b28-44fd-ac97-05faf9b54dad-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bjftc\" (UID: \"df579004-3b28-44fd-ac97-05faf9b54dad\") " pod="openshift-multus/multus-additional-cni-plugins-bjftc"
Sep 17 15:54:45.571212 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.568416    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ffe5f446-e608-459a-90f3-de1bcccba341-multus-daemon-config\") pod \"multus-fpptq\" (UID: \"ffe5f446-e608-459a-90f3-de1bcccba341\") " pod="openshift-multus/multus-fpptq"
Sep 17 15:54:45.571707 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.568343    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b9fd9b22-055f-4540-92c9-6c75c0c14fe3-hosts-file\") pod \"node-resolver-x4mhf\" (UID: \"b9fd9b22-055f-4540-92c9-6c75c0c14fe3\") " pod="openshift-dns/node-resolver-x4mhf"
Sep 17 15:54:45.571707 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.568444    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zh69p\" (UniqueName: \"kubernetes.io/projected/ffe5f446-e608-459a-90f3-de1bcccba341-kube-api-access-zh69p\") pod \"multus-fpptq\" (UID: \"ffe5f446-e608-459a-90f3-de1bcccba341\") " pod="openshift-multus/multus-fpptq"
Sep 17 15:54:45.571707 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.568445    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/54d8c06c-72e7-4b77-b3b2-6698b7653944-etc-openvswitch\") pod \"ovnkube-node-z8nmw\" (UID: \"54d8c06c-72e7-4b77-b3b2-6698b7653944\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:54:45.571707 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.568468    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5d4dd8b6-ef54-48cd-82d5-0a91da88af5a-etc-sysconfig\") pod \"tuned-77lh9\" (UID: \"5d4dd8b6-ef54-48cd-82d5-0a91da88af5a\") " pod="openshift-cluster-node-tuning-operator/tuned-77lh9"
Sep 17 15:54:45.571707 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.568510    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5d4dd8b6-ef54-48cd-82d5-0a91da88af5a-run\") pod \"tuned-77lh9\" (UID: \"5d4dd8b6-ef54-48cd-82d5-0a91da88af5a\") " pod="openshift-cluster-node-tuning-operator/tuned-77lh9"
Sep 17 15:54:45.571707 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.568526    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/54d8c06c-72e7-4b77-b3b2-6698b7653944-host-kubelet\") pod \"ovnkube-node-z8nmw\" (UID: \"54d8c06c-72e7-4b77-b3b2-6698b7653944\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:54:45.571707 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.568536    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kgbq\" (UniqueName: \"kubernetes.io/projected/5d4dd8b6-ef54-48cd-82d5-0a91da88af5a-kube-api-access-2kgbq\") pod \"tuned-77lh9\" (UID: \"5d4dd8b6-ef54-48cd-82d5-0a91da88af5a\") " pod="openshift-cluster-node-tuning-operator/tuned-77lh9"
Sep 17 15:54:45.571707 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.568560    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88xtl\" (UniqueName: \"kubernetes.io/projected/df579004-3b28-44fd-ac97-05faf9b54dad-kube-api-access-88xtl\") pod \"multus-additional-cni-plugins-bjftc\" (UID: \"df579004-3b28-44fd-ac97-05faf9b54dad\") " pod="openshift-multus/multus-additional-cni-plugins-bjftc"
Sep 17 15:54:45.571707 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.568585    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nt4h2\" (UniqueName: \"kubernetes.io/projected/54d8c06c-72e7-4b77-b3b2-6698b7653944-kube-api-access-nt4h2\") pod \"ovnkube-node-z8nmw\" (UID: \"54d8c06c-72e7-4b77-b3b2-6698b7653944\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:54:45.571707 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.568594    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ffe5f446-e608-459a-90f3-de1bcccba341-hostroot\") pod \"multus-fpptq\" (UID: \"ffe5f446-e608-459a-90f3-de1bcccba341\") " pod="openshift-multus/multus-fpptq"
Sep 17 15:54:45.571707 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.568621    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/df579004-3b28-44fd-ac97-05faf9b54dad-cni-binary-copy\") pod \"multus-additional-cni-plugins-bjftc\" (UID: \"df579004-3b28-44fd-ac97-05faf9b54dad\") " pod="openshift-multus/multus-additional-cni-plugins-bjftc"
Sep 17 15:54:45.571707 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.568648    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ffe5f446-e608-459a-90f3-de1bcccba341-host-var-lib-kubelet\") pod \"multus-fpptq\" (UID: \"ffe5f446-e608-459a-90f3-de1bcccba341\") " pod="openshift-multus/multus-fpptq"
Sep 17 15:54:45.571707 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.568673    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9e359937-2c4a-45c6-92b6-3c82ee32c922-konnectivity-ca\") pod \"konnectivity-agent-zlcqk\" (UID: \"9e359937-2c4a-45c6-92b6-3c82ee32c922\") " pod="kube-system/konnectivity-agent-zlcqk"
Sep 17 15:54:45.571707 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.568710    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d28f991c-888d-4396-8c52-e7dcb503799c-iptables-alerter-script\") pod \"iptables-alerter-hp2s4\" (UID: \"d28f991c-888d-4396-8c52-e7dcb503799c\") " pod="openshift-network-operator/iptables-alerter-hp2s4"
Sep 17 15:54:45.571707 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.568786    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5d4dd8b6-ef54-48cd-82d5-0a91da88af5a-etc-sysconfig\") pod \"tuned-77lh9\" (UID: \"5d4dd8b6-ef54-48cd-82d5-0a91da88af5a\") " pod="openshift-cluster-node-tuning-operator/tuned-77lh9"
Sep 17 15:54:45.571707 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.568970    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5d4dd8b6-ef54-48cd-82d5-0a91da88af5a-run\") pod \"tuned-77lh9\" (UID: \"5d4dd8b6-ef54-48cd-82d5-0a91da88af5a\") " pod="openshift-cluster-node-tuning-operator/tuned-77lh9"
Sep 17 15:54:45.571707 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.569098    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ffe5f446-e608-459a-90f3-de1bcccba341-multus-daemon-config\") pod \"multus-fpptq\" (UID: \"ffe5f446-e608-459a-90f3-de1bcccba341\") " pod="openshift-multus/multus-fpptq"
Sep 17 15:54:45.571707 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.568562    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/54d8c06c-72e7-4b77-b3b2-6698b7653944-host-cni-bin\") pod \"ovnkube-node-z8nmw\" (UID: \"54d8c06c-72e7-4b77-b3b2-6698b7653944\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:54:45.572174 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.569182    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ffe5f446-e608-459a-90f3-de1bcccba341-host-var-lib-kubelet\") pod \"multus-fpptq\" (UID: \"ffe5f446-e608-459a-90f3-de1bcccba341\") " pod="openshift-multus/multus-fpptq"
Sep 17 15:54:45.572174 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.569601    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/df579004-3b28-44fd-ac97-05faf9b54dad-cni-binary-copy\") pod \"multus-additional-cni-plugins-bjftc\" (UID: \"df579004-3b28-44fd-ac97-05faf9b54dad\") " pod="openshift-multus/multus-additional-cni-plugins-bjftc"
Sep 17 15:54:45.572174 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.569688    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9e359937-2c4a-45c6-92b6-3c82ee32c922-konnectivity-ca\") pod \"konnectivity-agent-zlcqk\" (UID: \"9e359937-2c4a-45c6-92b6-3c82ee32c922\") " pod="kube-system/konnectivity-agent-zlcqk"
Sep 17 15:54:45.572174 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.570884    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/54d8c06c-72e7-4b77-b3b2-6698b7653944-ovn-node-metrics-cert\") pod \"ovnkube-node-z8nmw\" (UID: \"54d8c06c-72e7-4b77-b3b2-6698b7653944\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:54:45.572174 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.570928    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5d4dd8b6-ef54-48cd-82d5-0a91da88af5a-tmp\") pod \"tuned-77lh9\" (UID: \"5d4dd8b6-ef54-48cd-82d5-0a91da88af5a\") " pod="openshift-cluster-node-tuning-operator/tuned-77lh9"
Sep 17 15:54:45.572174 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.570981    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5d4dd8b6-ef54-48cd-82d5-0a91da88af5a-etc-tuned\") pod \"tuned-77lh9\" (UID: \"5d4dd8b6-ef54-48cd-82d5-0a91da88af5a\") " pod="openshift-cluster-node-tuning-operator/tuned-77lh9"
Sep 17 15:54:45.572174 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.571079    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9e359937-2c4a-45c6-92b6-3c82ee32c922-agent-certs\") pod \"konnectivity-agent-zlcqk\" (UID: \"9e359937-2c4a-45c6-92b6-3c82ee32c922\") " pod="kube-system/konnectivity-agent-zlcqk"
Sep 17 15:54:45.583241 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.583222    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sw652\" (UniqueName: \"kubernetes.io/projected/800c58de-09f2-471c-a4c6-eaa0ed41ad9b-kube-api-access-sw652\") pod \"aws-ebs-csi-driver-node-xjhfp\" (UID: \"800c58de-09f2-471c-a4c6-eaa0ed41ad9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xjhfp"
Sep 17 15:54:45.588331 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.588317    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7bp5\" (UniqueName: \"kubernetes.io/projected/b9fd9b22-055f-4540-92c9-6c75c0c14fe3-kube-api-access-k7bp5\") pod \"node-resolver-x4mhf\" (UID: \"b9fd9b22-055f-4540-92c9-6c75c0c14fe3\") " pod="openshift-dns/node-resolver-x4mhf"
Sep 17 15:54:45.590149 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.590130    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kgbq\" (UniqueName: \"kubernetes.io/projected/5d4dd8b6-ef54-48cd-82d5-0a91da88af5a-kube-api-access-2kgbq\") pod \"tuned-77lh9\" (UID: \"5d4dd8b6-ef54-48cd-82d5-0a91da88af5a\") " pod="openshift-cluster-node-tuning-operator/tuned-77lh9"
Sep 17 15:54:45.591725 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.591706    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pk8l8\" (UniqueName: \"kubernetes.io/projected/d28f991c-888d-4396-8c52-e7dcb503799c-kube-api-access-pk8l8\") pod \"iptables-alerter-hp2s4\" (UID: \"d28f991c-888d-4396-8c52-e7dcb503799c\") " pod="openshift-network-operator/iptables-alerter-hp2s4"
Sep 17 15:54:45.591856 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.591840    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4vp7\" (UniqueName: \"kubernetes.io/projected/d7d3c798-4b01-4814-8e5c-c200c69dca8f-kube-api-access-v4vp7\") pod \"node-ca-9f2dg\" (UID: \"d7d3c798-4b01-4814-8e5c-c200c69dca8f\") " pod="openshift-image-registry/node-ca-9f2dg"
Sep 17 15:54:45.592342 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:45.592325    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 15:54:45.592342 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:45.592343    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 15:54:45.592441 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:45.592352    2584 projected.go:196] Error preparing data for projected volume kube-api-access-z65p7 for pod openshift-network-diagnostics/network-check-target-gg77s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 15:54:45.592441 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:45.592430    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34abf0a1-5178-487d-93af-577b29705d96-kube-api-access-z65p7 podName:34abf0a1-5178-487d-93af-577b29705d96 nodeName:}" failed. No retries permitted until 2026-09-17 15:54:46.092416855 +0000 UTC m=+3.706348366 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-z65p7" (UniqueName: "kubernetes.io/projected/34abf0a1-5178-487d-93af-577b29705d96-kube-api-access-z65p7") pod "network-check-target-gg77s" (UID: "34abf0a1-5178-487d-93af-577b29705d96") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 15:54:45.592545 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.592469    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4g82j\" (UniqueName: \"kubernetes.io/projected/b550e969-e4dd-4602-8d26-4a6275359d68-kube-api-access-4g82j\") pod \"network-metrics-daemon-nldm2\" (UID: \"b550e969-e4dd-4602-8d26-4a6275359d68\") " pod="openshift-multus/network-metrics-daemon-nldm2"
Sep 17 15:54:45.593200 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.593184    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nt4h2\" (UniqueName: \"kubernetes.io/projected/54d8c06c-72e7-4b77-b3b2-6698b7653944-kube-api-access-nt4h2\") pod \"ovnkube-node-z8nmw\" (UID: \"54d8c06c-72e7-4b77-b3b2-6698b7653944\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:54:45.594125 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.594106    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88xtl\" (UniqueName: \"kubernetes.io/projected/df579004-3b28-44fd-ac97-05faf9b54dad-kube-api-access-88xtl\") pod \"multus-additional-cni-plugins-bjftc\" (UID: \"df579004-3b28-44fd-ac97-05faf9b54dad\") " pod="openshift-multus/multus-additional-cni-plugins-bjftc"
Sep 17 15:54:45.601881 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.601865    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zh69p\" (UniqueName: \"kubernetes.io/projected/ffe5f446-e608-459a-90f3-de1bcccba341-kube-api-access-zh69p\") pod \"multus-fpptq\" (UID: \"ffe5f446-e608-459a-90f3-de1bcccba341\") " pod="openshift-multus/multus-fpptq"
Sep 17 15:54:45.690423 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.690383    2584 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 15:54:45.694810 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.694789    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9f2dg"
Sep 17 15:54:45.703509 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:45.703471    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7d3c798_4b01_4814_8e5c_c200c69dca8f.slice/crio-263d00d2d3ca3f50ca206a54822f8429ab1c99336a3a54ce47d3685b799121aa WatchSource:0}: Error finding container 263d00d2d3ca3f50ca206a54822f8429ab1c99336a3a54ce47d3685b799121aa: Status 404 returned error can't find the container with id 263d00d2d3ca3f50ca206a54822f8429ab1c99336a3a54ce47d3685b799121aa
Sep 17 15:54:45.706323 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.706296    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fpptq"
Sep 17 15:54:45.713640 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:45.713621    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffe5f446_e608_459a_90f3_de1bcccba341.slice/crio-159ca9e37fe144d171245b5ea4f9ab50255169fad79e4624881334026bca117e WatchSource:0}: Error finding container 159ca9e37fe144d171245b5ea4f9ab50255169fad79e4624881334026bca117e: Status 404 returned error can't find the container with id 159ca9e37fe144d171245b5ea4f9ab50255169fad79e4624881334026bca117e
Sep 17 15:54:45.721480 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.721464    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hp2s4"
Sep 17 15:54:45.725279 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.725265    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:54:45.729017 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:45.728999    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd28f991c_888d_4396_8c52_e7dcb503799c.slice/crio-bd93c3e65a41cd368d956a8216db7496ef12abc4b9861c0c8a3a6071ac6b50ce WatchSource:0}: Error finding container bd93c3e65a41cd368d956a8216db7496ef12abc4b9861c0c8a3a6071ac6b50ce: Status 404 returned error can't find the container with id bd93c3e65a41cd368d956a8216db7496ef12abc4b9861c0c8a3a6071ac6b50ce
Sep 17 15:54:45.733110 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:45.733092    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54d8c06c_72e7_4b77_b3b2_6698b7653944.slice/crio-a4111c332c7ae3b2dc6a30d98d65a3ff37d47c6fe923436e2d506259d5e5f7ab WatchSource:0}: Error finding container a4111c332c7ae3b2dc6a30d98d65a3ff37d47c6fe923436e2d506259d5e5f7ab: Status 404 returned error can't find the container with id a4111c332c7ae3b2dc6a30d98d65a3ff37d47c6fe923436e2d506259d5e5f7ab
Sep 17 15:54:45.742414 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.742398    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xjhfp"
Sep 17 15:54:45.750810 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:45.750792    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod800c58de_09f2_471c_a4c6_eaa0ed41ad9b.slice/crio-ae90e4d6e865f937496909c077463ad396c0c97b82095a254fdc73e2537ad6c1 WatchSource:0}: Error finding container ae90e4d6e865f937496909c077463ad396c0c97b82095a254fdc73e2537ad6c1: Status 404 returned error can't find the container with id ae90e4d6e865f937496909c077463ad396c0c97b82095a254fdc73e2537ad6c1
Sep 17 15:54:45.758031 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.758012    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-77lh9"
Sep 17 15:54:45.765021 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:45.765003    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d4dd8b6_ef54_48cd_82d5_0a91da88af5a.slice/crio-3b36b2dba1b13aec535961a8419ad187d3ad917df81bdfb64125c045435bc507 WatchSource:0}: Error finding container 3b36b2dba1b13aec535961a8419ad187d3ad917df81bdfb64125c045435bc507: Status 404 returned error can't find the container with id 3b36b2dba1b13aec535961a8419ad187d3ad917df81bdfb64125c045435bc507
Sep 17 15:54:45.774508 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.774474    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bjftc"
Sep 17 15:54:45.781565 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:45.781547    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf579004_3b28_44fd_ac97_05faf9b54dad.slice/crio-0cdac08ef95907ae2a814718fe251be0f4bf9fa8e47ec79e3fdc7ecdb37e9ced WatchSource:0}: Error finding container 0cdac08ef95907ae2a814718fe251be0f4bf9fa8e47ec79e3fdc7ecdb37e9ced: Status 404 returned error can't find the container with id 0cdac08ef95907ae2a814718fe251be0f4bf9fa8e47ec79e3fdc7ecdb37e9ced
Sep 17 15:54:45.781656 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.781599    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zlcqk"
Sep 17 15:54:45.786053 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.786038    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-x4mhf"
Sep 17 15:54:45.790238 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:45.790222    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e359937_2c4a_45c6_92b6_3c82ee32c922.slice/crio-d8dc3f521aefacce4aac8fd2df3d8a0fbae85679243c82c47fb9aaf651b8c189 WatchSource:0}: Error finding container d8dc3f521aefacce4aac8fd2df3d8a0fbae85679243c82c47fb9aaf651b8c189: Status 404 returned error can't find the container with id d8dc3f521aefacce4aac8fd2df3d8a0fbae85679243c82c47fb9aaf651b8c189
Sep 17 15:54:45.794466 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:54:45.794449    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9fd9b22_055f_4540_92c9_6c75c0c14fe3.slice/crio-6ace4905b7260c0fe1fae3327bfbd7cbf799f36275565cecb52e3272f31d9272 WatchSource:0}: Error finding container 6ace4905b7260c0fe1fae3327bfbd7cbf799f36275565cecb52e3272f31d9272: Status 404 returned error can't find the container with id 6ace4905b7260c0fe1fae3327bfbd7cbf799f36275565cecb52e3272f31d9272
Sep 17 15:54:45.885682 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:45.885657    2584 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 15:54:46.072633 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:46.072554    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/46630785-5a7e-496b-86fe-d32e237c8c1b-original-pull-secret\") pod \"global-pull-secret-syncer-7xl8l\" (UID: \"46630785-5a7e-496b-86fe-d32e237c8c1b\") " pod="kube-system/global-pull-secret-syncer-7xl8l"
Sep 17 15:54:46.072633 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:46.072595    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b550e969-e4dd-4602-8d26-4a6275359d68-metrics-certs\") pod \"network-metrics-daemon-nldm2\" (UID: \"b550e969-e4dd-4602-8d26-4a6275359d68\") " pod="openshift-multus/network-metrics-daemon-nldm2"
Sep 17 15:54:46.072827 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:46.072715    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 15:54:46.072827 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:46.072769    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b550e969-e4dd-4602-8d26-4a6275359d68-metrics-certs podName:b550e969-e4dd-4602-8d26-4a6275359d68 nodeName:}" failed. No retries permitted until 2026-09-17 15:54:47.072752006 +0000 UTC m=+4.686683516 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b550e969-e4dd-4602-8d26-4a6275359d68-metrics-certs") pod "network-metrics-daemon-nldm2" (UID: "b550e969-e4dd-4602-8d26-4a6275359d68") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 15:54:46.073114 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:46.073095    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 15:54:46.073237 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:46.073144    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46630785-5a7e-496b-86fe-d32e237c8c1b-original-pull-secret podName:46630785-5a7e-496b-86fe-d32e237c8c1b nodeName:}" failed. No retries permitted until 2026-09-17 15:54:47.073130111 +0000 UTC m=+4.687061606 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/46630785-5a7e-496b-86fe-d32e237c8c1b-original-pull-secret") pod "global-pull-secret-syncer-7xl8l" (UID: "46630785-5a7e-496b-86fe-d32e237c8c1b") : object "kube-system"/"original-pull-secret" not registered
Sep 17 15:54:46.174299 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:46.173778    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z65p7\" (UniqueName: \"kubernetes.io/projected/34abf0a1-5178-487d-93af-577b29705d96-kube-api-access-z65p7\") pod \"network-check-target-gg77s\" (UID: \"34abf0a1-5178-487d-93af-577b29705d96\") " pod="openshift-network-diagnostics/network-check-target-gg77s"
Sep 17 15:54:46.174299 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:46.173915    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 15:54:46.174299 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:46.173932    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 15:54:46.174299 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:46.173944    2584 projected.go:196] Error preparing data for projected volume kube-api-access-z65p7 for pod openshift-network-diagnostics/network-check-target-gg77s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 15:54:46.174299 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:46.173995    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34abf0a1-5178-487d-93af-577b29705d96-kube-api-access-z65p7 podName:34abf0a1-5178-487d-93af-577b29705d96 nodeName:}" failed. No retries permitted until 2026-09-17 15:54:47.173979063 +0000 UTC m=+4.787910566 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-z65p7" (UniqueName: "kubernetes.io/projected/34abf0a1-5178-487d-93af-577b29705d96-kube-api-access-z65p7") pod "network-check-target-gg77s" (UID: "34abf0a1-5178-487d-93af-577b29705d96") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 15:54:46.481593 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:46.481425    2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 15:49:45 +0000 UTC" deadline="2028-04-04 01:51:14.768756777 +0000 UTC"
Sep 17 15:54:46.481593 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:46.481482    2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13545h56m28.287279307s"
Sep 17 15:54:46.514998 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:46.514247    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nldm2"
Sep 17 15:54:46.514998 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:46.514391    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nldm2" podUID="b550e969-e4dd-4602-8d26-4a6275359d68"
Sep 17 15:54:46.538262 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:46.538156    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hp2s4" event={"ID":"d28f991c-888d-4396-8c52-e7dcb503799c","Type":"ContainerStarted","Data":"bd93c3e65a41cd368d956a8216db7496ef12abc4b9861c0c8a3a6071ac6b50ce"}
Sep 17 15:54:46.541041 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:46.541017    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9f2dg" event={"ID":"d7d3c798-4b01-4814-8e5c-c200c69dca8f","Type":"ContainerStarted","Data":"263d00d2d3ca3f50ca206a54822f8429ab1c99336a3a54ce47d3685b799121aa"}
Sep 17 15:54:46.547075 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:46.547050    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bjftc" event={"ID":"df579004-3b28-44fd-ac97-05faf9b54dad","Type":"ContainerStarted","Data":"0cdac08ef95907ae2a814718fe251be0f4bf9fa8e47ec79e3fdc7ecdb37e9ced"}
Sep 17 15:54:46.562941 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:46.562918    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xjhfp" event={"ID":"800c58de-09f2-471c-a4c6-eaa0ed41ad9b","Type":"ContainerStarted","Data":"ae90e4d6e865f937496909c077463ad396c0c97b82095a254fdc73e2537ad6c1"}
Sep 17 15:54:46.569554 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:46.569514    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw" event={"ID":"54d8c06c-72e7-4b77-b3b2-6698b7653944","Type":"ContainerStarted","Data":"a4111c332c7ae3b2dc6a30d98d65a3ff37d47c6fe923436e2d506259d5e5f7ab"}
Sep 17 15:54:46.596543 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:46.596517    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fpptq" event={"ID":"ffe5f446-e608-459a-90f3-de1bcccba341","Type":"ContainerStarted","Data":"159ca9e37fe144d171245b5ea4f9ab50255169fad79e4624881334026bca117e"}
Sep 17 15:54:46.604844 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:46.604819    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-191.ec2.internal" event={"ID":"311e9dffa75dc15b9f976eb249bd6092","Type":"ContainerStarted","Data":"46055ed7e0be2e8949174b5fecbecd55d0e09052427585166ab894e8e806fe9d"}
Sep 17 15:54:46.615480 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:46.615438    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-191.ec2.internal" event={"ID":"dc8c9739f6c89ebc2ed109ba6e1e7b17","Type":"ContainerStarted","Data":"35796b2f44dd017defaa00e7e2f72c70519c46b9ef7e582a53e4c8db3e845dfa"}
Sep 17 15:54:46.620639 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:46.620616    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-x4mhf" event={"ID":"b9fd9b22-055f-4540-92c9-6c75c0c14fe3","Type":"ContainerStarted","Data":"6ace4905b7260c0fe1fae3327bfbd7cbf799f36275565cecb52e3272f31d9272"}
Sep 17 15:54:46.629270 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:46.629246    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zlcqk" event={"ID":"9e359937-2c4a-45c6-92b6-3c82ee32c922","Type":"ContainerStarted","Data":"d8dc3f521aefacce4aac8fd2df3d8a0fbae85679243c82c47fb9aaf651b8c189"}
Sep 17 15:54:46.637757 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:46.636073    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-77lh9" event={"ID":"5d4dd8b6-ef54-48cd-82d5-0a91da88af5a","Type":"ContainerStarted","Data":"3b36b2dba1b13aec535961a8419ad187d3ad917df81bdfb64125c045435bc507"}
Sep 17 15:54:46.852038 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:46.851953    2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 15:54:47.023737 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:47.023690    2584 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 15:54:47.080487 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:47.080454    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/46630785-5a7e-496b-86fe-d32e237c8c1b-original-pull-secret\") pod \"global-pull-secret-syncer-7xl8l\" (UID: \"46630785-5a7e-496b-86fe-d32e237c8c1b\") " pod="kube-system/global-pull-secret-syncer-7xl8l"
Sep 17 15:54:47.080665 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:47.080516    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b550e969-e4dd-4602-8d26-4a6275359d68-metrics-certs\") pod \"network-metrics-daemon-nldm2\" (UID: \"b550e969-e4dd-4602-8d26-4a6275359d68\") " pod="openshift-multus/network-metrics-daemon-nldm2"
Sep 17 15:54:47.080775 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:47.080685    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 15:54:47.080838 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:47.080780    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b550e969-e4dd-4602-8d26-4a6275359d68-metrics-certs podName:b550e969-e4dd-4602-8d26-4a6275359d68 nodeName:}" failed. No retries permitted until 2026-09-17 15:54:49.080761062 +0000 UTC m=+6.694692550 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b550e969-e4dd-4602-8d26-4a6275359d68-metrics-certs") pod "network-metrics-daemon-nldm2" (UID: "b550e969-e4dd-4602-8d26-4a6275359d68") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 15:54:47.080896 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:47.080857    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 15:54:47.080896 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:47.080890    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46630785-5a7e-496b-86fe-d32e237c8c1b-original-pull-secret podName:46630785-5a7e-496b-86fe-d32e237c8c1b nodeName:}" failed. No retries permitted until 2026-09-17 15:54:49.080879465 +0000 UTC m=+6.694810970 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/46630785-5a7e-496b-86fe-d32e237c8c1b-original-pull-secret") pod "global-pull-secret-syncer-7xl8l" (UID: "46630785-5a7e-496b-86fe-d32e237c8c1b") : object "kube-system"/"original-pull-secret" not registered
Sep 17 15:54:47.181971 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:47.181890    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z65p7\" (UniqueName: \"kubernetes.io/projected/34abf0a1-5178-487d-93af-577b29705d96-kube-api-access-z65p7\") pod \"network-check-target-gg77s\" (UID: \"34abf0a1-5178-487d-93af-577b29705d96\") " pod="openshift-network-diagnostics/network-check-target-gg77s"
Sep 17 15:54:47.182149 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:47.182071    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 15:54:47.182149 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:47.182092    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 15:54:47.182149 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:47.182104    2584 projected.go:196] Error preparing data for projected volume kube-api-access-z65p7 for pod openshift-network-diagnostics/network-check-target-gg77s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 15:54:47.182416 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:47.182155    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34abf0a1-5178-487d-93af-577b29705d96-kube-api-access-z65p7 podName:34abf0a1-5178-487d-93af-577b29705d96 nodeName:}" failed. No retries permitted until 2026-09-17 15:54:49.182139516 +0000 UTC m=+6.796071027 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-z65p7" (UniqueName: "kubernetes.io/projected/34abf0a1-5178-487d-93af-577b29705d96-kube-api-access-z65p7") pod "network-check-target-gg77s" (UID: "34abf0a1-5178-487d-93af-577b29705d96") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 15:54:47.481773 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:47.481632    2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 15:49:45 +0000 UTC" deadline="2028-04-03 14:31:49.871919434 +0000 UTC"
Sep 17 15:54:47.481773 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:47.481666    2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13534h37m2.390258197s"
Sep 17 15:54:47.511465 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:47.511441    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gg77s"
Sep 17 15:54:47.511627 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:47.511573    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gg77s" podUID="34abf0a1-5178-487d-93af-577b29705d96"
Sep 17 15:54:47.511982 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:47.511963    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7xl8l"
Sep 17 15:54:47.512079 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:47.512060    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7xl8l" podUID="46630785-5a7e-496b-86fe-d32e237c8c1b"
Sep 17 15:54:48.513955 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:48.513926    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nldm2"
Sep 17 15:54:48.514432 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:48.514057    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nldm2" podUID="b550e969-e4dd-4602-8d26-4a6275359d68"
Sep 17 15:54:49.098524 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:49.098120    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/46630785-5a7e-496b-86fe-d32e237c8c1b-original-pull-secret\") pod \"global-pull-secret-syncer-7xl8l\" (UID: \"46630785-5a7e-496b-86fe-d32e237c8c1b\") " pod="kube-system/global-pull-secret-syncer-7xl8l"
Sep 17 15:54:49.098524 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:49.098168    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b550e969-e4dd-4602-8d26-4a6275359d68-metrics-certs\") pod \"network-metrics-daemon-nldm2\" (UID: \"b550e969-e4dd-4602-8d26-4a6275359d68\") " pod="openshift-multus/network-metrics-daemon-nldm2"
Sep 17 15:54:49.098524 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:49.098342    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 15:54:49.098524 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:49.098411    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b550e969-e4dd-4602-8d26-4a6275359d68-metrics-certs podName:b550e969-e4dd-4602-8d26-4a6275359d68 nodeName:}" failed. No retries permitted until 2026-09-17 15:54:53.098393351 +0000 UTC m=+10.712324852 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b550e969-e4dd-4602-8d26-4a6275359d68-metrics-certs") pod "network-metrics-daemon-nldm2" (UID: "b550e969-e4dd-4602-8d26-4a6275359d68") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 15:54:49.098992 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:49.098645    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 15:54:49.098992 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:49.098715    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46630785-5a7e-496b-86fe-d32e237c8c1b-original-pull-secret podName:46630785-5a7e-496b-86fe-d32e237c8c1b nodeName:}" failed. No retries permitted until 2026-09-17 15:54:53.098698052 +0000 UTC m=+10.712629557 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/46630785-5a7e-496b-86fe-d32e237c8c1b-original-pull-secret") pod "global-pull-secret-syncer-7xl8l" (UID: "46630785-5a7e-496b-86fe-d32e237c8c1b") : object "kube-system"/"original-pull-secret" not registered
Sep 17 15:54:49.199709 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:49.199193    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z65p7\" (UniqueName: \"kubernetes.io/projected/34abf0a1-5178-487d-93af-577b29705d96-kube-api-access-z65p7\") pod \"network-check-target-gg77s\" (UID: \"34abf0a1-5178-487d-93af-577b29705d96\") " pod="openshift-network-diagnostics/network-check-target-gg77s"
Sep 17 15:54:49.199709 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:49.199338    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 15:54:49.199709 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:49.199359    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 15:54:49.199709 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:49.199374    2584 projected.go:196] Error preparing data for projected volume kube-api-access-z65p7 for pod openshift-network-diagnostics/network-check-target-gg77s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 15:54:49.199709 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:49.199425    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34abf0a1-5178-487d-93af-577b29705d96-kube-api-access-z65p7 podName:34abf0a1-5178-487d-93af-577b29705d96 nodeName:}" failed. No retries permitted until 2026-09-17 15:54:53.199409251 +0000 UTC m=+10.813340754 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-z65p7" (UniqueName: "kubernetes.io/projected/34abf0a1-5178-487d-93af-577b29705d96-kube-api-access-z65p7") pod "network-check-target-gg77s" (UID: "34abf0a1-5178-487d-93af-577b29705d96") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 15:54:49.511551 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:49.511454    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7xl8l"
Sep 17 15:54:49.511705 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:49.511595    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7xl8l" podUID="46630785-5a7e-496b-86fe-d32e237c8c1b"
Sep 17 15:54:49.511846 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:49.511828    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gg77s"
Sep 17 15:54:49.511954 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:49.511933    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gg77s" podUID="34abf0a1-5178-487d-93af-577b29705d96"
Sep 17 15:54:50.511962 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:50.511469    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nldm2"
Sep 17 15:54:50.511962 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:50.511621    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nldm2" podUID="b550e969-e4dd-4602-8d26-4a6275359d68"
Sep 17 15:54:51.511772 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:51.511739    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7xl8l"
Sep 17 15:54:51.511960 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:51.511868    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7xl8l" podUID="46630785-5a7e-496b-86fe-d32e237c8c1b"
Sep 17 15:54:51.512222 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:51.512203    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gg77s"
Sep 17 15:54:51.512582 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:51.512291    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gg77s" podUID="34abf0a1-5178-487d-93af-577b29705d96"
Sep 17 15:54:52.513682 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:52.513602    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nldm2"
Sep 17 15:54:52.514130 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:52.513718    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nldm2" podUID="b550e969-e4dd-4602-8d26-4a6275359d68"
Sep 17 15:54:53.130450 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:53.130415    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/46630785-5a7e-496b-86fe-d32e237c8c1b-original-pull-secret\") pod \"global-pull-secret-syncer-7xl8l\" (UID: \"46630785-5a7e-496b-86fe-d32e237c8c1b\") " pod="kube-system/global-pull-secret-syncer-7xl8l"
Sep 17 15:54:53.130450 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:53.130452    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b550e969-e4dd-4602-8d26-4a6275359d68-metrics-certs\") pod \"network-metrics-daemon-nldm2\" (UID: \"b550e969-e4dd-4602-8d26-4a6275359d68\") " pod="openshift-multus/network-metrics-daemon-nldm2"
Sep 17 15:54:53.130692 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:53.130588    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 15:54:53.130692 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:53.130645    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b550e969-e4dd-4602-8d26-4a6275359d68-metrics-certs podName:b550e969-e4dd-4602-8d26-4a6275359d68 nodeName:}" failed. No retries permitted until 2026-09-17 15:55:01.13062673 +0000 UTC m=+18.744558232 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b550e969-e4dd-4602-8d26-4a6275359d68-metrics-certs") pod "network-metrics-daemon-nldm2" (UID: "b550e969-e4dd-4602-8d26-4a6275359d68") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 15:54:53.131034 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:53.131015    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 15:54:53.131085 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:53.131071    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46630785-5a7e-496b-86fe-d32e237c8c1b-original-pull-secret podName:46630785-5a7e-496b-86fe-d32e237c8c1b nodeName:}" failed. No retries permitted until 2026-09-17 15:55:01.131055937 +0000 UTC m=+18.744987440 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/46630785-5a7e-496b-86fe-d32e237c8c1b-original-pull-secret") pod "global-pull-secret-syncer-7xl8l" (UID: "46630785-5a7e-496b-86fe-d32e237c8c1b") : object "kube-system"/"original-pull-secret" not registered
Sep 17 15:54:53.231352 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:53.231319    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z65p7\" (UniqueName: \"kubernetes.io/projected/34abf0a1-5178-487d-93af-577b29705d96-kube-api-access-z65p7\") pod \"network-check-target-gg77s\" (UID: \"34abf0a1-5178-487d-93af-577b29705d96\") " pod="openshift-network-diagnostics/network-check-target-gg77s"
Sep 17 15:54:53.231524 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:53.231475    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 15:54:53.231524 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:53.231506    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 15:54:53.231524 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:53.231518    2584 projected.go:196] Error preparing data for projected volume kube-api-access-z65p7 for pod openshift-network-diagnostics/network-check-target-gg77s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 15:54:53.231656 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:53.231559    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34abf0a1-5178-487d-93af-577b29705d96-kube-api-access-z65p7 podName:34abf0a1-5178-487d-93af-577b29705d96 nodeName:}" failed. No retries permitted until 2026-09-17 15:55:01.231546991 +0000 UTC m=+18.845478492 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-z65p7" (UniqueName: "kubernetes.io/projected/34abf0a1-5178-487d-93af-577b29705d96-kube-api-access-z65p7") pod "network-check-target-gg77s" (UID: "34abf0a1-5178-487d-93af-577b29705d96") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 15:54:53.511842 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:53.511252    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7xl8l"
Sep 17 15:54:53.511842 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:53.511300    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gg77s"
Sep 17 15:54:53.511842 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:53.511424    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7xl8l" podUID="46630785-5a7e-496b-86fe-d32e237c8c1b"
Sep 17 15:54:53.511842 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:53.511522    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gg77s" podUID="34abf0a1-5178-487d-93af-577b29705d96"
Sep 17 15:54:54.511920 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:54.511889    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nldm2"
Sep 17 15:54:54.512325 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:54.511991    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nldm2" podUID="b550e969-e4dd-4602-8d26-4a6275359d68"
Sep 17 15:54:55.512021 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:55.511975    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7xl8l"
Sep 17 15:54:55.512557 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:55.511979    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gg77s"
Sep 17 15:54:55.512557 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:55.512117    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7xl8l" podUID="46630785-5a7e-496b-86fe-d32e237c8c1b"
Sep 17 15:54:55.512557 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:55.512198    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gg77s" podUID="34abf0a1-5178-487d-93af-577b29705d96"
Sep 17 15:54:56.512078 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:56.512045    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nldm2"
Sep 17 15:54:56.512526 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:56.512156    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nldm2" podUID="b550e969-e4dd-4602-8d26-4a6275359d68"
Sep 17 15:54:57.511361 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:57.511337    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7xl8l"
Sep 17 15:54:57.511536 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:57.511337    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gg77s"
Sep 17 15:54:57.511536 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:57.511429    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7xl8l" podUID="46630785-5a7e-496b-86fe-d32e237c8c1b"
Sep 17 15:54:57.511629 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:57.511546    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gg77s" podUID="34abf0a1-5178-487d-93af-577b29705d96"
Sep 17 15:54:58.511603 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:58.511570    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nldm2"
Sep 17 15:54:58.512011 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:58.511702    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nldm2" podUID="b550e969-e4dd-4602-8d26-4a6275359d68"
Sep 17 15:54:59.511703 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:59.511673    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7xl8l"
Sep 17 15:54:59.512181 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:54:59.511679    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gg77s"
Sep 17 15:54:59.512181 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:59.511772    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7xl8l" podUID="46630785-5a7e-496b-86fe-d32e237c8c1b"
Sep 17 15:54:59.512181 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:54:59.511876    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gg77s" podUID="34abf0a1-5178-487d-93af-577b29705d96"
Sep 17 15:55:00.511703 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:00.511678    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nldm2"
Sep 17 15:55:00.511821 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:00.511781    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nldm2" podUID="b550e969-e4dd-4602-8d26-4a6275359d68"
Sep 17 15:55:01.192262 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:01.192218    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/46630785-5a7e-496b-86fe-d32e237c8c1b-original-pull-secret\") pod \"global-pull-secret-syncer-7xl8l\" (UID: \"46630785-5a7e-496b-86fe-d32e237c8c1b\") " pod="kube-system/global-pull-secret-syncer-7xl8l"
Sep 17 15:55:01.192262 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:01.192260    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b550e969-e4dd-4602-8d26-4a6275359d68-metrics-certs\") pod \"network-metrics-daemon-nldm2\" (UID: \"b550e969-e4dd-4602-8d26-4a6275359d68\") " pod="openshift-multus/network-metrics-daemon-nldm2"
Sep 17 15:55:01.192600 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:01.192381    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 15:55:01.192600 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:01.192381    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 15:55:01.192600 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:01.192451    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b550e969-e4dd-4602-8d26-4a6275359d68-metrics-certs podName:b550e969-e4dd-4602-8d26-4a6275359d68 nodeName:}" failed. No retries permitted until 2026-09-17 15:55:17.19242979 +0000 UTC m=+34.806361298 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b550e969-e4dd-4602-8d26-4a6275359d68-metrics-certs") pod "network-metrics-daemon-nldm2" (UID: "b550e969-e4dd-4602-8d26-4a6275359d68") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 15:55:01.192600 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:01.192471    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46630785-5a7e-496b-86fe-d32e237c8c1b-original-pull-secret podName:46630785-5a7e-496b-86fe-d32e237c8c1b nodeName:}" failed. No retries permitted until 2026-09-17 15:55:17.192461463 +0000 UTC m=+34.806392956 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/46630785-5a7e-496b-86fe-d32e237c8c1b-original-pull-secret") pod "global-pull-secret-syncer-7xl8l" (UID: "46630785-5a7e-496b-86fe-d32e237c8c1b") : object "kube-system"/"original-pull-secret" not registered
Sep 17 15:55:01.293106 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:01.293081    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z65p7\" (UniqueName: \"kubernetes.io/projected/34abf0a1-5178-487d-93af-577b29705d96-kube-api-access-z65p7\") pod \"network-check-target-gg77s\" (UID: \"34abf0a1-5178-487d-93af-577b29705d96\") " pod="openshift-network-diagnostics/network-check-target-gg77s"
Sep 17 15:55:01.293253 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:01.293215    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 15:55:01.293253 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:01.293233    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 15:55:01.293253 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:01.293242    2584 projected.go:196] Error preparing data for projected volume kube-api-access-z65p7 for pod openshift-network-diagnostics/network-check-target-gg77s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 15:55:01.293367 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:01.293297    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34abf0a1-5178-487d-93af-577b29705d96-kube-api-access-z65p7 podName:34abf0a1-5178-487d-93af-577b29705d96 nodeName:}" failed. No retries permitted until 2026-09-17 15:55:17.293280609 +0000 UTC m=+34.907212101 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-z65p7" (UniqueName: "kubernetes.io/projected/34abf0a1-5178-487d-93af-577b29705d96-kube-api-access-z65p7") pod "network-check-target-gg77s" (UID: "34abf0a1-5178-487d-93af-577b29705d96") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 15:55:01.511591 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:01.511524    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7xl8l"
Sep 17 15:55:01.511591 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:01.511563    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gg77s"
Sep 17 15:55:01.511797 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:01.511651    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7xl8l" podUID="46630785-5a7e-496b-86fe-d32e237c8c1b"
Sep 17 15:55:01.511797 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:01.511778    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gg77s" podUID="34abf0a1-5178-487d-93af-577b29705d96"
Sep 17 15:55:02.511212 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:02.511179    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nldm2"
Sep 17 15:55:02.511379 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:02.511312    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nldm2" podUID="b550e969-e4dd-4602-8d26-4a6275359d68"
Sep 17 15:55:03.511719 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:03.511688    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gg77s"
Sep 17 15:55:03.512127 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:03.511695    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7xl8l"
Sep 17 15:55:03.512127 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:03.511805    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gg77s" podUID="34abf0a1-5178-487d-93af-577b29705d96"
Sep 17 15:55:03.512127 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:03.511896    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7xl8l" podUID="46630785-5a7e-496b-86fe-d32e237c8c1b"
Sep 17 15:55:04.513290 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:04.513265    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nldm2"
Sep 17 15:55:04.513618 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:04.513354    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nldm2" podUID="b550e969-e4dd-4602-8d26-4a6275359d68"
Sep 17 15:55:04.710005 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:04.709824    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-77lh9" event={"ID":"5d4dd8b6-ef54-48cd-82d5-0a91da88af5a","Type":"ContainerStarted","Data":"32498f969ff9dc9b25eb26f65910ebd3bc1a43faacabfaaa43267d1248130ca3"}
Sep 17 15:55:04.726574 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:04.726127    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-191.ec2.internal" event={"ID":"311e9dffa75dc15b9f976eb249bd6092","Type":"ContainerStarted","Data":"9ae75d4499d236814c3480559c1627cab0e8863565065f47b39fe397ddd29f18"}
Sep 17 15:55:04.726574 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:04.726365    2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-191.ec2.internal"
Sep 17 15:55:04.750854 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:04.750482    2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 17 15:55:04.751434 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:04.751270    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-77lh9" podStartSLOduration=2.027876507 podStartE2EDuration="20.75125287s" totalImagesPullingTime="18.723376363s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 15:54:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:55:04.735313548 +0000 UTC m=+22.349245057" watchObservedRunningTime="2026-09-17 15:55:04.75125287 +0000 UTC m=+22.365184380"
Sep 17 15:55:04.751434 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:04.751423    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-128-191.ec2.internal"]
Sep 17 15:55:05.511425 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:05.511358    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7xl8l"
Sep 17 15:55:05.511425 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:05.511401    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gg77s"
Sep 17 15:55:05.511646 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:05.511479    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7xl8l" podUID="46630785-5a7e-496b-86fe-d32e237c8c1b"
Sep 17 15:55:05.511704 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:05.511644    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gg77s" podUID="34abf0a1-5178-487d-93af-577b29705d96"
Sep 17 15:55:05.729896 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:05.729862    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9f2dg" event={"ID":"d7d3c798-4b01-4814-8e5c-c200c69dca8f","Type":"ContainerStarted","Data":"3d4c2128dc84293ee77678ba59c8c477b247719d31890ebb9f1a3a2f9520e18d"}
Sep 17 15:55:05.732157 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:05.732127    2584 generic.go:356] "Generic (PLEG): container finished" podID="df579004-3b28-44fd-ac97-05faf9b54dad" containerID="e3021dc125501eb16a6dc7b20888155e7bd765a39aabb90672d49e633acfd647" exitCode=0
Sep 17 15:55:05.732305 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:05.732228    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bjftc" event={"ID":"df579004-3b28-44fd-ac97-05faf9b54dad","Type":"ContainerDied","Data":"e3021dc125501eb16a6dc7b20888155e7bd765a39aabb90672d49e633acfd647"}
Sep 17 15:55:05.734203 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:05.734161    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xjhfp" event={"ID":"800c58de-09f2-471c-a4c6-eaa0ed41ad9b","Type":"ContainerStarted","Data":"ea368130b8d3a2ee04087f9f0e464f189bd629f50dc3fe67272c97cd79ebeb1b"}
Sep 17 15:55:05.737604 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:05.737580    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw" event={"ID":"54d8c06c-72e7-4b77-b3b2-6698b7653944","Type":"ContainerStarted","Data":"ef96329d2bad60f32f8fb9a6002e45f1acba2a291a7069915a1c385d8c0ccda6"}
Sep 17 15:55:05.737706 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:05.737662    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw" event={"ID":"54d8c06c-72e7-4b77-b3b2-6698b7653944","Type":"ContainerStarted","Data":"d84c072732aac07ed50cb8f0241c00f8f71ef37b518fd54fa47b2e602186c469"}
Sep 17 15:55:05.737769 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:05.737714    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw" event={"ID":"54d8c06c-72e7-4b77-b3b2-6698b7653944","Type":"ContainerStarted","Data":"f585eef95d1d5ea15bda88823a1c9334cf95659cef80c4326da73f4ecade6721"}
Sep 17 15:55:05.737769 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:05.737752    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw" event={"ID":"54d8c06c-72e7-4b77-b3b2-6698b7653944","Type":"ContainerStarted","Data":"1c3b15a5847fa29d0099ed6a556898474616b8781066f99b6a654c950b1bc1bd"}
Sep 17 15:55:05.737842 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:05.737789    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw" event={"ID":"54d8c06c-72e7-4b77-b3b2-6698b7653944","Type":"ContainerStarted","Data":"de69b41a819a84c1a17bcd1fdf1e2fb233235b76eea3bbe516b4989b68d3b923"}
Sep 17 15:55:05.737842 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:05.737818    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw" event={"ID":"54d8c06c-72e7-4b77-b3b2-6698b7653944","Type":"ContainerStarted","Data":"55866f6ba3d0e85ce7e76fb9b13bdcd9b65f3276427b62eedb71544afd62007b"}
Sep 17 15:55:05.739147 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:05.739126    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fpptq" event={"ID":"ffe5f446-e608-459a-90f3-de1bcccba341","Type":"ContainerStarted","Data":"15e53cacd277643acf1ab59cbeb6fa4aadd31deab63a6c60c6ecdf478cbc3575"}
Sep 17 15:55:05.740756 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:05.740732    2584 generic.go:356] "Generic (PLEG): container finished" podID="dc8c9739f6c89ebc2ed109ba6e1e7b17" containerID="2e48fcb09be409b378bf75da349dcd64a3205162b0becc8a01feb216c3f9d001" exitCode=0
Sep 17 15:55:05.740845 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:05.740771    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-191.ec2.internal" event={"ID":"dc8c9739f6c89ebc2ed109ba6e1e7b17","Type":"ContainerDied","Data":"2e48fcb09be409b378bf75da349dcd64a3205162b0becc8a01feb216c3f9d001"}
Sep 17 15:55:05.742318 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:05.742297    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-x4mhf" event={"ID":"b9fd9b22-055f-4540-92c9-6c75c0c14fe3","Type":"ContainerStarted","Data":"21ac15face3bb59becb0302af02617df8a6518773a6e2f387da1db6b4dc93e89"}
Sep 17 15:55:05.743769 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:05.743744    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zlcqk" event={"ID":"9e359937-2c4a-45c6-92b6-3c82ee32c922","Type":"ContainerStarted","Data":"507f5820390f90de62572669b1a963a458c49de04694467786a045795453e56e"}
Sep 17 15:55:05.744003 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:05.743988    2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-191.ec2.internal"
Sep 17 15:55:05.751131 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:05.751096    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-191.ec2.internal" podStartSLOduration=1.7510855250000001 podStartE2EDuration="1.751085525s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 15:55:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:55:05.750705999 +0000 UTC m=+23.364637509" watchObservedRunningTime="2026-09-17 15:55:05.751085525 +0000 UTC m=+23.365017035"
Sep 17 15:55:05.755852 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:05.755833    2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 17 15:55:05.755960 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:05.755885    2584 kubelet.go:3250] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-128-191.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-191.ec2.internal"
Sep 17 15:55:05.771360 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:05.771269    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9f2dg" podStartSLOduration=3.032596783 podStartE2EDuration="21.771253595s" totalImagesPullingTime="18.738656812s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 15:54:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:55:05.770773119 +0000 UTC m=+23.384704628" watchObservedRunningTime="2026-09-17 15:55:05.771253595 +0000 UTC m=+23.385185105"
Sep 17 15:55:05.839792 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:05.839758    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zlcqk" podStartSLOduration=2.187547416 podStartE2EDuration="20.839747845s" totalImagesPullingTime="18.652200429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:54:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:55:05.818915066 +0000 UTC m=+23.432846576" watchObservedRunningTime="2026-09-17 15:55:05.839747845 +0000 UTC m=+23.453679352"
Sep 17 15:55:05.862736 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:05.862700    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-fpptq" podStartSLOduration=2.880946366 podStartE2EDuration="21.862685584s" totalImagesPullingTime="18.981739218s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 15:54:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:55:05.862652881 +0000 UTC m=+23.476584389" watchObservedRunningTime="2026-09-17 15:55:05.862685584 +0000 UTC m=+23.476617095"
Sep 17 15:55:05.884551 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:05.884521    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-x4mhf" podStartSLOduration=2.190797782 podStartE2EDuration="20.884511947s" totalImagesPullingTime="18.693714165s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 15:54:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:55:05.884437271 +0000 UTC m=+23.498368781" watchObservedRunningTime="2026-09-17 15:55:05.884511947 +0000 UTC m=+23.498443451"
Sep 17 15:55:06.196974 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:06.196954    2584 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 17 15:55:06.441143 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:06.441042    2584 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-17T15:55:06.196969918Z","UUID":"b7982dfb-4a57-47a2-85ad-2b0fe8023bf5","Handler":null,"Name":"","Endpoint":""}
Sep 17 15:55:06.443951 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:06.443930    2584 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 17 15:55:06.444076 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:06.443965    2584 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 17 15:55:06.515222 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:06.515196    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nldm2"
Sep 17 15:55:06.515337 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:06.515313    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nldm2" podUID="b550e969-e4dd-4602-8d26-4a6275359d68"
Sep 17 15:55:06.748522 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:06.748397    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-191.ec2.internal" event={"ID":"dc8c9739f6c89ebc2ed109ba6e1e7b17","Type":"ContainerStarted","Data":"e7e0a747be9678ad114b15a54716a78647ac3676ffbd27c77326272a27f9a16c"}
Sep 17 15:55:06.750290 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:06.750121    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hp2s4" event={"ID":"d28f991c-888d-4396-8c52-e7dcb503799c","Type":"ContainerStarted","Data":"489333bb8aa493392714aca459b3cdd0484c37117bfa9a77e0e7de22f1ac1027"}
Sep 17 15:55:06.752081 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:06.752055    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xjhfp" event={"ID":"800c58de-09f2-471c-a4c6-eaa0ed41ad9b","Type":"ContainerStarted","Data":"ae865353dca71a8af6bd86ba8effe3fc2646005f36137ae8b308e1b90d22d309"}
Sep 17 15:55:06.797816 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:06.797769    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-191.ec2.internal" podStartSLOduration=21.797756177 podStartE2EDuration="21.797756177s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 15:54:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:55:06.775265795 +0000 UTC m=+24.389197305" watchObservedRunningTime="2026-09-17 15:55:06.797756177 +0000 UTC m=+24.411687687"
Sep 17 15:55:07.511458 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:07.511429    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gg77s"
Sep 17 15:55:07.511636 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:07.511430    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7xl8l"
Sep 17 15:55:07.511636 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:07.511569    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gg77s" podUID="34abf0a1-5178-487d-93af-577b29705d96"
Sep 17 15:55:07.511744 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:07.511689    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7xl8l" podUID="46630785-5a7e-496b-86fe-d32e237c8c1b"
Sep 17 15:55:07.758802 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:07.758708    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw" event={"ID":"54d8c06c-72e7-4b77-b3b2-6698b7653944","Type":"ContainerStarted","Data":"e13b919d3d4a3b8d9a1856fd749ccdcb208a1743aca47cc88e18a790a2c90ff3"}
Sep 17 15:55:08.054445 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:08.054421    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zlcqk"
Sep 17 15:55:08.054957 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:08.054938    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zlcqk"
Sep 17 15:55:08.075364 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:08.075323    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hp2s4" podStartSLOduration=5.362251188 podStartE2EDuration="24.075304409s" totalImagesPullingTime="18.713053221s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 15:54:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:55:06.797820715 +0000 UTC m=+24.411752225" watchObservedRunningTime="2026-09-17 15:55:08.075304409 +0000 UTC m=+25.689235909"
Sep 17 15:55:08.511292 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:08.511268    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nldm2"
Sep 17 15:55:08.511446 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:08.511402    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nldm2" podUID="b550e969-e4dd-4602-8d26-4a6275359d68"
Sep 17 15:55:08.763449 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:08.763366    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xjhfp" event={"ID":"800c58de-09f2-471c-a4c6-eaa0ed41ad9b","Type":"ContainerStarted","Data":"511739c980a1358d11ec924071387724e792d43feb464f4bd2c40729a0adf583"}
Sep 17 15:55:08.763896 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:08.763538    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zlcqk"
Sep 17 15:55:08.764264 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:08.764247    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zlcqk"
Sep 17 15:55:08.786431 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:08.786383    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xjhfp" podStartSLOduration=3.327803928 podStartE2EDuration="24.786366413s" totalImagesPullingTime="21.458562485s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 15:54:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:55:08.785935995 +0000 UTC m=+26.399867517" watchObservedRunningTime="2026-09-17 15:55:08.786366413 +0000 UTC m=+26.400297925"
Sep 17 15:55:09.511015 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:09.510988    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7xl8l"
Sep 17 15:55:09.511015 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:09.511016    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gg77s"
Sep 17 15:55:09.511273 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:09.511107    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7xl8l" podUID="46630785-5a7e-496b-86fe-d32e237c8c1b"
Sep 17 15:55:09.511273 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:09.511218    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gg77s" podUID="34abf0a1-5178-487d-93af-577b29705d96"
Sep 17 15:55:10.514283 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:10.514140    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nldm2"
Sep 17 15:55:10.514814 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:10.514357    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nldm2" podUID="b550e969-e4dd-4602-8d26-4a6275359d68"
Sep 17 15:55:10.768565 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:10.768506    2584 generic.go:356] "Generic (PLEG): container finished" podID="df579004-3b28-44fd-ac97-05faf9b54dad" containerID="07b5660d401186b11df932b992e82ad51bc59bbe8869caae9eba9e142b60fdfb" exitCode=0
Sep 17 15:55:10.768662 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:10.768584    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bjftc" event={"ID":"df579004-3b28-44fd-ac97-05faf9b54dad","Type":"ContainerDied","Data":"07b5660d401186b11df932b992e82ad51bc59bbe8869caae9eba9e142b60fdfb"}
Sep 17 15:55:10.772526 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:10.772504    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw" event={"ID":"54d8c06c-72e7-4b77-b3b2-6698b7653944","Type":"ContainerStarted","Data":"61c95d24c9dc9d00d7ec7896a053c2345e47bba2298e3b7a3dec3c4be952b17c"}
Sep 17 15:55:10.829011 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:10.828974    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw" podStartSLOduration=8.062348137 podStartE2EDuration="26.828963147s" totalImagesPullingTime="18.76661501s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 15:54:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:55:10.828201078 +0000 UTC m=+28.442132589" watchObservedRunningTime="2026-09-17 15:55:10.828963147 +0000 UTC m=+28.442894657"
Sep 17 15:55:11.511331 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:11.511203    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7xl8l"
Sep 17 15:55:11.511411 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:11.511241    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gg77s"
Sep 17 15:55:11.511443 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:11.511408    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7xl8l" podUID="46630785-5a7e-496b-86fe-d32e237c8c1b"
Sep 17 15:55:11.511485 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:11.511468    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gg77s" podUID="34abf0a1-5178-487d-93af-577b29705d96"
Sep 17 15:55:11.731466 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:11.731443    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7xl8l"]
Sep 17 15:55:11.734578 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:11.734556    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nldm2"]
Sep 17 15:55:11.734670 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:11.734653    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nldm2"
Sep 17 15:55:11.734759 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:11.734741    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nldm2" podUID="b550e969-e4dd-4602-8d26-4a6275359d68"
Sep 17 15:55:11.742789 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:11.742717    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gg77s"]
Sep 17 15:55:11.774938 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:11.774831    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gg77s"
Sep 17 15:55:11.774938 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:11.774929    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gg77s" podUID="34abf0a1-5178-487d-93af-577b29705d96"
Sep 17 15:55:11.775942 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:11.775925    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7xl8l"
Sep 17 15:55:11.776039 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:11.775963    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:55:11.776039 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:11.776037    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:55:11.776153 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:11.776126    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7xl8l" podUID="46630785-5a7e-496b-86fe-d32e237c8c1b"
Sep 17 15:55:11.776195 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:11.776167    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:55:11.790975 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:11.790960    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:55:11.791523 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:11.791504    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:55:12.778722 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:12.778693    2584 generic.go:356] "Generic (PLEG): container finished" podID="df579004-3b28-44fd-ac97-05faf9b54dad" containerID="637148f9183c8bf9421828299a4080c3fcc10b4970ad5b4e6d31792e861b7fd5" exitCode=0
Sep 17 15:55:12.779072 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:12.778779    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bjftc" event={"ID":"df579004-3b28-44fd-ac97-05faf9b54dad","Type":"ContainerDied","Data":"637148f9183c8bf9421828299a4080c3fcc10b4970ad5b4e6d31792e861b7fd5"}
Sep 17 15:55:13.511531 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:13.511505    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gg77s"
Sep 17 15:55:13.511662 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:13.511591    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gg77s" podUID="34abf0a1-5178-487d-93af-577b29705d96"
Sep 17 15:55:13.511662 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:13.511620    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7xl8l"
Sep 17 15:55:13.511752 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:13.511505    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nldm2"
Sep 17 15:55:13.511752 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:13.511735    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7xl8l" podUID="46630785-5a7e-496b-86fe-d32e237c8c1b"
Sep 17 15:55:13.511843 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:13.511787    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nldm2" podUID="b550e969-e4dd-4602-8d26-4a6275359d68"
Sep 17 15:55:13.784094 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:13.784025    2584 generic.go:356] "Generic (PLEG): container finished" podID="df579004-3b28-44fd-ac97-05faf9b54dad" containerID="ff4db23d1567398b56b8a1a4904e279a5aba32b3c2ac45dcde64ab9c1a8110fd" exitCode=0
Sep 17 15:55:13.784094 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:13.784064    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bjftc" event={"ID":"df579004-3b28-44fd-ac97-05faf9b54dad","Type":"ContainerDied","Data":"ff4db23d1567398b56b8a1a4904e279a5aba32b3c2ac45dcde64ab9c1a8110fd"}
Sep 17 15:55:15.511830 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:15.511795    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gg77s"
Sep 17 15:55:15.512248 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:15.511795    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7xl8l"
Sep 17 15:55:15.512248 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:15.511938    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gg77s" podUID="34abf0a1-5178-487d-93af-577b29705d96"
Sep 17 15:55:15.512248 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:15.511992    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7xl8l" podUID="46630785-5a7e-496b-86fe-d32e237c8c1b"
Sep 17 15:55:15.512248 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:15.511811    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nldm2"
Sep 17 15:55:15.512248 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:15.512099    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nldm2" podUID="b550e969-e4dd-4602-8d26-4a6275359d68"
Sep 17 15:55:17.224192 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:17.224149    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/46630785-5a7e-496b-86fe-d32e237c8c1b-original-pull-secret\") pod \"global-pull-secret-syncer-7xl8l\" (UID: \"46630785-5a7e-496b-86fe-d32e237c8c1b\") " pod="kube-system/global-pull-secret-syncer-7xl8l"
Sep 17 15:55:17.224192 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:17.224198    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b550e969-e4dd-4602-8d26-4a6275359d68-metrics-certs\") pod \"network-metrics-daemon-nldm2\" (UID: \"b550e969-e4dd-4602-8d26-4a6275359d68\") " pod="openshift-multus/network-metrics-daemon-nldm2"
Sep 17 15:55:17.224692 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:17.224317    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 15:55:17.224692 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:17.224324    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 15:55:17.224692 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:17.224392    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46630785-5a7e-496b-86fe-d32e237c8c1b-original-pull-secret podName:46630785-5a7e-496b-86fe-d32e237c8c1b nodeName:}" failed. No retries permitted until 2026-09-17 15:55:49.224371835 +0000 UTC m=+66.838303341 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/46630785-5a7e-496b-86fe-d32e237c8c1b-original-pull-secret") pod "global-pull-secret-syncer-7xl8l" (UID: "46630785-5a7e-496b-86fe-d32e237c8c1b") : object "kube-system"/"original-pull-secret" not registered
Sep 17 15:55:17.224692 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:17.224412    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b550e969-e4dd-4602-8d26-4a6275359d68-metrics-certs podName:b550e969-e4dd-4602-8d26-4a6275359d68 nodeName:}" failed. No retries permitted until 2026-09-17 15:55:49.224401969 +0000 UTC m=+66.838333471 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b550e969-e4dd-4602-8d26-4a6275359d68-metrics-certs") pod "network-metrics-daemon-nldm2" (UID: "b550e969-e4dd-4602-8d26-4a6275359d68") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 15:55:17.324723 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:17.324694    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z65p7\" (UniqueName: \"kubernetes.io/projected/34abf0a1-5178-487d-93af-577b29705d96-kube-api-access-z65p7\") pod \"network-check-target-gg77s\" (UID: \"34abf0a1-5178-487d-93af-577b29705d96\") " pod="openshift-network-diagnostics/network-check-target-gg77s"
Sep 17 15:55:17.324908 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:17.324819    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 15:55:17.324908 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:17.324835    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 15:55:17.324908 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:17.324846    2584 projected.go:196] Error preparing data for projected volume kube-api-access-z65p7 for pod openshift-network-diagnostics/network-check-target-gg77s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 15:55:17.324908 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:17.324895    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34abf0a1-5178-487d-93af-577b29705d96-kube-api-access-z65p7 podName:34abf0a1-5178-487d-93af-577b29705d96 nodeName:}" failed. No retries permitted until 2026-09-17 15:55:49.324881592 +0000 UTC m=+66.938813080 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-z65p7" (UniqueName: "kubernetes.io/projected/34abf0a1-5178-487d-93af-577b29705d96-kube-api-access-z65p7") pod "network-check-target-gg77s" (UID: "34abf0a1-5178-487d-93af-577b29705d96") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 15:55:17.511259 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:17.511188    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gg77s"
Sep 17 15:55:17.511259 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:17.511198    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7xl8l"
Sep 17 15:55:17.511563 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:17.511198    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nldm2"
Sep 17 15:55:17.511563 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:17.511274    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gg77s" podUID="34abf0a1-5178-487d-93af-577b29705d96"
Sep 17 15:55:17.511563 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:17.511382    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nldm2" podUID="b550e969-e4dd-4602-8d26-4a6275359d68"
Sep 17 15:55:17.511563 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:17.511440    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7xl8l" podUID="46630785-5a7e-496b-86fe-d32e237c8c1b"
Sep 17 15:55:18.385216 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:18.385049    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-191.ec2.internal" event="NodeReady"
Sep 17 15:55:18.385466 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:18.385298    2584 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 17 15:55:18.465896 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:18.465873    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-h84cz"]
Sep 17 15:55:18.478248 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:18.478230    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-f4g57"]
Sep 17 15:55:18.478361 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:18.478338    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-h84cz"
Sep 17 15:55:18.481578 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:18.481561    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 17 15:55:18.481679 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:18.481659    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-djqn9\""
Sep 17 15:55:18.482201 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:18.482184    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 17 15:55:18.482254 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:18.482209    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 17 15:55:18.492409 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:18.492386    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-f4g57"]
Sep 17 15:55:18.492526 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:18.492468    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f4g57"
Sep 17 15:55:18.496126 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:18.496109    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 17 15:55:18.496221 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:18.496113    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 17 15:55:18.496221 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:18.496173    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-h84cz"]
Sep 17 15:55:18.496817 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:18.496802    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nhj85\""
Sep 17 15:55:18.633746 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:18.633718    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbt4r\" (UniqueName: \"kubernetes.io/projected/4ef9814f-616a-47e8-b1b2-7994485705f0-kube-api-access-wbt4r\") pod \"dns-default-f4g57\" (UID: \"4ef9814f-616a-47e8-b1b2-7994485705f0\") " pod="openshift-dns/dns-default-f4g57"
Sep 17 15:55:18.633830 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:18.633748    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4ef9814f-616a-47e8-b1b2-7994485705f0-metrics-tls\") pod \"dns-default-f4g57\" (UID: \"4ef9814f-616a-47e8-b1b2-7994485705f0\") " pod="openshift-dns/dns-default-f4g57"
Sep 17 15:55:18.633830 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:18.633764    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m28w9\" (UniqueName: \"kubernetes.io/projected/d6dfa59f-620e-4edf-a630-d1e1dad50650-kube-api-access-m28w9\") pod \"ingress-canary-h84cz\" (UID: \"d6dfa59f-620e-4edf-a630-d1e1dad50650\") " pod="openshift-ingress-canary/ingress-canary-h84cz"
Sep 17 15:55:18.633830 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:18.633784    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4ef9814f-616a-47e8-b1b2-7994485705f0-config-volume\") pod \"dns-default-f4g57\" (UID: \"4ef9814f-616a-47e8-b1b2-7994485705f0\") " pod="openshift-dns/dns-default-f4g57"
Sep 17 15:55:18.633830 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:18.633798    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ef9814f-616a-47e8-b1b2-7994485705f0-tmp-dir\") pod \"dns-default-f4g57\" (UID: \"4ef9814f-616a-47e8-b1b2-7994485705f0\") " pod="openshift-dns/dns-default-f4g57"
Sep 17 15:55:18.633830 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:18.633811    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d6dfa59f-620e-4edf-a630-d1e1dad50650-cert\") pod \"ingress-canary-h84cz\" (UID: \"d6dfa59f-620e-4edf-a630-d1e1dad50650\") " pod="openshift-ingress-canary/ingress-canary-h84cz"
Sep 17 15:55:18.734156 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:18.734135    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4ef9814f-616a-47e8-b1b2-7994485705f0-config-volume\") pod \"dns-default-f4g57\" (UID: \"4ef9814f-616a-47e8-b1b2-7994485705f0\") " pod="openshift-dns/dns-default-f4g57"
Sep 17 15:55:18.734156 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:18.734164    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ef9814f-616a-47e8-b1b2-7994485705f0-tmp-dir\") pod \"dns-default-f4g57\" (UID: \"4ef9814f-616a-47e8-b1b2-7994485705f0\") " pod="openshift-dns/dns-default-f4g57"
Sep 17 15:55:18.734274 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:18.734177    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d6dfa59f-620e-4edf-a630-d1e1dad50650-cert\") pod \"ingress-canary-h84cz\" (UID: \"d6dfa59f-620e-4edf-a630-d1e1dad50650\") " pod="openshift-ingress-canary/ingress-canary-h84cz"
Sep 17 15:55:18.734274 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:18.734239    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbt4r\" (UniqueName: \"kubernetes.io/projected/4ef9814f-616a-47e8-b1b2-7994485705f0-kube-api-access-wbt4r\") pod \"dns-default-f4g57\" (UID: \"4ef9814f-616a-47e8-b1b2-7994485705f0\") " pod="openshift-dns/dns-default-f4g57"
Sep 17 15:55:18.734364 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:18.734273    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4ef9814f-616a-47e8-b1b2-7994485705f0-metrics-tls\") pod \"dns-default-f4g57\" (UID: \"4ef9814f-616a-47e8-b1b2-7994485705f0\") " pod="openshift-dns/dns-default-f4g57"
Sep 17 15:55:18.734364 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:18.734291    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m28w9\" (UniqueName: \"kubernetes.io/projected/d6dfa59f-620e-4edf-a630-d1e1dad50650-kube-api-access-m28w9\") pod \"ingress-canary-h84cz\" (UID: \"d6dfa59f-620e-4edf-a630-d1e1dad50650\") " pod="openshift-ingress-canary/ingress-canary-h84cz"
Sep 17 15:55:18.734455 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:18.734413    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 15:55:18.734528 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:18.734481    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ef9814f-616a-47e8-b1b2-7994485705f0-metrics-tls podName:4ef9814f-616a-47e8-b1b2-7994485705f0 nodeName:}" failed. No retries permitted until 2026-09-17 15:55:19.234462385 +0000 UTC m=+36.848393887 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4ef9814f-616a-47e8-b1b2-7994485705f0-metrics-tls") pod "dns-default-f4g57" (UID: "4ef9814f-616a-47e8-b1b2-7994485705f0") : secret "dns-default-metrics-tls" not found
Sep 17 15:55:18.734578 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:18.734521    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ef9814f-616a-47e8-b1b2-7994485705f0-tmp-dir\") pod \"dns-default-f4g57\" (UID: \"4ef9814f-616a-47e8-b1b2-7994485705f0\") " pod="openshift-dns/dns-default-f4g57"
Sep 17 15:55:18.734667 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:18.734650    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4ef9814f-616a-47e8-b1b2-7994485705f0-config-volume\") pod \"dns-default-f4g57\" (UID: \"4ef9814f-616a-47e8-b1b2-7994485705f0\") " pod="openshift-dns/dns-default-f4g57"
Sep 17 15:55:18.738270 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:18.738250    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d6dfa59f-620e-4edf-a630-d1e1dad50650-cert\") pod \"ingress-canary-h84cz\" (UID: \"d6dfa59f-620e-4edf-a630-d1e1dad50650\") " pod="openshift-ingress-canary/ingress-canary-h84cz"
Sep 17 15:55:18.746393 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:18.746374    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbt4r\" (UniqueName: \"kubernetes.io/projected/4ef9814f-616a-47e8-b1b2-7994485705f0-kube-api-access-wbt4r\") pod \"dns-default-f4g57\" (UID: \"4ef9814f-616a-47e8-b1b2-7994485705f0\") " pod="openshift-dns/dns-default-f4g57"
Sep 17 15:55:18.746922 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:18.746899    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m28w9\" (UniqueName: \"kubernetes.io/projected/d6dfa59f-620e-4edf-a630-d1e1dad50650-kube-api-access-m28w9\") pod \"ingress-canary-h84cz\" (UID: \"d6dfa59f-620e-4edf-a630-d1e1dad50650\") " pod="openshift-ingress-canary/ingress-canary-h84cz"
Sep 17 15:55:18.786741 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:18.786722    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-h84cz"
Sep 17 15:55:18.798034 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:18.798012    2584 generic.go:356] "Generic (PLEG): container finished" podID="df579004-3b28-44fd-ac97-05faf9b54dad" containerID="3626b5837e5eed486f198e2c923b15cb8e012914590f852dc036c70fb6a72c9f" exitCode=0
Sep 17 15:55:18.798108 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:18.798059    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bjftc" event={"ID":"df579004-3b28-44fd-ac97-05faf9b54dad","Type":"ContainerDied","Data":"3626b5837e5eed486f198e2c923b15cb8e012914590f852dc036c70fb6a72c9f"}
Sep 17 15:55:19.115625 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:19.115355    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-h84cz"]
Sep 17 15:55:19.117736 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:55:19.117708    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6dfa59f_620e_4edf_a630_d1e1dad50650.slice/crio-4afc8a8814b820209a947ffec0504aede07099b0e394c39ef6e0dc53b25021fe WatchSource:0}: Error finding container 4afc8a8814b820209a947ffec0504aede07099b0e394c39ef6e0dc53b25021fe: Status 404 returned error can't find the container with id 4afc8a8814b820209a947ffec0504aede07099b0e394c39ef6e0dc53b25021fe
Sep 17 15:55:19.237635 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:19.237615    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4ef9814f-616a-47e8-b1b2-7994485705f0-metrics-tls\") pod \"dns-default-f4g57\" (UID: \"4ef9814f-616a-47e8-b1b2-7994485705f0\") " pod="openshift-dns/dns-default-f4g57"
Sep 17 15:55:19.237725 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:19.237706    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 15:55:19.237767 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:19.237747    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ef9814f-616a-47e8-b1b2-7994485705f0-metrics-tls podName:4ef9814f-616a-47e8-b1b2-7994485705f0 nodeName:}" failed. No retries permitted until 2026-09-17 15:55:20.237735011 +0000 UTC m=+37.851666512 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4ef9814f-616a-47e8-b1b2-7994485705f0-metrics-tls") pod "dns-default-f4g57" (UID: "4ef9814f-616a-47e8-b1b2-7994485705f0") : secret "dns-default-metrics-tls" not found
Sep 17 15:55:19.511848 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:19.511825    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nldm2"
Sep 17 15:55:19.511848 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:19.511837    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gg77s"
Sep 17 15:55:19.512464 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:19.512102    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7xl8l"
Sep 17 15:55:19.517064 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:19.517047    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 17 15:55:19.517619 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:19.517603    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 17 15:55:19.517946 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:19.517931    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 17 15:55:19.518470 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:19.518164    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 17 15:55:19.518470 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:19.518185    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qr24f\""
Sep 17 15:55:19.518470 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:19.518209    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8v7v5\""
Sep 17 15:55:19.802229 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:19.802155    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-h84cz" event={"ID":"d6dfa59f-620e-4edf-a630-d1e1dad50650","Type":"ContainerStarted","Data":"4afc8a8814b820209a947ffec0504aede07099b0e394c39ef6e0dc53b25021fe"}
Sep 17 15:55:19.805763 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:19.805741    2584 generic.go:356] "Generic (PLEG): container finished" podID="df579004-3b28-44fd-ac97-05faf9b54dad" containerID="4afffeed8a6d3f5354ff49d1dccffd3b2054d929894099b1473f16804b901024" exitCode=0
Sep 17 15:55:19.805874 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:19.805780    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bjftc" event={"ID":"df579004-3b28-44fd-ac97-05faf9b54dad","Type":"ContainerDied","Data":"4afffeed8a6d3f5354ff49d1dccffd3b2054d929894099b1473f16804b901024"}
Sep 17 15:55:20.243025 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:20.242984    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4ef9814f-616a-47e8-b1b2-7994485705f0-metrics-tls\") pod \"dns-default-f4g57\" (UID: \"4ef9814f-616a-47e8-b1b2-7994485705f0\") " pod="openshift-dns/dns-default-f4g57"
Sep 17 15:55:20.243206 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:20.243095    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 15:55:20.243206 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:20.243163    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ef9814f-616a-47e8-b1b2-7994485705f0-metrics-tls podName:4ef9814f-616a-47e8-b1b2-7994485705f0 nodeName:}" failed. No retries permitted until 2026-09-17 15:55:22.24314541 +0000 UTC m=+39.857076900 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4ef9814f-616a-47e8-b1b2-7994485705f0-metrics-tls") pod "dns-default-f4g57" (UID: "4ef9814f-616a-47e8-b1b2-7994485705f0") : secret "dns-default-metrics-tls" not found
Sep 17 15:55:20.812827 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:20.812788    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bjftc" event={"ID":"df579004-3b28-44fd-ac97-05faf9b54dad","Type":"ContainerStarted","Data":"0ab8f8b92c387faebab23399b7420943a00b8d0f56c47c677ae7a01607917549"}
Sep 17 15:55:20.849953 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:20.849902    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-bjftc" podStartSLOduration=7.674341243 podStartE2EDuration="36.84988323s" totalImagesPullingTime="29.175541987s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 15:54:44 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:55:20.84840419 +0000 UTC m=+38.462335713" watchObservedRunningTime="2026-09-17 15:55:20.84988323 +0000 UTC m=+38.463814740"
Sep 17 15:55:21.816015 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:21.815942    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-h84cz" event={"ID":"d6dfa59f-620e-4edf-a630-d1e1dad50650","Type":"ContainerStarted","Data":"85bb4c243b3b035420635e36545cc3d611ef1244c9a55745c837cd34f0f3c7d9"}
Sep 17 15:55:21.842548 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:21.842485    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-h84cz" podStartSLOduration=1.465610652 podStartE2EDuration="3.84247038s" totalImagesPullingTime="2.376859728s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:55:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:55:21.84124516 +0000 UTC m=+39.455176670" watchObservedRunningTime="2026-09-17 15:55:21.84247038 +0000 UTC m=+39.456401922"
Sep 17 15:55:22.259455 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:22.259428    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4ef9814f-616a-47e8-b1b2-7994485705f0-metrics-tls\") pod \"dns-default-f4g57\" (UID: \"4ef9814f-616a-47e8-b1b2-7994485705f0\") " pod="openshift-dns/dns-default-f4g57"
Sep 17 15:55:22.259578 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:22.259523    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 15:55:22.259578 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:22.259577    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ef9814f-616a-47e8-b1b2-7994485705f0-metrics-tls podName:4ef9814f-616a-47e8-b1b2-7994485705f0 nodeName:}" failed. No retries permitted until 2026-09-17 15:55:26.259563968 +0000 UTC m=+43.873495456 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4ef9814f-616a-47e8-b1b2-7994485705f0-metrics-tls") pod "dns-default-f4g57" (UID: "4ef9814f-616a-47e8-b1b2-7994485705f0") : secret "dns-default-metrics-tls" not found
Sep 17 15:55:26.285909 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:26.285875    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4ef9814f-616a-47e8-b1b2-7994485705f0-metrics-tls\") pod \"dns-default-f4g57\" (UID: \"4ef9814f-616a-47e8-b1b2-7994485705f0\") " pod="openshift-dns/dns-default-f4g57"
Sep 17 15:55:26.286320 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:26.286013    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 15:55:26.286320 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:26.286079    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ef9814f-616a-47e8-b1b2-7994485705f0-metrics-tls podName:4ef9814f-616a-47e8-b1b2-7994485705f0 nodeName:}" failed. No retries permitted until 2026-09-17 15:55:34.286061207 +0000 UTC m=+51.899992696 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4ef9814f-616a-47e8-b1b2-7994485705f0-metrics-tls") pod "dns-default-f4g57" (UID: "4ef9814f-616a-47e8-b1b2-7994485705f0") : secret "dns-default-metrics-tls" not found
Sep 17 15:55:34.334580 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:34.334541    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4ef9814f-616a-47e8-b1b2-7994485705f0-metrics-tls\") pod \"dns-default-f4g57\" (UID: \"4ef9814f-616a-47e8-b1b2-7994485705f0\") " pod="openshift-dns/dns-default-f4g57"
Sep 17 15:55:34.335048 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:34.334654    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 15:55:34.335048 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:34.334715    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ef9814f-616a-47e8-b1b2-7994485705f0-metrics-tls podName:4ef9814f-616a-47e8-b1b2-7994485705f0 nodeName:}" failed. No retries permitted until 2026-09-17 15:55:50.33470126 +0000 UTC m=+67.948632769 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4ef9814f-616a-47e8-b1b2-7994485705f0-metrics-tls") pod "dns-default-f4g57" (UID: "4ef9814f-616a-47e8-b1b2-7994485705f0") : secret "dns-default-metrics-tls" not found
Sep 17 15:55:43.796920 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:43.796888    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z8nmw"
Sep 17 15:55:49.317945 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:49.317893    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/46630785-5a7e-496b-86fe-d32e237c8c1b-original-pull-secret\") pod \"global-pull-secret-syncer-7xl8l\" (UID: \"46630785-5a7e-496b-86fe-d32e237c8c1b\") " pod="kube-system/global-pull-secret-syncer-7xl8l"
Sep 17 15:55:49.317945 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:49.317945    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b550e969-e4dd-4602-8d26-4a6275359d68-metrics-certs\") pod \"network-metrics-daemon-nldm2\" (UID: \"b550e969-e4dd-4602-8d26-4a6275359d68\") " pod="openshift-multus/network-metrics-daemon-nldm2"
Sep 17 15:55:49.321391 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:49.321371    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 17 15:55:49.321452 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:49.321376    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 17 15:55:49.328142 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:49.328125    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 17 15:55:49.328210 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:49.328183    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b550e969-e4dd-4602-8d26-4a6275359d68-metrics-certs podName:b550e969-e4dd-4602-8d26-4a6275359d68 nodeName:}" failed. No retries permitted until 2026-09-17 15:56:53.328166835 +0000 UTC m=+130.942098339 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b550e969-e4dd-4602-8d26-4a6275359d68-metrics-certs") pod "network-metrics-daemon-nldm2" (UID: "b550e969-e4dd-4602-8d26-4a6275359d68") : secret "metrics-daemon-secret" not found
Sep 17 15:55:49.331386 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:49.331367    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/46630785-5a7e-496b-86fe-d32e237c8c1b-original-pull-secret\") pod \"global-pull-secret-syncer-7xl8l\" (UID: \"46630785-5a7e-496b-86fe-d32e237c8c1b\") " pod="kube-system/global-pull-secret-syncer-7xl8l"
Sep 17 15:55:49.418510 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:49.418460    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z65p7\" (UniqueName: \"kubernetes.io/projected/34abf0a1-5178-487d-93af-577b29705d96-kube-api-access-z65p7\") pod \"network-check-target-gg77s\" (UID: \"34abf0a1-5178-487d-93af-577b29705d96\") " pod="openshift-network-diagnostics/network-check-target-gg77s"
Sep 17 15:55:49.421407 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:49.421389    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 17 15:55:49.431372 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:49.431352    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 17 15:55:49.442054 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:49.442030    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z65p7\" (UniqueName: \"kubernetes.io/projected/34abf0a1-5178-487d-93af-577b29705d96-kube-api-access-z65p7\") pod \"network-check-target-gg77s\" (UID: \"34abf0a1-5178-487d-93af-577b29705d96\") " pod="openshift-network-diagnostics/network-check-target-gg77s"
Sep 17 15:55:49.527099 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:49.527054    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7xl8l"
Sep 17 15:55:49.533488 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:49.533462    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qr24f\""
Sep 17 15:55:49.540953 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:49.540935    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gg77s"
Sep 17 15:55:49.814015 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:49.813981    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7xl8l"]
Sep 17 15:55:49.817916 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:55:49.817891    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46630785_5a7e_496b_86fe_d32e237c8c1b.slice/crio-ed8784364c88be658bee8e0f2ab00eaff550e39b9a9348e7abfcbc9d9780c012 WatchSource:0}: Error finding container ed8784364c88be658bee8e0f2ab00eaff550e39b9a9348e7abfcbc9d9780c012: Status 404 returned error can't find the container with id ed8784364c88be658bee8e0f2ab00eaff550e39b9a9348e7abfcbc9d9780c012
Sep 17 15:55:49.834515 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:49.834440    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gg77s"]
Sep 17 15:55:49.837534 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:55:49.837487    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34abf0a1_5178_487d_93af_577b29705d96.slice/crio-5e909ec4d42d380ab0e5aeb6ff072c4bc1814c08c582254294c596248bdd2cbc WatchSource:0}: Error finding container 5e909ec4d42d380ab0e5aeb6ff072c4bc1814c08c582254294c596248bdd2cbc: Status 404 returned error can't find the container with id 5e909ec4d42d380ab0e5aeb6ff072c4bc1814c08c582254294c596248bdd2cbc
Sep 17 15:55:49.876697 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:49.876664    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7xl8l" event={"ID":"46630785-5a7e-496b-86fe-d32e237c8c1b","Type":"ContainerStarted","Data":"ed8784364c88be658bee8e0f2ab00eaff550e39b9a9348e7abfcbc9d9780c012"}
Sep 17 15:55:49.877812 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:49.877791    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gg77s" event={"ID":"34abf0a1-5178-487d-93af-577b29705d96","Type":"ContainerStarted","Data":"5e909ec4d42d380ab0e5aeb6ff072c4bc1814c08c582254294c596248bdd2cbc"}
Sep 17 15:55:50.425390 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:50.425356    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4ef9814f-616a-47e8-b1b2-7994485705f0-metrics-tls\") pod \"dns-default-f4g57\" (UID: \"4ef9814f-616a-47e8-b1b2-7994485705f0\") " pod="openshift-dns/dns-default-f4g57"
Sep 17 15:55:50.425971 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:50.425542    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 15:55:50.425971 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:50.425625    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ef9814f-616a-47e8-b1b2-7994485705f0-metrics-tls podName:4ef9814f-616a-47e8-b1b2-7994485705f0 nodeName:}" failed. No retries permitted until 2026-09-17 15:56:22.425604556 +0000 UTC m=+100.039536045 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4ef9814f-616a-47e8-b1b2-7994485705f0-metrics-tls") pod "dns-default-f4g57" (UID: "4ef9814f-616a-47e8-b1b2-7994485705f0") : secret "dns-default-metrics-tls" not found
Sep 17 15:55:54.893802 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:54.893758    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7xl8l" event={"ID":"46630785-5a7e-496b-86fe-d32e237c8c1b","Type":"ContainerStarted","Data":"879eef0e9540510abaafea6d686dcb8e23815b092369923747f4c31476cf0a64"}
Sep 17 15:55:54.895282 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:54.895257    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gg77s" event={"ID":"34abf0a1-5178-487d-93af-577b29705d96","Type":"ContainerStarted","Data":"1f38c9d089bc6a6682b6411719c8873f08a5c21c8f9f882f5e80aae5107aa7c5"}
Sep 17 15:55:54.895406 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:54.895389    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-gg77s"
Sep 17 15:55:54.914318 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:54.914275    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-7xl8l" podStartSLOduration=65.660583729 podStartE2EDuration="1m9.914263822s" totalImagesPullingTime="4.253680093s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 15:54:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:55:54.9137127 +0000 UTC m=+72.527644209" watchObservedRunningTime="2026-09-17 15:55:54.914263822 +0000 UTC m=+72.528195380"
Sep 17 15:55:54.931886 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:54.931838    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-gg77s" podStartSLOduration=66.700912193 podStartE2EDuration="1m10.931824129s" totalImagesPullingTime="4.230911936s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:54:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:55:54.930939196 +0000 UTC m=+72.544870704" watchObservedRunningTime="2026-09-17 15:55:54.931824129 +0000 UTC m=+72.545755636"
Sep 17 15:55:55.984005 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:55.983976    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-zwptf"]
Sep 17 15:55:55.986003 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:55.985987    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-zwptf"
Sep 17 15:55:55.988939 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:55.988915    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-hv7mq\""
Sep 17 15:55:55.989772 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:55.989756    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 17 15:55:55.989862 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:55.989787    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 17 15:55:55.993762 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:55.993745    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 17 15:55:55.996865 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:55.996845    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-mxggm"]
Sep 17 15:55:55.998595 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:55.998580    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-b59pt"]
Sep 17 15:55:55.998699 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:55.998685    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-mxggm"
Sep 17 15:55:56.000149 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:56.000131    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-b59pt"
Sep 17 15:55:56.001032 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:56.001015    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 17 15:55:56.001594 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:56.001579    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-mg42v\""
Sep 17 15:55:56.008861 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:56.008843    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 17 15:55:56.008989 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:56.008972    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 17 15:55:56.009065 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:56.008984    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-4qnck\""
Sep 17 15:55:56.009065 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:56.009030    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 17 15:55:56.009170 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:56.009074    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 17 15:55:56.011874 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:56.011856    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 17 15:55:56.014853 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:56.014833    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-zwptf"]
Sep 17 15:55:56.023035 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:56.023014    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-mxggm"]
Sep 17 15:55:56.053763 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:56.053739    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-b59pt"]
Sep 17 15:55:56.065245 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:56.065222    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-487g6\" (UniqueName: \"kubernetes.io/projected/7b599201-0bbd-4686-a57c-d10286df77ba-kube-api-access-487g6\") pod \"volume-data-source-validator-5c4db8bdf9-mxggm\" (UID: \"7b599201-0bbd-4686-a57c-d10286df77ba\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-mxggm"
Sep 17 15:55:56.065355 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:56.065251    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4e06f67c-f37e-4f4c-9e9a-5405d810efc4-serving-cert\") pod \"service-ca-operator-57cdc4b768-zwptf\" (UID: \"4e06f67c-f37e-4f4c-9e9a-5405d810efc4\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-zwptf"
Sep 17 15:55:56.065355 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:56.065286    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0fed33a8-badd-44d8-8d68-1422ac50f26a-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-b59pt\" (UID: \"0fed33a8-badd-44d8-8d68-1422ac50f26a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-b59pt"
Sep 17 15:55:56.065355 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:56.065330    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55b2r\" (UniqueName: \"kubernetes.io/projected/0fed33a8-badd-44d8-8d68-1422ac50f26a-kube-api-access-55b2r\") pod \"cluster-samples-operator-685d7d68b5-b59pt\" (UID: \"0fed33a8-badd-44d8-8d68-1422ac50f26a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-b59pt"
Sep 17 15:55:56.065465 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:56.065372    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4e06f67c-f37e-4f4c-9e9a-5405d810efc4-config\") pod \"service-ca-operator-57cdc4b768-zwptf\" (UID: \"4e06f67c-f37e-4f4c-9e9a-5405d810efc4\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-zwptf"
Sep 17 15:55:56.065465 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:56.065390    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4t9ps\" (UniqueName: \"kubernetes.io/projected/4e06f67c-f37e-4f4c-9e9a-5405d810efc4-kube-api-access-4t9ps\") pod \"service-ca-operator-57cdc4b768-zwptf\" (UID: \"4e06f67c-f37e-4f4c-9e9a-5405d810efc4\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-zwptf"
Sep 17 15:55:56.125173 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:56.125141    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-69d9cc557b-99lzw"]
Sep 17 15:55:56.127032 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:56.127017    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-69d9cc557b-99lzw"
Sep 17 15:55:56.133696 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:56.133676    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 17 15:55:56.133696 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:56.133687    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 17 15:55:56.134135 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:56.134121    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 17 15:55:56.134205 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:56.134191    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 17 15:55:56.134390 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:56.134372    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 17 15:55:56.134616 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:56.134602    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-9jmhg\""
Sep 17 15:55:56.135133 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:56.135121    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 17 15:55:56.150194 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:56.150161    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-69d9cc557b-99lzw"]
Sep 17 15:55:56.166335 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:56.166311    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed6896ba-27eb-4ba3-a9df-bdb614fca6c1-metrics-certs\") pod \"router-default-69d9cc557b-99lzw\" (UID: \"ed6896ba-27eb-4ba3-a9df-bdb614fca6c1\") " pod="openshift-ingress/router-default-69d9cc557b-99lzw"
Sep 17 15:55:56.166444 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:56.166357    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-487g6\" (UniqueName: \"kubernetes.io/projected/7b599201-0bbd-4686-a57c-d10286df77ba-kube-api-access-487g6\") pod \"volume-data-source-validator-5c4db8bdf9-mxggm\" (UID: \"7b599201-0bbd-4686-a57c-d10286df77ba\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-mxggm"
Sep 17 15:55:56.166444 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:56.166374    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4e06f67c-f37e-4f4c-9e9a-5405d810efc4-serving-cert\") pod \"service-ca-operator-57cdc4b768-zwptf\" (UID: \"4e06f67c-f37e-4f4c-9e9a-5405d810efc4\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-zwptf"
Sep 17 15:55:56.166444 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:56.166398    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed6896ba-27eb-4ba3-a9df-bdb614fca6c1-service-ca-bundle\") pod \"router-default-69d9cc557b-99lzw\" (UID: \"ed6896ba-27eb-4ba3-a9df-bdb614fca6c1\") " pod="openshift-ingress/router-default-69d9cc557b-99lzw"
Sep 17 15:55:56.166580 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:56.166471    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0fed33a8-badd-44d8-8d68-1422ac50f26a-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-b59pt\" (UID: \"0fed33a8-badd-44d8-8d68-1422ac50f26a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-b59pt"
Sep 17 15:55:56.166580 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:56.166527    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55b2r\" (UniqueName: \"kubernetes.io/projected/0fed33a8-badd-44d8-8d68-1422ac50f26a-kube-api-access-55b2r\") pod \"cluster-samples-operator-685d7d68b5-b59pt\" (UID: \"0fed33a8-badd-44d8-8d68-1422ac50f26a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-b59pt"
Sep 17 15:55:56.166580 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:56.166559    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4e06f67c-f37e-4f4c-9e9a-5405d810efc4-config\") pod \"service-ca-operator-57cdc4b768-zwptf\" (UID: \"4e06f67c-f37e-4f4c-9e9a-5405d810efc4\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-zwptf"
Sep 17 15:55:56.166580 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:56.166563    2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 17 15:55:56.166580 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:56.166575    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4t9ps\" (UniqueName: \"kubernetes.io/projected/4e06f67c-f37e-4f4c-9e9a-5405d810efc4-kube-api-access-4t9ps\") pod \"service-ca-operator-57cdc4b768-zwptf\" (UID: \"4e06f67c-f37e-4f4c-9e9a-5405d810efc4\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-zwptf"
Sep 17 15:55:56.166800 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:56.166601    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ed6896ba-27eb-4ba3-a9df-bdb614fca6c1-stats-auth\") pod \"router-default-69d9cc557b-99lzw\" (UID: \"ed6896ba-27eb-4ba3-a9df-bdb614fca6c1\") " pod="openshift-ingress/router-default-69d9cc557b-99lzw"
Sep 17 15:55:56.166800 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:56.166632    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fed33a8-badd-44d8-8d68-1422ac50f26a-samples-operator-tls podName:0fed33a8-badd-44d8-8d68-1422ac50f26a nodeName:}" failed. No retries permitted until 2026-09-17 15:55:56.666612278 +0000 UTC m=+74.280543780 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0fed33a8-badd-44d8-8d68-1422ac50f26a-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-b59pt" (UID: "0fed33a8-badd-44d8-8d68-1422ac50f26a") : secret "samples-operator-tls" not found
Sep 17 15:55:56.166800 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:56.166718    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ed6896ba-27eb-4ba3-a9df-bdb614fca6c1-default-certificate\") pod \"router-default-69d9cc557b-99lzw\" (UID: \"ed6896ba-27eb-4ba3-a9df-bdb614fca6c1\") " pod="openshift-ingress/router-default-69d9cc557b-99lzw"
Sep 17 15:55:56.166800 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:56.166749    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkksr\" (UniqueName: \"kubernetes.io/projected/ed6896ba-27eb-4ba3-a9df-bdb614fca6c1-kube-api-access-vkksr\") pod \"router-default-69d9cc557b-99lzw\" (UID: \"ed6896ba-27eb-4ba3-a9df-bdb614fca6c1\") " pod="openshift-ingress/router-default-69d9cc557b-99lzw"
Sep 17 15:55:56.167214 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:56.167193    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4e06f67c-f37e-4f4c-9e9a-5405d810efc4-config\") pod \"service-ca-operator-57cdc4b768-zwptf\" (UID: \"4e06f67c-f37e-4f4c-9e9a-5405d810efc4\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-zwptf"
Sep 17 15:55:56.168741 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:56.168723    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4e06f67c-f37e-4f4c-9e9a-5405d810efc4-serving-cert\") pod \"service-ca-operator-57cdc4b768-zwptf\" (UID: \"4e06f67c-f37e-4f4c-9e9a-5405d810efc4\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-zwptf"
Sep 17 15:55:56.184690 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:56.184663    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55b2r\" (UniqueName: \"kubernetes.io/projected/0fed33a8-badd-44d8-8d68-1422ac50f26a-kube-api-access-55b2r\") pod \"cluster-samples-operator-685d7d68b5-b59pt\" (UID: \"0fed33a8-badd-44d8-8d68-1422ac50f26a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-b59pt"
Sep 17 15:55:56.185552 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:56.185536    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4t9ps\" (UniqueName: \"kubernetes.io/projected/4e06f67c-f37e-4f4c-9e9a-5405d810efc4-kube-api-access-4t9ps\") pod \"service-ca-operator-57cdc4b768-zwptf\" (UID: \"4e06f67c-f37e-4f4c-9e9a-5405d810efc4\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-zwptf"
Sep 17 15:55:56.186433 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:56.186405    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-487g6\" (UniqueName: \"kubernetes.io/projected/7b599201-0bbd-4686-a57c-d10286df77ba-kube-api-access-487g6\") pod \"volume-data-source-validator-5c4db8bdf9-mxggm\" (UID: \"7b599201-0bbd-4686-a57c-d10286df77ba\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-mxggm"
Sep 17 15:55:56.267860 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:56.267762    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed6896ba-27eb-4ba3-a9df-bdb614fca6c1-service-ca-bundle\") pod \"router-default-69d9cc557b-99lzw\" (UID: \"ed6896ba-27eb-4ba3-a9df-bdb614fca6c1\") " pod="openshift-ingress/router-default-69d9cc557b-99lzw"
Sep 17 15:55:56.267860 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:56.267837    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ed6896ba-27eb-4ba3-a9df-bdb614fca6c1-stats-auth\") pod \"router-default-69d9cc557b-99lzw\" (UID: \"ed6896ba-27eb-4ba3-a9df-bdb614fca6c1\") " pod="openshift-ingress/router-default-69d9cc557b-99lzw"
Sep 17 15:55:56.267860 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:56.267870    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ed6896ba-27eb-4ba3-a9df-bdb614fca6c1-default-certificate\") pod \"router-default-69d9cc557b-99lzw\" (UID: \"ed6896ba-27eb-4ba3-a9df-bdb614fca6c1\") " pod="openshift-ingress/router-default-69d9cc557b-99lzw"
Sep 17 15:55:56.268162 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:56.267887    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkksr\" (UniqueName: \"kubernetes.io/projected/ed6896ba-27eb-4ba3-a9df-bdb614fca6c1-kube-api-access-vkksr\") pod \"router-default-69d9cc557b-99lzw\" (UID: \"ed6896ba-27eb-4ba3-a9df-bdb614fca6c1\") " pod="openshift-ingress/router-default-69d9cc557b-99lzw"
Sep 17 15:55:56.268162 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:56.267917    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed6896ba-27eb-4ba3-a9df-bdb614fca6c1-metrics-certs\") pod \"router-default-69d9cc557b-99lzw\" (UID: \"ed6896ba-27eb-4ba3-a9df-bdb614fca6c1\") " pod="openshift-ingress/router-default-69d9cc557b-99lzw"
Sep 17 15:55:56.268162 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:56.268007    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ed6896ba-27eb-4ba3-a9df-bdb614fca6c1-service-ca-bundle podName:ed6896ba-27eb-4ba3-a9df-bdb614fca6c1 nodeName:}" failed. No retries permitted until 2026-09-17 15:55:56.767985822 +0000 UTC m=+74.381917325 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ed6896ba-27eb-4ba3-a9df-bdb614fca6c1-service-ca-bundle") pod "router-default-69d9cc557b-99lzw" (UID: "ed6896ba-27eb-4ba3-a9df-bdb614fca6c1") : configmap references non-existent config key: service-ca.crt
Sep 17 15:55:56.268162 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:56.268014    2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 17 15:55:56.268162 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:56.268075    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed6896ba-27eb-4ba3-a9df-bdb614fca6c1-metrics-certs podName:ed6896ba-27eb-4ba3-a9df-bdb614fca6c1 nodeName:}" failed. No retries permitted until 2026-09-17 15:55:56.768060679 +0000 UTC m=+74.381992182 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed6896ba-27eb-4ba3-a9df-bdb614fca6c1-metrics-certs") pod "router-default-69d9cc557b-99lzw" (UID: "ed6896ba-27eb-4ba3-a9df-bdb614fca6c1") : secret "router-metrics-certs-default" not found
Sep 17 15:55:56.270392 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:56.270364    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ed6896ba-27eb-4ba3-a9df-bdb614fca6c1-stats-auth\") pod \"router-default-69d9cc557b-99lzw\" (UID: \"ed6896ba-27eb-4ba3-a9df-bdb614fca6c1\") " pod="openshift-ingress/router-default-69d9cc557b-99lzw"
Sep 17 15:55:56.270512 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:56.270420    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ed6896ba-27eb-4ba3-a9df-bdb614fca6c1-default-certificate\") pod \"router-default-69d9cc557b-99lzw\" (UID: \"ed6896ba-27eb-4ba3-a9df-bdb614fca6c1\") " pod="openshift-ingress/router-default-69d9cc557b-99lzw"
Sep 17 15:55:56.282430 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:56.282412    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkksr\" (UniqueName: \"kubernetes.io/projected/ed6896ba-27eb-4ba3-a9df-bdb614fca6c1-kube-api-access-vkksr\") pod \"router-default-69d9cc557b-99lzw\" (UID: \"ed6896ba-27eb-4ba3-a9df-bdb614fca6c1\") " pod="openshift-ingress/router-default-69d9cc557b-99lzw"
Sep 17 15:55:56.294314 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:56.294297    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-zwptf"
Sep 17 15:55:56.307861 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:56.307839    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-mxggm"
Sep 17 15:55:56.572305 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:56.572277    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-zwptf"]
Sep 17 15:55:56.574693 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:55:56.574649    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e06f67c_f37e_4f4c_9e9a_5405d810efc4.slice/crio-0ed9a825e86b7e0dccd4bf7e1f422582893f6be47582e79476c41658788a6e86 WatchSource:0}: Error finding container 0ed9a825e86b7e0dccd4bf7e1f422582893f6be47582e79476c41658788a6e86: Status 404 returned error can't find the container with id 0ed9a825e86b7e0dccd4bf7e1f422582893f6be47582e79476c41658788a6e86
Sep 17 15:55:56.594333 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:56.594293    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-mxggm"]
Sep 17 15:55:56.597146 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:55:56.597120    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b599201_0bbd_4686_a57c_d10286df77ba.slice/crio-d184fd8cff98b7a42fb7b12dcc2cdccb8b1bfe8a4cc64265ebce36ec287280aa WatchSource:0}: Error finding container d184fd8cff98b7a42fb7b12dcc2cdccb8b1bfe8a4cc64265ebce36ec287280aa: Status 404 returned error can't find the container with id d184fd8cff98b7a42fb7b12dcc2cdccb8b1bfe8a4cc64265ebce36ec287280aa
Sep 17 15:55:56.672615 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:56.672587    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0fed33a8-badd-44d8-8d68-1422ac50f26a-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-b59pt\" (UID: \"0fed33a8-badd-44d8-8d68-1422ac50f26a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-b59pt"
Sep 17 15:55:56.672780 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:56.672747    2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 17 15:55:56.672831 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:56.672809    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fed33a8-badd-44d8-8d68-1422ac50f26a-samples-operator-tls podName:0fed33a8-badd-44d8-8d68-1422ac50f26a nodeName:}" failed. No retries permitted until 2026-09-17 15:55:57.672793463 +0000 UTC m=+75.286724965 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0fed33a8-badd-44d8-8d68-1422ac50f26a-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-b59pt" (UID: "0fed33a8-badd-44d8-8d68-1422ac50f26a") : secret "samples-operator-tls" not found
Sep 17 15:55:56.773706 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:56.773671    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed6896ba-27eb-4ba3-a9df-bdb614fca6c1-metrics-certs\") pod \"router-default-69d9cc557b-99lzw\" (UID: \"ed6896ba-27eb-4ba3-a9df-bdb614fca6c1\") " pod="openshift-ingress/router-default-69d9cc557b-99lzw"
Sep 17 15:55:56.773881 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:56.773728    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed6896ba-27eb-4ba3-a9df-bdb614fca6c1-service-ca-bundle\") pod \"router-default-69d9cc557b-99lzw\" (UID: \"ed6896ba-27eb-4ba3-a9df-bdb614fca6c1\") " pod="openshift-ingress/router-default-69d9cc557b-99lzw"
Sep 17 15:55:56.773881 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:56.773819    2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 17 15:55:56.773881 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:56.773854    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ed6896ba-27eb-4ba3-a9df-bdb614fca6c1-service-ca-bundle podName:ed6896ba-27eb-4ba3-a9df-bdb614fca6c1 nodeName:}" failed. No retries permitted until 2026-09-17 15:55:57.773836858 +0000 UTC m=+75.387768361 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ed6896ba-27eb-4ba3-a9df-bdb614fca6c1-service-ca-bundle") pod "router-default-69d9cc557b-99lzw" (UID: "ed6896ba-27eb-4ba3-a9df-bdb614fca6c1") : configmap references non-existent config key: service-ca.crt
Sep 17 15:55:56.774046 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:56.773961    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed6896ba-27eb-4ba3-a9df-bdb614fca6c1-metrics-certs podName:ed6896ba-27eb-4ba3-a9df-bdb614fca6c1 nodeName:}" failed. No retries permitted until 2026-09-17 15:55:57.773938506 +0000 UTC m=+75.387870004 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed6896ba-27eb-4ba3-a9df-bdb614fca6c1-metrics-certs") pod "router-default-69d9cc557b-99lzw" (UID: "ed6896ba-27eb-4ba3-a9df-bdb614fca6c1") : secret "router-metrics-certs-default" not found
Sep 17 15:55:56.901654 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:56.901618    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-mxggm" event={"ID":"7b599201-0bbd-4686-a57c-d10286df77ba","Type":"ContainerStarted","Data":"d184fd8cff98b7a42fb7b12dcc2cdccb8b1bfe8a4cc64265ebce36ec287280aa"}
Sep 17 15:55:56.902739 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:56.902716    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-zwptf" event={"ID":"4e06f67c-f37e-4f4c-9e9a-5405d810efc4","Type":"ContainerStarted","Data":"0ed9a825e86b7e0dccd4bf7e1f422582893f6be47582e79476c41658788a6e86"}
Sep 17 15:55:57.681192 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:57.681156    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0fed33a8-badd-44d8-8d68-1422ac50f26a-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-b59pt\" (UID: \"0fed33a8-badd-44d8-8d68-1422ac50f26a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-b59pt"
Sep 17 15:55:57.681559 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:57.681318    2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 17 15:55:57.681559 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:57.681385    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fed33a8-badd-44d8-8d68-1422ac50f26a-samples-operator-tls podName:0fed33a8-badd-44d8-8d68-1422ac50f26a nodeName:}" failed. No retries permitted until 2026-09-17 15:55:59.68136918 +0000 UTC m=+77.295300669 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0fed33a8-badd-44d8-8d68-1422ac50f26a-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-b59pt" (UID: "0fed33a8-badd-44d8-8d68-1422ac50f26a") : secret "samples-operator-tls" not found
Sep 17 15:55:57.782315 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:57.782278    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed6896ba-27eb-4ba3-a9df-bdb614fca6c1-service-ca-bundle\") pod \"router-default-69d9cc557b-99lzw\" (UID: \"ed6896ba-27eb-4ba3-a9df-bdb614fca6c1\") " pod="openshift-ingress/router-default-69d9cc557b-99lzw"
Sep 17 15:55:57.782512 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:57.782366    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed6896ba-27eb-4ba3-a9df-bdb614fca6c1-metrics-certs\") pod \"router-default-69d9cc557b-99lzw\" (UID: \"ed6896ba-27eb-4ba3-a9df-bdb614fca6c1\") " pod="openshift-ingress/router-default-69d9cc557b-99lzw"
Sep 17 15:55:57.782512 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:57.782453    2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 17 15:55:57.782512 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:57.782471    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ed6896ba-27eb-4ba3-a9df-bdb614fca6c1-service-ca-bundle podName:ed6896ba-27eb-4ba3-a9df-bdb614fca6c1 nodeName:}" failed. No retries permitted until 2026-09-17 15:55:59.782452259 +0000 UTC m=+77.396383771 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ed6896ba-27eb-4ba3-a9df-bdb614fca6c1-service-ca-bundle") pod "router-default-69d9cc557b-99lzw" (UID: "ed6896ba-27eb-4ba3-a9df-bdb614fca6c1") : configmap references non-existent config key: service-ca.crt
Sep 17 15:55:57.782645 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:57.782516    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed6896ba-27eb-4ba3-a9df-bdb614fca6c1-metrics-certs podName:ed6896ba-27eb-4ba3-a9df-bdb614fca6c1 nodeName:}" failed. No retries permitted until 2026-09-17 15:55:59.782486642 +0000 UTC m=+77.396418130 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed6896ba-27eb-4ba3-a9df-bdb614fca6c1-metrics-certs") pod "router-default-69d9cc557b-99lzw" (UID: "ed6896ba-27eb-4ba3-a9df-bdb614fca6c1") : secret "router-metrics-certs-default" not found
Sep 17 15:55:57.907678 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:57.907636    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-mxggm" event={"ID":"7b599201-0bbd-4686-a57c-d10286df77ba","Type":"ContainerStarted","Data":"71b3c924450c058db986beafd556f653037a23910116bf453357e55ddded5f9a"}
Sep 17 15:55:57.927163 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:57.927111    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-mxggm" podStartSLOduration=1.990695118 podStartE2EDuration="2.927093393s" totalImagesPullingTime="936.398275ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:55:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:55:57.925745948 +0000 UTC m=+75.539677459" watchObservedRunningTime="2026-09-17 15:55:57.927093393 +0000 UTC m=+75.541024905"
Sep 17 15:55:58.912021 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:58.911984    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-zwptf" event={"ID":"4e06f67c-f37e-4f4c-9e9a-5405d810efc4","Type":"ContainerStarted","Data":"fad057517bbc03574cfa11b65c522a9bc2a0767a90abaa372ec928674cf47d1b"}
Sep 17 15:55:58.932319 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:58.932262    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-zwptf" podStartSLOduration=2.11095176 podStartE2EDuration="3.932241083s" totalImagesPullingTime="1.821289323s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:55:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:55:58.931744228 +0000 UTC m=+76.545675742" watchObservedRunningTime="2026-09-17 15:55:58.932241083 +0000 UTC m=+76.546172595"
Sep 17 15:55:59.697758 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:59.697709    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0fed33a8-badd-44d8-8d68-1422ac50f26a-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-b59pt\" (UID: \"0fed33a8-badd-44d8-8d68-1422ac50f26a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-b59pt"
Sep 17 15:55:59.697937 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:59.697863    2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 17 15:55:59.697937 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:59.697931    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fed33a8-badd-44d8-8d68-1422ac50f26a-samples-operator-tls podName:0fed33a8-badd-44d8-8d68-1422ac50f26a nodeName:}" failed. No retries permitted until 2026-09-17 15:56:03.6979163 +0000 UTC m=+81.311847806 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0fed33a8-badd-44d8-8d68-1422ac50f26a-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-b59pt" (UID: "0fed33a8-badd-44d8-8d68-1422ac50f26a") : secret "samples-operator-tls" not found
Sep 17 15:55:59.798653 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:59.798613    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed6896ba-27eb-4ba3-a9df-bdb614fca6c1-service-ca-bundle\") pod \"router-default-69d9cc557b-99lzw\" (UID: \"ed6896ba-27eb-4ba3-a9df-bdb614fca6c1\") " pod="openshift-ingress/router-default-69d9cc557b-99lzw"
Sep 17 15:55:59.798809 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:55:59.798698    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed6896ba-27eb-4ba3-a9df-bdb614fca6c1-metrics-certs\") pod \"router-default-69d9cc557b-99lzw\" (UID: \"ed6896ba-27eb-4ba3-a9df-bdb614fca6c1\") " pod="openshift-ingress/router-default-69d9cc557b-99lzw"
Sep 17 15:55:59.798809 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:59.798777    2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 17 15:55:59.798809 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:59.798802    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ed6896ba-27eb-4ba3-a9df-bdb614fca6c1-service-ca-bundle podName:ed6896ba-27eb-4ba3-a9df-bdb614fca6c1 nodeName:}" failed. No retries permitted until 2026-09-17 15:56:03.798781159 +0000 UTC m=+81.412712662 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ed6896ba-27eb-4ba3-a9df-bdb614fca6c1-service-ca-bundle") pod "router-default-69d9cc557b-99lzw" (UID: "ed6896ba-27eb-4ba3-a9df-bdb614fca6c1") : configmap references non-existent config key: service-ca.crt
Sep 17 15:55:59.798932 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:55:59.798828    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed6896ba-27eb-4ba3-a9df-bdb614fca6c1-metrics-certs podName:ed6896ba-27eb-4ba3-a9df-bdb614fca6c1 nodeName:}" failed. No retries permitted until 2026-09-17 15:56:03.798819279 +0000 UTC m=+81.412750775 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed6896ba-27eb-4ba3-a9df-bdb614fca6c1-metrics-certs") pod "router-default-69d9cc557b-99lzw" (UID: "ed6896ba-27eb-4ba3-a9df-bdb614fca6c1") : secret "router-metrics-certs-default" not found
Sep 17 15:56:00.351296 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:00.351260    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-72tfl"]
Sep 17 15:56:00.356525 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:00.356482    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-72tfl"
Sep 17 15:56:00.358788 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:00.358763    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 17 15:56:00.359212 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:00.359193    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hkffj\""
Sep 17 15:56:00.359294 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:00.359212    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 17 15:56:00.359294 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:00.359270    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 17 15:56:00.359840 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:00.359823    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 17 15:56:00.377205 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:00.377181    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-72tfl"]
Sep 17 15:56:00.403319 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:00.403300    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/753ea6fe-3f4b-4449-9be0-e35dcd8601b0-data-volume\") pod \"insights-runtime-extractor-72tfl\" (UID: \"753ea6fe-3f4b-4449-9be0-e35dcd8601b0\") " pod="openshift-insights/insights-runtime-extractor-72tfl"
Sep 17 15:56:00.403430 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:00.403324    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/753ea6fe-3f4b-4449-9be0-e35dcd8601b0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-72tfl\" (UID: \"753ea6fe-3f4b-4449-9be0-e35dcd8601b0\") " pod="openshift-insights/insights-runtime-extractor-72tfl"
Sep 17 15:56:00.403430 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:00.403364    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/753ea6fe-3f4b-4449-9be0-e35dcd8601b0-crio-socket\") pod \"insights-runtime-extractor-72tfl\" (UID: \"753ea6fe-3f4b-4449-9be0-e35dcd8601b0\") " pod="openshift-insights/insights-runtime-extractor-72tfl"
Sep 17 15:56:00.403430 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:00.403381    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/753ea6fe-3f4b-4449-9be0-e35dcd8601b0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-72tfl\" (UID: \"753ea6fe-3f4b-4449-9be0-e35dcd8601b0\") " pod="openshift-insights/insights-runtime-extractor-72tfl"
Sep 17 15:56:00.403430 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:00.403430    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft4s9\" (UniqueName: \"kubernetes.io/projected/753ea6fe-3f4b-4449-9be0-e35dcd8601b0-kube-api-access-ft4s9\") pod \"insights-runtime-extractor-72tfl\" (UID: \"753ea6fe-3f4b-4449-9be0-e35dcd8601b0\") " pod="openshift-insights/insights-runtime-extractor-72tfl"
Sep 17 15:56:00.417861 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:00.417835    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-s9tlv"]
Sep 17 15:56:00.420695 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:00.420677    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-s9tlv"
Sep 17 15:56:00.424116 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:00.424099    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 17 15:56:00.424349 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:00.424335    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 17 15:56:00.424434 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:00.424379    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-ffsr8\""
Sep 17 15:56:00.434440 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:00.434420    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-s9tlv"]
Sep 17 15:56:00.504531 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:00.504483    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/753ea6fe-3f4b-4449-9be0-e35dcd8601b0-crio-socket\") pod \"insights-runtime-extractor-72tfl\" (UID: \"753ea6fe-3f4b-4449-9be0-e35dcd8601b0\") " pod="openshift-insights/insights-runtime-extractor-72tfl"
Sep 17 15:56:00.504682 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:00.504538    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/753ea6fe-3f4b-4449-9be0-e35dcd8601b0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-72tfl\" (UID: \"753ea6fe-3f4b-4449-9be0-e35dcd8601b0\") " pod="openshift-insights/insights-runtime-extractor-72tfl"
Sep 17 15:56:00.504682 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:00.504585    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft4s9\" (UniqueName: \"kubernetes.io/projected/753ea6fe-3f4b-4449-9be0-e35dcd8601b0-kube-api-access-ft4s9\") pod \"insights-runtime-extractor-72tfl\" (UID: \"753ea6fe-3f4b-4449-9be0-e35dcd8601b0\") " pod="openshift-insights/insights-runtime-extractor-72tfl"
Sep 17 15:56:00.504682 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:00.504619    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/753ea6fe-3f4b-4449-9be0-e35dcd8601b0-crio-socket\") pod \"insights-runtime-extractor-72tfl\" (UID: \"753ea6fe-3f4b-4449-9be0-e35dcd8601b0\") " pod="openshift-insights/insights-runtime-extractor-72tfl"
Sep 17 15:56:00.504682 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:56:00.504675    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 15:56:00.504856 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:00.504684    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/753ea6fe-3f4b-4449-9be0-e35dcd8601b0-data-volume\") pod \"insights-runtime-extractor-72tfl\" (UID: \"753ea6fe-3f4b-4449-9be0-e35dcd8601b0\") " pod="openshift-insights/insights-runtime-extractor-72tfl"
Sep 17 15:56:00.504856 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:00.504708    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/753ea6fe-3f4b-4449-9be0-e35dcd8601b0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-72tfl\" (UID: \"753ea6fe-3f4b-4449-9be0-e35dcd8601b0\") " pod="openshift-insights/insights-runtime-extractor-72tfl"
Sep 17 15:56:00.504856 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:56:00.504735    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/753ea6fe-3f4b-4449-9be0-e35dcd8601b0-kube-rbac-proxy-cm podName:753ea6fe-3f4b-4449-9be0-e35dcd8601b0 nodeName:}" failed. No retries permitted until 2026-09-17 15:56:01.00471966 +0000 UTC m=+78.618651176 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/753ea6fe-3f4b-4449-9be0-e35dcd8601b0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-72tfl" (UID: "753ea6fe-3f4b-4449-9be0-e35dcd8601b0") : configmap "kube-rbac-proxy" not found
Sep 17 15:56:00.504856 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:00.504764    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59wv9\" (UniqueName: \"kubernetes.io/projected/c896a89e-55eb-4a94-b771-3d767805c68d-kube-api-access-59wv9\") pod \"migrator-76794cbd6c-s9tlv\" (UID: \"c896a89e-55eb-4a94-b771-3d767805c68d\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-s9tlv"
Sep 17 15:56:00.504856 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:56:00.504777    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 15:56:00.504856 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:56:00.504833    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/753ea6fe-3f4b-4449-9be0-e35dcd8601b0-insights-runtime-extractor-tls podName:753ea6fe-3f4b-4449-9be0-e35dcd8601b0 nodeName:}" failed. No retries permitted until 2026-09-17 15:56:01.004818851 +0000 UTC m=+78.618750349 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/753ea6fe-3f4b-4449-9be0-e35dcd8601b0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-72tfl" (UID: "753ea6fe-3f4b-4449-9be0-e35dcd8601b0") : secret "insights-runtime-extractor-tls" not found
Sep 17 15:56:00.505153 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:00.505136    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/753ea6fe-3f4b-4449-9be0-e35dcd8601b0-data-volume\") pod \"insights-runtime-extractor-72tfl\" (UID: \"753ea6fe-3f4b-4449-9be0-e35dcd8601b0\") " pod="openshift-insights/insights-runtime-extractor-72tfl"
Sep 17 15:56:00.513604 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:00.513578    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft4s9\" (UniqueName: \"kubernetes.io/projected/753ea6fe-3f4b-4449-9be0-e35dcd8601b0-kube-api-access-ft4s9\") pod \"insights-runtime-extractor-72tfl\" (UID: \"753ea6fe-3f4b-4449-9be0-e35dcd8601b0\") " pod="openshift-insights/insights-runtime-extractor-72tfl"
Sep 17 15:56:00.605715 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:00.605635    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59wv9\" (UniqueName: \"kubernetes.io/projected/c896a89e-55eb-4a94-b771-3d767805c68d-kube-api-access-59wv9\") pod \"migrator-76794cbd6c-s9tlv\" (UID: \"c896a89e-55eb-4a94-b771-3d767805c68d\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-s9tlv"
Sep 17 15:56:00.613392 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:00.613365    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59wv9\" (UniqueName: \"kubernetes.io/projected/c896a89e-55eb-4a94-b771-3d767805c68d-kube-api-access-59wv9\") pod \"migrator-76794cbd6c-s9tlv\" (UID: \"c896a89e-55eb-4a94-b771-3d767805c68d\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-s9tlv"
Sep 17 15:56:00.729025 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:00.728989    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-s9tlv"
Sep 17 15:56:00.998344 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:00.998314    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-s9tlv"]
Sep 17 15:56:01.001674 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:56:01.001642    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc896a89e_55eb_4a94_b771_3d767805c68d.slice/crio-da32b1bd40132e82505859a96c4b7663e30059ba2c32e1781d34749f88b8f7dc WatchSource:0}: Error finding container da32b1bd40132e82505859a96c4b7663e30059ba2c32e1781d34749f88b8f7dc: Status 404 returned error can't find the container with id da32b1bd40132e82505859a96c4b7663e30059ba2c32e1781d34749f88b8f7dc
Sep 17 15:56:01.010053 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:01.010033    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/753ea6fe-3f4b-4449-9be0-e35dcd8601b0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-72tfl\" (UID: \"753ea6fe-3f4b-4449-9be0-e35dcd8601b0\") " pod="openshift-insights/insights-runtime-extractor-72tfl"
Sep 17 15:56:01.010153 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:01.010084    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/753ea6fe-3f4b-4449-9be0-e35dcd8601b0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-72tfl\" (UID: \"753ea6fe-3f4b-4449-9be0-e35dcd8601b0\") " pod="openshift-insights/insights-runtime-extractor-72tfl"
Sep 17 15:56:01.010191 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:56:01.010164    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 15:56:01.010191 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:56:01.010180    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 15:56:01.010249 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:56:01.010209    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/753ea6fe-3f4b-4449-9be0-e35dcd8601b0-kube-rbac-proxy-cm podName:753ea6fe-3f4b-4449-9be0-e35dcd8601b0 nodeName:}" failed. No retries permitted until 2026-09-17 15:56:02.010197382 +0000 UTC m=+79.624128870 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/753ea6fe-3f4b-4449-9be0-e35dcd8601b0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-72tfl" (UID: "753ea6fe-3f4b-4449-9be0-e35dcd8601b0") : configmap "kube-rbac-proxy" not found
Sep 17 15:56:01.010249 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:56:01.010232    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/753ea6fe-3f4b-4449-9be0-e35dcd8601b0-insights-runtime-extractor-tls podName:753ea6fe-3f4b-4449-9be0-e35dcd8601b0 nodeName:}" failed. No retries permitted until 2026-09-17 15:56:02.010218924 +0000 UTC m=+79.624150412 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/753ea6fe-3f4b-4449-9be0-e35dcd8601b0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-72tfl" (UID: "753ea6fe-3f4b-4449-9be0-e35dcd8601b0") : secret "insights-runtime-extractor-tls" not found
Sep 17 15:56:01.921416 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:01.921373    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-s9tlv" event={"ID":"c896a89e-55eb-4a94-b771-3d767805c68d","Type":"ContainerStarted","Data":"da32b1bd40132e82505859a96c4b7663e30059ba2c32e1781d34749f88b8f7dc"}
Sep 17 15:56:02.019229 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:02.019191    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/753ea6fe-3f4b-4449-9be0-e35dcd8601b0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-72tfl\" (UID: \"753ea6fe-3f4b-4449-9be0-e35dcd8601b0\") " pod="openshift-insights/insights-runtime-extractor-72tfl"
Sep 17 15:56:02.019426 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:02.019280    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/753ea6fe-3f4b-4449-9be0-e35dcd8601b0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-72tfl\" (UID: \"753ea6fe-3f4b-4449-9be0-e35dcd8601b0\") " pod="openshift-insights/insights-runtime-extractor-72tfl"
Sep 17 15:56:02.019426 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:56:02.019345    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 15:56:02.019426 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:56:02.019404    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 15:56:02.019581 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:56:02.019444    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/753ea6fe-3f4b-4449-9be0-e35dcd8601b0-kube-rbac-proxy-cm podName:753ea6fe-3f4b-4449-9be0-e35dcd8601b0 nodeName:}" failed. No retries permitted until 2026-09-17 15:56:04.019421643 +0000 UTC m=+81.633353145 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/753ea6fe-3f4b-4449-9be0-e35dcd8601b0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-72tfl" (UID: "753ea6fe-3f4b-4449-9be0-e35dcd8601b0") : configmap "kube-rbac-proxy" not found
Sep 17 15:56:02.019581 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:56:02.019464    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/753ea6fe-3f4b-4449-9be0-e35dcd8601b0-insights-runtime-extractor-tls podName:753ea6fe-3f4b-4449-9be0-e35dcd8601b0 nodeName:}" failed. No retries permitted until 2026-09-17 15:56:04.019454383 +0000 UTC m=+81.633385874 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/753ea6fe-3f4b-4449-9be0-e35dcd8601b0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-72tfl" (UID: "753ea6fe-3f4b-4449-9be0-e35dcd8601b0") : secret "insights-runtime-extractor-tls" not found
Sep 17 15:56:02.365295 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:02.365226    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-bzgjm"]
Sep 17 15:56:02.368182 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:02.368167    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-bzgjm"
Sep 17 15:56:02.371395 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:02.371370    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 17 15:56:02.371536 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:02.371375    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 17 15:56:02.372356 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:02.372335    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-5cqhq\""
Sep 17 15:56:02.372439 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:02.372392    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 17 15:56:02.372704 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:02.372690    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 17 15:56:02.380143 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:02.380122    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-bzgjm"]
Sep 17 15:56:02.422845 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:02.422816    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/622269a1-214f-45bb-836b-c363025d3327-signing-key\") pod \"service-ca-55f6fc7b86-bzgjm\" (UID: \"622269a1-214f-45bb-836b-c363025d3327\") " pod="openshift-service-ca/service-ca-55f6fc7b86-bzgjm"
Sep 17 15:56:02.422991 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:02.422915    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/622269a1-214f-45bb-836b-c363025d3327-signing-cabundle\") pod \"service-ca-55f6fc7b86-bzgjm\" (UID: \"622269a1-214f-45bb-836b-c363025d3327\") " pod="openshift-service-ca/service-ca-55f6fc7b86-bzgjm"
Sep 17 15:56:02.422991 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:02.422931    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bf9v7\" (UniqueName: \"kubernetes.io/projected/622269a1-214f-45bb-836b-c363025d3327-kube-api-access-bf9v7\") pod \"service-ca-55f6fc7b86-bzgjm\" (UID: \"622269a1-214f-45bb-836b-c363025d3327\") " pod="openshift-service-ca/service-ca-55f6fc7b86-bzgjm"
Sep 17 15:56:02.453473 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:02.453450    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-x4mhf_b9fd9b22-055f-4540-92c9-6c75c0c14fe3/dns-node-resolver/0.log"
Sep 17 15:56:02.523296 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:02.523264    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/622269a1-214f-45bb-836b-c363025d3327-signing-cabundle\") pod \"service-ca-55f6fc7b86-bzgjm\" (UID: \"622269a1-214f-45bb-836b-c363025d3327\") " pod="openshift-service-ca/service-ca-55f6fc7b86-bzgjm"
Sep 17 15:56:02.523296 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:02.523299    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bf9v7\" (UniqueName: \"kubernetes.io/projected/622269a1-214f-45bb-836b-c363025d3327-kube-api-access-bf9v7\") pod \"service-ca-55f6fc7b86-bzgjm\" (UID: \"622269a1-214f-45bb-836b-c363025d3327\") " pod="openshift-service-ca/service-ca-55f6fc7b86-bzgjm"
Sep 17 15:56:02.523536 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:02.523333    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/622269a1-214f-45bb-836b-c363025d3327-signing-key\") pod \"service-ca-55f6fc7b86-bzgjm\" (UID: \"622269a1-214f-45bb-836b-c363025d3327\") " pod="openshift-service-ca/service-ca-55f6fc7b86-bzgjm"
Sep 17 15:56:02.523969 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:02.523947    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/622269a1-214f-45bb-836b-c363025d3327-signing-cabundle\") pod \"service-ca-55f6fc7b86-bzgjm\" (UID: \"622269a1-214f-45bb-836b-c363025d3327\") " pod="openshift-service-ca/service-ca-55f6fc7b86-bzgjm"
Sep 17 15:56:02.525958 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:02.525922    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/622269a1-214f-45bb-836b-c363025d3327-signing-key\") pod \"service-ca-55f6fc7b86-bzgjm\" (UID: \"622269a1-214f-45bb-836b-c363025d3327\") " pod="openshift-service-ca/service-ca-55f6fc7b86-bzgjm"
Sep 17 15:56:02.536120 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:02.536097    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bf9v7\" (UniqueName: \"kubernetes.io/projected/622269a1-214f-45bb-836b-c363025d3327-kube-api-access-bf9v7\") pod \"service-ca-55f6fc7b86-bzgjm\" (UID: \"622269a1-214f-45bb-836b-c363025d3327\") " pod="openshift-service-ca/service-ca-55f6fc7b86-bzgjm"
Sep 17 15:56:02.676872 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:02.676843    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-bzgjm"
Sep 17 15:56:02.930103 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:02.930033    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-s9tlv" event={"ID":"c896a89e-55eb-4a94-b771-3d767805c68d","Type":"ContainerStarted","Data":"d7acd97fa5a688c2463bda778fa7aa5e2e589bae0199bd77c7d68a8760b8ca36"}
Sep 17 15:56:02.930441 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:02.930114    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-s9tlv" event={"ID":"c896a89e-55eb-4a94-b771-3d767805c68d","Type":"ContainerStarted","Data":"00cc2416b94c7d257aba691cf6e85424b31831c7901ba84641b7ab70b89ec373"}
Sep 17 15:56:02.951329 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:02.951303    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-bzgjm"]
Sep 17 15:56:02.954512 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:56:02.954465    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod622269a1_214f_45bb_836b_c363025d3327.slice/crio-45d857723c18c17d31aa939058f75362e2db2edc8414616f17f927d91873f8ad WatchSource:0}: Error finding container 45d857723c18c17d31aa939058f75362e2db2edc8414616f17f927d91873f8ad: Status 404 returned error can't find the container with id 45d857723c18c17d31aa939058f75362e2db2edc8414616f17f927d91873f8ad
Sep 17 15:56:02.959116 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:02.959071    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-s9tlv" podStartSLOduration=1.898422376 podStartE2EDuration="2.959056416s" totalImagesPullingTime="1.06063404s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:56:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:56:02.957938317 +0000 UTC m=+80.571869827" watchObservedRunningTime="2026-09-17 15:56:02.959056416 +0000 UTC m=+80.572987926"
Sep 17 15:56:03.053635 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:03.053607    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9f2dg_d7d3c798-4b01-4814-8e5c-c200c69dca8f/node-ca/0.log"
Sep 17 15:56:03.733115 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:03.733080    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0fed33a8-badd-44d8-8d68-1422ac50f26a-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-b59pt\" (UID: \"0fed33a8-badd-44d8-8d68-1422ac50f26a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-b59pt"
Sep 17 15:56:03.733266 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:56:03.733228    2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 17 15:56:03.733302 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:56:03.733296    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fed33a8-badd-44d8-8d68-1422ac50f26a-samples-operator-tls podName:0fed33a8-badd-44d8-8d68-1422ac50f26a nodeName:}" failed. No retries permitted until 2026-09-17 15:56:11.733279378 +0000 UTC m=+89.347210866 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0fed33a8-badd-44d8-8d68-1422ac50f26a-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-b59pt" (UID: "0fed33a8-badd-44d8-8d68-1422ac50f26a") : secret "samples-operator-tls" not found
Sep 17 15:56:03.834362 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:03.834324    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed6896ba-27eb-4ba3-a9df-bdb614fca6c1-metrics-certs\") pod \"router-default-69d9cc557b-99lzw\" (UID: \"ed6896ba-27eb-4ba3-a9df-bdb614fca6c1\") " pod="openshift-ingress/router-default-69d9cc557b-99lzw"
Sep 17 15:56:03.834481 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:03.834374    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed6896ba-27eb-4ba3-a9df-bdb614fca6c1-service-ca-bundle\") pod \"router-default-69d9cc557b-99lzw\" (UID: \"ed6896ba-27eb-4ba3-a9df-bdb614fca6c1\") " pod="openshift-ingress/router-default-69d9cc557b-99lzw"
Sep 17 15:56:03.834557 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:56:03.834473    2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 17 15:56:03.834557 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:56:03.834546    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ed6896ba-27eb-4ba3-a9df-bdb614fca6c1-service-ca-bundle podName:ed6896ba-27eb-4ba3-a9df-bdb614fca6c1 nodeName:}" failed. No retries permitted until 2026-09-17 15:56:11.834533581 +0000 UTC m=+89.448465069 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ed6896ba-27eb-4ba3-a9df-bdb614fca6c1-service-ca-bundle") pod "router-default-69d9cc557b-99lzw" (UID: "ed6896ba-27eb-4ba3-a9df-bdb614fca6c1") : configmap references non-existent config key: service-ca.crt
Sep 17 15:56:03.834674 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:56:03.834563    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed6896ba-27eb-4ba3-a9df-bdb614fca6c1-metrics-certs podName:ed6896ba-27eb-4ba3-a9df-bdb614fca6c1 nodeName:}" failed. No retries permitted until 2026-09-17 15:56:11.834557121 +0000 UTC m=+89.448488609 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ed6896ba-27eb-4ba3-a9df-bdb614fca6c1-metrics-certs") pod "router-default-69d9cc557b-99lzw" (UID: "ed6896ba-27eb-4ba3-a9df-bdb614fca6c1") : secret "router-metrics-certs-default" not found
Sep 17 15:56:03.853982 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:03.853964    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-h84cz_d6dfa59f-620e-4edf-a630-d1e1dad50650/serve-healthcheck-canary/0.log"
Sep 17 15:56:03.934372 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:03.934339    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-bzgjm" event={"ID":"622269a1-214f-45bb-836b-c363025d3327","Type":"ContainerStarted","Data":"d3ecbb85a47b6cda9e72209f86c85f592994a48ece70f816d33b0f3362c1499d"}
Sep 17 15:56:03.934765 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:03.934400    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-bzgjm" event={"ID":"622269a1-214f-45bb-836b-c363025d3327","Type":"ContainerStarted","Data":"45d857723c18c17d31aa939058f75362e2db2edc8414616f17f927d91873f8ad"}
Sep 17 15:56:04.035149 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:04.035086    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/753ea6fe-3f4b-4449-9be0-e35dcd8601b0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-72tfl\" (UID: \"753ea6fe-3f4b-4449-9be0-e35dcd8601b0\") " pod="openshift-insights/insights-runtime-extractor-72tfl"
Sep 17 15:56:04.035266 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:56:04.035178    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 15:56:04.035266 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:56:04.035219    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/753ea6fe-3f4b-4449-9be0-e35dcd8601b0-insights-runtime-extractor-tls podName:753ea6fe-3f4b-4449-9be0-e35dcd8601b0 nodeName:}" failed. No retries permitted until 2026-09-17 15:56:08.035207119 +0000 UTC m=+85.649138627 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/753ea6fe-3f4b-4449-9be0-e35dcd8601b0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-72tfl" (UID: "753ea6fe-3f4b-4449-9be0-e35dcd8601b0") : secret "insights-runtime-extractor-tls" not found
Sep 17 15:56:04.035395 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:04.035267    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/753ea6fe-3f4b-4449-9be0-e35dcd8601b0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-72tfl\" (UID: \"753ea6fe-3f4b-4449-9be0-e35dcd8601b0\") " pod="openshift-insights/insights-runtime-extractor-72tfl"
Sep 17 15:56:04.035395 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:56:04.035322    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 15:56:04.035395 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:56:04.035383    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/753ea6fe-3f4b-4449-9be0-e35dcd8601b0-kube-rbac-proxy-cm podName:753ea6fe-3f4b-4449-9be0-e35dcd8601b0 nodeName:}" failed. No retries permitted until 2026-09-17 15:56:08.035368541 +0000 UTC m=+85.649300055 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/753ea6fe-3f4b-4449-9be0-e35dcd8601b0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-72tfl" (UID: "753ea6fe-3f4b-4449-9be0-e35dcd8601b0") : configmap "kube-rbac-proxy" not found
Sep 17 15:56:08.065745 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:08.065717    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/753ea6fe-3f4b-4449-9be0-e35dcd8601b0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-72tfl\" (UID: \"753ea6fe-3f4b-4449-9be0-e35dcd8601b0\") " pod="openshift-insights/insights-runtime-extractor-72tfl"
Sep 17 15:56:08.066104 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:08.065777    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/753ea6fe-3f4b-4449-9be0-e35dcd8601b0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-72tfl\" (UID: \"753ea6fe-3f4b-4449-9be0-e35dcd8601b0\") " pod="openshift-insights/insights-runtime-extractor-72tfl"
Sep 17 15:56:08.066104 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:56:08.065851    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 15:56:08.066104 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:56:08.065861    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 15:56:08.066104 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:56:08.065910    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/753ea6fe-3f4b-4449-9be0-e35dcd8601b0-kube-rbac-proxy-cm podName:753ea6fe-3f4b-4449-9be0-e35dcd8601b0 nodeName:}" failed. No retries permitted until 2026-09-17 15:56:16.065896163 +0000 UTC m=+93.679827652 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/753ea6fe-3f4b-4449-9be0-e35dcd8601b0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-72tfl" (UID: "753ea6fe-3f4b-4449-9be0-e35dcd8601b0") : configmap "kube-rbac-proxy" not found
Sep 17 15:56:08.066104 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:56:08.065924    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/753ea6fe-3f4b-4449-9be0-e35dcd8601b0-insights-runtime-extractor-tls podName:753ea6fe-3f4b-4449-9be0-e35dcd8601b0 nodeName:}" failed. No retries permitted until 2026-09-17 15:56:16.065917979 +0000 UTC m=+93.679849468 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/753ea6fe-3f4b-4449-9be0-e35dcd8601b0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-72tfl" (UID: "753ea6fe-3f4b-4449-9be0-e35dcd8601b0") : secret "insights-runtime-extractor-tls" not found
Sep 17 15:56:11.794673 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:11.794643    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0fed33a8-badd-44d8-8d68-1422ac50f26a-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-b59pt\" (UID: \"0fed33a8-badd-44d8-8d68-1422ac50f26a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-b59pt"
Sep 17 15:56:11.797077 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:11.797042    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0fed33a8-badd-44d8-8d68-1422ac50f26a-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-b59pt\" (UID: \"0fed33a8-badd-44d8-8d68-1422ac50f26a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-b59pt"
Sep 17 15:56:11.895050 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:11.895028    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed6896ba-27eb-4ba3-a9df-bdb614fca6c1-metrics-certs\") pod \"router-default-69d9cc557b-99lzw\" (UID: \"ed6896ba-27eb-4ba3-a9df-bdb614fca6c1\") " pod="openshift-ingress/router-default-69d9cc557b-99lzw"
Sep 17 15:56:11.895153 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:11.895066    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed6896ba-27eb-4ba3-a9df-bdb614fca6c1-service-ca-bundle\") pod \"router-default-69d9cc557b-99lzw\" (UID: \"ed6896ba-27eb-4ba3-a9df-bdb614fca6c1\") " pod="openshift-ingress/router-default-69d9cc557b-99lzw"
Sep 17 15:56:11.895598 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:11.895583    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed6896ba-27eb-4ba3-a9df-bdb614fca6c1-service-ca-bundle\") pod \"router-default-69d9cc557b-99lzw\" (UID: \"ed6896ba-27eb-4ba3-a9df-bdb614fca6c1\") " pod="openshift-ingress/router-default-69d9cc557b-99lzw"
Sep 17 15:56:11.897224 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:11.897198    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed6896ba-27eb-4ba3-a9df-bdb614fca6c1-metrics-certs\") pod \"router-default-69d9cc557b-99lzw\" (UID: \"ed6896ba-27eb-4ba3-a9df-bdb614fca6c1\") " pod="openshift-ingress/router-default-69d9cc557b-99lzw"
Sep 17 15:56:11.912232 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:11.912212    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-b59pt"
Sep 17 15:56:12.035652 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:12.035630    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-69d9cc557b-99lzw"
Sep 17 15:56:12.196889 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:12.196842    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-55f6fc7b86-bzgjm" podStartSLOduration=10.196822914 podStartE2EDuration="10.196822914s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:56:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:56:03.977740519 +0000 UTC m=+81.591672032" watchObservedRunningTime="2026-09-17 15:56:12.196822914 +0000 UTC m=+89.810754424"
Sep 17 15:56:12.197823 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:12.197800    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-b59pt"]
Sep 17 15:56:12.333363 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:12.333294    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-69d9cc557b-99lzw"]
Sep 17 15:56:12.337390 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:56:12.337362    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded6896ba_27eb_4ba3_a9df_bdb614fca6c1.slice/crio-3a3e596dbf2ee0eb7338be481be0e5e3c54b3718d6e715733e731918420a846a WatchSource:0}: Error finding container 3a3e596dbf2ee0eb7338be481be0e5e3c54b3718d6e715733e731918420a846a: Status 404 returned error can't find the container with id 3a3e596dbf2ee0eb7338be481be0e5e3c54b3718d6e715733e731918420a846a
Sep 17 15:56:12.966970 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:12.966926    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-69d9cc557b-99lzw" event={"ID":"ed6896ba-27eb-4ba3-a9df-bdb614fca6c1","Type":"ContainerStarted","Data":"3c562bb2577d183f29ca614398204d870c35fac37bc66feadbe036322471f17d"}
Sep 17 15:56:12.967389 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:12.966980    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-69d9cc557b-99lzw" event={"ID":"ed6896ba-27eb-4ba3-a9df-bdb614fca6c1","Type":"ContainerStarted","Data":"3a3e596dbf2ee0eb7338be481be0e5e3c54b3718d6e715733e731918420a846a"}
Sep 17 15:56:12.968265 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:12.968235    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-b59pt" event={"ID":"0fed33a8-badd-44d8-8d68-1422ac50f26a","Type":"ContainerStarted","Data":"bf19b063aa5af3c85643538f97f6cb4fee4569b13a60395c9ff3eedbd7e5132d"}
Sep 17 15:56:13.007458 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:13.007415    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-69d9cc557b-99lzw" podStartSLOduration=17.007395335 podStartE2EDuration="17.007395335s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:55:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:56:13.006547854 +0000 UTC m=+90.620479366" watchObservedRunningTime="2026-09-17 15:56:13.007395335 +0000 UTC m=+90.621326849"
Sep 17 15:56:13.036718 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:13.036689    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-69d9cc557b-99lzw"
Sep 17 15:56:13.039639 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:13.039622    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-69d9cc557b-99lzw"
Sep 17 15:56:13.971930 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:13.971906    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-69d9cc557b-99lzw"
Sep 17 15:56:13.973168 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:13.973149    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-69d9cc557b-99lzw"
Sep 17 15:56:14.976602 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:14.976569    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-b59pt" event={"ID":"0fed33a8-badd-44d8-8d68-1422ac50f26a","Type":"ContainerStarted","Data":"d316deba76d8d1c8c12be774aa53befd849e94dabab2f78f506f521ff42ddb20"}
Sep 17 15:56:14.976971 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:14.976639    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-b59pt" event={"ID":"0fed33a8-badd-44d8-8d68-1422ac50f26a","Type":"ContainerStarted","Data":"bfee322c07c8cceca523e955fba7fbd537239870c8bee1472b16fd66f29163de"}
Sep 17 15:56:15.000568 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:15.000520    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-b59pt" podStartSLOduration=18.301058033 podStartE2EDuration="20.0004809s" totalImagesPullingTime="1.699422867s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:55:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:56:14.9999734 +0000 UTC m=+92.613904912" watchObservedRunningTime="2026-09-17 15:56:15.0004809 +0000 UTC m=+92.614412410"
Sep 17 15:56:16.127518 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:16.127472    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/753ea6fe-3f4b-4449-9be0-e35dcd8601b0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-72tfl\" (UID: \"753ea6fe-3f4b-4449-9be0-e35dcd8601b0\") " pod="openshift-insights/insights-runtime-extractor-72tfl"
Sep 17 15:56:16.127956 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:16.127567    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/753ea6fe-3f4b-4449-9be0-e35dcd8601b0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-72tfl\" (UID: \"753ea6fe-3f4b-4449-9be0-e35dcd8601b0\") " pod="openshift-insights/insights-runtime-extractor-72tfl"
Sep 17 15:56:16.128140 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:16.128120    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/753ea6fe-3f4b-4449-9be0-e35dcd8601b0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-72tfl\" (UID: \"753ea6fe-3f4b-4449-9be0-e35dcd8601b0\") " pod="openshift-insights/insights-runtime-extractor-72tfl"
Sep 17 15:56:16.129837 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:16.129814    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/753ea6fe-3f4b-4449-9be0-e35dcd8601b0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-72tfl\" (UID: \"753ea6fe-3f4b-4449-9be0-e35dcd8601b0\") " pod="openshift-insights/insights-runtime-extractor-72tfl"
Sep 17 15:56:16.264758 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:16.264730    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-72tfl"
Sep 17 15:56:16.548328 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:16.548291    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-72tfl"]
Sep 17 15:56:16.551644 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:56:16.551617    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod753ea6fe_3f4b_4449_9be0_e35dcd8601b0.slice/crio-f828a0075e40cc09ef5edfa2ba09a4dca7523a4dec29e6814a9918318fce7701 WatchSource:0}: Error finding container f828a0075e40cc09ef5edfa2ba09a4dca7523a4dec29e6814a9918318fce7701: Status 404 returned error can't find the container with id f828a0075e40cc09ef5edfa2ba09a4dca7523a4dec29e6814a9918318fce7701
Sep 17 15:56:16.984420 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:16.984384    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-72tfl" event={"ID":"753ea6fe-3f4b-4449-9be0-e35dcd8601b0","Type":"ContainerStarted","Data":"b3e14477f6cc8554b25cf9e2c93db245500256d65a29c07cc617b956c57f3562"}
Sep 17 15:56:16.984564 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:16.984449    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-72tfl" event={"ID":"753ea6fe-3f4b-4449-9be0-e35dcd8601b0","Type":"ContainerStarted","Data":"f828a0075e40cc09ef5edfa2ba09a4dca7523a4dec29e6814a9918318fce7701"}
Sep 17 15:56:17.990901 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:17.990867    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-72tfl" event={"ID":"753ea6fe-3f4b-4449-9be0-e35dcd8601b0","Type":"ContainerStarted","Data":"42a9baffb25a28d764a1bb58af8f6b8e9edec311a78ca0d7519b19925cf2d09a"}
Sep 17 15:56:18.996102 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:18.996068    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-72tfl" event={"ID":"753ea6fe-3f4b-4449-9be0-e35dcd8601b0","Type":"ContainerStarted","Data":"c268133a95a8069888b40fff5097ebcbaf4102e377ff2e358120682b1eab52f6"}
Sep 17 15:56:19.022831 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:19.022783    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-72tfl" podStartSLOduration=17.135788129 podStartE2EDuration="19.022769798s" totalImagesPullingTime="1.886981669s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 15:56:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:56:19.021898541 +0000 UTC m=+96.635830053" watchObservedRunningTime="2026-09-17 15:56:19.022769798 +0000 UTC m=+96.636701309"
Sep 17 15:56:22.470577 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:22.470523    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4ef9814f-616a-47e8-b1b2-7994485705f0-metrics-tls\") pod \"dns-default-f4g57\" (UID: \"4ef9814f-616a-47e8-b1b2-7994485705f0\") " pod="openshift-dns/dns-default-f4g57"
Sep 17 15:56:22.473106 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:22.473076    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4ef9814f-616a-47e8-b1b2-7994485705f0-metrics-tls\") pod \"dns-default-f4g57\" (UID: \"4ef9814f-616a-47e8-b1b2-7994485705f0\") " pod="openshift-dns/dns-default-f4g57"
Sep 17 15:56:22.703392 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:22.703359    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nhj85\""
Sep 17 15:56:22.711634 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:22.711617    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f4g57"
Sep 17 15:56:22.989990 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:22.989906    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-f4g57"]
Sep 17 15:56:22.992771 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:56:22.992746    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ef9814f_616a_47e8_b1b2_7994485705f0.slice/crio-2f6d0be05b194ba91bc875d6385b060856e51ed0acf8bef8501de9b48b470071 WatchSource:0}: Error finding container 2f6d0be05b194ba91bc875d6385b060856e51ed0acf8bef8501de9b48b470071: Status 404 returned error can't find the container with id 2f6d0be05b194ba91bc875d6385b060856e51ed0acf8bef8501de9b48b470071
Sep 17 15:56:23.009963 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:23.009934    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f4g57" event={"ID":"4ef9814f-616a-47e8-b1b2-7994485705f0","Type":"ContainerStarted","Data":"2f6d0be05b194ba91bc875d6385b060856e51ed0acf8bef8501de9b48b470071"}
Sep 17 15:56:25.018324 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:25.018240    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f4g57" event={"ID":"4ef9814f-616a-47e8-b1b2-7994485705f0","Type":"ContainerStarted","Data":"3d5faa987525cab0ac2251d44c151ba6640452336199e08a73a328310f80ce34"}
Sep 17 15:56:25.018324 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:25.018290    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f4g57" event={"ID":"4ef9814f-616a-47e8-b1b2-7994485705f0","Type":"ContainerStarted","Data":"94a5ff21a21994f0d30dca1329608056fe0a3df771bc3c0f2193571b233115de"}
Sep 17 15:56:25.018324 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:25.018319    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-f4g57"
Sep 17 15:56:25.042029 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:25.041982    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-f4g57" podStartSLOduration=65.384798932 podStartE2EDuration="1m7.041967694s" totalImagesPullingTime="1.657168762s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:55:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:56:25.041567327 +0000 UTC m=+102.655498842" watchObservedRunningTime="2026-09-17 15:56:25.041967694 +0000 UTC m=+102.655899205"
Sep 17 15:56:25.900227 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:25.900194    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-gg77s"
Sep 17 15:56:35.024781 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:35.024741    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-f4g57"
Sep 17 15:56:40.538826 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:40.538795    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-s2vgq"]
Sep 17 15:56:40.541658 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:40.541642    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-s2vgq"
Sep 17 15:56:40.546809 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:40.546788    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-f78ds\""
Sep 17 15:56:40.547635 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:40.547616    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 17 15:56:40.547949 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:40.547929    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 17 15:56:40.548026 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:40.548009    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 17 15:56:40.550790 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:40.550769    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 17 15:56:40.550911 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:40.550785    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 17 15:56:40.561408 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:40.561387    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-s2vgq"]
Sep 17 15:56:40.693776 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:40.693753    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8afb0437-a7da-41aa-b723-60b16f938e25-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-s2vgq\" (UID: \"8afb0437-a7da-41aa-b723-60b16f938e25\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-s2vgq"
Sep 17 15:56:40.693884 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:40.693781    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8afb0437-a7da-41aa-b723-60b16f938e25-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-s2vgq\" (UID: \"8afb0437-a7da-41aa-b723-60b16f938e25\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-s2vgq"
Sep 17 15:56:40.693884 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:40.693803    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-978hl\" (UniqueName: \"kubernetes.io/projected/8afb0437-a7da-41aa-b723-60b16f938e25-kube-api-access-978hl\") pod \"prometheus-operator-7bd5d56d6-s2vgq\" (UID: \"8afb0437-a7da-41aa-b723-60b16f938e25\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-s2vgq"
Sep 17 15:56:40.693884 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:40.693860    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8afb0437-a7da-41aa-b723-60b16f938e25-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-s2vgq\" (UID: \"8afb0437-a7da-41aa-b723-60b16f938e25\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-s2vgq"
Sep 17 15:56:40.795133 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:40.795083    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8afb0437-a7da-41aa-b723-60b16f938e25-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-s2vgq\" (UID: \"8afb0437-a7da-41aa-b723-60b16f938e25\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-s2vgq"
Sep 17 15:56:40.795235 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:40.795145    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8afb0437-a7da-41aa-b723-60b16f938e25-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-s2vgq\" (UID: \"8afb0437-a7da-41aa-b723-60b16f938e25\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-s2vgq"
Sep 17 15:56:40.795301 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:56:40.795233    2584 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Sep 17 15:56:40.795301 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:40.795251    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8afb0437-a7da-41aa-b723-60b16f938e25-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-s2vgq\" (UID: \"8afb0437-a7da-41aa-b723-60b16f938e25\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-s2vgq"
Sep 17 15:56:40.795301 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:40.795283    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-978hl\" (UniqueName: \"kubernetes.io/projected/8afb0437-a7da-41aa-b723-60b16f938e25-kube-api-access-978hl\") pod \"prometheus-operator-7bd5d56d6-s2vgq\" (UID: \"8afb0437-a7da-41aa-b723-60b16f938e25\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-s2vgq"
Sep 17 15:56:40.795433 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:56:40.795305    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8afb0437-a7da-41aa-b723-60b16f938e25-prometheus-operator-tls podName:8afb0437-a7da-41aa-b723-60b16f938e25 nodeName:}" failed. No retries permitted until 2026-09-17 15:56:41.295286273 +0000 UTC m=+118.909217782 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/8afb0437-a7da-41aa-b723-60b16f938e25-prometheus-operator-tls") pod "prometheus-operator-7bd5d56d6-s2vgq" (UID: "8afb0437-a7da-41aa-b723-60b16f938e25") : secret "prometheus-operator-tls" not found
Sep 17 15:56:40.795903 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:40.795885    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8afb0437-a7da-41aa-b723-60b16f938e25-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-s2vgq\" (UID: \"8afb0437-a7da-41aa-b723-60b16f938e25\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-s2vgq"
Sep 17 15:56:40.797475 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:40.797458    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8afb0437-a7da-41aa-b723-60b16f938e25-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-s2vgq\" (UID: \"8afb0437-a7da-41aa-b723-60b16f938e25\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-s2vgq"
Sep 17 15:56:40.805706 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:40.805686    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-978hl\" (UniqueName: \"kubernetes.io/projected/8afb0437-a7da-41aa-b723-60b16f938e25-kube-api-access-978hl\") pod \"prometheus-operator-7bd5d56d6-s2vgq\" (UID: \"8afb0437-a7da-41aa-b723-60b16f938e25\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-s2vgq"
Sep 17 15:56:41.298471 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:41.298419    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8afb0437-a7da-41aa-b723-60b16f938e25-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-s2vgq\" (UID: \"8afb0437-a7da-41aa-b723-60b16f938e25\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-s2vgq"
Sep 17 15:56:41.300990 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:41.300967    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8afb0437-a7da-41aa-b723-60b16f938e25-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-s2vgq\" (UID: \"8afb0437-a7da-41aa-b723-60b16f938e25\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-s2vgq"
Sep 17 15:56:41.454082 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:41.454047    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-s2vgq"
Sep 17 15:56:41.709158 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:41.709126    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6594f4c75-pb7nf"]
Sep 17 15:56:41.712652 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:41.712630    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6594f4c75-pb7nf"
Sep 17 15:56:41.715577 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:41.715513    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 17 15:56:41.715813 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:41.715794    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-vn2vc\""
Sep 17 15:56:41.716580 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:41.716556    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 17 15:56:41.728950 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:41.728920    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6594f4c75-pb7nf"]
Sep 17 15:56:41.744946 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:41.744921    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-s2vgq"]
Sep 17 15:56:41.747905 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:56:41.747880    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8afb0437_a7da_41aa_b723_60b16f938e25.slice/crio-a130f057c7b9e2381531974fb5607c9d80f92a92f599e1a2c48cb1f80a471a4c WatchSource:0}: Error finding container a130f057c7b9e2381531974fb5607c9d80f92a92f599e1a2c48cb1f80a471a4c: Status 404 returned error can't find the container with id a130f057c7b9e2381531974fb5607c9d80f92a92f599e1a2c48cb1f80a471a4c
Sep 17 15:56:41.803715 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:41.803695    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qphrq\" (UniqueName: \"kubernetes.io/projected/18bcc485-4178-40a4-b51d-0ec2d8ef2430-kube-api-access-qphrq\") pod \"downloads-6594f4c75-pb7nf\" (UID: \"18bcc485-4178-40a4-b51d-0ec2d8ef2430\") " pod="openshift-console/downloads-6594f4c75-pb7nf"
Sep 17 15:56:41.904683 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:41.904657    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qphrq\" (UniqueName: \"kubernetes.io/projected/18bcc485-4178-40a4-b51d-0ec2d8ef2430-kube-api-access-qphrq\") pod \"downloads-6594f4c75-pb7nf\" (UID: \"18bcc485-4178-40a4-b51d-0ec2d8ef2430\") " pod="openshift-console/downloads-6594f4c75-pb7nf"
Sep 17 15:56:41.914067 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:41.914035    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qphrq\" (UniqueName: \"kubernetes.io/projected/18bcc485-4178-40a4-b51d-0ec2d8ef2430-kube-api-access-qphrq\") pod \"downloads-6594f4c75-pb7nf\" (UID: \"18bcc485-4178-40a4-b51d-0ec2d8ef2430\") " pod="openshift-console/downloads-6594f4c75-pb7nf"
Sep 17 15:56:42.022735 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:42.022672    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6594f4c75-pb7nf"
Sep 17 15:56:42.078463 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:42.078422    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-s2vgq" event={"ID":"8afb0437-a7da-41aa-b723-60b16f938e25","Type":"ContainerStarted","Data":"a130f057c7b9e2381531974fb5607c9d80f92a92f599e1a2c48cb1f80a471a4c"}
Sep 17 15:56:42.299485 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:42.299459    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6594f4c75-pb7nf"]
Sep 17 15:56:42.302058 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:56:42.302030    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18bcc485_4178_40a4_b51d_0ec2d8ef2430.slice/crio-298e42fb9c2716c40b2118fde9d22b00bdb813d4e198dccbd3105acd147077bd WatchSource:0}: Error finding container 298e42fb9c2716c40b2118fde9d22b00bdb813d4e198dccbd3105acd147077bd: Status 404 returned error can't find the container with id 298e42fb9c2716c40b2118fde9d22b00bdb813d4e198dccbd3105acd147077bd
Sep 17 15:56:43.084425 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:43.084382    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6594f4c75-pb7nf" event={"ID":"18bcc485-4178-40a4-b51d-0ec2d8ef2430","Type":"ContainerStarted","Data":"298e42fb9c2716c40b2118fde9d22b00bdb813d4e198dccbd3105acd147077bd"}
Sep 17 15:56:43.086704 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:43.086676    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-s2vgq" event={"ID":"8afb0437-a7da-41aa-b723-60b16f938e25","Type":"ContainerStarted","Data":"b12d8522f37138971a19bb3f6841be5b6037f237558fff5869f234f2e0e0a443"}
Sep 17 15:56:43.086832 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:43.086731    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-s2vgq" event={"ID":"8afb0437-a7da-41aa-b723-60b16f938e25","Type":"ContainerStarted","Data":"d559c55685559e19474b72027a928461aeb215e30c657ac45b7e2255f1092279"}
Sep 17 15:56:43.117961 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:43.117916    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-s2vgq" podStartSLOduration=1.956196158 podStartE2EDuration="3.117902187s" totalImagesPullingTime="1.161706029s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:56:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:56:43.11718926 +0000 UTC m=+120.731120770" watchObservedRunningTime="2026-09-17 15:56:43.117902187 +0000 UTC m=+120.731833745"
Sep 17 15:56:44.978317 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:44.978283    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-7q45d"]
Sep 17 15:56:44.981242 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:44.981222    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-7q45d"
Sep 17 15:56:44.984554 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:44.984448    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 17 15:56:44.984554 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:44.984536    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 17 15:56:44.985426 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:44.985405    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 17 15:56:44.985670 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:44.985645    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-m54pn\""
Sep 17 15:56:44.998417 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:44.998391    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-7q45d"]
Sep 17 15:56:45.040016 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:45.039992    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-766qq"]
Sep 17 15:56:45.042563 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:45.042109    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-766qq"
Sep 17 15:56:45.045860 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:45.045840    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 17 15:56:45.047316 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:45.047297    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 17 15:56:45.047589 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:45.047569    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 17 15:56:45.050525 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:45.050485    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dc5q2\""
Sep 17 15:56:45.128702 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:45.128673    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/792e2670-e133-4ad2-b739-4a11a314a37c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-7q45d\" (UID: \"792e2670-e133-4ad2-b739-4a11a314a37c\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-7q45d"
Sep 17 15:56:45.128702 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:45.128702    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/317ab750-2c95-4a60-ba94-738339edab42-node-exporter-textfile\") pod \"node-exporter-766qq\" (UID: \"317ab750-2c95-4a60-ba94-738339edab42\") " pod="openshift-monitoring/node-exporter-766qq"
Sep 17 15:56:45.128883 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:45.128738    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6slgp\" (UniqueName: \"kubernetes.io/projected/317ab750-2c95-4a60-ba94-738339edab42-kube-api-access-6slgp\") pod \"node-exporter-766qq\" (UID: \"317ab750-2c95-4a60-ba94-738339edab42\") " pod="openshift-monitoring/node-exporter-766qq"
Sep 17 15:56:45.128883 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:45.128768    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/317ab750-2c95-4a60-ba94-738339edab42-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-766qq\" (UID: \"317ab750-2c95-4a60-ba94-738339edab42\") " pod="openshift-monitoring/node-exporter-766qq"
Sep 17 15:56:45.128883 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:45.128787    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/317ab750-2c95-4a60-ba94-738339edab42-sys\") pod \"node-exporter-766qq\" (UID: \"317ab750-2c95-4a60-ba94-738339edab42\") " pod="openshift-monitoring/node-exporter-766qq"
Sep 17 15:56:45.128883 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:45.128803    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/317ab750-2c95-4a60-ba94-738339edab42-node-exporter-accelerators-collector-config\") pod \"node-exporter-766qq\" (UID: \"317ab750-2c95-4a60-ba94-738339edab42\") " pod="openshift-monitoring/node-exporter-766qq"
Sep 17 15:56:45.128883 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:45.128823    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/317ab750-2c95-4a60-ba94-738339edab42-root\") pod \"node-exporter-766qq\" (UID: \"317ab750-2c95-4a60-ba94-738339edab42\") " pod="openshift-monitoring/node-exporter-766qq"
Sep 17 15:56:45.128883 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:45.128856    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/792e2670-e133-4ad2-b739-4a11a314a37c-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-7q45d\" (UID: \"792e2670-e133-4ad2-b739-4a11a314a37c\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-7q45d"
Sep 17 15:56:45.128883 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:45.128871    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/317ab750-2c95-4a60-ba94-738339edab42-metrics-client-ca\") pod \"node-exporter-766qq\" (UID: \"317ab750-2c95-4a60-ba94-738339edab42\") " pod="openshift-monitoring/node-exporter-766qq"
Sep 17 15:56:45.129207 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:45.128899    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/317ab750-2c95-4a60-ba94-738339edab42-node-exporter-tls\") pod \"node-exporter-766qq\" (UID: \"317ab750-2c95-4a60-ba94-738339edab42\") " pod="openshift-monitoring/node-exporter-766qq"
Sep 17 15:56:45.129207 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:45.128920    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/792e2670-e133-4ad2-b739-4a11a314a37c-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-7q45d\" (UID: \"792e2670-e133-4ad2-b739-4a11a314a37c\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-7q45d"
Sep 17 15:56:45.129207 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:45.128936    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/792e2670-e133-4ad2-b739-4a11a314a37c-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-7q45d\" (UID: \"792e2670-e133-4ad2-b739-4a11a314a37c\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-7q45d"
Sep 17 15:56:45.129207 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:45.128962    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctvsp\" (UniqueName: \"kubernetes.io/projected/792e2670-e133-4ad2-b739-4a11a314a37c-kube-api-access-ctvsp\") pod \"kube-state-metrics-84c885658c-7q45d\" (UID: \"792e2670-e133-4ad2-b739-4a11a314a37c\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-7q45d"
Sep 17 15:56:45.129207 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:45.128983    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/317ab750-2c95-4a60-ba94-738339edab42-node-exporter-wtmp\") pod \"node-exporter-766qq\" (UID: \"317ab750-2c95-4a60-ba94-738339edab42\") " pod="openshift-monitoring/node-exporter-766qq"
Sep 17 15:56:45.129207 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:45.129017    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/792e2670-e133-4ad2-b739-4a11a314a37c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-7q45d\" (UID: \"792e2670-e133-4ad2-b739-4a11a314a37c\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-7q45d"
Sep 17 15:56:45.230240 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:45.230173    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/317ab750-2c95-4a60-ba94-738339edab42-root\") pod \"node-exporter-766qq\" (UID: \"317ab750-2c95-4a60-ba94-738339edab42\") " pod="openshift-monitoring/node-exporter-766qq"
Sep 17 15:56:45.230240 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:45.230223    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/792e2670-e133-4ad2-b739-4a11a314a37c-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-7q45d\" (UID: \"792e2670-e133-4ad2-b739-4a11a314a37c\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-7q45d"
Sep 17 15:56:45.230406 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:45.230250    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/317ab750-2c95-4a60-ba94-738339edab42-metrics-client-ca\") pod \"node-exporter-766qq\" (UID: \"317ab750-2c95-4a60-ba94-738339edab42\") " pod="openshift-monitoring/node-exporter-766qq"
Sep 17 15:56:45.230406 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:45.230280    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/317ab750-2c95-4a60-ba94-738339edab42-root\") pod \"node-exporter-766qq\" (UID: \"317ab750-2c95-4a60-ba94-738339edab42\") " pod="openshift-monitoring/node-exporter-766qq"
Sep 17 15:56:45.230406 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:45.230286    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/317ab750-2c95-4a60-ba94-738339edab42-node-exporter-tls\") pod \"node-exporter-766qq\" (UID: \"317ab750-2c95-4a60-ba94-738339edab42\") " pod="openshift-monitoring/node-exporter-766qq"
Sep 17 15:56:45.230406 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:45.230347    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/792e2670-e133-4ad2-b739-4a11a314a37c-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-7q45d\" (UID: \"792e2670-e133-4ad2-b739-4a11a314a37c\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-7q45d"
Sep 17 15:56:45.230406 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:45.230372    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/792e2670-e133-4ad2-b739-4a11a314a37c-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-7q45d\" (UID: \"792e2670-e133-4ad2-b739-4a11a314a37c\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-7q45d"
Sep 17 15:56:45.230406 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:56:45.230392    2584 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Sep 17 15:56:45.230406 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:45.230402    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctvsp\" (UniqueName: \"kubernetes.io/projected/792e2670-e133-4ad2-b739-4a11a314a37c-kube-api-access-ctvsp\") pod \"kube-state-metrics-84c885658c-7q45d\" (UID: \"792e2670-e133-4ad2-b739-4a11a314a37c\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-7q45d"
Sep 17 15:56:45.230796 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:45.230423    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/317ab750-2c95-4a60-ba94-738339edab42-node-exporter-wtmp\") pod \"node-exporter-766qq\" (UID: \"317ab750-2c95-4a60-ba94-738339edab42\") " pod="openshift-monitoring/node-exporter-766qq"
Sep 17 15:56:45.230796 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:56:45.230469    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/792e2670-e133-4ad2-b739-4a11a314a37c-kube-state-metrics-tls podName:792e2670-e133-4ad2-b739-4a11a314a37c nodeName:}" failed. No retries permitted until 2026-09-17 15:56:45.730448602 +0000 UTC m=+123.344380092 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/792e2670-e133-4ad2-b739-4a11a314a37c-kube-state-metrics-tls") pod "kube-state-metrics-84c885658c-7q45d" (UID: "792e2670-e133-4ad2-b739-4a11a314a37c") : secret "kube-state-metrics-tls" not found
Sep 17 15:56:45.230796 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:45.230524    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/792e2670-e133-4ad2-b739-4a11a314a37c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-7q45d\" (UID: \"792e2670-e133-4ad2-b739-4a11a314a37c\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-7q45d"
Sep 17 15:56:45.230796 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:45.230568    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/317ab750-2c95-4a60-ba94-738339edab42-node-exporter-wtmp\") pod \"node-exporter-766qq\" (UID: \"317ab750-2c95-4a60-ba94-738339edab42\") " pod="openshift-monitoring/node-exporter-766qq"
Sep 17 15:56:45.230796 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:45.230575    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/792e2670-e133-4ad2-b739-4a11a314a37c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-7q45d\" (UID: \"792e2670-e133-4ad2-b739-4a11a314a37c\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-7q45d"
Sep 17 15:56:45.230796 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:45.230602    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/317ab750-2c95-4a60-ba94-738339edab42-node-exporter-textfile\") pod \"node-exporter-766qq\" (UID: \"317ab750-2c95-4a60-ba94-738339edab42\") " pod="openshift-monitoring/node-exporter-766qq"
Sep 17 15:56:45.231081 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:45.230990    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/317ab750-2c95-4a60-ba94-738339edab42-node-exporter-textfile\") pod \"node-exporter-766qq\" (UID: \"317ab750-2c95-4a60-ba94-738339edab42\") " pod="openshift-monitoring/node-exporter-766qq"
Sep 17 15:56:45.231527 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:45.231149    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/792e2670-e133-4ad2-b739-4a11a314a37c-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-7q45d\" (UID: \"792e2670-e133-4ad2-b739-4a11a314a37c\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-7q45d"
Sep 17 15:56:45.231527 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:45.231210    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/792e2670-e133-4ad2-b739-4a11a314a37c-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-7q45d\" (UID: \"792e2670-e133-4ad2-b739-4a11a314a37c\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-7q45d"
Sep 17 15:56:45.231527 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:45.231269    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6slgp\" (UniqueName: \"kubernetes.io/projected/317ab750-2c95-4a60-ba94-738339edab42-kube-api-access-6slgp\") pod \"node-exporter-766qq\" (UID: \"317ab750-2c95-4a60-ba94-738339edab42\") " pod="openshift-monitoring/node-exporter-766qq"
Sep 17 15:56:45.231527 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:45.231314    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/317ab750-2c95-4a60-ba94-738339edab42-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-766qq\" (UID: \"317ab750-2c95-4a60-ba94-738339edab42\") " pod="openshift-monitoring/node-exporter-766qq"
Sep 17 15:56:45.231527 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:45.231318    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/792e2670-e133-4ad2-b739-4a11a314a37c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-7q45d\" (UID: \"792e2670-e133-4ad2-b739-4a11a314a37c\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-7q45d"
Sep 17 15:56:45.231527 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:45.231342    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/317ab750-2c95-4a60-ba94-738339edab42-sys\") pod \"node-exporter-766qq\" (UID: \"317ab750-2c95-4a60-ba94-738339edab42\") " pod="openshift-monitoring/node-exporter-766qq"
Sep 17 15:56:45.231527 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:45.231368    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/317ab750-2c95-4a60-ba94-738339edab42-node-exporter-accelerators-collector-config\") pod \"node-exporter-766qq\" (UID: \"317ab750-2c95-4a60-ba94-738339edab42\") " pod="openshift-monitoring/node-exporter-766qq"
Sep 17 15:56:45.231527 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:45.231426    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/317ab750-2c95-4a60-ba94-738339edab42-sys\") pod \"node-exporter-766qq\" (UID: \"317ab750-2c95-4a60-ba94-738339edab42\") " pod="openshift-monitoring/node-exporter-766qq"
Sep 17 15:56:45.231972 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:45.231660    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/317ab750-2c95-4a60-ba94-738339edab42-metrics-client-ca\") pod \"node-exporter-766qq\" (UID: \"317ab750-2c95-4a60-ba94-738339edab42\") " pod="openshift-monitoring/node-exporter-766qq"
Sep 17 15:56:45.231972 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:45.231839    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/317ab750-2c95-4a60-ba94-738339edab42-node-exporter-accelerators-collector-config\") pod \"node-exporter-766qq\" (UID: \"317ab750-2c95-4a60-ba94-738339edab42\") " pod="openshift-monitoring/node-exporter-766qq"
Sep 17 15:56:45.233726 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:45.233597    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/317ab750-2c95-4a60-ba94-738339edab42-node-exporter-tls\") pod \"node-exporter-766qq\" (UID: \"317ab750-2c95-4a60-ba94-738339edab42\") " pod="openshift-monitoring/node-exporter-766qq"
Sep 17 15:56:45.234307 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:45.234266    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/792e2670-e133-4ad2-b739-4a11a314a37c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-7q45d\" (UID: \"792e2670-e133-4ad2-b739-4a11a314a37c\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-7q45d"
Sep 17 15:56:45.234805 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:45.234786    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/317ab750-2c95-4a60-ba94-738339edab42-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-766qq\" (UID: \"317ab750-2c95-4a60-ba94-738339edab42\") " pod="openshift-monitoring/node-exporter-766qq"
Sep 17 15:56:45.248707 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:45.248685    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6slgp\" (UniqueName: \"kubernetes.io/projected/317ab750-2c95-4a60-ba94-738339edab42-kube-api-access-6slgp\") pod \"node-exporter-766qq\" (UID: \"317ab750-2c95-4a60-ba94-738339edab42\") " pod="openshift-monitoring/node-exporter-766qq"
Sep 17 15:56:45.252147 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:45.252123    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctvsp\" (UniqueName: \"kubernetes.io/projected/792e2670-e133-4ad2-b739-4a11a314a37c-kube-api-access-ctvsp\") pod \"kube-state-metrics-84c885658c-7q45d\" (UID: \"792e2670-e133-4ad2-b739-4a11a314a37c\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-7q45d"
Sep 17 15:56:45.352557 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:45.352528    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-766qq"
Sep 17 15:56:45.363586 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:56:45.363558    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod317ab750_2c95_4a60_ba94_738339edab42.slice/crio-6d6d89686c3a006f2843ddfce4eeb257f92becdf22aeaaaa4037d25f4e391e3a WatchSource:0}: Error finding container 6d6d89686c3a006f2843ddfce4eeb257f92becdf22aeaaaa4037d25f4e391e3a: Status 404 returned error can't find the container with id 6d6d89686c3a006f2843ddfce4eeb257f92becdf22aeaaaa4037d25f4e391e3a
Sep 17 15:56:45.736884 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:45.736846    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/792e2670-e133-4ad2-b739-4a11a314a37c-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-7q45d\" (UID: \"792e2670-e133-4ad2-b739-4a11a314a37c\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-7q45d"
Sep 17 15:56:45.739765 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:45.739740    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/792e2670-e133-4ad2-b739-4a11a314a37c-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-7q45d\" (UID: \"792e2670-e133-4ad2-b739-4a11a314a37c\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-7q45d"
Sep 17 15:56:45.892880 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:45.892850    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-7q45d"
Sep 17 15:56:46.118435 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:46.118339    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-766qq" event={"ID":"317ab750-2c95-4a60-ba94-738339edab42","Type":"ContainerStarted","Data":"6d6d89686c3a006f2843ddfce4eeb257f92becdf22aeaaaa4037d25f4e391e3a"}
Sep 17 15:56:46.191252 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:46.191222    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-7q45d"]
Sep 17 15:56:46.418697 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:56:46.418656    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod792e2670_e133_4ad2_b739_4a11a314a37c.slice/crio-1bfab96bcbac3b4551cea24478c72adca6e852cc027b13c43a90526aa6375dcf WatchSource:0}: Error finding container 1bfab96bcbac3b4551cea24478c72adca6e852cc027b13c43a90526aa6375dcf: Status 404 returned error can't find the container with id 1bfab96bcbac3b4551cea24478c72adca6e852cc027b13c43a90526aa6375dcf
Sep 17 15:56:47.124328 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:47.124246    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-7q45d" event={"ID":"792e2670-e133-4ad2-b739-4a11a314a37c","Type":"ContainerStarted","Data":"1bfab96bcbac3b4551cea24478c72adca6e852cc027b13c43a90526aa6375dcf"}
Sep 17 15:56:47.126779 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:47.126676    2584 generic.go:356] "Generic (PLEG): container finished" podID="317ab750-2c95-4a60-ba94-738339edab42" containerID="b740dbb016ce958a2c106d97af3bb9e841b147db4df90287117274703e588c1d" exitCode=0
Sep 17 15:56:47.126779 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:47.126728    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-766qq" event={"ID":"317ab750-2c95-4a60-ba94-738339edab42","Type":"ContainerDied","Data":"b740dbb016ce958a2c106d97af3bb9e841b147db4df90287117274703e588c1d"}
Sep 17 15:56:48.134836 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:48.134748    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-766qq" event={"ID":"317ab750-2c95-4a60-ba94-738339edab42","Type":"ContainerStarted","Data":"368ce9376a8c959a8de76e1ba88c68aa13ee20285b53c5f9abb8f9a9fb87ec10"}
Sep 17 15:56:48.134836 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:48.134811    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-766qq" event={"ID":"317ab750-2c95-4a60-ba94-738339edab42","Type":"ContainerStarted","Data":"cc8682130651c6cba34f326c311233ac82ebc86564612e52a0196e746e14707a"}
Sep 17 15:56:48.137819 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:48.137709    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-7q45d" event={"ID":"792e2670-e133-4ad2-b739-4a11a314a37c","Type":"ContainerStarted","Data":"41d543f715fb57d00d8598778b0e061b94c4d7d071b5db70dd934ef7f252dbdb"}
Sep 17 15:56:48.137819 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:48.137766    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-7q45d" event={"ID":"792e2670-e133-4ad2-b739-4a11a314a37c","Type":"ContainerStarted","Data":"b280d00ab272eb1f0238084b716a1bf8662cbd8dbd2fc4be2dcb46748562d843"}
Sep 17 15:56:48.137819 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:48.137793    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-7q45d" event={"ID":"792e2670-e133-4ad2-b739-4a11a314a37c","Type":"ContainerStarted","Data":"ede09b8d8e252c6bbc06fa0720b4f6f2fe62cc13ba6f132de28d8affbe477473"}
Sep 17 15:56:48.216964 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:48.216851    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-84c885658c-7q45d" podStartSLOduration=2.9927037690000002 podStartE2EDuration="4.21683044s" totalImagesPullingTime="1.224126671s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:56:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:56:48.215621127 +0000 UTC m=+125.829552639" watchObservedRunningTime="2026-09-17 15:56:48.21683044 +0000 UTC m=+125.830761951"
Sep 17 15:56:48.217292 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:48.217257    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-766qq" podStartSLOduration=2.015275684 podStartE2EDuration="3.217243327s" totalImagesPullingTime="1.12376852s" totalInitContainerRuntime="78.199123ms" isStatefulPod=true podCreationTimestamp="2026-09-17 15:56:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:56:48.180837605 +0000 UTC m=+125.794769116" watchObservedRunningTime="2026-09-17 15:56:48.217243327 +0000 UTC m=+125.831174840"
Sep 17 15:56:49.421655 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:49.421622    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-698fbc5854-jf54h"]
Sep 17 15:56:49.424440 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:49.424418    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-698fbc5854-jf54h"
Sep 17 15:56:49.429080 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:49.429057    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 17 15:56:49.429202 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:49.429120    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 17 15:56:49.430257 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:49.430078    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 17 15:56:49.430257 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:49.430110    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 17 15:56:49.430257 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:49.430179    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-f4wl7\""
Sep 17 15:56:49.430257 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:49.430086    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-4eo0r6v9ud15d\""
Sep 17 15:56:49.437294 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:49.437271    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-698fbc5854-jf54h"]
Sep 17 15:56:49.574551 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:49.574529    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/43584f09-84be-4cb8-8a5f-5398bcad4c74-audit-log\") pod \"metrics-server-698fbc5854-jf54h\" (UID: \"43584f09-84be-4cb8-8a5f-5398bcad4c74\") " pod="openshift-monitoring/metrics-server-698fbc5854-jf54h"
Sep 17 15:56:49.574685 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:49.574559    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/43584f09-84be-4cb8-8a5f-5398bcad4c74-secret-metrics-server-client-certs\") pod \"metrics-server-698fbc5854-jf54h\" (UID: \"43584f09-84be-4cb8-8a5f-5398bcad4c74\") " pod="openshift-monitoring/metrics-server-698fbc5854-jf54h"
Sep 17 15:56:49.574685 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:49.574583    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dx27\" (UniqueName: \"kubernetes.io/projected/43584f09-84be-4cb8-8a5f-5398bcad4c74-kube-api-access-8dx27\") pod \"metrics-server-698fbc5854-jf54h\" (UID: \"43584f09-84be-4cb8-8a5f-5398bcad4c74\") " pod="openshift-monitoring/metrics-server-698fbc5854-jf54h"
Sep 17 15:56:49.574685 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:49.574603    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/43584f09-84be-4cb8-8a5f-5398bcad4c74-client-ca-bundle\") pod \"metrics-server-698fbc5854-jf54h\" (UID: \"43584f09-84be-4cb8-8a5f-5398bcad4c74\") " pod="openshift-monitoring/metrics-server-698fbc5854-jf54h"
Sep 17 15:56:49.574685 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:49.574678    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43584f09-84be-4cb8-8a5f-5398bcad4c74-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-698fbc5854-jf54h\" (UID: \"43584f09-84be-4cb8-8a5f-5398bcad4c74\") " pod="openshift-monitoring/metrics-server-698fbc5854-jf54h"
Sep 17 15:56:49.574868 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:49.574703    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/43584f09-84be-4cb8-8a5f-5398bcad4c74-metrics-server-audit-profiles\") pod \"metrics-server-698fbc5854-jf54h\" (UID: \"43584f09-84be-4cb8-8a5f-5398bcad4c74\") " pod="openshift-monitoring/metrics-server-698fbc5854-jf54h"
Sep 17 15:56:49.574868 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:49.574783    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/43584f09-84be-4cb8-8a5f-5398bcad4c74-secret-metrics-server-tls\") pod \"metrics-server-698fbc5854-jf54h\" (UID: \"43584f09-84be-4cb8-8a5f-5398bcad4c74\") " pod="openshift-monitoring/metrics-server-698fbc5854-jf54h"
Sep 17 15:56:49.675780 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:49.675683    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/43584f09-84be-4cb8-8a5f-5398bcad4c74-audit-log\") pod \"metrics-server-698fbc5854-jf54h\" (UID: \"43584f09-84be-4cb8-8a5f-5398bcad4c74\") " pod="openshift-monitoring/metrics-server-698fbc5854-jf54h"
Sep 17 15:56:49.676525 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:49.676386    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/43584f09-84be-4cb8-8a5f-5398bcad4c74-secret-metrics-server-client-certs\") pod \"metrics-server-698fbc5854-jf54h\" (UID: \"43584f09-84be-4cb8-8a5f-5398bcad4c74\") " pod="openshift-monitoring/metrics-server-698fbc5854-jf54h"
Sep 17 15:56:49.676525 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:49.676461    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/43584f09-84be-4cb8-8a5f-5398bcad4c74-audit-log\") pod \"metrics-server-698fbc5854-jf54h\" (UID: \"43584f09-84be-4cb8-8a5f-5398bcad4c74\") " pod="openshift-monitoring/metrics-server-698fbc5854-jf54h"
Sep 17 15:56:49.678201 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:49.676620    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dx27\" (UniqueName: \"kubernetes.io/projected/43584f09-84be-4cb8-8a5f-5398bcad4c74-kube-api-access-8dx27\") pod \"metrics-server-698fbc5854-jf54h\" (UID: \"43584f09-84be-4cb8-8a5f-5398bcad4c74\") " pod="openshift-monitoring/metrics-server-698fbc5854-jf54h"
Sep 17 15:56:49.678201 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:49.676834    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/43584f09-84be-4cb8-8a5f-5398bcad4c74-client-ca-bundle\") pod \"metrics-server-698fbc5854-jf54h\" (UID: \"43584f09-84be-4cb8-8a5f-5398bcad4c74\") " pod="openshift-monitoring/metrics-server-698fbc5854-jf54h"
Sep 17 15:56:49.678201 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:49.676883    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43584f09-84be-4cb8-8a5f-5398bcad4c74-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-698fbc5854-jf54h\" (UID: \"43584f09-84be-4cb8-8a5f-5398bcad4c74\") " pod="openshift-monitoring/metrics-server-698fbc5854-jf54h"
Sep 17 15:56:49.678201 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:49.676917    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/43584f09-84be-4cb8-8a5f-5398bcad4c74-metrics-server-audit-profiles\") pod \"metrics-server-698fbc5854-jf54h\" (UID: \"43584f09-84be-4cb8-8a5f-5398bcad4c74\") " pod="openshift-monitoring/metrics-server-698fbc5854-jf54h"
Sep 17 15:56:49.680398 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:49.678479    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/43584f09-84be-4cb8-8a5f-5398bcad4c74-secret-metrics-server-tls\") pod \"metrics-server-698fbc5854-jf54h\" (UID: \"43584f09-84be-4cb8-8a5f-5398bcad4c74\") " pod="openshift-monitoring/metrics-server-698fbc5854-jf54h"
Sep 17 15:56:49.680398 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:49.678582    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43584f09-84be-4cb8-8a5f-5398bcad4c74-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-698fbc5854-jf54h\" (UID: \"43584f09-84be-4cb8-8a5f-5398bcad4c74\") " pod="openshift-monitoring/metrics-server-698fbc5854-jf54h"
Sep 17 15:56:49.680398 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:49.679518    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/43584f09-84be-4cb8-8a5f-5398bcad4c74-metrics-server-audit-profiles\") pod \"metrics-server-698fbc5854-jf54h\" (UID: \"43584f09-84be-4cb8-8a5f-5398bcad4c74\") " pod="openshift-monitoring/metrics-server-698fbc5854-jf54h"
Sep 17 15:56:49.680398 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:49.679758    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/43584f09-84be-4cb8-8a5f-5398bcad4c74-client-ca-bundle\") pod \"metrics-server-698fbc5854-jf54h\" (UID: \"43584f09-84be-4cb8-8a5f-5398bcad4c74\") " pod="openshift-monitoring/metrics-server-698fbc5854-jf54h"
Sep 17 15:56:49.681161 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:49.681127    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/43584f09-84be-4cb8-8a5f-5398bcad4c74-secret-metrics-server-client-certs\") pod \"metrics-server-698fbc5854-jf54h\" (UID: \"43584f09-84be-4cb8-8a5f-5398bcad4c74\") " pod="openshift-monitoring/metrics-server-698fbc5854-jf54h"
Sep 17 15:56:49.684837 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:49.684814    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/43584f09-84be-4cb8-8a5f-5398bcad4c74-secret-metrics-server-tls\") pod \"metrics-server-698fbc5854-jf54h\" (UID: \"43584f09-84be-4cb8-8a5f-5398bcad4c74\") " pod="openshift-monitoring/metrics-server-698fbc5854-jf54h"
Sep 17 15:56:49.688014 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:49.687993    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dx27\" (UniqueName: \"kubernetes.io/projected/43584f09-84be-4cb8-8a5f-5398bcad4c74-kube-api-access-8dx27\") pod \"metrics-server-698fbc5854-jf54h\" (UID: \"43584f09-84be-4cb8-8a5f-5398bcad4c74\") " pod="openshift-monitoring/metrics-server-698fbc5854-jf54h"
Sep 17 15:56:49.735925 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:49.735904    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-698fbc5854-jf54h"
Sep 17 15:56:50.021759 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:50.021671    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-698fbc5854-jf54h"]
Sep 17 15:56:50.026056 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:56:50.026017    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43584f09_84be_4cb8_8a5f_5398bcad4c74.slice/crio-a8ef9d04c31f6cb862677357304c1b3c5bed71df2fb142d3162880603f8c0094 WatchSource:0}: Error finding container a8ef9d04c31f6cb862677357304c1b3c5bed71df2fb142d3162880603f8c0094: Status 404 returned error can't find the container with id a8ef9d04c31f6cb862677357304c1b3c5bed71df2fb142d3162880603f8c0094
Sep 17 15:56:50.146146 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:50.146106    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-698fbc5854-jf54h" event={"ID":"43584f09-84be-4cb8-8a5f-5398bcad4c74","Type":"ContainerStarted","Data":"a8ef9d04c31f6cb862677357304c1b3c5bed71df2fb142d3162880603f8c0094"}
Sep 17 15:56:51.484275 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.484240    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 17 15:56:51.489641 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.489614    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:56:51.492223 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.492043    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 17 15:56:51.493571 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.492652    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-63a0aiv0konpc\""
Sep 17 15:56:51.493571 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.492717    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 17 15:56:51.493571 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.492955    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 17 15:56:51.493571 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.493177    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 17 15:56:51.493571 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.493380    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 17 15:56:51.493571 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.493395    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 17 15:56:51.493571 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.493547    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 17 15:56:51.495907 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.495533    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 17 15:56:51.495907 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.495753    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 17 15:56:51.496397 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.496369    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 17 15:56:51.496807 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.496614    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-6cnmq\""
Sep 17 15:56:51.497119 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.497047    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 17 15:56:51.498035 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.498014    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 17 15:56:51.498662 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.498525    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 17 15:56:51.498847 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.498676    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 17 15:56:51.513524 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.512522    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 17 15:56:51.594435 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.594329    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:56:51.594435 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.594361    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:56:51.594435 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.594395    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:56:51.594723 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.594445    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:56:51.594723 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.594554    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:56:51.594723 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.594586    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-config-out\") pod \"prometheus-k8s-0\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:56:51.594723 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.594611    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:56:51.594723 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.594640    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-config\") pod \"prometheus-k8s-0\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:56:51.594723 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.594670    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:56:51.594723 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.594693    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:56:51.595056 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.594740    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:56:51.595056 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.594810    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:56:51.595056 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.594833    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:56:51.595056 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.594865    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:56:51.595056 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.594896    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:56:51.595056 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.594945    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:56:51.595056 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.594987    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:56:51.595056 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.595033    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9xkh\" (UniqueName: \"kubernetes.io/projected/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-kube-api-access-w9xkh\") pod \"prometheus-k8s-0\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:56:51.595336 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.595076    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-web-config\") pod \"prometheus-k8s-0\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:56:51.595336 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.595105    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:56:51.696566 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.695760    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-web-config\") pod \"prometheus-k8s-0\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:56:51.696566 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.695808    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:56:51.696566 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.695838    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:56:51.696566 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.695860    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:56:51.696566 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.695893    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:56:51.696566 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.695942    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:56:51.696566 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.695977    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:56:51.696566 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.696005    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-config-out\") pod \"prometheus-k8s-0\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:56:51.696566 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.696034    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:56:51.696566 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.696077    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-config\") pod \"prometheus-k8s-0\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:56:51.696566 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.696106    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:56:51.696566 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.696128    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:56:51.696566 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.696188    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:56:51.696566 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.696261    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:56:51.696566 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.696285    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:56:51.696566 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.696333    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:56:51.696566 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.696366    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:56:51.697879 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.696390    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:56:51.697879 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.696415    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:56:51.697879 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.696442    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9xkh\" (UniqueName: \"kubernetes.io/projected/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-kube-api-access-w9xkh\") pod \"prometheus-k8s-0\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:56:51.697879 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.697370    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:56:51.698536 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.698443    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:56:51.702342 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.702303    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:56:51.702461 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.702417    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:56:51.702865 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.702842    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:56:51.703202 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.703176    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:56:51.703671 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.703651    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:56:51.704558 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.704535    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:56:51.706173 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.706129    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:56:51.706665 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.706646    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:56:51.707635 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.707265    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-web-config\") pod \"prometheus-k8s-0\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:56:51.707635 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.707388    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:56:51.707635 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.707593    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:56:51.707953 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.707930    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-config-out\") pod \"prometheus-k8s-0\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:56:51.708034 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.707941    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:56:51.710307 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.710288    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:56:51.710470 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.710390    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-config\") pod \"prometheus-k8s-0\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:56:51.710589 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.710543    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:56:51.711075 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.711053    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:56:51.712878 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.712857    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9xkh\" (UniqueName: \"kubernetes.io/projected/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-kube-api-access-w9xkh\") pod \"prometheus-k8s-0\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:56:51.805441 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:51.805361    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:56:52.134997 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:52.134885    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 17 15:56:52.137613 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:56:52.137583    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68feab7b_51ee_4e7a_974c_ef429bf9d5e1.slice/crio-27285bd8420b70e97326a7993c9260276caaf7178c9955eca1d49a0bebd68b35 WatchSource:0}: Error finding container 27285bd8420b70e97326a7993c9260276caaf7178c9955eca1d49a0bebd68b35: Status 404 returned error can't find the container with id 27285bd8420b70e97326a7993c9260276caaf7178c9955eca1d49a0bebd68b35
Sep 17 15:56:52.156200 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:52.156169    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-698fbc5854-jf54h" event={"ID":"43584f09-84be-4cb8-8a5f-5398bcad4c74","Type":"ContainerStarted","Data":"d11db1195fad0f34b11adc1f503bd7d644ae23024329c501aa8aa14df56254b7"}
Sep 17 15:56:52.157714 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:52.157687    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68feab7b-51ee-4e7a-974c-ef429bf9d5e1","Type":"ContainerStarted","Data":"27285bd8420b70e97326a7993c9260276caaf7178c9955eca1d49a0bebd68b35"}
Sep 17 15:56:52.195171 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:52.195120    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-698fbc5854-jf54h" podStartSLOduration=1.727362595 podStartE2EDuration="3.195105048s" totalImagesPullingTime="1.467742453s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:56:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:56:52.194571509 +0000 UTC m=+129.808503021" watchObservedRunningTime="2026-09-17 15:56:52.195105048 +0000 UTC m=+129.809036558"
Sep 17 15:56:53.412219 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:53.412185    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b550e969-e4dd-4602-8d26-4a6275359d68-metrics-certs\") pod \"network-metrics-daemon-nldm2\" (UID: \"b550e969-e4dd-4602-8d26-4a6275359d68\") " pod="openshift-multus/network-metrics-daemon-nldm2"
Sep 17 15:56:53.414937 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:53.414904    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b550e969-e4dd-4602-8d26-4a6275359d68-metrics-certs\") pod \"network-metrics-daemon-nldm2\" (UID: \"b550e969-e4dd-4602-8d26-4a6275359d68\") " pod="openshift-multus/network-metrics-daemon-nldm2"
Sep 17 15:56:53.423734 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:53.423706    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8v7v5\""
Sep 17 15:56:53.431235 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:56:53.431218    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nldm2"
Sep 17 15:57:00.196400 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:57:00.196320    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6594f4c75-pb7nf" event={"ID":"18bcc485-4178-40a4-b51d-0ec2d8ef2430","Type":"ContainerStarted","Data":"9b5863ff3b8d68a047706a428039f79aef88ee80565784eb8a06349f0bcb5fbe"}
Sep 17 15:57:00.196857 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:57:00.196739    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6594f4c75-pb7nf"
Sep 17 15:57:00.198429 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:57:00.198398    2584 generic.go:356] "Generic (PLEG): container finished" podID="68feab7b-51ee-4e7a-974c-ef429bf9d5e1" containerID="dac7c10ee9a676cd50accc8bb2dfd6d816905dd1cbaaea6ca436314bdca1592a" exitCode=0
Sep 17 15:57:00.198629 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:57:00.198557    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68feab7b-51ee-4e7a-974c-ef429bf9d5e1","Type":"ContainerDied","Data":"dac7c10ee9a676cd50accc8bb2dfd6d816905dd1cbaaea6ca436314bdca1592a"}
Sep 17 15:57:00.212321 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:57:00.212296    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6594f4c75-pb7nf"
Sep 17 15:57:00.217229 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:57:00.217194    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nldm2"]
Sep 17 15:57:00.222514 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:57:00.222452    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb550e969_e4dd_4602_8d26_4a6275359d68.slice/crio-efec9ef98ce231ca95241113ede46e4c69a6f36e816654354ebf8ff32d0d6024 WatchSource:0}: Error finding container efec9ef98ce231ca95241113ede46e4c69a6f36e816654354ebf8ff32d0d6024: Status 404 returned error can't find the container with id efec9ef98ce231ca95241113ede46e4c69a6f36e816654354ebf8ff32d0d6024
Sep 17 15:57:00.224231 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:57:00.223995    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6594f4c75-pb7nf" podStartSLOduration=1.532063062 podStartE2EDuration="19.223979551s" totalImagesPullingTime="17.691916489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:56:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:57:00.221376432 +0000 UTC m=+137.835307943" watchObservedRunningTime="2026-09-17 15:57:00.223979551 +0000 UTC m=+137.837911062"
Sep 17 15:57:01.206363 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:57:01.206260    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nldm2" event={"ID":"b550e969-e4dd-4602-8d26-4a6275359d68","Type":"ContainerStarted","Data":"efec9ef98ce231ca95241113ede46e4c69a6f36e816654354ebf8ff32d0d6024"}
Sep 17 15:57:02.213975 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:57:02.213862    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nldm2" event={"ID":"b550e969-e4dd-4602-8d26-4a6275359d68","Type":"ContainerStarted","Data":"8969eb6789599977df305c8be375a1dc24dff9c5b5f83ca983bbcd997b7e5890"}
Sep 17 15:57:02.214481 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:57:02.214003    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nldm2" event={"ID":"b550e969-e4dd-4602-8d26-4a6275359d68","Type":"ContainerStarted","Data":"d0c5d6d49a3dc249f2af123d0f0899c35a322d5cf093fed721299729a5f508e2"}
Sep 17 15:57:02.232956 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:57:02.232899    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-nldm2" podStartSLOduration=135.940723234 podStartE2EDuration="2m17.23287882s" totalImagesPullingTime="1.292155586s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:54:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:57:02.230677021 +0000 UTC m=+139.844608533" watchObservedRunningTime="2026-09-17 15:57:02.23287882 +0000 UTC m=+139.846810348"
Sep 17 15:57:05.230126 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:57:05.230087    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68feab7b-51ee-4e7a-974c-ef429bf9d5e1","Type":"ContainerStarted","Data":"2bc7c1784a4475334810c960079d700672f0d13e3998bf2bad98b95597284896"}
Sep 17 15:57:05.230593 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:57:05.230202    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68feab7b-51ee-4e7a-974c-ef429bf9d5e1","Type":"ContainerStarted","Data":"d94d469dbc5ebfd72c974579b50cd26db1993ef213c0bcf973574e2fcb1435e2"}
Sep 17 15:57:08.248317 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:57:08.247705    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68feab7b-51ee-4e7a-974c-ef429bf9d5e1","Type":"ContainerStarted","Data":"51b56c20748fe30631cd61cd2323ccd767b19da7a0818da994cd9325b40a1721"}
Sep 17 15:57:08.248317 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:57:08.247817    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68feab7b-51ee-4e7a-974c-ef429bf9d5e1","Type":"ContainerStarted","Data":"80ddaa91a1c8454d3760fc65394e72e6cc80c91cbc918a370f73baae44640e14"}
Sep 17 15:57:08.248317 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:57:08.247865    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68feab7b-51ee-4e7a-974c-ef429bf9d5e1","Type":"ContainerStarted","Data":"f4c92b3c4ffd0f47d5e97e1628193124462c184d7534415d532c87a59653ac72"}
Sep 17 15:57:08.248317 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:57:08.247902    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68feab7b-51ee-4e7a-974c-ef429bf9d5e1","Type":"ContainerStarted","Data":"83b2eaee80daaaa5bc289c92ead81063779c3eea8333bc30042e0ff1ad1e3a9a"}
Sep 17 15:57:08.286136 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:57:08.286082    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.250483645 podStartE2EDuration="17.286063759s" totalImagesPullingTime="15.015621491s" totalInitContainerRuntime="19.958623ms" isStatefulPod=false podCreationTimestamp="2026-09-17 15:56:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:57:08.283578032 +0000 UTC m=+145.897509544" watchObservedRunningTime="2026-09-17 15:57:08.286063759 +0000 UTC m=+145.899995270"
Sep 17 15:57:09.736163 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:57:09.736132    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-698fbc5854-jf54h"
Sep 17 15:57:09.736563 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:57:09.736188    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-698fbc5854-jf54h"
Sep 17 15:57:11.806387 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:57:11.806356    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:57:29.742161 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:57:29.742066    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-698fbc5854-jf54h"
Sep 17 15:57:29.745966 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:57:29.745943    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-698fbc5854-jf54h"
Sep 17 15:57:34.357597 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:57:34.357558    2584 generic.go:356] "Generic (PLEG): container finished" podID="4e06f67c-f37e-4f4c-9e9a-5405d810efc4" containerID="fad057517bbc03574cfa11b65c522a9bc2a0767a90abaa372ec928674cf47d1b" exitCode=0
Sep 17 15:57:34.357889 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:57:34.357636    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-zwptf" event={"ID":"4e06f67c-f37e-4f4c-9e9a-5405d810efc4","Type":"ContainerDied","Data":"fad057517bbc03574cfa11b65c522a9bc2a0767a90abaa372ec928674cf47d1b"}
Sep 17 15:57:34.357962 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:57:34.357946    2584 scope.go:117] "RemoveContainer" containerID="fad057517bbc03574cfa11b65c522a9bc2a0767a90abaa372ec928674cf47d1b"
Sep 17 15:57:35.363332 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:57:35.363293    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-zwptf" event={"ID":"4e06f67c-f37e-4f4c-9e9a-5405d810efc4","Type":"ContainerStarted","Data":"3acbf041c0f2f77cbcaf1358ea3b88885d59bf4b07675eb3183d1b1feb05f7bf"}
Sep 17 15:57:51.806335 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:57:51.806298    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:57:51.822480 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:57:51.822456    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:57:52.446710 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:57:52.446678    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:58:09.867163 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:09.867123    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 17 15:58:09.867762 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:09.867480    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="68feab7b-51ee-4e7a-974c-ef429bf9d5e1" containerName="prometheus" containerID="cri-o://d94d469dbc5ebfd72c974579b50cd26db1993ef213c0bcf973574e2fcb1435e2" gracePeriod=600
Sep 17 15:58:09.867955 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:09.867924    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="68feab7b-51ee-4e7a-974c-ef429bf9d5e1" containerName="thanos-sidecar" containerID="cri-o://83b2eaee80daaaa5bc289c92ead81063779c3eea8333bc30042e0ff1ad1e3a9a" gracePeriod=600
Sep 17 15:58:09.868594 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:09.867948    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="68feab7b-51ee-4e7a-974c-ef429bf9d5e1" containerName="kube-rbac-proxy-thanos" containerID="cri-o://51b56c20748fe30631cd61cd2323ccd767b19da7a0818da994cd9325b40a1721" gracePeriod=600
Sep 17 15:58:09.868594 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:09.868014    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="68feab7b-51ee-4e7a-974c-ef429bf9d5e1" containerName="kube-rbac-proxy" containerID="cri-o://80ddaa91a1c8454d3760fc65394e72e6cc80c91cbc918a370f73baae44640e14" gracePeriod=600
Sep 17 15:58:09.868594 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:09.868004    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="68feab7b-51ee-4e7a-974c-ef429bf9d5e1" containerName="config-reloader" containerID="cri-o://2bc7c1784a4475334810c960079d700672f0d13e3998bf2bad98b95597284896" gracePeriod=600
Sep 17 15:58:09.868594 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:09.867936    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="68feab7b-51ee-4e7a-974c-ef429bf9d5e1" containerName="kube-rbac-proxy-web" containerID="cri-o://f4c92b3c4ffd0f47d5e97e1628193124462c184d7534415d532c87a59653ac72" gracePeriod=600
Sep 17 15:58:10.123987 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.123917    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:58:10.303320 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.303288    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") "
Sep 17 15:58:10.303478 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.303329    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-configmap-metrics-client-ca\") pod \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") "
Sep 17 15:58:10.303478 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.303360    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-secret-kube-rbac-proxy\") pod \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") "
Sep 17 15:58:10.303478 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.303394    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-prometheus-k8s-rulefiles-2\") pod \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") "
Sep 17 15:58:10.303693 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.303518    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-configmap-kubelet-serving-ca-bundle\") pod \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") "
Sep 17 15:58:10.303693 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.303568    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-secret-grpc-tls\") pod \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") "
Sep 17 15:58:10.303693 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.303599    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-tls-assets\") pod \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") "
Sep 17 15:58:10.303693 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.303626    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-secret-prometheus-k8s-tls\") pod \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") "
Sep 17 15:58:10.303693 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.303652    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-secret-metrics-client-certs\") pod \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") "
Sep 17 15:58:10.303693 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.303687    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-prometheus-trusted-ca-bundle\") pod \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") "
Sep 17 15:58:10.303974 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.303712    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-prometheus-k8s-rulefiles-1\") pod \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") "
Sep 17 15:58:10.303974 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.303710    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "68feab7b-51ee-4e7a-974c-ef429bf9d5e1" (UID: "68feab7b-51ee-4e7a-974c-ef429bf9d5e1"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 15:58:10.303974 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.303741    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-thanos-prometheus-http-client-file\") pod \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") "
Sep 17 15:58:10.303974 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.303747    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "68feab7b-51ee-4e7a-974c-ef429bf9d5e1" (UID: "68feab7b-51ee-4e7a-974c-ef429bf9d5e1"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 15:58:10.303974 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.303799    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-config-out\") pod \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") "
Sep 17 15:58:10.303974 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.303810    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "68feab7b-51ee-4e7a-974c-ef429bf9d5e1" (UID: "68feab7b-51ee-4e7a-974c-ef429bf9d5e1"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 15:58:10.303974 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.303826    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-web-config\") pod \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") "
Sep 17 15:58:10.303974 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.303866    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-config\") pod \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") "
Sep 17 15:58:10.303974 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.303906    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-prometheus-k8s-rulefiles-0\") pod \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") "
Sep 17 15:58:10.303974 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.303944    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-prometheus-k8s-db\") pod \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") "
Sep 17 15:58:10.303974 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.303971    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w9xkh\" (UniqueName: \"kubernetes.io/projected/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-kube-api-access-w9xkh\") pod \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") "
Sep 17 15:58:10.304539 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.304006    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") "
Sep 17 15:58:10.304539 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.304027    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "68feab7b-51ee-4e7a-974c-ef429bf9d5e1" (UID: "68feab7b-51ee-4e7a-974c-ef429bf9d5e1"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 15:58:10.304539 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.304034    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-configmap-serving-certs-ca-bundle\") pod \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\" (UID: \"68feab7b-51ee-4e7a-974c-ef429bf9d5e1\") "
Sep 17 15:58:10.304539 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.304296    2584 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-configmap-metrics-client-ca\") on node \"ip-10-0-128-191.ec2.internal\" DevicePath \"\""
Sep 17 15:58:10.304539 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.304312    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "68feab7b-51ee-4e7a-974c-ef429bf9d5e1" (UID: "68feab7b-51ee-4e7a-974c-ef429bf9d5e1"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 15:58:10.304539 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.304391    2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-128-191.ec2.internal\" DevicePath \"\""
Sep 17 15:58:10.304539 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.304518    2584 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-128-191.ec2.internal\" DevicePath \"\""
Sep 17 15:58:10.304539 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.304534    2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-prometheus-trusted-ca-bundle\") on node \"ip-10-0-128-191.ec2.internal\" DevicePath \"\""
Sep 17 15:58:10.304944 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.304873    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "68feab7b-51ee-4e7a-974c-ef429bf9d5e1" (UID: "68feab7b-51ee-4e7a-974c-ef429bf9d5e1"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 15:58:10.305477 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.305376    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "68feab7b-51ee-4e7a-974c-ef429bf9d5e1" (UID: "68feab7b-51ee-4e7a-974c-ef429bf9d5e1"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 15:58:10.306791 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.306759    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "68feab7b-51ee-4e7a-974c-ef429bf9d5e1" (UID: "68feab7b-51ee-4e7a-974c-ef429bf9d5e1"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 15:58:10.306914 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.306887    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "68feab7b-51ee-4e7a-974c-ef429bf9d5e1" (UID: "68feab7b-51ee-4e7a-974c-ef429bf9d5e1"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 15:58:10.307193 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.307165    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "68feab7b-51ee-4e7a-974c-ef429bf9d5e1" (UID: "68feab7b-51ee-4e7a-974c-ef429bf9d5e1"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 15:58:10.307352 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.307258    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "68feab7b-51ee-4e7a-974c-ef429bf9d5e1" (UID: "68feab7b-51ee-4e7a-974c-ef429bf9d5e1"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 15:58:10.307918 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.307836    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "68feab7b-51ee-4e7a-974c-ef429bf9d5e1" (UID: "68feab7b-51ee-4e7a-974c-ef429bf9d5e1"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 15:58:10.307918 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.307857    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "68feab7b-51ee-4e7a-974c-ef429bf9d5e1" (UID: "68feab7b-51ee-4e7a-974c-ef429bf9d5e1"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 15:58:10.307918 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.307910    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "68feab7b-51ee-4e7a-974c-ef429bf9d5e1" (UID: "68feab7b-51ee-4e7a-974c-ef429bf9d5e1"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 15:58:10.308143 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.307980    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "68feab7b-51ee-4e7a-974c-ef429bf9d5e1" (UID: "68feab7b-51ee-4e7a-974c-ef429bf9d5e1"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 15:58:10.308915 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.308895    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "68feab7b-51ee-4e7a-974c-ef429bf9d5e1" (UID: "68feab7b-51ee-4e7a-974c-ef429bf9d5e1"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 15:58:10.309097 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.309078    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-config" (OuterVolumeSpecName: "config") pod "68feab7b-51ee-4e7a-974c-ef429bf9d5e1" (UID: "68feab7b-51ee-4e7a-974c-ef429bf9d5e1"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 15:58:10.309390 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.309370    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-config-out" (OuterVolumeSpecName: "config-out") pod "68feab7b-51ee-4e7a-974c-ef429bf9d5e1" (UID: "68feab7b-51ee-4e7a-974c-ef429bf9d5e1"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 15:58:10.309599 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.309579    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-kube-api-access-w9xkh" (OuterVolumeSpecName: "kube-api-access-w9xkh") pod "68feab7b-51ee-4e7a-974c-ef429bf9d5e1" (UID: "68feab7b-51ee-4e7a-974c-ef429bf9d5e1"). InnerVolumeSpecName "kube-api-access-w9xkh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 15:58:10.319506 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.319474    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-web-config" (OuterVolumeSpecName: "web-config") pod "68feab7b-51ee-4e7a-974c-ef429bf9d5e1" (UID: "68feab7b-51ee-4e7a-974c-ef429bf9d5e1"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 15:58:10.405369 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.405345    2584 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-secret-kube-rbac-proxy\") on node \"ip-10-0-128-191.ec2.internal\" DevicePath \"\""
Sep 17 15:58:10.405473 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.405369    2584 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-secret-grpc-tls\") on node \"ip-10-0-128-191.ec2.internal\" DevicePath \"\""
Sep 17 15:58:10.405473 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.405384    2584 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-tls-assets\") on node \"ip-10-0-128-191.ec2.internal\" DevicePath \"\""
Sep 17 15:58:10.405473 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.405396    2584 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-secret-prometheus-k8s-tls\") on node \"ip-10-0-128-191.ec2.internal\" DevicePath \"\""
Sep 17 15:58:10.405473 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.405409    2584 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-secret-metrics-client-certs\") on node \"ip-10-0-128-191.ec2.internal\" DevicePath \"\""
Sep 17 15:58:10.405473 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.405422    2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-128-191.ec2.internal\" DevicePath \"\""
Sep 17 15:58:10.405473 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.405435    2584 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-thanos-prometheus-http-client-file\") on node \"ip-10-0-128-191.ec2.internal\" DevicePath \"\""
Sep 17 15:58:10.405473 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.405448    2584 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-config-out\") on node \"ip-10-0-128-191.ec2.internal\" DevicePath \"\""
Sep 17 15:58:10.405473 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.405460    2584 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-web-config\") on node \"ip-10-0-128-191.ec2.internal\" DevicePath \"\""
Sep 17 15:58:10.405473 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.405471    2584 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-config\") on node \"ip-10-0-128-191.ec2.internal\" DevicePath \"\""
Sep 17 15:58:10.405807 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.405483    2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-128-191.ec2.internal\" DevicePath \"\""
Sep 17 15:58:10.405807 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.405520    2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-prometheus-k8s-db\") on node \"ip-10-0-128-191.ec2.internal\" DevicePath \"\""
Sep 17 15:58:10.405807 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.405533    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w9xkh\" (UniqueName: \"kubernetes.io/projected/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-kube-api-access-w9xkh\") on node \"ip-10-0-128-191.ec2.internal\" DevicePath \"\""
Sep 17 15:58:10.405807 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.405547    2584 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-128-191.ec2.internal\" DevicePath \"\""
Sep 17 15:58:10.405807 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.405562    2584 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-128-191.ec2.internal\" DevicePath \"\""
Sep 17 15:58:10.405807 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.405576    2584 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/68feab7b-51ee-4e7a-974c-ef429bf9d5e1-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-128-191.ec2.internal\" DevicePath \"\""
Sep 17 15:58:10.505748 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.505717    2584 generic.go:356] "Generic (PLEG): container finished" podID="68feab7b-51ee-4e7a-974c-ef429bf9d5e1" containerID="51b56c20748fe30631cd61cd2323ccd767b19da7a0818da994cd9325b40a1721" exitCode=0
Sep 17 15:58:10.505748 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.505745    2584 generic.go:356] "Generic (PLEG): container finished" podID="68feab7b-51ee-4e7a-974c-ef429bf9d5e1" containerID="80ddaa91a1c8454d3760fc65394e72e6cc80c91cbc918a370f73baae44640e14" exitCode=0
Sep 17 15:58:10.505892 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.505756    2584 generic.go:356] "Generic (PLEG): container finished" podID="68feab7b-51ee-4e7a-974c-ef429bf9d5e1" containerID="f4c92b3c4ffd0f47d5e97e1628193124462c184d7534415d532c87a59653ac72" exitCode=0
Sep 17 15:58:10.505892 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.505766    2584 generic.go:356] "Generic (PLEG): container finished" podID="68feab7b-51ee-4e7a-974c-ef429bf9d5e1" containerID="83b2eaee80daaaa5bc289c92ead81063779c3eea8333bc30042e0ff1ad1e3a9a" exitCode=0
Sep 17 15:58:10.505892 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.505774    2584 generic.go:356] "Generic (PLEG): container finished" podID="68feab7b-51ee-4e7a-974c-ef429bf9d5e1" containerID="2bc7c1784a4475334810c960079d700672f0d13e3998bf2bad98b95597284896" exitCode=0
Sep 17 15:58:10.505892 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.505784    2584 generic.go:356] "Generic (PLEG): container finished" podID="68feab7b-51ee-4e7a-974c-ef429bf9d5e1" containerID="d94d469dbc5ebfd72c974579b50cd26db1993ef213c0bcf973574e2fcb1435e2" exitCode=0
Sep 17 15:58:10.505892 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.505802    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68feab7b-51ee-4e7a-974c-ef429bf9d5e1","Type":"ContainerDied","Data":"51b56c20748fe30631cd61cd2323ccd767b19da7a0818da994cd9325b40a1721"}
Sep 17 15:58:10.505892 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.505876    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68feab7b-51ee-4e7a-974c-ef429bf9d5e1","Type":"ContainerDied","Data":"80ddaa91a1c8454d3760fc65394e72e6cc80c91cbc918a370f73baae44640e14"}
Sep 17 15:58:10.506169 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.505811    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:58:10.506169 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.505928    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68feab7b-51ee-4e7a-974c-ef429bf9d5e1","Type":"ContainerDied","Data":"f4c92b3c4ffd0f47d5e97e1628193124462c184d7534415d532c87a59653ac72"}
Sep 17 15:58:10.506169 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.505955    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68feab7b-51ee-4e7a-974c-ef429bf9d5e1","Type":"ContainerDied","Data":"83b2eaee80daaaa5bc289c92ead81063779c3eea8333bc30042e0ff1ad1e3a9a"}
Sep 17 15:58:10.506169 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.505980    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68feab7b-51ee-4e7a-974c-ef429bf9d5e1","Type":"ContainerDied","Data":"2bc7c1784a4475334810c960079d700672f0d13e3998bf2bad98b95597284896"}
Sep 17 15:58:10.506169 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.505999    2584 scope.go:117] "RemoveContainer" containerID="51b56c20748fe30631cd61cd2323ccd767b19da7a0818da994cd9325b40a1721"
Sep 17 15:58:10.506169 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.506005    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68feab7b-51ee-4e7a-974c-ef429bf9d5e1","Type":"ContainerDied","Data":"d94d469dbc5ebfd72c974579b50cd26db1993ef213c0bcf973574e2fcb1435e2"}
Sep 17 15:58:10.506169 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.506030    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68feab7b-51ee-4e7a-974c-ef429bf9d5e1","Type":"ContainerDied","Data":"27285bd8420b70e97326a7993c9260276caaf7178c9955eca1d49a0bebd68b35"}
Sep 17 15:58:10.514471 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.514448    2584 scope.go:117] "RemoveContainer" containerID="80ddaa91a1c8454d3760fc65394e72e6cc80c91cbc918a370f73baae44640e14"
Sep 17 15:58:10.522170 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.522153    2584 scope.go:117] "RemoveContainer" containerID="f4c92b3c4ffd0f47d5e97e1628193124462c184d7534415d532c87a59653ac72"
Sep 17 15:58:10.529078 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.529059    2584 scope.go:117] "RemoveContainer" containerID="83b2eaee80daaaa5bc289c92ead81063779c3eea8333bc30042e0ff1ad1e3a9a"
Sep 17 15:58:10.531228 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.531196    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 17 15:58:10.536708 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.536686    2584 scope.go:117] "RemoveContainer" containerID="2bc7c1784a4475334810c960079d700672f0d13e3998bf2bad98b95597284896"
Sep 17 15:58:10.537787 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.537679    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 17 15:58:10.543405 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.543386    2584 scope.go:117] "RemoveContainer" containerID="d94d469dbc5ebfd72c974579b50cd26db1993ef213c0bcf973574e2fcb1435e2"
Sep 17 15:58:10.550340 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.550324    2584 scope.go:117] "RemoveContainer" containerID="dac7c10ee9a676cd50accc8bb2dfd6d816905dd1cbaaea6ca436314bdca1592a"
Sep 17 15:58:10.556784 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.556769    2584 scope.go:117] "RemoveContainer" containerID="51b56c20748fe30631cd61cd2323ccd767b19da7a0818da994cd9325b40a1721"
Sep 17 15:58:10.557048 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:58:10.557027    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51b56c20748fe30631cd61cd2323ccd767b19da7a0818da994cd9325b40a1721\": container with ID starting with 51b56c20748fe30631cd61cd2323ccd767b19da7a0818da994cd9325b40a1721 not found: ID does not exist" containerID="51b56c20748fe30631cd61cd2323ccd767b19da7a0818da994cd9325b40a1721"
Sep 17 15:58:10.557113 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.557056    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51b56c20748fe30631cd61cd2323ccd767b19da7a0818da994cd9325b40a1721"} err="failed to get container status \"51b56c20748fe30631cd61cd2323ccd767b19da7a0818da994cd9325b40a1721\": rpc error: code = NotFound desc = could not find container \"51b56c20748fe30631cd61cd2323ccd767b19da7a0818da994cd9325b40a1721\": container with ID starting with 51b56c20748fe30631cd61cd2323ccd767b19da7a0818da994cd9325b40a1721 not found: ID does not exist"
Sep 17 15:58:10.557113 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.557086    2584 scope.go:117] "RemoveContainer" containerID="80ddaa91a1c8454d3760fc65394e72e6cc80c91cbc918a370f73baae44640e14"
Sep 17 15:58:10.557373 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:58:10.557348    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80ddaa91a1c8454d3760fc65394e72e6cc80c91cbc918a370f73baae44640e14\": container with ID starting with 80ddaa91a1c8454d3760fc65394e72e6cc80c91cbc918a370f73baae44640e14 not found: ID does not exist" containerID="80ddaa91a1c8454d3760fc65394e72e6cc80c91cbc918a370f73baae44640e14"
Sep 17 15:58:10.557456 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.557382    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80ddaa91a1c8454d3760fc65394e72e6cc80c91cbc918a370f73baae44640e14"} err="failed to get container status \"80ddaa91a1c8454d3760fc65394e72e6cc80c91cbc918a370f73baae44640e14\": rpc error: code = NotFound desc = could not find container \"80ddaa91a1c8454d3760fc65394e72e6cc80c91cbc918a370f73baae44640e14\": container with ID starting with 80ddaa91a1c8454d3760fc65394e72e6cc80c91cbc918a370f73baae44640e14 not found: ID does not exist"
Sep 17 15:58:10.557456 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.557404    2584 scope.go:117] "RemoveContainer" containerID="f4c92b3c4ffd0f47d5e97e1628193124462c184d7534415d532c87a59653ac72"
Sep 17 15:58:10.557766 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:58:10.557743    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4c92b3c4ffd0f47d5e97e1628193124462c184d7534415d532c87a59653ac72\": container with ID starting with f4c92b3c4ffd0f47d5e97e1628193124462c184d7534415d532c87a59653ac72 not found: ID does not exist" containerID="f4c92b3c4ffd0f47d5e97e1628193124462c184d7534415d532c87a59653ac72"
Sep 17 15:58:10.557832 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.557774    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4c92b3c4ffd0f47d5e97e1628193124462c184d7534415d532c87a59653ac72"} err="failed to get container status \"f4c92b3c4ffd0f47d5e97e1628193124462c184d7534415d532c87a59653ac72\": rpc error: code = NotFound desc = could not find container \"f4c92b3c4ffd0f47d5e97e1628193124462c184d7534415d532c87a59653ac72\": container with ID starting with f4c92b3c4ffd0f47d5e97e1628193124462c184d7534415d532c87a59653ac72 not found: ID does not exist"
Sep 17 15:58:10.557832 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.557797    2584 scope.go:117] "RemoveContainer" containerID="83b2eaee80daaaa5bc289c92ead81063779c3eea8333bc30042e0ff1ad1e3a9a"
Sep 17 15:58:10.558105 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:58:10.558078    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83b2eaee80daaaa5bc289c92ead81063779c3eea8333bc30042e0ff1ad1e3a9a\": container with ID starting with 83b2eaee80daaaa5bc289c92ead81063779c3eea8333bc30042e0ff1ad1e3a9a not found: ID does not exist" containerID="83b2eaee80daaaa5bc289c92ead81063779c3eea8333bc30042e0ff1ad1e3a9a"
Sep 17 15:58:10.558200 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.558112    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83b2eaee80daaaa5bc289c92ead81063779c3eea8333bc30042e0ff1ad1e3a9a"} err="failed to get container status \"83b2eaee80daaaa5bc289c92ead81063779c3eea8333bc30042e0ff1ad1e3a9a\": rpc error: code = NotFound desc = could not find container \"83b2eaee80daaaa5bc289c92ead81063779c3eea8333bc30042e0ff1ad1e3a9a\": container with ID starting with 83b2eaee80daaaa5bc289c92ead81063779c3eea8333bc30042e0ff1ad1e3a9a not found: ID does not exist"
Sep 17 15:58:10.558200 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.558128    2584 scope.go:117] "RemoveContainer" containerID="2bc7c1784a4475334810c960079d700672f0d13e3998bf2bad98b95597284896"
Sep 17 15:58:10.558412 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:58:10.558397    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2bc7c1784a4475334810c960079d700672f0d13e3998bf2bad98b95597284896\": container with ID starting with 2bc7c1784a4475334810c960079d700672f0d13e3998bf2bad98b95597284896 not found: ID does not exist" containerID="2bc7c1784a4475334810c960079d700672f0d13e3998bf2bad98b95597284896"
Sep 17 15:58:10.558456 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.558414    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bc7c1784a4475334810c960079d700672f0d13e3998bf2bad98b95597284896"} err="failed to get container status \"2bc7c1784a4475334810c960079d700672f0d13e3998bf2bad98b95597284896\": rpc error: code = NotFound desc = could not find container \"2bc7c1784a4475334810c960079d700672f0d13e3998bf2bad98b95597284896\": container with ID starting with 2bc7c1784a4475334810c960079d700672f0d13e3998bf2bad98b95597284896 not found: ID does not exist"
Sep 17 15:58:10.558456 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.558427    2584 scope.go:117] "RemoveContainer" containerID="d94d469dbc5ebfd72c974579b50cd26db1993ef213c0bcf973574e2fcb1435e2"
Sep 17 15:58:10.558744 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:58:10.558726    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d94d469dbc5ebfd72c974579b50cd26db1993ef213c0bcf973574e2fcb1435e2\": container with ID starting with d94d469dbc5ebfd72c974579b50cd26db1993ef213c0bcf973574e2fcb1435e2 not found: ID does not exist" containerID="d94d469dbc5ebfd72c974579b50cd26db1993ef213c0bcf973574e2fcb1435e2"
Sep 17 15:58:10.558816 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.558748    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d94d469dbc5ebfd72c974579b50cd26db1993ef213c0bcf973574e2fcb1435e2"} err="failed to get container status \"d94d469dbc5ebfd72c974579b50cd26db1993ef213c0bcf973574e2fcb1435e2\": rpc error: code = NotFound desc = could not find container \"d94d469dbc5ebfd72c974579b50cd26db1993ef213c0bcf973574e2fcb1435e2\": container with ID starting with d94d469dbc5ebfd72c974579b50cd26db1993ef213c0bcf973574e2fcb1435e2 not found: ID does not exist"
Sep 17 15:58:10.558816 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.558761    2584 scope.go:117] "RemoveContainer" containerID="dac7c10ee9a676cd50accc8bb2dfd6d816905dd1cbaaea6ca436314bdca1592a"
Sep 17 15:58:10.559012 ip-10-0-128-191 kubenswrapper[2584]: E0917 15:58:10.558994    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dac7c10ee9a676cd50accc8bb2dfd6d816905dd1cbaaea6ca436314bdca1592a\": container with ID starting with dac7c10ee9a676cd50accc8bb2dfd6d816905dd1cbaaea6ca436314bdca1592a not found: ID does not exist" containerID="dac7c10ee9a676cd50accc8bb2dfd6d816905dd1cbaaea6ca436314bdca1592a"
Sep 17 15:58:10.559061 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.559015    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dac7c10ee9a676cd50accc8bb2dfd6d816905dd1cbaaea6ca436314bdca1592a"} err="failed to get container status \"dac7c10ee9a676cd50accc8bb2dfd6d816905dd1cbaaea6ca436314bdca1592a\": rpc error: code = NotFound desc = could not find container \"dac7c10ee9a676cd50accc8bb2dfd6d816905dd1cbaaea6ca436314bdca1592a\": container with ID starting with dac7c10ee9a676cd50accc8bb2dfd6d816905dd1cbaaea6ca436314bdca1592a not found: ID does not exist"
Sep 17 15:58:10.559061 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.559028    2584 scope.go:117] "RemoveContainer" containerID="51b56c20748fe30631cd61cd2323ccd767b19da7a0818da994cd9325b40a1721"
Sep 17 15:58:10.559281 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.559263    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51b56c20748fe30631cd61cd2323ccd767b19da7a0818da994cd9325b40a1721"} err="failed to get container status \"51b56c20748fe30631cd61cd2323ccd767b19da7a0818da994cd9325b40a1721\": rpc error: code = NotFound desc = could not find container \"51b56c20748fe30631cd61cd2323ccd767b19da7a0818da994cd9325b40a1721\": container with ID starting with 51b56c20748fe30631cd61cd2323ccd767b19da7a0818da994cd9325b40a1721 not found: ID does not exist"
Sep 17 15:58:10.559281 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.559280    2584 scope.go:117] "RemoveContainer" containerID="80ddaa91a1c8454d3760fc65394e72e6cc80c91cbc918a370f73baae44640e14"
Sep 17 15:58:10.559527 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.559508    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80ddaa91a1c8454d3760fc65394e72e6cc80c91cbc918a370f73baae44640e14"} err="failed to get container status \"80ddaa91a1c8454d3760fc65394e72e6cc80c91cbc918a370f73baae44640e14\": rpc error: code = NotFound desc = could not find container \"80ddaa91a1c8454d3760fc65394e72e6cc80c91cbc918a370f73baae44640e14\": container with ID starting with 80ddaa91a1c8454d3760fc65394e72e6cc80c91cbc918a370f73baae44640e14 not found: ID does not exist"
Sep 17 15:58:10.559575 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.559530    2584 scope.go:117] "RemoveContainer" containerID="f4c92b3c4ffd0f47d5e97e1628193124462c184d7534415d532c87a59653ac72"
Sep 17 15:58:10.559758 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.559743    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4c92b3c4ffd0f47d5e97e1628193124462c184d7534415d532c87a59653ac72"} err="failed to get container status \"f4c92b3c4ffd0f47d5e97e1628193124462c184d7534415d532c87a59653ac72\": rpc error: code = NotFound desc = could not find container \"f4c92b3c4ffd0f47d5e97e1628193124462c184d7534415d532c87a59653ac72\": container with ID starting with f4c92b3c4ffd0f47d5e97e1628193124462c184d7534415d532c87a59653ac72 not found: ID does not exist"
Sep 17 15:58:10.559809 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.559758    2584 scope.go:117] "RemoveContainer" containerID="83b2eaee80daaaa5bc289c92ead81063779c3eea8333bc30042e0ff1ad1e3a9a"
Sep 17 15:58:10.559987 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.559968    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83b2eaee80daaaa5bc289c92ead81063779c3eea8333bc30042e0ff1ad1e3a9a"} err="failed to get container status \"83b2eaee80daaaa5bc289c92ead81063779c3eea8333bc30042e0ff1ad1e3a9a\": rpc error: code = NotFound desc = could not find container \"83b2eaee80daaaa5bc289c92ead81063779c3eea8333bc30042e0ff1ad1e3a9a\": container with ID starting with 83b2eaee80daaaa5bc289c92ead81063779c3eea8333bc30042e0ff1ad1e3a9a not found: ID does not exist"
Sep 17 15:58:10.560040 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.559987    2584 scope.go:117] "RemoveContainer" containerID="2bc7c1784a4475334810c960079d700672f0d13e3998bf2bad98b95597284896"
Sep 17 15:58:10.560237 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.560218    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bc7c1784a4475334810c960079d700672f0d13e3998bf2bad98b95597284896"} err="failed to get container status \"2bc7c1784a4475334810c960079d700672f0d13e3998bf2bad98b95597284896\": rpc error: code = NotFound desc = could not find container \"2bc7c1784a4475334810c960079d700672f0d13e3998bf2bad98b95597284896\": container with ID starting with 2bc7c1784a4475334810c960079d700672f0d13e3998bf2bad98b95597284896 not found: ID does not exist"
Sep 17 15:58:10.560298 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.560239    2584 scope.go:117] "RemoveContainer" containerID="d94d469dbc5ebfd72c974579b50cd26db1993ef213c0bcf973574e2fcb1435e2"
Sep 17 15:58:10.560463 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.560447    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d94d469dbc5ebfd72c974579b50cd26db1993ef213c0bcf973574e2fcb1435e2"} err="failed to get container status \"d94d469dbc5ebfd72c974579b50cd26db1993ef213c0bcf973574e2fcb1435e2\": rpc error: code = NotFound desc = could not find container \"d94d469dbc5ebfd72c974579b50cd26db1993ef213c0bcf973574e2fcb1435e2\": container with ID starting with d94d469dbc5ebfd72c974579b50cd26db1993ef213c0bcf973574e2fcb1435e2 not found: ID does not exist"
Sep 17 15:58:10.560575 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.560462    2584 scope.go:117] "RemoveContainer" containerID="dac7c10ee9a676cd50accc8bb2dfd6d816905dd1cbaaea6ca436314bdca1592a"
Sep 17 15:58:10.560743 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.560725    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dac7c10ee9a676cd50accc8bb2dfd6d816905dd1cbaaea6ca436314bdca1592a"} err="failed to get container status \"dac7c10ee9a676cd50accc8bb2dfd6d816905dd1cbaaea6ca436314bdca1592a\": rpc error: code = NotFound desc = could not find container \"dac7c10ee9a676cd50accc8bb2dfd6d816905dd1cbaaea6ca436314bdca1592a\": container with ID starting with dac7c10ee9a676cd50accc8bb2dfd6d816905dd1cbaaea6ca436314bdca1592a not found: ID does not exist"
Sep 17 15:58:10.560810 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.560756    2584 scope.go:117] "RemoveContainer" containerID="51b56c20748fe30631cd61cd2323ccd767b19da7a0818da994cd9325b40a1721"
Sep 17 15:58:10.560996 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.560981    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51b56c20748fe30631cd61cd2323ccd767b19da7a0818da994cd9325b40a1721"} err="failed to get container status \"51b56c20748fe30631cd61cd2323ccd767b19da7a0818da994cd9325b40a1721\": rpc error: code = NotFound desc = could not find container \"51b56c20748fe30631cd61cd2323ccd767b19da7a0818da994cd9325b40a1721\": container with ID starting with 51b56c20748fe30631cd61cd2323ccd767b19da7a0818da994cd9325b40a1721 not found: ID does not exist"
Sep 17 15:58:10.561040 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.560996    2584 scope.go:117] "RemoveContainer" containerID="80ddaa91a1c8454d3760fc65394e72e6cc80c91cbc918a370f73baae44640e14"
Sep 17 15:58:10.561197 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.561180    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80ddaa91a1c8454d3760fc65394e72e6cc80c91cbc918a370f73baae44640e14"} err="failed to get container status \"80ddaa91a1c8454d3760fc65394e72e6cc80c91cbc918a370f73baae44640e14\": rpc error: code = NotFound desc = could not find container \"80ddaa91a1c8454d3760fc65394e72e6cc80c91cbc918a370f73baae44640e14\": container with ID starting with 80ddaa91a1c8454d3760fc65394e72e6cc80c91cbc918a370f73baae44640e14 not found: ID does not exist"
Sep 17 15:58:10.561266 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.561201    2584 scope.go:117] "RemoveContainer" containerID="f4c92b3c4ffd0f47d5e97e1628193124462c184d7534415d532c87a59653ac72"
Sep 17 15:58:10.561408 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.561392    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4c92b3c4ffd0f47d5e97e1628193124462c184d7534415d532c87a59653ac72"} err="failed to get container status \"f4c92b3c4ffd0f47d5e97e1628193124462c184d7534415d532c87a59653ac72\": rpc error: code = NotFound desc = could not find container \"f4c92b3c4ffd0f47d5e97e1628193124462c184d7534415d532c87a59653ac72\": container with ID starting with f4c92b3c4ffd0f47d5e97e1628193124462c184d7534415d532c87a59653ac72 not found: ID does not exist"
Sep 17 15:58:10.561472 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.561409    2584 scope.go:117] "RemoveContainer" containerID="83b2eaee80daaaa5bc289c92ead81063779c3eea8333bc30042e0ff1ad1e3a9a"
Sep 17 15:58:10.561706 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.561680    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83b2eaee80daaaa5bc289c92ead81063779c3eea8333bc30042e0ff1ad1e3a9a"} err="failed to get container status \"83b2eaee80daaaa5bc289c92ead81063779c3eea8333bc30042e0ff1ad1e3a9a\": rpc error: code = NotFound desc = could not find container \"83b2eaee80daaaa5bc289c92ead81063779c3eea8333bc30042e0ff1ad1e3a9a\": container with ID starting with 83b2eaee80daaaa5bc289c92ead81063779c3eea8333bc30042e0ff1ad1e3a9a not found: ID does not exist"
Sep 17 15:58:10.561756 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.561707    2584 scope.go:117] "RemoveContainer" containerID="2bc7c1784a4475334810c960079d700672f0d13e3998bf2bad98b95597284896"
Sep 17 15:58:10.561951 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.561931    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bc7c1784a4475334810c960079d700672f0d13e3998bf2bad98b95597284896"} err="failed to get container status \"2bc7c1784a4475334810c960079d700672f0d13e3998bf2bad98b95597284896\": rpc error: code = NotFound desc = could not find container \"2bc7c1784a4475334810c960079d700672f0d13e3998bf2bad98b95597284896\": container with ID starting with 2bc7c1784a4475334810c960079d700672f0d13e3998bf2bad98b95597284896 not found: ID does not exist"
Sep 17 15:58:10.562014 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.561952    2584 scope.go:117] "RemoveContainer" containerID="d94d469dbc5ebfd72c974579b50cd26db1993ef213c0bcf973574e2fcb1435e2"
Sep 17 15:58:10.562184 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.562168    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d94d469dbc5ebfd72c974579b50cd26db1993ef213c0bcf973574e2fcb1435e2"} err="failed to get container status \"d94d469dbc5ebfd72c974579b50cd26db1993ef213c0bcf973574e2fcb1435e2\": rpc error: code = NotFound desc = could not find container \"d94d469dbc5ebfd72c974579b50cd26db1993ef213c0bcf973574e2fcb1435e2\": container with ID starting with d94d469dbc5ebfd72c974579b50cd26db1993ef213c0bcf973574e2fcb1435e2 not found: ID does not exist"
Sep 17 15:58:10.562236 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.562185    2584 scope.go:117] "RemoveContainer" containerID="dac7c10ee9a676cd50accc8bb2dfd6d816905dd1cbaaea6ca436314bdca1592a"
Sep 17 15:58:10.562479 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.562446    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dac7c10ee9a676cd50accc8bb2dfd6d816905dd1cbaaea6ca436314bdca1592a"} err="failed to get container status \"dac7c10ee9a676cd50accc8bb2dfd6d816905dd1cbaaea6ca436314bdca1592a\": rpc error: code = NotFound desc = could not find container \"dac7c10ee9a676cd50accc8bb2dfd6d816905dd1cbaaea6ca436314bdca1592a\": container with ID starting with dac7c10ee9a676cd50accc8bb2dfd6d816905dd1cbaaea6ca436314bdca1592a not found: ID does not exist"
Sep 17 15:58:10.562557 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.562483    2584 scope.go:117] "RemoveContainer" containerID="51b56c20748fe30631cd61cd2323ccd767b19da7a0818da994cd9325b40a1721"
Sep 17 15:58:10.562768 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.562749    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51b56c20748fe30631cd61cd2323ccd767b19da7a0818da994cd9325b40a1721"} err="failed to get container status \"51b56c20748fe30631cd61cd2323ccd767b19da7a0818da994cd9325b40a1721\": rpc error: code = NotFound desc = could not find container \"51b56c20748fe30631cd61cd2323ccd767b19da7a0818da994cd9325b40a1721\": container with ID starting with 51b56c20748fe30631cd61cd2323ccd767b19da7a0818da994cd9325b40a1721 not found: ID does not exist"
Sep 17 15:58:10.562768 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.562768    2584 scope.go:117] "RemoveContainer" containerID="80ddaa91a1c8454d3760fc65394e72e6cc80c91cbc918a370f73baae44640e14"
Sep 17 15:58:10.563025 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.562999    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80ddaa91a1c8454d3760fc65394e72e6cc80c91cbc918a370f73baae44640e14"} err="failed to get container status \"80ddaa91a1c8454d3760fc65394e72e6cc80c91cbc918a370f73baae44640e14\": rpc error: code = NotFound desc = could not find container \"80ddaa91a1c8454d3760fc65394e72e6cc80c91cbc918a370f73baae44640e14\": container with ID starting with 80ddaa91a1c8454d3760fc65394e72e6cc80c91cbc918a370f73baae44640e14 not found: ID does not exist"
Sep 17 15:58:10.563075 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.563026    2584 scope.go:117] "RemoveContainer" containerID="f4c92b3c4ffd0f47d5e97e1628193124462c184d7534415d532c87a59653ac72"
Sep 17 15:58:10.563286 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.563259    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4c92b3c4ffd0f47d5e97e1628193124462c184d7534415d532c87a59653ac72"} err="failed to get container status \"f4c92b3c4ffd0f47d5e97e1628193124462c184d7534415d532c87a59653ac72\": rpc error: code = NotFound desc = could not find container \"f4c92b3c4ffd0f47d5e97e1628193124462c184d7534415d532c87a59653ac72\": container with ID starting with f4c92b3c4ffd0f47d5e97e1628193124462c184d7534415d532c87a59653ac72 not found: ID does not exist"
Sep 17 15:58:10.563286 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.563277    2584 scope.go:117] "RemoveContainer" containerID="83b2eaee80daaaa5bc289c92ead81063779c3eea8333bc30042e0ff1ad1e3a9a"
Sep 17 15:58:10.563483 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.563467    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83b2eaee80daaaa5bc289c92ead81063779c3eea8333bc30042e0ff1ad1e3a9a"} err="failed to get container status \"83b2eaee80daaaa5bc289c92ead81063779c3eea8333bc30042e0ff1ad1e3a9a\": rpc error: code = NotFound desc = could not find container \"83b2eaee80daaaa5bc289c92ead81063779c3eea8333bc30042e0ff1ad1e3a9a\": container with ID starting with 83b2eaee80daaaa5bc289c92ead81063779c3eea8333bc30042e0ff1ad1e3a9a not found: ID does not exist"
Sep 17 15:58:10.563575 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.563483    2584 scope.go:117] "RemoveContainer" containerID="2bc7c1784a4475334810c960079d700672f0d13e3998bf2bad98b95597284896"
Sep 17 15:58:10.563748 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.563724    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bc7c1784a4475334810c960079d700672f0d13e3998bf2bad98b95597284896"} err="failed to get container status \"2bc7c1784a4475334810c960079d700672f0d13e3998bf2bad98b95597284896\": rpc error: code = NotFound desc = could not find container \"2bc7c1784a4475334810c960079d700672f0d13e3998bf2bad98b95597284896\": container with ID starting with 2bc7c1784a4475334810c960079d700672f0d13e3998bf2bad98b95597284896 not found: ID does not exist"
Sep 17 15:58:10.563748 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.563748    2584 scope.go:117] "RemoveContainer" containerID="d94d469dbc5ebfd72c974579b50cd26db1993ef213c0bcf973574e2fcb1435e2"
Sep 17 15:58:10.564014 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.563994    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d94d469dbc5ebfd72c974579b50cd26db1993ef213c0bcf973574e2fcb1435e2"} err="failed to get container status \"d94d469dbc5ebfd72c974579b50cd26db1993ef213c0bcf973574e2fcb1435e2\": rpc error: code = NotFound desc = could not find container \"d94d469dbc5ebfd72c974579b50cd26db1993ef213c0bcf973574e2fcb1435e2\": container with ID starting with d94d469dbc5ebfd72c974579b50cd26db1993ef213c0bcf973574e2fcb1435e2 not found: ID does not exist"
Sep 17 15:58:10.564088 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.564015    2584 scope.go:117] "RemoveContainer" containerID="dac7c10ee9a676cd50accc8bb2dfd6d816905dd1cbaaea6ca436314bdca1592a"
Sep 17 15:58:10.564273 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.564256    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dac7c10ee9a676cd50accc8bb2dfd6d816905dd1cbaaea6ca436314bdca1592a"} err="failed to get container status \"dac7c10ee9a676cd50accc8bb2dfd6d816905dd1cbaaea6ca436314bdca1592a\": rpc error: code = NotFound desc = could not find container \"dac7c10ee9a676cd50accc8bb2dfd6d816905dd1cbaaea6ca436314bdca1592a\": container with ID starting with dac7c10ee9a676cd50accc8bb2dfd6d816905dd1cbaaea6ca436314bdca1592a not found: ID does not exist"
Sep 17 15:58:10.564340 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.564274    2584 scope.go:117] "RemoveContainer" containerID="51b56c20748fe30631cd61cd2323ccd767b19da7a0818da994cd9325b40a1721"
Sep 17 15:58:10.564564 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.564545    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51b56c20748fe30631cd61cd2323ccd767b19da7a0818da994cd9325b40a1721"} err="failed to get container status \"51b56c20748fe30631cd61cd2323ccd767b19da7a0818da994cd9325b40a1721\": rpc error: code = NotFound desc = could not find container \"51b56c20748fe30631cd61cd2323ccd767b19da7a0818da994cd9325b40a1721\": container with ID starting with 51b56c20748fe30631cd61cd2323ccd767b19da7a0818da994cd9325b40a1721 not found: ID does not exist"
Sep 17 15:58:10.564705 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.564566    2584 scope.go:117] "RemoveContainer" containerID="80ddaa91a1c8454d3760fc65394e72e6cc80c91cbc918a370f73baae44640e14"
Sep 17 15:58:10.564952 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.564835    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80ddaa91a1c8454d3760fc65394e72e6cc80c91cbc918a370f73baae44640e14"} err="failed to get container status \"80ddaa91a1c8454d3760fc65394e72e6cc80c91cbc918a370f73baae44640e14\": rpc error: code = NotFound desc = could not find container \"80ddaa91a1c8454d3760fc65394e72e6cc80c91cbc918a370f73baae44640e14\": container with ID starting with 80ddaa91a1c8454d3760fc65394e72e6cc80c91cbc918a370f73baae44640e14 not found: ID does not exist"
Sep 17 15:58:10.564952 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.564858    2584 scope.go:117] "RemoveContainer" containerID="f4c92b3c4ffd0f47d5e97e1628193124462c184d7534415d532c87a59653ac72"
Sep 17 15:58:10.565142 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.565113    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4c92b3c4ffd0f47d5e97e1628193124462c184d7534415d532c87a59653ac72"} err="failed to get container status \"f4c92b3c4ffd0f47d5e97e1628193124462c184d7534415d532c87a59653ac72\": rpc error: code = NotFound desc = could not find container \"f4c92b3c4ffd0f47d5e97e1628193124462c184d7534415d532c87a59653ac72\": container with ID starting with f4c92b3c4ffd0f47d5e97e1628193124462c184d7534415d532c87a59653ac72 not found: ID does not exist"
Sep 17 15:58:10.565142 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.565143    2584 scope.go:117] "RemoveContainer" containerID="83b2eaee80daaaa5bc289c92ead81063779c3eea8333bc30042e0ff1ad1e3a9a"
Sep 17 15:58:10.565408 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.565369    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83b2eaee80daaaa5bc289c92ead81063779c3eea8333bc30042e0ff1ad1e3a9a"} err="failed to get container status \"83b2eaee80daaaa5bc289c92ead81063779c3eea8333bc30042e0ff1ad1e3a9a\": rpc error: code = NotFound desc = could not find container \"83b2eaee80daaaa5bc289c92ead81063779c3eea8333bc30042e0ff1ad1e3a9a\": container with ID starting with 83b2eaee80daaaa5bc289c92ead81063779c3eea8333bc30042e0ff1ad1e3a9a not found: ID does not exist"
Sep 17 15:58:10.565408 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.565399    2584 scope.go:117] "RemoveContainer" containerID="2bc7c1784a4475334810c960079d700672f0d13e3998bf2bad98b95597284896"
Sep 17 15:58:10.565692 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.565662    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bc7c1784a4475334810c960079d700672f0d13e3998bf2bad98b95597284896"} err="failed to get container status \"2bc7c1784a4475334810c960079d700672f0d13e3998bf2bad98b95597284896\": rpc error: code = NotFound desc = could not find container \"2bc7c1784a4475334810c960079d700672f0d13e3998bf2bad98b95597284896\": container with ID starting with 2bc7c1784a4475334810c960079d700672f0d13e3998bf2bad98b95597284896 not found: ID does not exist"
Sep 17 15:58:10.565786 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.565692    2584 scope.go:117] "RemoveContainer" containerID="d94d469dbc5ebfd72c974579b50cd26db1993ef213c0bcf973574e2fcb1435e2"
Sep 17 15:58:10.565983 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.565955    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d94d469dbc5ebfd72c974579b50cd26db1993ef213c0bcf973574e2fcb1435e2"} err="failed to get container status \"d94d469dbc5ebfd72c974579b50cd26db1993ef213c0bcf973574e2fcb1435e2\": rpc error: code = NotFound desc = could not find container \"d94d469dbc5ebfd72c974579b50cd26db1993ef213c0bcf973574e2fcb1435e2\": container with ID starting with d94d469dbc5ebfd72c974579b50cd26db1993ef213c0bcf973574e2fcb1435e2 not found: ID does not exist"
Sep 17 15:58:10.565983 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.565982    2584 scope.go:117] "RemoveContainer" containerID="dac7c10ee9a676cd50accc8bb2dfd6d816905dd1cbaaea6ca436314bdca1592a"
Sep 17 15:58:10.566322 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.566295    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dac7c10ee9a676cd50accc8bb2dfd6d816905dd1cbaaea6ca436314bdca1592a"} err="failed to get container status \"dac7c10ee9a676cd50accc8bb2dfd6d816905dd1cbaaea6ca436314bdca1592a\": rpc error: code = NotFound desc = could not find container \"dac7c10ee9a676cd50accc8bb2dfd6d816905dd1cbaaea6ca436314bdca1592a\": container with ID starting with dac7c10ee9a676cd50accc8bb2dfd6d816905dd1cbaaea6ca436314bdca1592a not found: ID does not exist"
Sep 17 15:58:10.566391 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.566324    2584 scope.go:117] "RemoveContainer" containerID="51b56c20748fe30631cd61cd2323ccd767b19da7a0818da994cd9325b40a1721"
Sep 17 15:58:10.566646 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.566621    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51b56c20748fe30631cd61cd2323ccd767b19da7a0818da994cd9325b40a1721"} err="failed to get container status \"51b56c20748fe30631cd61cd2323ccd767b19da7a0818da994cd9325b40a1721\": rpc error: code = NotFound desc = could not find container \"51b56c20748fe30631cd61cd2323ccd767b19da7a0818da994cd9325b40a1721\": container with ID starting with 51b56c20748fe30631cd61cd2323ccd767b19da7a0818da994cd9325b40a1721 not found: ID does not exist"
Sep 17 15:58:10.566730 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.566648    2584 scope.go:117] "RemoveContainer" containerID="80ddaa91a1c8454d3760fc65394e72e6cc80c91cbc918a370f73baae44640e14"
Sep 17 15:58:10.566730 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.566718    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 17 15:58:10.567022 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.566995    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80ddaa91a1c8454d3760fc65394e72e6cc80c91cbc918a370f73baae44640e14"} err="failed to get container status \"80ddaa91a1c8454d3760fc65394e72e6cc80c91cbc918a370f73baae44640e14\": rpc error: code = NotFound desc = could not find container \"80ddaa91a1c8454d3760fc65394e72e6cc80c91cbc918a370f73baae44640e14\": container with ID starting with 80ddaa91a1c8454d3760fc65394e72e6cc80c91cbc918a370f73baae44640e14 not found: ID does not exist"
Sep 17 15:58:10.567094 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.567024    2584 scope.go:117] "RemoveContainer" containerID="f4c92b3c4ffd0f47d5e97e1628193124462c184d7534415d532c87a59653ac72"
Sep 17 15:58:10.567094 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.567065    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68feab7b-51ee-4e7a-974c-ef429bf9d5e1" containerName="init-config-reloader"
Sep 17 15:58:10.567094 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.567083    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="68feab7b-51ee-4e7a-974c-ef429bf9d5e1" containerName="init-config-reloader"
Sep 17 15:58:10.567215 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.567102    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68feab7b-51ee-4e7a-974c-ef429bf9d5e1" containerName="kube-rbac-proxy-web"
Sep 17 15:58:10.567215 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.567110    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="68feab7b-51ee-4e7a-974c-ef429bf9d5e1" containerName="kube-rbac-proxy-web"
Sep 17 15:58:10.567215 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.567122    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68feab7b-51ee-4e7a-974c-ef429bf9d5e1" containerName="config-reloader"
Sep 17 15:58:10.567215 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.567128    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="68feab7b-51ee-4e7a-974c-ef429bf9d5e1" containerName="config-reloader"
Sep 17 15:58:10.567215 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.567146    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68feab7b-51ee-4e7a-974c-ef429bf9d5e1" containerName="thanos-sidecar"
Sep 17 15:58:10.567215 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.567155    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="68feab7b-51ee-4e7a-974c-ef429bf9d5e1" containerName="thanos-sidecar"
Sep 17 15:58:10.567215 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.567171    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68feab7b-51ee-4e7a-974c-ef429bf9d5e1" containerName="prometheus"
Sep 17 15:58:10.567215 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.567179    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="68feab7b-51ee-4e7a-974c-ef429bf9d5e1" containerName="prometheus"
Sep 17 15:58:10.567215 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.567188    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68feab7b-51ee-4e7a-974c-ef429bf9d5e1" containerName="kube-rbac-proxy-thanos"
Sep 17 15:58:10.567215 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.567196    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="68feab7b-51ee-4e7a-974c-ef429bf9d5e1" containerName="kube-rbac-proxy-thanos"
Sep 17 15:58:10.567215 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.567209    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68feab7b-51ee-4e7a-974c-ef429bf9d5e1" containerName="kube-rbac-proxy"
Sep 17 15:58:10.567215 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.567217    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="68feab7b-51ee-4e7a-974c-ef429bf9d5e1" containerName="kube-rbac-proxy"
Sep 17 15:58:10.567685 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.567286    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="68feab7b-51ee-4e7a-974c-ef429bf9d5e1" containerName="kube-rbac-proxy-web"
Sep 17 15:58:10.567685 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.567299    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="68feab7b-51ee-4e7a-974c-ef429bf9d5e1" containerName="config-reloader"
Sep 17 15:58:10.567685 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.567309    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="68feab7b-51ee-4e7a-974c-ef429bf9d5e1" containerName="thanos-sidecar"
Sep 17 15:58:10.567685 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.567320    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="68feab7b-51ee-4e7a-974c-ef429bf9d5e1" containerName="kube-rbac-proxy-thanos"
Sep 17 15:58:10.567685 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.567329    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="68feab7b-51ee-4e7a-974c-ef429bf9d5e1" containerName="kube-rbac-proxy"
Sep 17 15:58:10.567685 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.567334    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="68feab7b-51ee-4e7a-974c-ef429bf9d5e1" containerName="prometheus"
Sep 17 15:58:10.567685 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.567292    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4c92b3c4ffd0f47d5e97e1628193124462c184d7534415d532c87a59653ac72"} err="failed to get container status \"f4c92b3c4ffd0f47d5e97e1628193124462c184d7534415d532c87a59653ac72\": rpc error: code = NotFound desc = could not find container \"f4c92b3c4ffd0f47d5e97e1628193124462c184d7534415d532c87a59653ac72\": container with ID starting with f4c92b3c4ffd0f47d5e97e1628193124462c184d7534415d532c87a59653ac72 not found: ID does not exist"
Sep 17 15:58:10.567685 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.567386    2584 scope.go:117] "RemoveContainer" containerID="83b2eaee80daaaa5bc289c92ead81063779c3eea8333bc30042e0ff1ad1e3a9a"
Sep 17 15:58:10.568057 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.567722    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83b2eaee80daaaa5bc289c92ead81063779c3eea8333bc30042e0ff1ad1e3a9a"} err="failed to get container status \"83b2eaee80daaaa5bc289c92ead81063779c3eea8333bc30042e0ff1ad1e3a9a\": rpc error: code = NotFound desc = could not find container \"83b2eaee80daaaa5bc289c92ead81063779c3eea8333bc30042e0ff1ad1e3a9a\": container with ID starting with 83b2eaee80daaaa5bc289c92ead81063779c3eea8333bc30042e0ff1ad1e3a9a not found: ID does not exist"
Sep 17 15:58:10.568057 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.567748    2584 scope.go:117] "RemoveContainer" containerID="2bc7c1784a4475334810c960079d700672f0d13e3998bf2bad98b95597284896"
Sep 17 15:58:10.568129 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.568068    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bc7c1784a4475334810c960079d700672f0d13e3998bf2bad98b95597284896"} err="failed to get container status \"2bc7c1784a4475334810c960079d700672f0d13e3998bf2bad98b95597284896\": rpc error: code = NotFound desc = could not find container \"2bc7c1784a4475334810c960079d700672f0d13e3998bf2bad98b95597284896\": container with ID starting with 2bc7c1784a4475334810c960079d700672f0d13e3998bf2bad98b95597284896 not found: ID does not exist"
Sep 17 15:58:10.568129 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.568101    2584 scope.go:117] "RemoveContainer" containerID="d94d469dbc5ebfd72c974579b50cd26db1993ef213c0bcf973574e2fcb1435e2"
Sep 17 15:58:10.568397 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.568375    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d94d469dbc5ebfd72c974579b50cd26db1993ef213c0bcf973574e2fcb1435e2"} err="failed to get container status \"d94d469dbc5ebfd72c974579b50cd26db1993ef213c0bcf973574e2fcb1435e2\": rpc error: code = NotFound desc = could not find container \"d94d469dbc5ebfd72c974579b50cd26db1993ef213c0bcf973574e2fcb1435e2\": container with ID starting with d94d469dbc5ebfd72c974579b50cd26db1993ef213c0bcf973574e2fcb1435e2 not found: ID does not exist"
Sep 17 15:58:10.568397 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.568396    2584 scope.go:117] "RemoveContainer" containerID="dac7c10ee9a676cd50accc8bb2dfd6d816905dd1cbaaea6ca436314bdca1592a"
Sep 17 15:58:10.568687 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.568665    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dac7c10ee9a676cd50accc8bb2dfd6d816905dd1cbaaea6ca436314bdca1592a"} err="failed to get container status \"dac7c10ee9a676cd50accc8bb2dfd6d816905dd1cbaaea6ca436314bdca1592a\": rpc error: code = NotFound desc = could not find container \"dac7c10ee9a676cd50accc8bb2dfd6d816905dd1cbaaea6ca436314bdca1592a\": container with ID starting with dac7c10ee9a676cd50accc8bb2dfd6d816905dd1cbaaea6ca436314bdca1592a not found: ID does not exist"
Sep 17 15:58:10.571399 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.571382    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:58:10.574241 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.574220    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 17 15:58:10.574386 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.574271    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 17 15:58:10.574636 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.574617    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-63a0aiv0konpc\""
Sep 17 15:58:10.574716 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.574617    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 17 15:58:10.574842 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.574827    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 17 15:58:10.575054 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.575035    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 17 15:58:10.575184 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.575165    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 17 15:58:10.575249 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.575181    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-6cnmq\""
Sep 17 15:58:10.575249 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.575206    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 17 15:58:10.575351 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.575261    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 17 15:58:10.575412 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.575396    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 17 15:58:10.575466 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.575452    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 17 15:58:10.575567 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.575546    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 17 15:58:10.575759 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.575552    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 17 15:58:10.582586 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.582561    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 17 15:58:10.584552 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.584525    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 17 15:58:10.586630 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.586609    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 17 15:58:10.707864 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.707809    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bf0343d0-75f3-4950-85d3-223e116316d5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bf0343d0-75f3-4950-85d3-223e116316d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:58:10.707864 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.707844    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bf0343d0-75f3-4950-85d3-223e116316d5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bf0343d0-75f3-4950-85d3-223e116316d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:58:10.707864 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.707862    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bf0343d0-75f3-4950-85d3-223e116316d5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bf0343d0-75f3-4950-85d3-223e116316d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:58:10.708073 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.707879    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf0343d0-75f3-4950-85d3-223e116316d5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bf0343d0-75f3-4950-85d3-223e116316d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:58:10.708073 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.707984    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bf0343d0-75f3-4950-85d3-223e116316d5-web-config\") pod \"prometheus-k8s-0\" (UID: \"bf0343d0-75f3-4950-85d3-223e116316d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:58:10.708073 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.708024    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bf0343d0-75f3-4950-85d3-223e116316d5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bf0343d0-75f3-4950-85d3-223e116316d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:58:10.708073 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.708053    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bf0343d0-75f3-4950-85d3-223e116316d5-config-out\") pod \"prometheus-k8s-0\" (UID: \"bf0343d0-75f3-4950-85d3-223e116316d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:58:10.708276 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.708084    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bf0343d0-75f3-4950-85d3-223e116316d5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bf0343d0-75f3-4950-85d3-223e116316d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:58:10.708276 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.708109    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bf0343d0-75f3-4950-85d3-223e116316d5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bf0343d0-75f3-4950-85d3-223e116316d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:58:10.708276 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.708139    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf0343d0-75f3-4950-85d3-223e116316d5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bf0343d0-75f3-4950-85d3-223e116316d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:58:10.708276 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.708168    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bf0343d0-75f3-4950-85d3-223e116316d5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bf0343d0-75f3-4950-85d3-223e116316d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:58:10.708276 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.708195    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bf0343d0-75f3-4950-85d3-223e116316d5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bf0343d0-75f3-4950-85d3-223e116316d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:58:10.708276 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.708258    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf0343d0-75f3-4950-85d3-223e116316d5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bf0343d0-75f3-4950-85d3-223e116316d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:58:10.708565 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.708282    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bf0343d0-75f3-4950-85d3-223e116316d5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bf0343d0-75f3-4950-85d3-223e116316d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:58:10.708565 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.708330    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hbh6\" (UniqueName: \"kubernetes.io/projected/bf0343d0-75f3-4950-85d3-223e116316d5-kube-api-access-9hbh6\") pod \"prometheus-k8s-0\" (UID: \"bf0343d0-75f3-4950-85d3-223e116316d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:58:10.708565 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.708360    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bf0343d0-75f3-4950-85d3-223e116316d5-config\") pod \"prometheus-k8s-0\" (UID: \"bf0343d0-75f3-4950-85d3-223e116316d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:58:10.708565 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.708405    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf0343d0-75f3-4950-85d3-223e116316d5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bf0343d0-75f3-4950-85d3-223e116316d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:58:10.708565 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.708444    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bf0343d0-75f3-4950-85d3-223e116316d5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bf0343d0-75f3-4950-85d3-223e116316d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:58:10.708565 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.708467    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bf0343d0-75f3-4950-85d3-223e116316d5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bf0343d0-75f3-4950-85d3-223e116316d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:58:10.708565 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.708521    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bf0343d0-75f3-4950-85d3-223e116316d5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bf0343d0-75f3-4950-85d3-223e116316d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:58:10.809059 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.809031    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bf0343d0-75f3-4950-85d3-223e116316d5-config-out\") pod \"prometheus-k8s-0\" (UID: \"bf0343d0-75f3-4950-85d3-223e116316d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:58:10.809142 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.809066    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bf0343d0-75f3-4950-85d3-223e116316d5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bf0343d0-75f3-4950-85d3-223e116316d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:58:10.809142 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.809082    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bf0343d0-75f3-4950-85d3-223e116316d5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bf0343d0-75f3-4950-85d3-223e116316d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:58:10.809142 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.809097    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf0343d0-75f3-4950-85d3-223e116316d5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bf0343d0-75f3-4950-85d3-223e116316d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:58:10.809142 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.809114    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bf0343d0-75f3-4950-85d3-223e116316d5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bf0343d0-75f3-4950-85d3-223e116316d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:58:10.809142 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.809131    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bf0343d0-75f3-4950-85d3-223e116316d5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bf0343d0-75f3-4950-85d3-223e116316d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:58:10.809379 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.809156    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf0343d0-75f3-4950-85d3-223e116316d5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bf0343d0-75f3-4950-85d3-223e116316d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:58:10.809379 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.809179    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bf0343d0-75f3-4950-85d3-223e116316d5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bf0343d0-75f3-4950-85d3-223e116316d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:58:10.809379 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.809205    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hbh6\" (UniqueName: \"kubernetes.io/projected/bf0343d0-75f3-4950-85d3-223e116316d5-kube-api-access-9hbh6\") pod \"prometheus-k8s-0\" (UID: \"bf0343d0-75f3-4950-85d3-223e116316d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:58:10.809379 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.809228    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bf0343d0-75f3-4950-85d3-223e116316d5-config\") pod \"prometheus-k8s-0\" (UID: \"bf0343d0-75f3-4950-85d3-223e116316d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:58:10.809379 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.809250    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf0343d0-75f3-4950-85d3-223e116316d5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bf0343d0-75f3-4950-85d3-223e116316d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:58:10.809379 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.809279    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bf0343d0-75f3-4950-85d3-223e116316d5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bf0343d0-75f3-4950-85d3-223e116316d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:58:10.809379 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.809309    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bf0343d0-75f3-4950-85d3-223e116316d5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bf0343d0-75f3-4950-85d3-223e116316d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:58:10.809379 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.809333    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bf0343d0-75f3-4950-85d3-223e116316d5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bf0343d0-75f3-4950-85d3-223e116316d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:58:10.809379 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.809367    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bf0343d0-75f3-4950-85d3-223e116316d5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bf0343d0-75f3-4950-85d3-223e116316d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:58:10.809839 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.809405    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bf0343d0-75f3-4950-85d3-223e116316d5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bf0343d0-75f3-4950-85d3-223e116316d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:58:10.809839 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.809432    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bf0343d0-75f3-4950-85d3-223e116316d5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bf0343d0-75f3-4950-85d3-223e116316d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:58:10.809839 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.809460    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf0343d0-75f3-4950-85d3-223e116316d5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bf0343d0-75f3-4950-85d3-223e116316d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:58:10.809839 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.809530    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bf0343d0-75f3-4950-85d3-223e116316d5-web-config\") pod \"prometheus-k8s-0\" (UID: \"bf0343d0-75f3-4950-85d3-223e116316d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:58:10.809839 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.809562    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bf0343d0-75f3-4950-85d3-223e116316d5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bf0343d0-75f3-4950-85d3-223e116316d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:58:10.810255 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.809992    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf0343d0-75f3-4950-85d3-223e116316d5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bf0343d0-75f3-4950-85d3-223e116316d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:58:10.810255 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.810034    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf0343d0-75f3-4950-85d3-223e116316d5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bf0343d0-75f3-4950-85d3-223e116316d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:58:10.810255 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.810055    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bf0343d0-75f3-4950-85d3-223e116316d5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bf0343d0-75f3-4950-85d3-223e116316d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:58:10.810786 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.810643    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bf0343d0-75f3-4950-85d3-223e116316d5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bf0343d0-75f3-4950-85d3-223e116316d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:58:10.812531 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.812371    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bf0343d0-75f3-4950-85d3-223e116316d5-config-out\") pod \"prometheus-k8s-0\" (UID: \"bf0343d0-75f3-4950-85d3-223e116316d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:58:10.812629 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.812605    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bf0343d0-75f3-4950-85d3-223e116316d5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bf0343d0-75f3-4950-85d3-223e116316d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:58:10.812758 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.812729    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bf0343d0-75f3-4950-85d3-223e116316d5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bf0343d0-75f3-4950-85d3-223e116316d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:58:10.812877 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.812783    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bf0343d0-75f3-4950-85d3-223e116316d5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bf0343d0-75f3-4950-85d3-223e116316d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:58:10.813151 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.813120    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bf0343d0-75f3-4950-85d3-223e116316d5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bf0343d0-75f3-4950-85d3-223e116316d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:58:10.814293 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.813707    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf0343d0-75f3-4950-85d3-223e116316d5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bf0343d0-75f3-4950-85d3-223e116316d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:58:10.814293 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.813882    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf0343d0-75f3-4950-85d3-223e116316d5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bf0343d0-75f3-4950-85d3-223e116316d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:58:10.814293 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.813947    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bf0343d0-75f3-4950-85d3-223e116316d5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bf0343d0-75f3-4950-85d3-223e116316d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:58:10.814293 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.814026    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bf0343d0-75f3-4950-85d3-223e116316d5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bf0343d0-75f3-4950-85d3-223e116316d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:58:10.814293 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.814226    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bf0343d0-75f3-4950-85d3-223e116316d5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bf0343d0-75f3-4950-85d3-223e116316d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:58:10.814586 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.814352    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bf0343d0-75f3-4950-85d3-223e116316d5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bf0343d0-75f3-4950-85d3-223e116316d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:58:10.815255 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.815229    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bf0343d0-75f3-4950-85d3-223e116316d5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bf0343d0-75f3-4950-85d3-223e116316d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:58:10.815762 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.815741    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/bf0343d0-75f3-4950-85d3-223e116316d5-config\") pod \"prometheus-k8s-0\" (UID: \"bf0343d0-75f3-4950-85d3-223e116316d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:58:10.815907 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.815882    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bf0343d0-75f3-4950-85d3-223e116316d5-web-config\") pod \"prometheus-k8s-0\" (UID: \"bf0343d0-75f3-4950-85d3-223e116316d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:58:10.816263 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.816245    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bf0343d0-75f3-4950-85d3-223e116316d5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bf0343d0-75f3-4950-85d3-223e116316d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:58:10.822283 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.822264    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hbh6\" (UniqueName: \"kubernetes.io/projected/bf0343d0-75f3-4950-85d3-223e116316d5-kube-api-access-9hbh6\") pod \"prometheus-k8s-0\" (UID: \"bf0343d0-75f3-4950-85d3-223e116316d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:58:10.883289 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:10.883267    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:58:11.171972 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:11.171942    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 17 15:58:11.173882 ip-10-0-128-191 kubenswrapper[2584]: W0917 15:58:11.173857    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf0343d0_75f3_4950_85d3_223e116316d5.slice/crio-3613e56fa3e0f19a428883419b66e390b712cc61318e3014ba312a405aee0479 WatchSource:0}: Error finding container 3613e56fa3e0f19a428883419b66e390b712cc61318e3014ba312a405aee0479: Status 404 returned error can't find the container with id 3613e56fa3e0f19a428883419b66e390b712cc61318e3014ba312a405aee0479
Sep 17 15:58:11.512028 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:11.511965    2584 generic.go:356] "Generic (PLEG): container finished" podID="bf0343d0-75f3-4950-85d3-223e116316d5" containerID="b4d774a831b11ba1147fcf0ff84608d83a9f9f363c0615aa183dbbf2cad1cf04" exitCode=0
Sep 17 15:58:11.512028 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:11.512008    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bf0343d0-75f3-4950-85d3-223e116316d5","Type":"ContainerDied","Data":"b4d774a831b11ba1147fcf0ff84608d83a9f9f363c0615aa183dbbf2cad1cf04"}
Sep 17 15:58:11.512172 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:11.512058    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bf0343d0-75f3-4950-85d3-223e116316d5","Type":"ContainerStarted","Data":"3613e56fa3e0f19a428883419b66e390b712cc61318e3014ba312a405aee0479"}
Sep 17 15:58:12.523324 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:12.523284    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68feab7b-51ee-4e7a-974c-ef429bf9d5e1" path="/var/lib/kubelet/pods/68feab7b-51ee-4e7a-974c-ef429bf9d5e1/volumes"
Sep 17 15:58:12.525959 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:12.525927    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bf0343d0-75f3-4950-85d3-223e116316d5","Type":"ContainerStarted","Data":"e68b66dd65af006de34016beb404e3213e352e3fe16196fd0a6ca5a74ba9f329"}
Sep 17 15:58:12.526110 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:12.525982    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bf0343d0-75f3-4950-85d3-223e116316d5","Type":"ContainerStarted","Data":"9babc557e8933bb629a881ccdc85acc96df83f6b358365253df25603d578972b"}
Sep 17 15:58:12.526110 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:12.526010    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bf0343d0-75f3-4950-85d3-223e116316d5","Type":"ContainerStarted","Data":"029415d802428fcb1fbdb1ff21d05d3950fb263bde8027836acb0d33ca8c1e26"}
Sep 17 15:58:12.526110 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:12.526035    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bf0343d0-75f3-4950-85d3-223e116316d5","Type":"ContainerStarted","Data":"b4029ea255c7d974f001988d4310978ad8fd63c6ba890553e7253d010e9b15f8"}
Sep 17 15:58:12.526110 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:12.526057    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bf0343d0-75f3-4950-85d3-223e116316d5","Type":"ContainerStarted","Data":"9aea7c12431ed5f455ebfec3c4b164429727d9719ed2a52806c42018b747443f"}
Sep 17 15:58:12.526110 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:12.526080    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bf0343d0-75f3-4950-85d3-223e116316d5","Type":"ContainerStarted","Data":"82df764f6d3e198d9a4ee5c60ac564b2843eef7b43b2c6d53602bac7e309d433"}
Sep 17 15:58:12.556511 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:12.556444    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.537081904 podStartE2EDuration="2.556430023s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.348119ms" isStatefulPod=false podCreationTimestamp="2026-09-17 15:58:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:58:12.555173923 +0000 UTC m=+210.169105448" watchObservedRunningTime="2026-09-17 15:58:12.556430023 +0000 UTC m=+210.170361586"
Sep 17 15:58:15.883704 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:58:15.883664    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:59:10.883472 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:59:10.883429    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:59:10.900973 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:59:10.900941    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:59:11.782430 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:59:11.782395    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:59:44.380513 ip-10-0-128-191 kubenswrapper[2584]: I0917 15:59:44.380461    2584 kubelet.go:1648] "Image garbage collection succeeded"
Sep 17 16:05:13.500809 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:05:13.500771    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-init-qwns4"]
Sep 17 16:05:13.504200 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:05:13.504180    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-qwns4"
Sep 17 16:05:13.506814 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:05:13.506794    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"hf-token\""
Sep 17 16:05:13.506930 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:05:13.506793    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Sep 17 16:05:13.507597 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:05:13.507581    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Sep 17 16:05:13.507674 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:05:13.507654    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\""
Sep 17 16:05:13.507727 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:05:13.507663    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-swth9\""
Sep 17 16:05:13.512447 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:05:13.512422    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-qwns4"]
Sep 17 16:05:13.620097 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:05:13.620056    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcjvq\" (UniqueName: \"kubernetes.io/projected/1489cb8e-d55a-4d7a-a397-1e6ead376e44-kube-api-access-tcjvq\") pod \"s3-init-qwns4\" (UID: \"1489cb8e-d55a-4d7a-a397-1e6ead376e44\") " pod="kserve/s3-init-qwns4"
Sep 17 16:05:13.620275 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:05:13.620112    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1489cb8e-d55a-4d7a-a397-1e6ead376e44-model-cache\") pod \"s3-init-qwns4\" (UID: \"1489cb8e-d55a-4d7a-a397-1e6ead376e44\") " pod="kserve/s3-init-qwns4"
Sep 17 16:05:13.721399 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:05:13.721363    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1489cb8e-d55a-4d7a-a397-1e6ead376e44-model-cache\") pod \"s3-init-qwns4\" (UID: \"1489cb8e-d55a-4d7a-a397-1e6ead376e44\") " pod="kserve/s3-init-qwns4"
Sep 17 16:05:13.721533 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:05:13.721442    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcjvq\" (UniqueName: \"kubernetes.io/projected/1489cb8e-d55a-4d7a-a397-1e6ead376e44-kube-api-access-tcjvq\") pod \"s3-init-qwns4\" (UID: \"1489cb8e-d55a-4d7a-a397-1e6ead376e44\") " pod="kserve/s3-init-qwns4"
Sep 17 16:05:13.721932 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:05:13.721914    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1489cb8e-d55a-4d7a-a397-1e6ead376e44-model-cache\") pod \"s3-init-qwns4\" (UID: \"1489cb8e-d55a-4d7a-a397-1e6ead376e44\") " pod="kserve/s3-init-qwns4"
Sep 17 16:05:13.730585 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:05:13.730550    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcjvq\" (UniqueName: \"kubernetes.io/projected/1489cb8e-d55a-4d7a-a397-1e6ead376e44-kube-api-access-tcjvq\") pod \"s3-init-qwns4\" (UID: \"1489cb8e-d55a-4d7a-a397-1e6ead376e44\") " pod="kserve/s3-init-qwns4"
Sep 17 16:05:13.824115 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:05:13.824029    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-qwns4"
Sep 17 16:05:14.098095 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:05:14.097885    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-qwns4"]
Sep 17 16:05:14.100982 ip-10-0-128-191 kubenswrapper[2584]: W0917 16:05:14.100950    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1489cb8e_d55a_4d7a_a397_1e6ead376e44.slice/crio-3c16cd8f103114688355ab596e43aec2db4896aed8f259171c083f21b88608ef WatchSource:0}: Error finding container 3c16cd8f103114688355ab596e43aec2db4896aed8f259171c083f21b88608ef: Status 404 returned error can't find the container with id 3c16cd8f103114688355ab596e43aec2db4896aed8f259171c083f21b88608ef
Sep 17 16:05:14.103352 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:05:14.103336    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 16:05:14.169840 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:05:14.169806    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-qwns4" event={"ID":"1489cb8e-d55a-4d7a-a397-1e6ead376e44","Type":"ContainerStarted","Data":"3c16cd8f103114688355ab596e43aec2db4896aed8f259171c083f21b88608ef"}
Sep 17 16:05:18.188685 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:05:18.188640    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-qwns4" event={"ID":"1489cb8e-d55a-4d7a-a397-1e6ead376e44","Type":"ContainerStarted","Data":"b5adf31bc7c8dbf1bb88b41ca105f1969d6cfc0ae6c2eed43bb0a3a52ea52e81"}
Sep 17 16:05:20.198472 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:05:20.198435    2584 generic.go:356] "Generic (PLEG): container finished" podID="1489cb8e-d55a-4d7a-a397-1e6ead376e44" containerID="b5adf31bc7c8dbf1bb88b41ca105f1969d6cfc0ae6c2eed43bb0a3a52ea52e81" exitCode=0
Sep 17 16:05:20.198864 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:05:20.198516    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-qwns4" event={"ID":"1489cb8e-d55a-4d7a-a397-1e6ead376e44","Type":"ContainerDied","Data":"b5adf31bc7c8dbf1bb88b41ca105f1969d6cfc0ae6c2eed43bb0a3a52ea52e81"}
Sep 17 16:05:25.224358 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:05:25.224323    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-qwns4" event={"ID":"1489cb8e-d55a-4d7a-a397-1e6ead376e44","Type":"ContainerStarted","Data":"a61a6f2bb56cd9d8d2d2f0cce91a37576c298bb5e03b885b3172b7b554f9fd57"}
Sep 17 16:05:25.243601 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:05:25.243546    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-init-qwns4" podStartSLOduration=2.398093996 podStartE2EDuration="12.243527036s" totalImagesPullingTime="8.085377073s" totalInitContainerRuntime="1.760055967s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:05:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:05:25.242529183 +0000 UTC m=+642.856460696" watchObservedRunningTime="2026-09-17 16:05:25.243527036 +0000 UTC m=+642.857458546"
Sep 17 16:06:30.478756 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:06:30.478722    2584 generic.go:356] "Generic (PLEG): container finished" podID="1489cb8e-d55a-4d7a-a397-1e6ead376e44" containerID="a61a6f2bb56cd9d8d2d2f0cce91a37576c298bb5e03b885b3172b7b554f9fd57" exitCode=0
Sep 17 16:06:30.479155 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:06:30.478803    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-qwns4" event={"ID":"1489cb8e-d55a-4d7a-a397-1e6ead376e44","Type":"ContainerDied","Data":"a61a6f2bb56cd9d8d2d2f0cce91a37576c298bb5e03b885b3172b7b554f9fd57"}
Sep 17 16:06:31.603224 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:06:31.603201    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-qwns4"
Sep 17 16:06:31.679459 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:06:31.679418    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tcjvq\" (UniqueName: \"kubernetes.io/projected/1489cb8e-d55a-4d7a-a397-1e6ead376e44-kube-api-access-tcjvq\") pod \"1489cb8e-d55a-4d7a-a397-1e6ead376e44\" (UID: \"1489cb8e-d55a-4d7a-a397-1e6ead376e44\") "
Sep 17 16:06:31.679679 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:06:31.679542    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1489cb8e-d55a-4d7a-a397-1e6ead376e44-model-cache\") pod \"1489cb8e-d55a-4d7a-a397-1e6ead376e44\" (UID: \"1489cb8e-d55a-4d7a-a397-1e6ead376e44\") "
Sep 17 16:06:31.681811 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:06:31.681787    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1489cb8e-d55a-4d7a-a397-1e6ead376e44-kube-api-access-tcjvq" (OuterVolumeSpecName: "kube-api-access-tcjvq") pod "1489cb8e-d55a-4d7a-a397-1e6ead376e44" (UID: "1489cb8e-d55a-4d7a-a397-1e6ead376e44"). InnerVolumeSpecName "kube-api-access-tcjvq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 16:06:31.701612 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:06:31.701582    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1489cb8e-d55a-4d7a-a397-1e6ead376e44-model-cache" (OuterVolumeSpecName: "model-cache") pod "1489cb8e-d55a-4d7a-a397-1e6ead376e44" (UID: "1489cb8e-d55a-4d7a-a397-1e6ead376e44"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 16:06:31.780429 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:06:31.780357    2584 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1489cb8e-d55a-4d7a-a397-1e6ead376e44-model-cache\") on node \"ip-10-0-128-191.ec2.internal\" DevicePath \"\""
Sep 17 16:06:31.780429 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:06:31.780391    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tcjvq\" (UniqueName: \"kubernetes.io/projected/1489cb8e-d55a-4d7a-a397-1e6ead376e44-kube-api-access-tcjvq\") on node \"ip-10-0-128-191.ec2.internal\" DevicePath \"\""
Sep 17 16:06:32.488029 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:06:32.487999    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-qwns4"
Sep 17 16:06:32.488237 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:06:32.488026    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-qwns4" event={"ID":"1489cb8e-d55a-4d7a-a397-1e6ead376e44","Type":"ContainerDied","Data":"3c16cd8f103114688355ab596e43aec2db4896aed8f259171c083f21b88608ef"}
Sep 17 16:06:32.488237 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:06:32.488067    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3c16cd8f103114688355ab596e43aec2db4896aed8f259171c083f21b88608ef"
Sep 17 16:06:45.047261 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:06:45.047225    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-6b9dfd44-dqcdb"]
Sep 17 16:06:45.047709 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:06:45.047689    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1489cb8e-d55a-4d7a-a397-1e6ead376e44" containerName="s3-init"
Sep 17 16:06:45.047709 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:06:45.047704    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="1489cb8e-d55a-4d7a-a397-1e6ead376e44" containerName="s3-init"
Sep 17 16:06:45.047789 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:06:45.047725    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1489cb8e-d55a-4d7a-a397-1e6ead376e44" containerName="download-hf-model"
Sep 17 16:06:45.047789 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:06:45.047735    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="1489cb8e-d55a-4d7a-a397-1e6ead376e44" containerName="download-hf-model"
Sep 17 16:06:45.047854 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:06:45.047804    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="1489cb8e-d55a-4d7a-a397-1e6ead376e44" containerName="s3-init"
Sep 17 16:06:45.050596 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:06:45.050573    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6b9dfd44-dqcdb"
Sep 17 16:06:45.055010 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:06:45.054986    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Sep 17 16:06:45.055322 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:06:45.055300    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Sep 17 16:06:45.055456 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:06:45.055427    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-rollback-kube-rbac-proxy-sar-config\""
Sep 17 16:06:45.055585 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:06:45.055406    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-rollback-predictor-serving-cert\""
Sep 17 16:06:45.055998 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:06:45.055979    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Sep 17 16:06:45.056129 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:06:45.056004    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Sep 17 16:06:45.056189 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:06:45.056039    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-z8dwv\""
Sep 17 16:06:45.064094 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:06:45.064069    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-6b9dfd44-dqcdb"]
Sep 17 16:06:45.198702 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:06:45.198672    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/b5ae44cf-3732-4277-9831-95fc73c78a29-cabundle-cert\") pod \"isvc-canary-rollback-predictor-6b9dfd44-dqcdb\" (UID: \"b5ae44cf-3732-4277-9831-95fc73c78a29\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6b9dfd44-dqcdb"
Sep 17 16:06:45.198857 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:06:45.198717    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b5ae44cf-3732-4277-9831-95fc73c78a29-kserve-provision-location\") pod \"isvc-canary-rollback-predictor-6b9dfd44-dqcdb\" (UID: \"b5ae44cf-3732-4277-9831-95fc73c78a29\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6b9dfd44-dqcdb"
Sep 17 16:06:45.198857 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:06:45.198818    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b5ae44cf-3732-4277-9831-95fc73c78a29-proxy-tls\") pod \"isvc-canary-rollback-predictor-6b9dfd44-dqcdb\" (UID: \"b5ae44cf-3732-4277-9831-95fc73c78a29\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6b9dfd44-dqcdb"
Sep 17 16:06:45.198952 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:06:45.198860    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b5ae44cf-3732-4277-9831-95fc73c78a29-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-predictor-6b9dfd44-dqcdb\" (UID: \"b5ae44cf-3732-4277-9831-95fc73c78a29\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6b9dfd44-dqcdb"
Sep 17 16:06:45.198952 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:06:45.198912    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ldw7\" (UniqueName: \"kubernetes.io/projected/b5ae44cf-3732-4277-9831-95fc73c78a29-kube-api-access-2ldw7\") pod \"isvc-canary-rollback-predictor-6b9dfd44-dqcdb\" (UID: \"b5ae44cf-3732-4277-9831-95fc73c78a29\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6b9dfd44-dqcdb"
Sep 17 16:06:45.300142 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:06:45.300046    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b5ae44cf-3732-4277-9831-95fc73c78a29-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-predictor-6b9dfd44-dqcdb\" (UID: \"b5ae44cf-3732-4277-9831-95fc73c78a29\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6b9dfd44-dqcdb"
Sep 17 16:06:45.300142 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:06:45.300132    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ldw7\" (UniqueName: \"kubernetes.io/projected/b5ae44cf-3732-4277-9831-95fc73c78a29-kube-api-access-2ldw7\") pod \"isvc-canary-rollback-predictor-6b9dfd44-dqcdb\" (UID: \"b5ae44cf-3732-4277-9831-95fc73c78a29\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6b9dfd44-dqcdb"
Sep 17 16:06:45.300357 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:06:45.300166    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/b5ae44cf-3732-4277-9831-95fc73c78a29-cabundle-cert\") pod \"isvc-canary-rollback-predictor-6b9dfd44-dqcdb\" (UID: \"b5ae44cf-3732-4277-9831-95fc73c78a29\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6b9dfd44-dqcdb"
Sep 17 16:06:45.300357 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:06:45.300204    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b5ae44cf-3732-4277-9831-95fc73c78a29-kserve-provision-location\") pod \"isvc-canary-rollback-predictor-6b9dfd44-dqcdb\" (UID: \"b5ae44cf-3732-4277-9831-95fc73c78a29\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6b9dfd44-dqcdb"
Sep 17 16:06:45.300357 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:06:45.300252    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b5ae44cf-3732-4277-9831-95fc73c78a29-proxy-tls\") pod \"isvc-canary-rollback-predictor-6b9dfd44-dqcdb\" (UID: \"b5ae44cf-3732-4277-9831-95fc73c78a29\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6b9dfd44-dqcdb"
Sep 17 16:06:45.300674 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:06:45.300650    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b5ae44cf-3732-4277-9831-95fc73c78a29-kserve-provision-location\") pod \"isvc-canary-rollback-predictor-6b9dfd44-dqcdb\" (UID: \"b5ae44cf-3732-4277-9831-95fc73c78a29\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6b9dfd44-dqcdb"
Sep 17 16:06:45.300866 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:06:45.300848    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/b5ae44cf-3732-4277-9831-95fc73c78a29-cabundle-cert\") pod \"isvc-canary-rollback-predictor-6b9dfd44-dqcdb\" (UID: \"b5ae44cf-3732-4277-9831-95fc73c78a29\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6b9dfd44-dqcdb"
Sep 17 16:06:45.300913 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:06:45.300868    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b5ae44cf-3732-4277-9831-95fc73c78a29-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-predictor-6b9dfd44-dqcdb\" (UID: \"b5ae44cf-3732-4277-9831-95fc73c78a29\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6b9dfd44-dqcdb"
Sep 17 16:06:45.302910 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:06:45.302893    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b5ae44cf-3732-4277-9831-95fc73c78a29-proxy-tls\") pod \"isvc-canary-rollback-predictor-6b9dfd44-dqcdb\" (UID: \"b5ae44cf-3732-4277-9831-95fc73c78a29\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6b9dfd44-dqcdb"
Sep 17 16:06:45.310224 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:06:45.310201    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ldw7\" (UniqueName: \"kubernetes.io/projected/b5ae44cf-3732-4277-9831-95fc73c78a29-kube-api-access-2ldw7\") pod \"isvc-canary-rollback-predictor-6b9dfd44-dqcdb\" (UID: \"b5ae44cf-3732-4277-9831-95fc73c78a29\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6b9dfd44-dqcdb"
Sep 17 16:06:45.362438 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:06:45.362395    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6b9dfd44-dqcdb"
Sep 17 16:06:45.636008 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:06:45.635983    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-6b9dfd44-dqcdb"]
Sep 17 16:06:45.638533 ip-10-0-128-191 kubenswrapper[2584]: W0917 16:06:45.638507    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5ae44cf_3732_4277_9831_95fc73c78a29.slice/crio-53ab5ae37f3945da8acaa40c19b15f61f7a0eab859da84bd8c3d110ed33138f1 WatchSource:0}: Error finding container 53ab5ae37f3945da8acaa40c19b15f61f7a0eab859da84bd8c3d110ed33138f1: Status 404 returned error can't find the container with id 53ab5ae37f3945da8acaa40c19b15f61f7a0eab859da84bd8c3d110ed33138f1
Sep 17 16:06:46.543254 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:06:46.543216    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6b9dfd44-dqcdb" event={"ID":"b5ae44cf-3732-4277-9831-95fc73c78a29","Type":"ContainerStarted","Data":"7cb19514a8402d09c83ff753e561caa43d9af25c8954b219d37488223ad9303e"}
Sep 17 16:06:46.543661 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:06:46.543275    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6b9dfd44-dqcdb" event={"ID":"b5ae44cf-3732-4277-9831-95fc73c78a29","Type":"ContainerStarted","Data":"53ab5ae37f3945da8acaa40c19b15f61f7a0eab859da84bd8c3d110ed33138f1"}
Sep 17 16:06:49.558144 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:06:49.558111    2584 generic.go:356] "Generic (PLEG): container finished" podID="b5ae44cf-3732-4277-9831-95fc73c78a29" containerID="7cb19514a8402d09c83ff753e561caa43d9af25c8954b219d37488223ad9303e" exitCode=0
Sep 17 16:06:49.558658 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:06:49.558190    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6b9dfd44-dqcdb" event={"ID":"b5ae44cf-3732-4277-9831-95fc73c78a29","Type":"ContainerDied","Data":"7cb19514a8402d09c83ff753e561caa43d9af25c8954b219d37488223ad9303e"}
Sep 17 16:07:03.638517 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:07:03.638454    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6b9dfd44-dqcdb" event={"ID":"b5ae44cf-3732-4277-9831-95fc73c78a29","Type":"ContainerStarted","Data":"08a733442c68464059d6b2b06761c38f7163b37ed18cde5ab89d2f7cae812e5e"}
Sep 17 16:07:05.654778 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:07:05.654741    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6b9dfd44-dqcdb" event={"ID":"b5ae44cf-3732-4277-9831-95fc73c78a29","Type":"ContainerStarted","Data":"1582615291bc8578be2176548121fef615cc8f582cf9bbc55ffacbdfaa4f1fd1"}
Sep 17 16:07:05.655218 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:07:05.654941    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6b9dfd44-dqcdb"
Sep 17 16:07:05.655218 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:07:05.655000    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6b9dfd44-dqcdb"
Sep 17 16:07:05.656326 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:07:05.656293    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6b9dfd44-dqcdb" podUID="b5ae44cf-3732-4277-9831-95fc73c78a29" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.22:8080: connect: connection refused"
Sep 17 16:07:05.685548 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:07:05.685472    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6b9dfd44-dqcdb" podStartSLOduration=1.310743748 podStartE2EDuration="20.685455196s" totalImagesPullingTime="15.603251952s" totalInitContainerRuntime="3.771459496s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:06:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:07:05.683754862 +0000 UTC m=+743.297686373" watchObservedRunningTime="2026-09-17 16:07:05.685455196 +0000 UTC m=+743.299386707"
Sep 17 16:07:06.658540 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:07:06.658478    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6b9dfd44-dqcdb" podUID="b5ae44cf-3732-4277-9831-95fc73c78a29" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.22:8080: connect: connection refused"
Sep 17 16:07:11.662975 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:07:11.662946    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6b9dfd44-dqcdb"
Sep 17 16:07:11.663453 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:07:11.663424    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6b9dfd44-dqcdb" podUID="b5ae44cf-3732-4277-9831-95fc73c78a29" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.22:8080: connect: connection refused"
Sep 17 16:07:21.663551 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:07:21.663487    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6b9dfd44-dqcdb" podUID="b5ae44cf-3732-4277-9831-95fc73c78a29" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.22:8080: connect: connection refused"
Sep 17 16:07:31.663605 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:07:31.663562    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6b9dfd44-dqcdb" podUID="b5ae44cf-3732-4277-9831-95fc73c78a29" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.22:8080: connect: connection refused"
Sep 17 16:07:41.664377 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:07:41.664334    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6b9dfd44-dqcdb" podUID="b5ae44cf-3732-4277-9831-95fc73c78a29" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.22:8080: connect: connection refused"
Sep 17 16:07:51.664014 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:07:51.663969    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6b9dfd44-dqcdb" podUID="b5ae44cf-3732-4277-9831-95fc73c78a29" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.22:8080: connect: connection refused"
Sep 17 16:08:01.664424 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:08:01.664334    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6b9dfd44-dqcdb" podUID="b5ae44cf-3732-4277-9831-95fc73c78a29" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.22:8080: connect: connection refused"
Sep 17 16:08:11.663864 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:08:11.663819    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6b9dfd44-dqcdb" podUID="b5ae44cf-3732-4277-9831-95fc73c78a29" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.22:8080: connect: connection refused"
Sep 17 16:08:21.664445 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:08:21.664413    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6b9dfd44-dqcdb"
Sep 17 16:10:04.879065 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:04.879030    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-6b9dfd44-dqcdb"]
Sep 17 16:10:04.879556 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:04.879291    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6b9dfd44-dqcdb" podUID="b5ae44cf-3732-4277-9831-95fc73c78a29" containerName="kserve-container" containerID="cri-o://08a733442c68464059d6b2b06761c38f7163b37ed18cde5ab89d2f7cae812e5e" gracePeriod=30
Sep 17 16:10:04.879556 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:04.879325    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6b9dfd44-dqcdb" podUID="b5ae44cf-3732-4277-9831-95fc73c78a29" containerName="kube-rbac-proxy" containerID="cri-o://1582615291bc8578be2176548121fef615cc8f582cf9bbc55ffacbdfaa4f1fd1" gracePeriod=30
Sep 17 16:10:05.358180 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:05.358149    2584 generic.go:356] "Generic (PLEG): container finished" podID="b5ae44cf-3732-4277-9831-95fc73c78a29" containerID="1582615291bc8578be2176548121fef615cc8f582cf9bbc55ffacbdfaa4f1fd1" exitCode=2
Sep 17 16:10:05.358340 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:05.358205    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6b9dfd44-dqcdb" event={"ID":"b5ae44cf-3732-4277-9831-95fc73c78a29","Type":"ContainerDied","Data":"1582615291bc8578be2176548121fef615cc8f582cf9bbc55ffacbdfaa4f1fd1"}
Sep 17 16:10:06.658868 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:06.658820    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6b9dfd44-dqcdb" podUID="b5ae44cf-3732-4277-9831-95fc73c78a29" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.22:8643/healthz\": dial tcp 10.134.0.22:8643: connect: connection refused"
Sep 17 16:10:09.331854 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:09.331828    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6b9dfd44-dqcdb"
Sep 17 16:10:09.376434 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:09.376407    2584 generic.go:356] "Generic (PLEG): container finished" podID="b5ae44cf-3732-4277-9831-95fc73c78a29" containerID="08a733442c68464059d6b2b06761c38f7163b37ed18cde5ab89d2f7cae812e5e" exitCode=0
Sep 17 16:10:09.376610 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:09.376461    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6b9dfd44-dqcdb" event={"ID":"b5ae44cf-3732-4277-9831-95fc73c78a29","Type":"ContainerDied","Data":"08a733442c68464059d6b2b06761c38f7163b37ed18cde5ab89d2f7cae812e5e"}
Sep 17 16:10:09.376610 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:09.376468    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6b9dfd44-dqcdb"
Sep 17 16:10:09.376610 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:09.376577    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-6b9dfd44-dqcdb" event={"ID":"b5ae44cf-3732-4277-9831-95fc73c78a29","Type":"ContainerDied","Data":"53ab5ae37f3945da8acaa40c19b15f61f7a0eab859da84bd8c3d110ed33138f1"}
Sep 17 16:10:09.376773 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:09.376617    2584 scope.go:117] "RemoveContainer" containerID="1582615291bc8578be2176548121fef615cc8f582cf9bbc55ffacbdfaa4f1fd1"
Sep 17 16:10:09.384382 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:09.384365    2584 scope.go:117] "RemoveContainer" containerID="08a733442c68464059d6b2b06761c38f7163b37ed18cde5ab89d2f7cae812e5e"
Sep 17 16:10:09.385115 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:09.385089    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/b5ae44cf-3732-4277-9831-95fc73c78a29-cabundle-cert\") pod \"b5ae44cf-3732-4277-9831-95fc73c78a29\" (UID: \"b5ae44cf-3732-4277-9831-95fc73c78a29\") "
Sep 17 16:10:09.385215 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:09.385140    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b5ae44cf-3732-4277-9831-95fc73c78a29-kube-rbac-proxy-sar-config\") pod \"b5ae44cf-3732-4277-9831-95fc73c78a29\" (UID: \"b5ae44cf-3732-4277-9831-95fc73c78a29\") "
Sep 17 16:10:09.385350 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:09.385269    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2ldw7\" (UniqueName: \"kubernetes.io/projected/b5ae44cf-3732-4277-9831-95fc73c78a29-kube-api-access-2ldw7\") pod \"b5ae44cf-3732-4277-9831-95fc73c78a29\" (UID: \"b5ae44cf-3732-4277-9831-95fc73c78a29\") "
Sep 17 16:10:09.385407 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:09.385373    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b5ae44cf-3732-4277-9831-95fc73c78a29-proxy-tls\") pod \"b5ae44cf-3732-4277-9831-95fc73c78a29\" (UID: \"b5ae44cf-3732-4277-9831-95fc73c78a29\") "
Sep 17 16:10:09.385459 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:09.385404    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b5ae44cf-3732-4277-9831-95fc73c78a29-kserve-provision-location\") pod \"b5ae44cf-3732-4277-9831-95fc73c78a29\" (UID: \"b5ae44cf-3732-4277-9831-95fc73c78a29\") "
Sep 17 16:10:09.385540 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:09.385526    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5ae44cf-3732-4277-9831-95fc73c78a29-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "b5ae44cf-3732-4277-9831-95fc73c78a29" (UID: "b5ae44cf-3732-4277-9831-95fc73c78a29"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 16:10:09.385593 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:09.385529    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5ae44cf-3732-4277-9831-95fc73c78a29-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "b5ae44cf-3732-4277-9831-95fc73c78a29" (UID: "b5ae44cf-3732-4277-9831-95fc73c78a29"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 16:10:09.385833 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:09.385809    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5ae44cf-3732-4277-9831-95fc73c78a29-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "b5ae44cf-3732-4277-9831-95fc73c78a29" (UID: "b5ae44cf-3732-4277-9831-95fc73c78a29"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 16:10:09.385952 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:09.385871    2584 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b5ae44cf-3732-4277-9831-95fc73c78a29-kube-rbac-proxy-sar-config\") on node \"ip-10-0-128-191.ec2.internal\" DevicePath \"\""
Sep 17 16:10:09.385952 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:09.385890    2584 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/b5ae44cf-3732-4277-9831-95fc73c78a29-cabundle-cert\") on node \"ip-10-0-128-191.ec2.internal\" DevicePath \"\""
Sep 17 16:10:09.387596 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:09.387565    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5ae44cf-3732-4277-9831-95fc73c78a29-kube-api-access-2ldw7" (OuterVolumeSpecName: "kube-api-access-2ldw7") pod "b5ae44cf-3732-4277-9831-95fc73c78a29" (UID: "b5ae44cf-3732-4277-9831-95fc73c78a29"). InnerVolumeSpecName "kube-api-access-2ldw7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 16:10:09.387825 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:09.387796    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5ae44cf-3732-4277-9831-95fc73c78a29-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "b5ae44cf-3732-4277-9831-95fc73c78a29" (UID: "b5ae44cf-3732-4277-9831-95fc73c78a29"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:10:09.400427 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:09.400409    2584 scope.go:117] "RemoveContainer" containerID="7cb19514a8402d09c83ff753e561caa43d9af25c8954b219d37488223ad9303e"
Sep 17 16:10:09.407364 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:09.407347    2584 scope.go:117] "RemoveContainer" containerID="1582615291bc8578be2176548121fef615cc8f582cf9bbc55ffacbdfaa4f1fd1"
Sep 17 16:10:09.407647 ip-10-0-128-191 kubenswrapper[2584]: E0917 16:10:09.407629    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1582615291bc8578be2176548121fef615cc8f582cf9bbc55ffacbdfaa4f1fd1\": container with ID starting with 1582615291bc8578be2176548121fef615cc8f582cf9bbc55ffacbdfaa4f1fd1 not found: ID does not exist" containerID="1582615291bc8578be2176548121fef615cc8f582cf9bbc55ffacbdfaa4f1fd1"
Sep 17 16:10:09.407728 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:09.407661    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1582615291bc8578be2176548121fef615cc8f582cf9bbc55ffacbdfaa4f1fd1"} err="failed to get container status \"1582615291bc8578be2176548121fef615cc8f582cf9bbc55ffacbdfaa4f1fd1\": rpc error: code = NotFound desc = could not find container \"1582615291bc8578be2176548121fef615cc8f582cf9bbc55ffacbdfaa4f1fd1\": container with ID starting with 1582615291bc8578be2176548121fef615cc8f582cf9bbc55ffacbdfaa4f1fd1 not found: ID does not exist"
Sep 17 16:10:09.407728 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:09.407686    2584 scope.go:117] "RemoveContainer" containerID="08a733442c68464059d6b2b06761c38f7163b37ed18cde5ab89d2f7cae812e5e"
Sep 17 16:10:09.407959 ip-10-0-128-191 kubenswrapper[2584]: E0917 16:10:09.407941    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08a733442c68464059d6b2b06761c38f7163b37ed18cde5ab89d2f7cae812e5e\": container with ID starting with 08a733442c68464059d6b2b06761c38f7163b37ed18cde5ab89d2f7cae812e5e not found: ID does not exist" containerID="08a733442c68464059d6b2b06761c38f7163b37ed18cde5ab89d2f7cae812e5e"
Sep 17 16:10:09.407997 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:09.407965    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08a733442c68464059d6b2b06761c38f7163b37ed18cde5ab89d2f7cae812e5e"} err="failed to get container status \"08a733442c68464059d6b2b06761c38f7163b37ed18cde5ab89d2f7cae812e5e\": rpc error: code = NotFound desc = could not find container \"08a733442c68464059d6b2b06761c38f7163b37ed18cde5ab89d2f7cae812e5e\": container with ID starting with 08a733442c68464059d6b2b06761c38f7163b37ed18cde5ab89d2f7cae812e5e not found: ID does not exist"
Sep 17 16:10:09.407997 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:09.407980    2584 scope.go:117] "RemoveContainer" containerID="7cb19514a8402d09c83ff753e561caa43d9af25c8954b219d37488223ad9303e"
Sep 17 16:10:09.408246 ip-10-0-128-191 kubenswrapper[2584]: E0917 16:10:09.408229    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7cb19514a8402d09c83ff753e561caa43d9af25c8954b219d37488223ad9303e\": container with ID starting with 7cb19514a8402d09c83ff753e561caa43d9af25c8954b219d37488223ad9303e not found: ID does not exist" containerID="7cb19514a8402d09c83ff753e561caa43d9af25c8954b219d37488223ad9303e"
Sep 17 16:10:09.408289 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:09.408252    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cb19514a8402d09c83ff753e561caa43d9af25c8954b219d37488223ad9303e"} err="failed to get container status \"7cb19514a8402d09c83ff753e561caa43d9af25c8954b219d37488223ad9303e\": rpc error: code = NotFound desc = could not find container \"7cb19514a8402d09c83ff753e561caa43d9af25c8954b219d37488223ad9303e\": container with ID starting with 7cb19514a8402d09c83ff753e561caa43d9af25c8954b219d37488223ad9303e not found: ID does not exist"
Sep 17 16:10:09.486310 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:09.486245    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2ldw7\" (UniqueName: \"kubernetes.io/projected/b5ae44cf-3732-4277-9831-95fc73c78a29-kube-api-access-2ldw7\") on node \"ip-10-0-128-191.ec2.internal\" DevicePath \"\""
Sep 17 16:10:09.486310 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:09.486271    2584 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b5ae44cf-3732-4277-9831-95fc73c78a29-proxy-tls\") on node \"ip-10-0-128-191.ec2.internal\" DevicePath \"\""
Sep 17 16:10:09.486310 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:09.486284    2584 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b5ae44cf-3732-4277-9831-95fc73c78a29-kserve-provision-location\") on node \"ip-10-0-128-191.ec2.internal\" DevicePath \"\""
Sep 17 16:10:09.700152 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:09.700121    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-6b9dfd44-dqcdb"]
Sep 17 16:10:09.704009 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:09.703981    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-6b9dfd44-dqcdb"]
Sep 17 16:10:10.167376 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:10.167340    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-canary-stop-predictor-7f68f9d4d-wb4wf"]
Sep 17 16:10:10.167675 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:10.167663    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5ae44cf-3732-4277-9831-95fc73c78a29" containerName="kube-rbac-proxy"
Sep 17 16:10:10.167675 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:10.167677    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5ae44cf-3732-4277-9831-95fc73c78a29" containerName="kube-rbac-proxy"
Sep 17 16:10:10.167760 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:10.167685    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5ae44cf-3732-4277-9831-95fc73c78a29" containerName="storage-initializer"
Sep 17 16:10:10.167760 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:10.167690    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5ae44cf-3732-4277-9831-95fc73c78a29" containerName="storage-initializer"
Sep 17 16:10:10.167760 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:10.167704    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5ae44cf-3732-4277-9831-95fc73c78a29" containerName="kserve-container"
Sep 17 16:10:10.167760 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:10.167710    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5ae44cf-3732-4277-9831-95fc73c78a29" containerName="kserve-container"
Sep 17 16:10:10.167760 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:10.167756    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5ae44cf-3732-4277-9831-95fc73c78a29" containerName="kube-rbac-proxy"
Sep 17 16:10:10.167934 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:10.167763    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5ae44cf-3732-4277-9831-95fc73c78a29" containerName="kserve-container"
Sep 17 16:10:10.172133 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:10.172113    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-7f68f9d4d-wb4wf"
Sep 17 16:10:10.175077 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:10.175056    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Sep 17 16:10:10.175188 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:10.175159    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Sep 17 16:10:10.175319 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:10.175296    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Sep 17 16:10:10.175485 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:10.175463    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-stop-predictor-serving-cert\""
Sep 17 16:10:10.175585 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:10.175467    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-stop-kube-rbac-proxy-sar-config\""
Sep 17 16:10:10.175585 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:10.175522    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-z8dwv\""
Sep 17 16:10:10.175585 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:10.175524    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Sep 17 16:10:10.181347 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:10.181324    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-stop-predictor-7f68f9d4d-wb4wf"]
Sep 17 16:10:10.191994 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:10.191961    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/4500d358-c35f-42c7-a52a-88a5f66944b4-kube-rbac-proxy-sar-config\") pod \"isvc-canary-stop-predictor-7f68f9d4d-wb4wf\" (UID: \"4500d358-c35f-42c7-a52a-88a5f66944b4\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-7f68f9d4d-wb4wf"
Sep 17 16:10:10.192101 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:10.192038    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/4500d358-c35f-42c7-a52a-88a5f66944b4-cabundle-cert\") pod \"isvc-canary-stop-predictor-7f68f9d4d-wb4wf\" (UID: \"4500d358-c35f-42c7-a52a-88a5f66944b4\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-7f68f9d4d-wb4wf"
Sep 17 16:10:10.192101 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:10.192078    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4500d358-c35f-42c7-a52a-88a5f66944b4-kserve-provision-location\") pod \"isvc-canary-stop-predictor-7f68f9d4d-wb4wf\" (UID: \"4500d358-c35f-42c7-a52a-88a5f66944b4\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-7f68f9d4d-wb4wf"
Sep 17 16:10:10.192207 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:10.192132    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5q4zt\" (UniqueName: \"kubernetes.io/projected/4500d358-c35f-42c7-a52a-88a5f66944b4-kube-api-access-5q4zt\") pod \"isvc-canary-stop-predictor-7f68f9d4d-wb4wf\" (UID: \"4500d358-c35f-42c7-a52a-88a5f66944b4\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-7f68f9d4d-wb4wf"
Sep 17 16:10:10.192207 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:10.192169    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4500d358-c35f-42c7-a52a-88a5f66944b4-proxy-tls\") pod \"isvc-canary-stop-predictor-7f68f9d4d-wb4wf\" (UID: \"4500d358-c35f-42c7-a52a-88a5f66944b4\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-7f68f9d4d-wb4wf"
Sep 17 16:10:10.293541 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:10.293505    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/4500d358-c35f-42c7-a52a-88a5f66944b4-kube-rbac-proxy-sar-config\") pod \"isvc-canary-stop-predictor-7f68f9d4d-wb4wf\" (UID: \"4500d358-c35f-42c7-a52a-88a5f66944b4\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-7f68f9d4d-wb4wf"
Sep 17 16:10:10.293541 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:10.293542    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/4500d358-c35f-42c7-a52a-88a5f66944b4-cabundle-cert\") pod \"isvc-canary-stop-predictor-7f68f9d4d-wb4wf\" (UID: \"4500d358-c35f-42c7-a52a-88a5f66944b4\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-7f68f9d4d-wb4wf"
Sep 17 16:10:10.293826 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:10.293672    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4500d358-c35f-42c7-a52a-88a5f66944b4-kserve-provision-location\") pod \"isvc-canary-stop-predictor-7f68f9d4d-wb4wf\" (UID: \"4500d358-c35f-42c7-a52a-88a5f66944b4\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-7f68f9d4d-wb4wf"
Sep 17 16:10:10.293826 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:10.293737    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5q4zt\" (UniqueName: \"kubernetes.io/projected/4500d358-c35f-42c7-a52a-88a5f66944b4-kube-api-access-5q4zt\") pod \"isvc-canary-stop-predictor-7f68f9d4d-wb4wf\" (UID: \"4500d358-c35f-42c7-a52a-88a5f66944b4\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-7f68f9d4d-wb4wf"
Sep 17 16:10:10.293826 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:10.293776    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4500d358-c35f-42c7-a52a-88a5f66944b4-proxy-tls\") pod \"isvc-canary-stop-predictor-7f68f9d4d-wb4wf\" (UID: \"4500d358-c35f-42c7-a52a-88a5f66944b4\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-7f68f9d4d-wb4wf"
Sep 17 16:10:10.294017 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:10.293997    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4500d358-c35f-42c7-a52a-88a5f66944b4-kserve-provision-location\") pod \"isvc-canary-stop-predictor-7f68f9d4d-wb4wf\" (UID: \"4500d358-c35f-42c7-a52a-88a5f66944b4\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-7f68f9d4d-wb4wf"
Sep 17 16:10:10.294087 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:10.294068    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/4500d358-c35f-42c7-a52a-88a5f66944b4-cabundle-cert\") pod \"isvc-canary-stop-predictor-7f68f9d4d-wb4wf\" (UID: \"4500d358-c35f-42c7-a52a-88a5f66944b4\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-7f68f9d4d-wb4wf"
Sep 17 16:10:10.294312 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:10.294293    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/4500d358-c35f-42c7-a52a-88a5f66944b4-kube-rbac-proxy-sar-config\") pod \"isvc-canary-stop-predictor-7f68f9d4d-wb4wf\" (UID: \"4500d358-c35f-42c7-a52a-88a5f66944b4\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-7f68f9d4d-wb4wf"
Sep 17 16:10:10.296430 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:10.296410    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4500d358-c35f-42c7-a52a-88a5f66944b4-proxy-tls\") pod \"isvc-canary-stop-predictor-7f68f9d4d-wb4wf\" (UID: \"4500d358-c35f-42c7-a52a-88a5f66944b4\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-7f68f9d4d-wb4wf"
Sep 17 16:10:10.303488 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:10.303467    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5q4zt\" (UniqueName: \"kubernetes.io/projected/4500d358-c35f-42c7-a52a-88a5f66944b4-kube-api-access-5q4zt\") pod \"isvc-canary-stop-predictor-7f68f9d4d-wb4wf\" (UID: \"4500d358-c35f-42c7-a52a-88a5f66944b4\") " pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-7f68f9d4d-wb4wf"
Sep 17 16:10:10.483120 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:10.483033    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-7f68f9d4d-wb4wf"
Sep 17 16:10:10.516452 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:10.516416    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5ae44cf-3732-4277-9831-95fc73c78a29" path="/var/lib/kubelet/pods/b5ae44cf-3732-4277-9831-95fc73c78a29/volumes"
Sep 17 16:10:10.754517 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:10.754466    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-stop-predictor-7f68f9d4d-wb4wf"]
Sep 17 16:10:10.756689 ip-10-0-128-191 kubenswrapper[2584]: W0917 16:10:10.756652    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4500d358_c35f_42c7_a52a_88a5f66944b4.slice/crio-32807cdce9551274c5b3b1f6fb599f00c03caf0c299870a4fc77937640831832 WatchSource:0}: Error finding container 32807cdce9551274c5b3b1f6fb599f00c03caf0c299870a4fc77937640831832: Status 404 returned error can't find the container with id 32807cdce9551274c5b3b1f6fb599f00c03caf0c299870a4fc77937640831832
Sep 17 16:10:11.386834 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:11.386794    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-7f68f9d4d-wb4wf" event={"ID":"4500d358-c35f-42c7-a52a-88a5f66944b4","Type":"ContainerStarted","Data":"a7d77bab458a8a8d62b76c453fa8825bbe1eb4863a26472f94aff1774c7723ff"}
Sep 17 16:10:11.387051 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:11.386850    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-7f68f9d4d-wb4wf" event={"ID":"4500d358-c35f-42c7-a52a-88a5f66944b4","Type":"ContainerStarted","Data":"32807cdce9551274c5b3b1f6fb599f00c03caf0c299870a4fc77937640831832"}
Sep 17 16:10:15.404084 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:15.404048    2584 generic.go:356] "Generic (PLEG): container finished" podID="4500d358-c35f-42c7-a52a-88a5f66944b4" containerID="a7d77bab458a8a8d62b76c453fa8825bbe1eb4863a26472f94aff1774c7723ff" exitCode=0
Sep 17 16:10:15.404461 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:15.404121    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-7f68f9d4d-wb4wf" event={"ID":"4500d358-c35f-42c7-a52a-88a5f66944b4","Type":"ContainerDied","Data":"a7d77bab458a8a8d62b76c453fa8825bbe1eb4863a26472f94aff1774c7723ff"}
Sep 17 16:10:16.410790 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:16.410747    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-7f68f9d4d-wb4wf" event={"ID":"4500d358-c35f-42c7-a52a-88a5f66944b4","Type":"ContainerStarted","Data":"106292ae19c4273c9d2490b5cd4fe2ac11489ac4cb8f153268aeb186f07c56cd"}
Sep 17 16:10:16.411184 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:16.410841    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-7f68f9d4d-wb4wf" event={"ID":"4500d358-c35f-42c7-a52a-88a5f66944b4","Type":"ContainerStarted","Data":"7a52406934946df9e455a42968a81c948b1605eea0d556287760bcb45126b65d"}
Sep 17 16:10:16.411184 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:16.411036    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-7f68f9d4d-wb4wf"
Sep 17 16:10:16.438116 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:16.438070    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-7f68f9d4d-wb4wf" podStartSLOduration=2.416892751 podStartE2EDuration="6.438053781s" totalImagesPullingTime="0s" totalInitContainerRuntime="4.02116103s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:10:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:10:16.43751623 +0000 UTC m=+934.051447734" watchObservedRunningTime="2026-09-17 16:10:16.438053781 +0000 UTC m=+934.051985340"
Sep 17 16:10:17.415456 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:17.415431    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-7f68f9d4d-wb4wf"
Sep 17 16:10:17.416821 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:17.416791    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-7f68f9d4d-wb4wf" podUID="4500d358-c35f-42c7-a52a-88a5f66944b4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.23:8080: connect: connection refused"
Sep 17 16:10:18.419672 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:18.419629    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-7f68f9d4d-wb4wf" podUID="4500d358-c35f-42c7-a52a-88a5f66944b4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.23:8080: connect: connection refused"
Sep 17 16:10:23.424749 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:23.424718    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-7f68f9d4d-wb4wf"
Sep 17 16:10:23.425274 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:23.425243    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-7f68f9d4d-wb4wf" podUID="4500d358-c35f-42c7-a52a-88a5f66944b4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.23:8080: connect: connection refused"
Sep 17 16:10:30.339178 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:30.339142    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4"]
Sep 17 16:10:30.342583 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:30.342561    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4"
Sep 17 16:10:30.345317 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:30.345296    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-raw-hpa-aa09f-kube-rbac-proxy-sar-config\""
Sep 17 16:10:30.345784 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:30.345767    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-raw-hpa-aa09f-predictor-serving-cert\""
Sep 17 16:10:30.362805 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:30.362780    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4"]
Sep 17 16:10:30.463734 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:30.463706    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd"]
Sep 17 16:10:30.463962 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:30.463934    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkg2k\" (UniqueName: \"kubernetes.io/projected/a50d45d2-8d82-401b-a218-5242d2846b3b-kube-api-access-mkg2k\") pod \"isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4\" (UID: \"a50d45d2-8d82-401b-a218-5242d2846b3b\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4"
Sep 17 16:10:30.464045 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:30.463981    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a50d45d2-8d82-401b-a218-5242d2846b3b-kserve-provision-location\") pod \"isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4\" (UID: \"a50d45d2-8d82-401b-a218-5242d2846b3b\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4"
Sep 17 16:10:30.464045 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:30.464011    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a50d45d2-8d82-401b-a218-5242d2846b3b-proxy-tls\") pod \"isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4\" (UID: \"a50d45d2-8d82-401b-a218-5242d2846b3b\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4"
Sep 17 16:10:30.464154 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:30.464118    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a50d45d2-8d82-401b-a218-5242d2846b3b-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4\" (UID: \"a50d45d2-8d82-401b-a218-5242d2846b3b\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4"
Sep 17 16:10:30.464260 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:30.464243    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a50d45d2-8d82-401b-a218-5242d2846b3b-cabundle-cert\") pod \"isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4\" (UID: \"a50d45d2-8d82-401b-a218-5242d2846b3b\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4"
Sep 17 16:10:30.468348 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:30.468328    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd"
Sep 17 16:10:30.471066 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:30.471047    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-raw-hpa-aa09f-predictor-serving-cert\""
Sep 17 16:10:30.471745 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:30.471725    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-raw-hpa-aa09f-kube-rbac-proxy-sar-config\""
Sep 17 16:10:30.479364 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:30.479345    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd"]
Sep 17 16:10:30.565283 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:30.565254    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a70e519e-d72b-408f-b1a4-7aebd3fb52ef-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd\" (UID: \"a70e519e-d72b-408f-b1a4-7aebd3fb52ef\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd"
Sep 17 16:10:30.565416 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:30.565347    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44hp9\" (UniqueName: \"kubernetes.io/projected/a70e519e-d72b-408f-b1a4-7aebd3fb52ef-kube-api-access-44hp9\") pod \"isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd\" (UID: \"a70e519e-d72b-408f-b1a4-7aebd3fb52ef\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd"
Sep 17 16:10:30.565416 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:30.565397    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a50d45d2-8d82-401b-a218-5242d2846b3b-cabundle-cert\") pod \"isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4\" (UID: \"a50d45d2-8d82-401b-a218-5242d2846b3b\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4"
Sep 17 16:10:30.565552 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:30.565437    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkg2k\" (UniqueName: \"kubernetes.io/projected/a50d45d2-8d82-401b-a218-5242d2846b3b-kube-api-access-mkg2k\") pod \"isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4\" (UID: \"a50d45d2-8d82-401b-a218-5242d2846b3b\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4"
Sep 17 16:10:30.565552 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:30.565466    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a50d45d2-8d82-401b-a218-5242d2846b3b-kserve-provision-location\") pod \"isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4\" (UID: \"a50d45d2-8d82-401b-a218-5242d2846b3b\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4"
Sep 17 16:10:30.565552 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:30.565521    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a50d45d2-8d82-401b-a218-5242d2846b3b-proxy-tls\") pod \"isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4\" (UID: \"a50d45d2-8d82-401b-a218-5242d2846b3b\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4"
Sep 17 16:10:30.565713 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:30.565553    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a70e519e-d72b-408f-b1a4-7aebd3fb52ef-proxy-tls\") pod \"isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd\" (UID: \"a70e519e-d72b-408f-b1a4-7aebd3fb52ef\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd"
Sep 17 16:10:30.565713 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:30.565580    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a70e519e-d72b-408f-b1a4-7aebd3fb52ef-kserve-provision-location\") pod \"isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd\" (UID: \"a70e519e-d72b-408f-b1a4-7aebd3fb52ef\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd"
Sep 17 16:10:30.565713 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:30.565615    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a50d45d2-8d82-401b-a218-5242d2846b3b-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4\" (UID: \"a50d45d2-8d82-401b-a218-5242d2846b3b\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4"
Sep 17 16:10:30.565713 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:30.565639    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a70e519e-d72b-408f-b1a4-7aebd3fb52ef-cabundle-cert\") pod \"isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd\" (UID: \"a70e519e-d72b-408f-b1a4-7aebd3fb52ef\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd"
Sep 17 16:10:30.565917 ip-10-0-128-191 kubenswrapper[2584]: E0917 16:10:30.565777    2584 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-aa09f-predictor-serving-cert: secret "isvc-sklearn-graph-raw-hpa-aa09f-predictor-serving-cert" not found
Sep 17 16:10:30.565917 ip-10-0-128-191 kubenswrapper[2584]: E0917 16:10:30.565837    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a50d45d2-8d82-401b-a218-5242d2846b3b-proxy-tls podName:a50d45d2-8d82-401b-a218-5242d2846b3b nodeName:}" failed. No retries permitted until 2026-09-17 16:10:31.065818256 +0000 UTC m=+948.679749763 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/a50d45d2-8d82-401b-a218-5242d2846b3b-proxy-tls") pod "isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4" (UID: "a50d45d2-8d82-401b-a218-5242d2846b3b") : secret "isvc-sklearn-graph-raw-hpa-aa09f-predictor-serving-cert" not found
Sep 17 16:10:30.566196 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:30.566169    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a50d45d2-8d82-401b-a218-5242d2846b3b-cabundle-cert\") pod \"isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4\" (UID: \"a50d45d2-8d82-401b-a218-5242d2846b3b\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4"
Sep 17 16:10:30.566305 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:30.566285    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a50d45d2-8d82-401b-a218-5242d2846b3b-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4\" (UID: \"a50d45d2-8d82-401b-a218-5242d2846b3b\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4"
Sep 17 16:10:30.566360 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:30.566292    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a50d45d2-8d82-401b-a218-5242d2846b3b-kserve-provision-location\") pod \"isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4\" (UID: \"a50d45d2-8d82-401b-a218-5242d2846b3b\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4"
Sep 17 16:10:30.574761 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:30.574731    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkg2k\" (UniqueName: \"kubernetes.io/projected/a50d45d2-8d82-401b-a218-5242d2846b3b-kube-api-access-mkg2k\") pod \"isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4\" (UID: \"a50d45d2-8d82-401b-a218-5242d2846b3b\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4"
Sep 17 16:10:30.666580 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:30.666553    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a70e519e-d72b-408f-b1a4-7aebd3fb52ef-proxy-tls\") pod \"isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd\" (UID: \"a70e519e-d72b-408f-b1a4-7aebd3fb52ef\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd"
Sep 17 16:10:30.666705 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:30.666586    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a70e519e-d72b-408f-b1a4-7aebd3fb52ef-kserve-provision-location\") pod \"isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd\" (UID: \"a70e519e-d72b-408f-b1a4-7aebd3fb52ef\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd"
Sep 17 16:10:30.666705 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:30.666609    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a70e519e-d72b-408f-b1a4-7aebd3fb52ef-cabundle-cert\") pod \"isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd\" (UID: \"a70e519e-d72b-408f-b1a4-7aebd3fb52ef\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd"
Sep 17 16:10:30.666705 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:30.666641    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a70e519e-d72b-408f-b1a4-7aebd3fb52ef-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd\" (UID: \"a70e519e-d72b-408f-b1a4-7aebd3fb52ef\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd"
Sep 17 16:10:30.666705 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:30.666684    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44hp9\" (UniqueName: \"kubernetes.io/projected/a70e519e-d72b-408f-b1a4-7aebd3fb52ef-kube-api-access-44hp9\") pod \"isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd\" (UID: \"a70e519e-d72b-408f-b1a4-7aebd3fb52ef\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd"
Sep 17 16:10:30.666913 ip-10-0-128-191 kubenswrapper[2584]: E0917 16:10:30.666727    2584 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-aa09f-predictor-serving-cert: secret "isvc-xgboost-graph-raw-hpa-aa09f-predictor-serving-cert" not found
Sep 17 16:10:30.666913 ip-10-0-128-191 kubenswrapper[2584]: E0917 16:10:30.666804    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a70e519e-d72b-408f-b1a4-7aebd3fb52ef-proxy-tls podName:a70e519e-d72b-408f-b1a4-7aebd3fb52ef nodeName:}" failed. No retries permitted until 2026-09-17 16:10:31.166782514 +0000 UTC m=+948.780714004 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/a70e519e-d72b-408f-b1a4-7aebd3fb52ef-proxy-tls") pod "isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd" (UID: "a70e519e-d72b-408f-b1a4-7aebd3fb52ef") : secret "isvc-xgboost-graph-raw-hpa-aa09f-predictor-serving-cert" not found
Sep 17 16:10:30.667046 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:30.667025    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a70e519e-d72b-408f-b1a4-7aebd3fb52ef-kserve-provision-location\") pod \"isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd\" (UID: \"a70e519e-d72b-408f-b1a4-7aebd3fb52ef\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd"
Sep 17 16:10:30.667382 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:30.667363    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a70e519e-d72b-408f-b1a4-7aebd3fb52ef-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd\" (UID: \"a70e519e-d72b-408f-b1a4-7aebd3fb52ef\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd"
Sep 17 16:10:30.667456 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:30.667434    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a70e519e-d72b-408f-b1a4-7aebd3fb52ef-cabundle-cert\") pod \"isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd\" (UID: \"a70e519e-d72b-408f-b1a4-7aebd3fb52ef\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd"
Sep 17 16:10:30.676640 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:30.676611    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-44hp9\" (UniqueName: \"kubernetes.io/projected/a70e519e-d72b-408f-b1a4-7aebd3fb52ef-kube-api-access-44hp9\") pod \"isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd\" (UID: \"a70e519e-d72b-408f-b1a4-7aebd3fb52ef\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd"
Sep 17 16:10:31.070378 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:31.070296    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a50d45d2-8d82-401b-a218-5242d2846b3b-proxy-tls\") pod \"isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4\" (UID: \"a50d45d2-8d82-401b-a218-5242d2846b3b\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4"
Sep 17 16:10:31.072793 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:31.072764    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a50d45d2-8d82-401b-a218-5242d2846b3b-proxy-tls\") pod \"isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4\" (UID: \"a50d45d2-8d82-401b-a218-5242d2846b3b\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4"
Sep 17 16:10:31.171014 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:31.170985    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a70e519e-d72b-408f-b1a4-7aebd3fb52ef-proxy-tls\") pod \"isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd\" (UID: \"a70e519e-d72b-408f-b1a4-7aebd3fb52ef\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd"
Sep 17 16:10:31.173377 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:31.173350    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a70e519e-d72b-408f-b1a4-7aebd3fb52ef-proxy-tls\") pod \"isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd\" (UID: \"a70e519e-d72b-408f-b1a4-7aebd3fb52ef\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd"
Sep 17 16:10:31.254510 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:31.254460    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4"
Sep 17 16:10:31.379830 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:31.379754    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd"
Sep 17 16:10:31.532774 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:31.532750    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4"]
Sep 17 16:10:31.534338 ip-10-0-128-191 kubenswrapper[2584]: W0917 16:10:31.534309    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda50d45d2_8d82_401b_a218_5242d2846b3b.slice/crio-45137d3220f89c38ddd3b73b38bf187bb8a6f7961369581421b73f3d69f0be7f WatchSource:0}: Error finding container 45137d3220f89c38ddd3b73b38bf187bb8a6f7961369581421b73f3d69f0be7f: Status 404 returned error can't find the container with id 45137d3220f89c38ddd3b73b38bf187bb8a6f7961369581421b73f3d69f0be7f
Sep 17 16:10:31.669183 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:31.669149    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd"]
Sep 17 16:10:31.673275 ip-10-0-128-191 kubenswrapper[2584]: W0917 16:10:31.673245    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda70e519e_d72b_408f_b1a4_7aebd3fb52ef.slice/crio-1deba81609be375181fe3f8717dabda343f31dcb8c5da755804af012cd1e7608 WatchSource:0}: Error finding container 1deba81609be375181fe3f8717dabda343f31dcb8c5da755804af012cd1e7608: Status 404 returned error can't find the container with id 1deba81609be375181fe3f8717dabda343f31dcb8c5da755804af012cd1e7608
Sep 17 16:10:32.476596 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:32.476558    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd" event={"ID":"a70e519e-d72b-408f-b1a4-7aebd3fb52ef","Type":"ContainerStarted","Data":"da0e84ed3e9a01ae88cebd557a5b6e8008a27ec15aa2b8787f96b16bc9d71fb2"}
Sep 17 16:10:32.477032 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:32.476620    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd" event={"ID":"a70e519e-d72b-408f-b1a4-7aebd3fb52ef","Type":"ContainerStarted","Data":"1deba81609be375181fe3f8717dabda343f31dcb8c5da755804af012cd1e7608"}
Sep 17 16:10:32.478214 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:32.478182    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4" event={"ID":"a50d45d2-8d82-401b-a218-5242d2846b3b","Type":"ContainerStarted","Data":"83eec0f009833ec70e94ab718a2a70a086b09e29c0e0a0c57b1f9e40e56d8e08"}
Sep 17 16:10:32.478334 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:32.478246    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4" event={"ID":"a50d45d2-8d82-401b-a218-5242d2846b3b","Type":"ContainerStarted","Data":"45137d3220f89c38ddd3b73b38bf187bb8a6f7961369581421b73f3d69f0be7f"}
Sep 17 16:10:33.426086 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:33.426042    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-7f68f9d4d-wb4wf" podUID="4500d358-c35f-42c7-a52a-88a5f66944b4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.23:8080: connect: connection refused"
Sep 17 16:10:35.491974 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:35.491943    2584 generic.go:356] "Generic (PLEG): container finished" podID="a70e519e-d72b-408f-b1a4-7aebd3fb52ef" containerID="da0e84ed3e9a01ae88cebd557a5b6e8008a27ec15aa2b8787f96b16bc9d71fb2" exitCode=0
Sep 17 16:10:35.492308 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:35.492018    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd" event={"ID":"a70e519e-d72b-408f-b1a4-7aebd3fb52ef","Type":"ContainerDied","Data":"da0e84ed3e9a01ae88cebd557a5b6e8008a27ec15aa2b8787f96b16bc9d71fb2"}
Sep 17 16:10:35.493579 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:35.493562    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 16:10:35.493710 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:35.493692    2584 generic.go:356] "Generic (PLEG): container finished" podID="a50d45d2-8d82-401b-a218-5242d2846b3b" containerID="83eec0f009833ec70e94ab718a2a70a086b09e29c0e0a0c57b1f9e40e56d8e08" exitCode=0
Sep 17 16:10:35.493782 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:35.493763    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4" event={"ID":"a50d45d2-8d82-401b-a218-5242d2846b3b","Type":"ContainerDied","Data":"83eec0f009833ec70e94ab718a2a70a086b09e29c0e0a0c57b1f9e40e56d8e08"}
Sep 17 16:10:36.501587 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:36.501544    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4" event={"ID":"a50d45d2-8d82-401b-a218-5242d2846b3b","Type":"ContainerStarted","Data":"475c8024b0d4b0fb0f2e8d1be3d7bcf9236db70fb93ab8d2a6eff03c77efbd26"}
Sep 17 16:10:36.502044 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:36.501630    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4" event={"ID":"a50d45d2-8d82-401b-a218-5242d2846b3b","Type":"ContainerStarted","Data":"479db3c0973f2846dc0f1cda5713b71feb7288c830c3d896e3e573b67748fbf8"}
Sep 17 16:10:36.502044 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:36.501878    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4"
Sep 17 16:10:37.507599 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:37.507548    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4"
Sep 17 16:10:37.508869 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:37.508840    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4" podUID="a50d45d2-8d82-401b-a218-5242d2846b3b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.24:8080: connect: connection refused"
Sep 17 16:10:38.511816 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:38.511776    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4" podUID="a50d45d2-8d82-401b-a218-5242d2846b3b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.24:8080: connect: connection refused"
Sep 17 16:10:43.425440 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:43.425393    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-7f68f9d4d-wb4wf" podUID="4500d358-c35f-42c7-a52a-88a5f66944b4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.23:8080: connect: connection refused"
Sep 17 16:10:43.518304 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:43.518259    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4"
Sep 17 16:10:43.519040 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:43.518889    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4" podUID="a50d45d2-8d82-401b-a218-5242d2846b3b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.24:8080: connect: connection refused"
Sep 17 16:10:43.556864 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:43.556799    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4" podStartSLOduration=9.756848685 podStartE2EDuration="13.556775874s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.799927189s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:10:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:10:36.537993766 +0000 UTC m=+954.151925278" watchObservedRunningTime="2026-09-17 16:10:43.556775874 +0000 UTC m=+961.170707385"
Sep 17 16:10:53.425395 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:53.425350    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-7f68f9d4d-wb4wf" podUID="4500d358-c35f-42c7-a52a-88a5f66944b4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.23:8080: connect: connection refused"
Sep 17 16:10:53.519348 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:53.519306    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4" podUID="a50d45d2-8d82-401b-a218-5242d2846b3b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.24:8080: connect: connection refused"
Sep 17 16:10:56.592968 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:56.592931    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd" event={"ID":"a70e519e-d72b-408f-b1a4-7aebd3fb52ef","Type":"ContainerStarted","Data":"f144b9e339726248cd13544f1d167bd32ab888dd1eac7f15eb6ae2486b10020f"}
Sep 17 16:10:56.593451 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:56.592995    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd" event={"ID":"a70e519e-d72b-408f-b1a4-7aebd3fb52ef","Type":"ContainerStarted","Data":"289c3a4c7339573803ead148f274afc5deea2013539861ffdf4bc1724d128cb1"}
Sep 17 16:10:56.593451 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:56.593254    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd"
Sep 17 16:10:56.593451 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:56.593378    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd"
Sep 17 16:10:56.594816 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:56.594789    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd" podUID="a70e519e-d72b-408f-b1a4-7aebd3fb52ef" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.25:8080: connect: connection refused"
Sep 17 16:10:56.616270 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:56.616229    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd" podStartSLOduration=2.466377834 podStartE2EDuration="26.616218156s" totalImagesPullingTime="20.439485604s" totalInitContainerRuntime="3.710354718s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:10:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:10:56.613596371 +0000 UTC m=+974.227527887" watchObservedRunningTime="2026-09-17 16:10:56.616218156 +0000 UTC m=+974.230149667"
Sep 17 16:10:57.597772 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:10:57.597726    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd" podUID="a70e519e-d72b-408f-b1a4-7aebd3fb52ef" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.25:8080: connect: connection refused"
Sep 17 16:11:02.602695 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:11:02.602665    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd"
Sep 17 16:11:02.603208 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:11:02.603176    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd" podUID="a70e519e-d72b-408f-b1a4-7aebd3fb52ef" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.25:8080: connect: connection refused"
Sep 17 16:11:03.426045 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:11:03.426007    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-7f68f9d4d-wb4wf" podUID="4500d358-c35f-42c7-a52a-88a5f66944b4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.23:8080: connect: connection refused"
Sep 17 16:11:03.519269 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:11:03.519236    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4" podUID="a50d45d2-8d82-401b-a218-5242d2846b3b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.24:8080: connect: connection refused"
Sep 17 16:11:12.603225 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:11:12.603176    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd" podUID="a70e519e-d72b-408f-b1a4-7aebd3fb52ef" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.25:8080: connect: connection refused"
Sep 17 16:11:13.426073 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:11:13.426028    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-7f68f9d4d-wb4wf" podUID="4500d358-c35f-42c7-a52a-88a5f66944b4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.23:8080: connect: connection refused"
Sep 17 16:11:13.521604 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:11:13.520810    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4" podUID="a50d45d2-8d82-401b-a218-5242d2846b3b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.24:8080: connect: connection refused"
Sep 17 16:11:22.603393 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:11:22.603354    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd" podUID="a70e519e-d72b-408f-b1a4-7aebd3fb52ef" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.25:8080: connect: connection refused"
Sep 17 16:11:23.426103 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:11:23.426063    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-7f68f9d4d-wb4wf" podUID="4500d358-c35f-42c7-a52a-88a5f66944b4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.23:8080: connect: connection refused"
Sep 17 16:11:23.518936 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:11:23.518898    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4" podUID="a50d45d2-8d82-401b-a218-5242d2846b3b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.24:8080: connect: connection refused"
Sep 17 16:11:28.512338 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:11:28.512289    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-7f68f9d4d-wb4wf" podUID="4500d358-c35f-42c7-a52a-88a5f66944b4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.23:8080: connect: connection refused"
Sep 17 16:11:32.603173 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:11:32.603134    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd" podUID="a70e519e-d72b-408f-b1a4-7aebd3fb52ef" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.25:8080: connect: connection refused"
Sep 17 16:11:33.519510 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:11:33.519448    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4" podUID="a50d45d2-8d82-401b-a218-5242d2846b3b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.24:8080: connect: connection refused"
Sep 17 16:11:38.506718 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:11:38.506686    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-stop-predictor-7f68f9d4d-wb4wf"]
Sep 17 16:11:38.507116 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:11:38.506912    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-7f68f9d4d-wb4wf" podUID="4500d358-c35f-42c7-a52a-88a5f66944b4" containerName="kserve-container" containerID="cri-o://7a52406934946df9e455a42968a81c948b1605eea0d556287760bcb45126b65d" gracePeriod=30
Sep 17 16:11:38.507116 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:11:38.506969    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-7f68f9d4d-wb4wf" podUID="4500d358-c35f-42c7-a52a-88a5f66944b4" containerName="kube-rbac-proxy" containerID="cri-o://106292ae19c4273c9d2490b5cd4fe2ac11489ac4cb8f153268aeb186f07c56cd" gracePeriod=30
Sep 17 16:11:38.507981 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:11:38.507959    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-7f68f9d4d-wb4wf"
Sep 17 16:11:38.773188 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:11:38.773098    2584 generic.go:356] "Generic (PLEG): container finished" podID="4500d358-c35f-42c7-a52a-88a5f66944b4" containerID="106292ae19c4273c9d2490b5cd4fe2ac11489ac4cb8f153268aeb186f07c56cd" exitCode=2
Sep 17 16:11:38.773188 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:11:38.773165    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-7f68f9d4d-wb4wf" event={"ID":"4500d358-c35f-42c7-a52a-88a5f66944b4","Type":"ContainerDied","Data":"106292ae19c4273c9d2490b5cd4fe2ac11489ac4cb8f153268aeb186f07c56cd"}
Sep 17 16:11:42.603997 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:11:42.603964    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd" podUID="a70e519e-d72b-408f-b1a4-7aebd3fb52ef" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.25:8080: connect: connection refused"
Sep 17 16:11:43.249144 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:11:43.249113    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-7f68f9d4d-wb4wf"
Sep 17 16:11:43.374787 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:11:43.374693    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5q4zt\" (UniqueName: \"kubernetes.io/projected/4500d358-c35f-42c7-a52a-88a5f66944b4-kube-api-access-5q4zt\") pod \"4500d358-c35f-42c7-a52a-88a5f66944b4\" (UID: \"4500d358-c35f-42c7-a52a-88a5f66944b4\") "
Sep 17 16:11:43.374787 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:11:43.374748    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4500d358-c35f-42c7-a52a-88a5f66944b4-kserve-provision-location\") pod \"4500d358-c35f-42c7-a52a-88a5f66944b4\" (UID: \"4500d358-c35f-42c7-a52a-88a5f66944b4\") "
Sep 17 16:11:43.374787 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:11:43.374781    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/4500d358-c35f-42c7-a52a-88a5f66944b4-kube-rbac-proxy-sar-config\") pod \"4500d358-c35f-42c7-a52a-88a5f66944b4\" (UID: \"4500d358-c35f-42c7-a52a-88a5f66944b4\") "
Sep 17 16:11:43.375062 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:11:43.374900    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4500d358-c35f-42c7-a52a-88a5f66944b4-proxy-tls\") pod \"4500d358-c35f-42c7-a52a-88a5f66944b4\" (UID: \"4500d358-c35f-42c7-a52a-88a5f66944b4\") "
Sep 17 16:11:43.375062 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:11:43.374945    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/4500d358-c35f-42c7-a52a-88a5f66944b4-cabundle-cert\") pod \"4500d358-c35f-42c7-a52a-88a5f66944b4\" (UID: \"4500d358-c35f-42c7-a52a-88a5f66944b4\") "
Sep 17 16:11:43.375159 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:11:43.375084    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4500d358-c35f-42c7-a52a-88a5f66944b4-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "4500d358-c35f-42c7-a52a-88a5f66944b4" (UID: "4500d358-c35f-42c7-a52a-88a5f66944b4"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 16:11:43.375159 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:11:43.375114    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4500d358-c35f-42c7-a52a-88a5f66944b4-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "4500d358-c35f-42c7-a52a-88a5f66944b4" (UID: "4500d358-c35f-42c7-a52a-88a5f66944b4"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 16:11:43.375280 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:11:43.375256    2584 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4500d358-c35f-42c7-a52a-88a5f66944b4-kserve-provision-location\") on node \"ip-10-0-128-191.ec2.internal\" DevicePath \"\""
Sep 17 16:11:43.375337 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:11:43.375279    2584 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/4500d358-c35f-42c7-a52a-88a5f66944b4-kube-rbac-proxy-sar-config\") on node \"ip-10-0-128-191.ec2.internal\" DevicePath \"\""
Sep 17 16:11:43.375453 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:11:43.375431    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4500d358-c35f-42c7-a52a-88a5f66944b4-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "4500d358-c35f-42c7-a52a-88a5f66944b4" (UID: "4500d358-c35f-42c7-a52a-88a5f66944b4"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 16:11:43.377179 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:11:43.377138    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4500d358-c35f-42c7-a52a-88a5f66944b4-kube-api-access-5q4zt" (OuterVolumeSpecName: "kube-api-access-5q4zt") pod "4500d358-c35f-42c7-a52a-88a5f66944b4" (UID: "4500d358-c35f-42c7-a52a-88a5f66944b4"). InnerVolumeSpecName "kube-api-access-5q4zt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 16:11:43.377486 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:11:43.377465    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4500d358-c35f-42c7-a52a-88a5f66944b4-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "4500d358-c35f-42c7-a52a-88a5f66944b4" (UID: "4500d358-c35f-42c7-a52a-88a5f66944b4"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:11:43.476454 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:11:43.476420    2584 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4500d358-c35f-42c7-a52a-88a5f66944b4-proxy-tls\") on node \"ip-10-0-128-191.ec2.internal\" DevicePath \"\""
Sep 17 16:11:43.476454 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:11:43.476445    2584 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/4500d358-c35f-42c7-a52a-88a5f66944b4-cabundle-cert\") on node \"ip-10-0-128-191.ec2.internal\" DevicePath \"\""
Sep 17 16:11:43.476454 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:11:43.476454    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5q4zt\" (UniqueName: \"kubernetes.io/projected/4500d358-c35f-42c7-a52a-88a5f66944b4-kube-api-access-5q4zt\") on node \"ip-10-0-128-191.ec2.internal\" DevicePath \"\""
Sep 17 16:11:43.519075 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:11:43.519039    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4" podUID="a50d45d2-8d82-401b-a218-5242d2846b3b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.24:8080: connect: connection refused"
Sep 17 16:11:43.800239 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:11:43.800206    2584 generic.go:356] "Generic (PLEG): container finished" podID="4500d358-c35f-42c7-a52a-88a5f66944b4" containerID="7a52406934946df9e455a42968a81c948b1605eea0d556287760bcb45126b65d" exitCode=0
Sep 17 16:11:43.800622 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:11:43.800252    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-7f68f9d4d-wb4wf" event={"ID":"4500d358-c35f-42c7-a52a-88a5f66944b4","Type":"ContainerDied","Data":"7a52406934946df9e455a42968a81c948b1605eea0d556287760bcb45126b65d"}
Sep 17 16:11:43.800622 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:11:43.800274    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-7f68f9d4d-wb4wf"
Sep 17 16:11:43.800622 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:11:43.800301    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-stop-predictor-7f68f9d4d-wb4wf" event={"ID":"4500d358-c35f-42c7-a52a-88a5f66944b4","Type":"ContainerDied","Data":"32807cdce9551274c5b3b1f6fb599f00c03caf0c299870a4fc77937640831832"}
Sep 17 16:11:43.800622 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:11:43.800329    2584 scope.go:117] "RemoveContainer" containerID="106292ae19c4273c9d2490b5cd4fe2ac11489ac4cb8f153268aeb186f07c56cd"
Sep 17 16:11:43.809278 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:11:43.809261    2584 scope.go:117] "RemoveContainer" containerID="7a52406934946df9e455a42968a81c948b1605eea0d556287760bcb45126b65d"
Sep 17 16:11:43.816629 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:11:43.816610    2584 scope.go:117] "RemoveContainer" containerID="a7d77bab458a8a8d62b76c453fa8825bbe1eb4863a26472f94aff1774c7723ff"
Sep 17 16:11:43.823169 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:11:43.823144    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-stop-predictor-7f68f9d4d-wb4wf"]
Sep 17 16:11:43.824410 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:11:43.824394    2584 scope.go:117] "RemoveContainer" containerID="106292ae19c4273c9d2490b5cd4fe2ac11489ac4cb8f153268aeb186f07c56cd"
Sep 17 16:11:43.824734 ip-10-0-128-191 kubenswrapper[2584]: E0917 16:11:43.824713    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"106292ae19c4273c9d2490b5cd4fe2ac11489ac4cb8f153268aeb186f07c56cd\": container with ID starting with 106292ae19c4273c9d2490b5cd4fe2ac11489ac4cb8f153268aeb186f07c56cd not found: ID does not exist" containerID="106292ae19c4273c9d2490b5cd4fe2ac11489ac4cb8f153268aeb186f07c56cd"
Sep 17 16:11:43.824789 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:11:43.824742    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"106292ae19c4273c9d2490b5cd4fe2ac11489ac4cb8f153268aeb186f07c56cd"} err="failed to get container status \"106292ae19c4273c9d2490b5cd4fe2ac11489ac4cb8f153268aeb186f07c56cd\": rpc error: code = NotFound desc = could not find container \"106292ae19c4273c9d2490b5cd4fe2ac11489ac4cb8f153268aeb186f07c56cd\": container with ID starting with 106292ae19c4273c9d2490b5cd4fe2ac11489ac4cb8f153268aeb186f07c56cd not found: ID does not exist"
Sep 17 16:11:43.824789 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:11:43.824760    2584 scope.go:117] "RemoveContainer" containerID="7a52406934946df9e455a42968a81c948b1605eea0d556287760bcb45126b65d"
Sep 17 16:11:43.825004 ip-10-0-128-191 kubenswrapper[2584]: E0917 16:11:43.824984    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a52406934946df9e455a42968a81c948b1605eea0d556287760bcb45126b65d\": container with ID starting with 7a52406934946df9e455a42968a81c948b1605eea0d556287760bcb45126b65d not found: ID does not exist" containerID="7a52406934946df9e455a42968a81c948b1605eea0d556287760bcb45126b65d"
Sep 17 16:11:43.825067 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:11:43.825014    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a52406934946df9e455a42968a81c948b1605eea0d556287760bcb45126b65d"} err="failed to get container status \"7a52406934946df9e455a42968a81c948b1605eea0d556287760bcb45126b65d\": rpc error: code = NotFound desc = could not find container \"7a52406934946df9e455a42968a81c948b1605eea0d556287760bcb45126b65d\": container with ID starting with 7a52406934946df9e455a42968a81c948b1605eea0d556287760bcb45126b65d not found: ID does not exist"
Sep 17 16:11:43.825067 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:11:43.825036    2584 scope.go:117] "RemoveContainer" containerID="a7d77bab458a8a8d62b76c453fa8825bbe1eb4863a26472f94aff1774c7723ff"
Sep 17 16:11:43.825311 ip-10-0-128-191 kubenswrapper[2584]: E0917 16:11:43.825291    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7d77bab458a8a8d62b76c453fa8825bbe1eb4863a26472f94aff1774c7723ff\": container with ID starting with a7d77bab458a8a8d62b76c453fa8825bbe1eb4863a26472f94aff1774c7723ff not found: ID does not exist" containerID="a7d77bab458a8a8d62b76c453fa8825bbe1eb4863a26472f94aff1774c7723ff"
Sep 17 16:11:43.825424 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:11:43.825312    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7d77bab458a8a8d62b76c453fa8825bbe1eb4863a26472f94aff1774c7723ff"} err="failed to get container status \"a7d77bab458a8a8d62b76c453fa8825bbe1eb4863a26472f94aff1774c7723ff\": rpc error: code = NotFound desc = could not find container \"a7d77bab458a8a8d62b76c453fa8825bbe1eb4863a26472f94aff1774c7723ff\": container with ID starting with a7d77bab458a8a8d62b76c453fa8825bbe1eb4863a26472f94aff1774c7723ff not found: ID does not exist"
Sep 17 16:11:43.827451 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:11:43.827429    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-stop-predictor-7f68f9d4d-wb4wf"]
Sep 17 16:11:44.515786 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:11:44.515750    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4500d358-c35f-42c7-a52a-88a5f66944b4" path="/var/lib/kubelet/pods/4500d358-c35f-42c7-a52a-88a5f66944b4/volumes"
Sep 17 16:11:51.512556 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:11:51.512508    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4" podUID="a50d45d2-8d82-401b-a218-5242d2846b3b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.24:8080: connect: connection refused"
Sep 17 16:11:52.604095 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:11:52.604051    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd" podUID="a70e519e-d72b-408f-b1a4-7aebd3fb52ef" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.25:8080: connect: connection refused"
Sep 17 16:12:01.513508 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:01.513471    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4"
Sep 17 16:12:02.604279 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:02.604250    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd"
Sep 17 16:12:30.488228 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:30.488146    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4"]
Sep 17 16:12:30.488876 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:30.488406    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4" podUID="a50d45d2-8d82-401b-a218-5242d2846b3b" containerName="kserve-container" containerID="cri-o://479db3c0973f2846dc0f1cda5713b71feb7288c830c3d896e3e573b67748fbf8" gracePeriod=30
Sep 17 16:12:30.488876 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:30.488476    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4" podUID="a50d45d2-8d82-401b-a218-5242d2846b3b" containerName="kube-rbac-proxy" containerID="cri-o://475c8024b0d4b0fb0f2e8d1be3d7bcf9236db70fb93ab8d2a6eff03c77efbd26" gracePeriod=30
Sep 17 16:12:30.580453 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:30.580418    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd"]
Sep 17 16:12:30.580775 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:30.580721    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd" podUID="a70e519e-d72b-408f-b1a4-7aebd3fb52ef" containerName="kserve-container" containerID="cri-o://289c3a4c7339573803ead148f274afc5deea2013539861ffdf4bc1724d128cb1" gracePeriod=30
Sep 17 16:12:30.580909 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:30.580823    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd" podUID="a70e519e-d72b-408f-b1a4-7aebd3fb52ef" containerName="kube-rbac-proxy" containerID="cri-o://f144b9e339726248cd13544f1d167bd32ab888dd1eac7f15eb6ae2486b10020f" gracePeriod=30
Sep 17 16:12:30.993343 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:30.993289    2584 generic.go:356] "Generic (PLEG): container finished" podID="a70e519e-d72b-408f-b1a4-7aebd3fb52ef" containerID="f144b9e339726248cd13544f1d167bd32ab888dd1eac7f15eb6ae2486b10020f" exitCode=2
Sep 17 16:12:30.993547 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:30.993363    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd" event={"ID":"a70e519e-d72b-408f-b1a4-7aebd3fb52ef","Type":"ContainerDied","Data":"f144b9e339726248cd13544f1d167bd32ab888dd1eac7f15eb6ae2486b10020f"}
Sep 17 16:12:30.995684 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:30.995659    2584 generic.go:356] "Generic (PLEG): container finished" podID="a50d45d2-8d82-401b-a218-5242d2846b3b" containerID="475c8024b0d4b0fb0f2e8d1be3d7bcf9236db70fb93ab8d2a6eff03c77efbd26" exitCode=2
Sep 17 16:12:30.995815 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:30.995696    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4" event={"ID":"a50d45d2-8d82-401b-a218-5242d2846b3b","Type":"ContainerDied","Data":"475c8024b0d4b0fb0f2e8d1be3d7bcf9236db70fb93ab8d2a6eff03c77efbd26"}
Sep 17 16:12:31.513469 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:31.513431    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4" podUID="a50d45d2-8d82-401b-a218-5242d2846b3b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.24:8080: connect: connection refused"
Sep 17 16:12:32.598310 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:32.598256    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd" podUID="a70e519e-d72b-408f-b1a4-7aebd3fb52ef" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.25:8643/healthz\": dial tcp 10.134.0.25:8643: connect: connection refused"
Sep 17 16:12:32.603648 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:32.603623    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd" podUID="a70e519e-d72b-408f-b1a4-7aebd3fb52ef" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.25:8080: connect: connection refused"
Sep 17 16:12:33.512022 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:33.511983    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4" podUID="a50d45d2-8d82-401b-a218-5242d2846b3b" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.24:8643/healthz\": dial tcp 10.134.0.24:8643: connect: connection refused"
Sep 17 16:12:34.532609 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:34.532583    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd"
Sep 17 16:12:34.597048 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:34.597017    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a70e519e-d72b-408f-b1a4-7aebd3fb52ef-proxy-tls\") pod \"a70e519e-d72b-408f-b1a4-7aebd3fb52ef\" (UID: \"a70e519e-d72b-408f-b1a4-7aebd3fb52ef\") "
Sep 17 16:12:34.597198 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:34.597110    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a70e519e-d72b-408f-b1a4-7aebd3fb52ef-kserve-provision-location\") pod \"a70e519e-d72b-408f-b1a4-7aebd3fb52ef\" (UID: \"a70e519e-d72b-408f-b1a4-7aebd3fb52ef\") "
Sep 17 16:12:34.597198 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:34.597131    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a70e519e-d72b-408f-b1a4-7aebd3fb52ef-cabundle-cert\") pod \"a70e519e-d72b-408f-b1a4-7aebd3fb52ef\" (UID: \"a70e519e-d72b-408f-b1a4-7aebd3fb52ef\") "
Sep 17 16:12:34.597198 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:34.597162    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-44hp9\" (UniqueName: \"kubernetes.io/projected/a70e519e-d72b-408f-b1a4-7aebd3fb52ef-kube-api-access-44hp9\") pod \"a70e519e-d72b-408f-b1a4-7aebd3fb52ef\" (UID: \"a70e519e-d72b-408f-b1a4-7aebd3fb52ef\") "
Sep 17 16:12:34.597319 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:34.597201    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a70e519e-d72b-408f-b1a4-7aebd3fb52ef-kube-rbac-proxy-sar-config\") pod \"a70e519e-d72b-408f-b1a4-7aebd3fb52ef\" (UID: \"a70e519e-d72b-408f-b1a4-7aebd3fb52ef\") "
Sep 17 16:12:34.597444 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:34.597408    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a70e519e-d72b-408f-b1a4-7aebd3fb52ef-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "a70e519e-d72b-408f-b1a4-7aebd3fb52ef" (UID: "a70e519e-d72b-408f-b1a4-7aebd3fb52ef"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 16:12:34.597639 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:34.597611    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a70e519e-d72b-408f-b1a4-7aebd3fb52ef-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "a70e519e-d72b-408f-b1a4-7aebd3fb52ef" (UID: "a70e519e-d72b-408f-b1a4-7aebd3fb52ef"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 16:12:34.597889 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:34.597654    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a70e519e-d72b-408f-b1a4-7aebd3fb52ef-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "a70e519e-d72b-408f-b1a4-7aebd3fb52ef" (UID: "a70e519e-d72b-408f-b1a4-7aebd3fb52ef"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 16:12:34.599255 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:34.599236    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a70e519e-d72b-408f-b1a4-7aebd3fb52ef-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "a70e519e-d72b-408f-b1a4-7aebd3fb52ef" (UID: "a70e519e-d72b-408f-b1a4-7aebd3fb52ef"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:12:34.599444 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:34.599424    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a70e519e-d72b-408f-b1a4-7aebd3fb52ef-kube-api-access-44hp9" (OuterVolumeSpecName: "kube-api-access-44hp9") pod "a70e519e-d72b-408f-b1a4-7aebd3fb52ef" (UID: "a70e519e-d72b-408f-b1a4-7aebd3fb52ef"). InnerVolumeSpecName "kube-api-access-44hp9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 16:12:34.697824 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:34.697797    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-44hp9\" (UniqueName: \"kubernetes.io/projected/a70e519e-d72b-408f-b1a4-7aebd3fb52ef-kube-api-access-44hp9\") on node \"ip-10-0-128-191.ec2.internal\" DevicePath \"\""
Sep 17 16:12:34.697824 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:34.697820    2584 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a70e519e-d72b-408f-b1a4-7aebd3fb52ef-kube-rbac-proxy-sar-config\") on node \"ip-10-0-128-191.ec2.internal\" DevicePath \"\""
Sep 17 16:12:34.698038 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:34.697832    2584 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a70e519e-d72b-408f-b1a4-7aebd3fb52ef-proxy-tls\") on node \"ip-10-0-128-191.ec2.internal\" DevicePath \"\""
Sep 17 16:12:34.698038 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:34.697845    2584 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a70e519e-d72b-408f-b1a4-7aebd3fb52ef-kserve-provision-location\") on node \"ip-10-0-128-191.ec2.internal\" DevicePath \"\""
Sep 17 16:12:34.698038 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:34.697857    2584 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a70e519e-d72b-408f-b1a4-7aebd3fb52ef-cabundle-cert\") on node \"ip-10-0-128-191.ec2.internal\" DevicePath \"\""
Sep 17 16:12:35.014717 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:35.014683    2584 generic.go:356] "Generic (PLEG): container finished" podID="a70e519e-d72b-408f-b1a4-7aebd3fb52ef" containerID="289c3a4c7339573803ead148f274afc5deea2013539861ffdf4bc1724d128cb1" exitCode=0
Sep 17 16:12:35.014717 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:35.014707    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd" event={"ID":"a70e519e-d72b-408f-b1a4-7aebd3fb52ef","Type":"ContainerDied","Data":"289c3a4c7339573803ead148f274afc5deea2013539861ffdf4bc1724d128cb1"}
Sep 17 16:12:35.014903 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:35.014747    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd"
Sep 17 16:12:35.014903 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:35.014772    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd" event={"ID":"a70e519e-d72b-408f-b1a4-7aebd3fb52ef","Type":"ContainerDied","Data":"1deba81609be375181fe3f8717dabda343f31dcb8c5da755804af012cd1e7608"}
Sep 17 16:12:35.014903 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:35.014803    2584 scope.go:117] "RemoveContainer" containerID="f144b9e339726248cd13544f1d167bd32ab888dd1eac7f15eb6ae2486b10020f"
Sep 17 16:12:35.017242 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:35.017210    2584 generic.go:356] "Generic (PLEG): container finished" podID="a50d45d2-8d82-401b-a218-5242d2846b3b" containerID="479db3c0973f2846dc0f1cda5713b71feb7288c830c3d896e3e573b67748fbf8" exitCode=0
Sep 17 16:12:35.017358 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:35.017242    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4" event={"ID":"a50d45d2-8d82-401b-a218-5242d2846b3b","Type":"ContainerDied","Data":"479db3c0973f2846dc0f1cda5713b71feb7288c830c3d896e3e573b67748fbf8"}
Sep 17 16:12:35.019302 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:35.019282    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4"
Sep 17 16:12:35.024801 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:35.024783    2584 scope.go:117] "RemoveContainer" containerID="289c3a4c7339573803ead148f274afc5deea2013539861ffdf4bc1724d128cb1"
Sep 17 16:12:35.034032 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:35.034016    2584 scope.go:117] "RemoveContainer" containerID="da0e84ed3e9a01ae88cebd557a5b6e8008a27ec15aa2b8787f96b16bc9d71fb2"
Sep 17 16:12:35.043156 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:35.043131    2584 scope.go:117] "RemoveContainer" containerID="f144b9e339726248cd13544f1d167bd32ab888dd1eac7f15eb6ae2486b10020f"
Sep 17 16:12:35.043675 ip-10-0-128-191 kubenswrapper[2584]: E0917 16:12:35.043650    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f144b9e339726248cd13544f1d167bd32ab888dd1eac7f15eb6ae2486b10020f\": container with ID starting with f144b9e339726248cd13544f1d167bd32ab888dd1eac7f15eb6ae2486b10020f not found: ID does not exist" containerID="f144b9e339726248cd13544f1d167bd32ab888dd1eac7f15eb6ae2486b10020f"
Sep 17 16:12:35.043740 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:35.043687    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f144b9e339726248cd13544f1d167bd32ab888dd1eac7f15eb6ae2486b10020f"} err="failed to get container status \"f144b9e339726248cd13544f1d167bd32ab888dd1eac7f15eb6ae2486b10020f\": rpc error: code = NotFound desc = could not find container \"f144b9e339726248cd13544f1d167bd32ab888dd1eac7f15eb6ae2486b10020f\": container with ID starting with f144b9e339726248cd13544f1d167bd32ab888dd1eac7f15eb6ae2486b10020f not found: ID does not exist"
Sep 17 16:12:35.043740 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:35.043713    2584 scope.go:117] "RemoveContainer" containerID="289c3a4c7339573803ead148f274afc5deea2013539861ffdf4bc1724d128cb1"
Sep 17 16:12:35.044174 ip-10-0-128-191 kubenswrapper[2584]: E0917 16:12:35.044152    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"289c3a4c7339573803ead148f274afc5deea2013539861ffdf4bc1724d128cb1\": container with ID starting with 289c3a4c7339573803ead148f274afc5deea2013539861ffdf4bc1724d128cb1 not found: ID does not exist" containerID="289c3a4c7339573803ead148f274afc5deea2013539861ffdf4bc1724d128cb1"
Sep 17 16:12:35.044238 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:35.044184    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"289c3a4c7339573803ead148f274afc5deea2013539861ffdf4bc1724d128cb1"} err="failed to get container status \"289c3a4c7339573803ead148f274afc5deea2013539861ffdf4bc1724d128cb1\": rpc error: code = NotFound desc = could not find container \"289c3a4c7339573803ead148f274afc5deea2013539861ffdf4bc1724d128cb1\": container with ID starting with 289c3a4c7339573803ead148f274afc5deea2013539861ffdf4bc1724d128cb1 not found: ID does not exist"
Sep 17 16:12:35.044238 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:35.044205    2584 scope.go:117] "RemoveContainer" containerID="da0e84ed3e9a01ae88cebd557a5b6e8008a27ec15aa2b8787f96b16bc9d71fb2"
Sep 17 16:12:35.044553 ip-10-0-128-191 kubenswrapper[2584]: E0917 16:12:35.044523    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da0e84ed3e9a01ae88cebd557a5b6e8008a27ec15aa2b8787f96b16bc9d71fb2\": container with ID starting with da0e84ed3e9a01ae88cebd557a5b6e8008a27ec15aa2b8787f96b16bc9d71fb2 not found: ID does not exist" containerID="da0e84ed3e9a01ae88cebd557a5b6e8008a27ec15aa2b8787f96b16bc9d71fb2"
Sep 17 16:12:35.044661 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:35.044560    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da0e84ed3e9a01ae88cebd557a5b6e8008a27ec15aa2b8787f96b16bc9d71fb2"} err="failed to get container status \"da0e84ed3e9a01ae88cebd557a5b6e8008a27ec15aa2b8787f96b16bc9d71fb2\": rpc error: code = NotFound desc = could not find container \"da0e84ed3e9a01ae88cebd557a5b6e8008a27ec15aa2b8787f96b16bc9d71fb2\": container with ID starting with da0e84ed3e9a01ae88cebd557a5b6e8008a27ec15aa2b8787f96b16bc9d71fb2 not found: ID does not exist"
Sep 17 16:12:35.051890 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:35.051868    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd"]
Sep 17 16:12:35.055478 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:35.055453    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-aa09f-predictor-7f8c79648f-pnrpd"]
Sep 17 16:12:35.101038 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:35.101014    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a50d45d2-8d82-401b-a218-5242d2846b3b-kserve-provision-location\") pod \"a50d45d2-8d82-401b-a218-5242d2846b3b\" (UID: \"a50d45d2-8d82-401b-a218-5242d2846b3b\") "
Sep 17 16:12:35.101144 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:35.101053    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a50d45d2-8d82-401b-a218-5242d2846b3b-proxy-tls\") pod \"a50d45d2-8d82-401b-a218-5242d2846b3b\" (UID: \"a50d45d2-8d82-401b-a218-5242d2846b3b\") "
Sep 17 16:12:35.101144 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:35.101093    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a50d45d2-8d82-401b-a218-5242d2846b3b-kube-rbac-proxy-sar-config\") pod \"a50d45d2-8d82-401b-a218-5242d2846b3b\" (UID: \"a50d45d2-8d82-401b-a218-5242d2846b3b\") "
Sep 17 16:12:35.101144 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:35.101118    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mkg2k\" (UniqueName: \"kubernetes.io/projected/a50d45d2-8d82-401b-a218-5242d2846b3b-kube-api-access-mkg2k\") pod \"a50d45d2-8d82-401b-a218-5242d2846b3b\" (UID: \"a50d45d2-8d82-401b-a218-5242d2846b3b\") "
Sep 17 16:12:35.101291 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:35.101148    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a50d45d2-8d82-401b-a218-5242d2846b3b-cabundle-cert\") pod \"a50d45d2-8d82-401b-a218-5242d2846b3b\" (UID: \"a50d45d2-8d82-401b-a218-5242d2846b3b\") "
Sep 17 16:12:35.101462 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:35.101437    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a50d45d2-8d82-401b-a218-5242d2846b3b-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "a50d45d2-8d82-401b-a218-5242d2846b3b" (UID: "a50d45d2-8d82-401b-a218-5242d2846b3b"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 16:12:35.101569 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:35.101454    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a50d45d2-8d82-401b-a218-5242d2846b3b-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "a50d45d2-8d82-401b-a218-5242d2846b3b" (UID: "a50d45d2-8d82-401b-a218-5242d2846b3b"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 16:12:35.101633 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:35.101575    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a50d45d2-8d82-401b-a218-5242d2846b3b-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "a50d45d2-8d82-401b-a218-5242d2846b3b" (UID: "a50d45d2-8d82-401b-a218-5242d2846b3b"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 16:12:35.103265 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:35.103245    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a50d45d2-8d82-401b-a218-5242d2846b3b-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "a50d45d2-8d82-401b-a218-5242d2846b3b" (UID: "a50d45d2-8d82-401b-a218-5242d2846b3b"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:12:35.103377 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:35.103356    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a50d45d2-8d82-401b-a218-5242d2846b3b-kube-api-access-mkg2k" (OuterVolumeSpecName: "kube-api-access-mkg2k") pod "a50d45d2-8d82-401b-a218-5242d2846b3b" (UID: "a50d45d2-8d82-401b-a218-5242d2846b3b"). InnerVolumeSpecName "kube-api-access-mkg2k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 16:12:35.202648 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:35.202564    2584 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a50d45d2-8d82-401b-a218-5242d2846b3b-cabundle-cert\") on node \"ip-10-0-128-191.ec2.internal\" DevicePath \"\""
Sep 17 16:12:35.202648 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:35.202603    2584 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a50d45d2-8d82-401b-a218-5242d2846b3b-kserve-provision-location\") on node \"ip-10-0-128-191.ec2.internal\" DevicePath \"\""
Sep 17 16:12:35.202648 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:35.202617    2584 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a50d45d2-8d82-401b-a218-5242d2846b3b-proxy-tls\") on node \"ip-10-0-128-191.ec2.internal\" DevicePath \"\""
Sep 17 16:12:35.202648 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:35.202629    2584 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a50d45d2-8d82-401b-a218-5242d2846b3b-kube-rbac-proxy-sar-config\") on node \"ip-10-0-128-191.ec2.internal\" DevicePath \"\""
Sep 17 16:12:35.202648 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:35.202643    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mkg2k\" (UniqueName: \"kubernetes.io/projected/a50d45d2-8d82-401b-a218-5242d2846b3b-kube-api-access-mkg2k\") on node \"ip-10-0-128-191.ec2.internal\" DevicePath \"\""
Sep 17 16:12:36.023549 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:36.023512    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4" event={"ID":"a50d45d2-8d82-401b-a218-5242d2846b3b","Type":"ContainerDied","Data":"45137d3220f89c38ddd3b73b38bf187bb8a6f7961369581421b73f3d69f0be7f"}
Sep 17 16:12:36.023549 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:36.023535    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4"
Sep 17 16:12:36.024085 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:36.023579    2584 scope.go:117] "RemoveContainer" containerID="475c8024b0d4b0fb0f2e8d1be3d7bcf9236db70fb93ab8d2a6eff03c77efbd26"
Sep 17 16:12:36.032542 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:36.032524    2584 scope.go:117] "RemoveContainer" containerID="479db3c0973f2846dc0f1cda5713b71feb7288c830c3d896e3e573b67748fbf8"
Sep 17 16:12:36.040034 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:36.040016    2584 scope.go:117] "RemoveContainer" containerID="83eec0f009833ec70e94ab718a2a70a086b09e29c0e0a0c57b1f9e40e56d8e08"
Sep 17 16:12:36.045547 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:36.045525    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4"]
Sep 17 16:12:36.051742 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:36.051721    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-aa09f-predictor-58f8c8f757-dvxn4"]
Sep 17 16:12:36.516835 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:36.516802    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a50d45d2-8d82-401b-a218-5242d2846b3b" path="/var/lib/kubelet/pods/a50d45d2-8d82-401b-a218-5242d2846b3b/volumes"
Sep 17 16:12:36.517283 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:12:36.517270    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a70e519e-d72b-408f-b1a4-7aebd3fb52ef" path="/var/lib/kubelet/pods/a70e519e-d72b-408f-b1a4-7aebd3fb52ef/volumes"
Sep 17 16:13:35.622581 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:35.622544    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-secondary-68dcdd-predictor-6d6f7496f9-q52ch"]
Sep 17 16:13:35.623033 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:35.622831    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4500d358-c35f-42c7-a52a-88a5f66944b4" containerName="kserve-container"
Sep 17 16:13:35.623033 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:35.622842    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="4500d358-c35f-42c7-a52a-88a5f66944b4" containerName="kserve-container"
Sep 17 16:13:35.623033 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:35.622853    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a70e519e-d72b-408f-b1a4-7aebd3fb52ef" containerName="kube-rbac-proxy"
Sep 17 16:13:35.623033 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:35.622858    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="a70e519e-d72b-408f-b1a4-7aebd3fb52ef" containerName="kube-rbac-proxy"
Sep 17 16:13:35.623033 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:35.622867    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4500d358-c35f-42c7-a52a-88a5f66944b4" containerName="kube-rbac-proxy"
Sep 17 16:13:35.623033 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:35.622873    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="4500d358-c35f-42c7-a52a-88a5f66944b4" containerName="kube-rbac-proxy"
Sep 17 16:13:35.623033 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:35.622882    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a70e519e-d72b-408f-b1a4-7aebd3fb52ef" containerName="storage-initializer"
Sep 17 16:13:35.623033 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:35.622887    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="a70e519e-d72b-408f-b1a4-7aebd3fb52ef" containerName="storage-initializer"
Sep 17 16:13:35.623033 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:35.622895    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a50d45d2-8d82-401b-a218-5242d2846b3b" containerName="storage-initializer"
Sep 17 16:13:35.623033 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:35.622901    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="a50d45d2-8d82-401b-a218-5242d2846b3b" containerName="storage-initializer"
Sep 17 16:13:35.623033 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:35.622911    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a50d45d2-8d82-401b-a218-5242d2846b3b" containerName="kserve-container"
Sep 17 16:13:35.623033 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:35.622916    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="a50d45d2-8d82-401b-a218-5242d2846b3b" containerName="kserve-container"
Sep 17 16:13:35.623033 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:35.622923    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4500d358-c35f-42c7-a52a-88a5f66944b4" containerName="storage-initializer"
Sep 17 16:13:35.623033 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:35.622928    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="4500d358-c35f-42c7-a52a-88a5f66944b4" containerName="storage-initializer"
Sep 17 16:13:35.623033 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:35.622934    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a50d45d2-8d82-401b-a218-5242d2846b3b" containerName="kube-rbac-proxy"
Sep 17 16:13:35.623033 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:35.622940    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="a50d45d2-8d82-401b-a218-5242d2846b3b" containerName="kube-rbac-proxy"
Sep 17 16:13:35.623033 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:35.622945    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a70e519e-d72b-408f-b1a4-7aebd3fb52ef" containerName="kserve-container"
Sep 17 16:13:35.623033 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:35.622950    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="a70e519e-d72b-408f-b1a4-7aebd3fb52ef" containerName="kserve-container"
Sep 17 16:13:35.623033 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:35.622993    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="a50d45d2-8d82-401b-a218-5242d2846b3b" containerName="kube-rbac-proxy"
Sep 17 16:13:35.623033 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:35.623000    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="a70e519e-d72b-408f-b1a4-7aebd3fb52ef" containerName="kube-rbac-proxy"
Sep 17 16:13:35.623033 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:35.623006    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="a70e519e-d72b-408f-b1a4-7aebd3fb52ef" containerName="kserve-container"
Sep 17 16:13:35.623033 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:35.623014    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="a50d45d2-8d82-401b-a218-5242d2846b3b" containerName="kserve-container"
Sep 17 16:13:35.623033 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:35.623019    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="4500d358-c35f-42c7-a52a-88a5f66944b4" containerName="kserve-container"
Sep 17 16:13:35.623033 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:35.623024    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="4500d358-c35f-42c7-a52a-88a5f66944b4" containerName="kube-rbac-proxy"
Sep 17 16:13:35.626056 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:35.626036    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-secondary-68dcdd-predictor-6d6f7496f9-q52ch"
Sep 17 16:13:35.630359 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:35.630330    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-secondary-68dcdd-predictor-serving-cert\""
Sep 17 16:13:35.631286 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:35.631268    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"invalid-s3-sa-68dcdd-dockercfg-rspdp\""
Sep 17 16:13:35.631413 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:35.631325    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Sep 17 16:13:35.631413 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:35.631389    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"invalid-s3-secret-68dcdd\""
Sep 17 16:13:35.631562 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:35.631414    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-secondary-68dcdd-kube-rbac-proxy-sar-config\""
Sep 17 16:13:35.631562 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:35.631545    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Sep 17 16:13:35.632046 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:35.632033    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Sep 17 16:13:35.649196 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:35.649172    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-secondary-68dcdd-predictor-6d6f7496f9-q52ch"]
Sep 17 16:13:35.755548 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:35.755512    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/75234626-a956-480b-ad13-872fe1042e2e-proxy-tls\") pod \"isvc-secondary-68dcdd-predictor-6d6f7496f9-q52ch\" (UID: \"75234626-a956-480b-ad13-872fe1042e2e\") " pod="kserve-ci-e2e-test/isvc-secondary-68dcdd-predictor-6d6f7496f9-q52ch"
Sep 17 16:13:35.755708 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:35.755559    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6s8bt\" (UniqueName: \"kubernetes.io/projected/75234626-a956-480b-ad13-872fe1042e2e-kube-api-access-6s8bt\") pod \"isvc-secondary-68dcdd-predictor-6d6f7496f9-q52ch\" (UID: \"75234626-a956-480b-ad13-872fe1042e2e\") " pod="kserve-ci-e2e-test/isvc-secondary-68dcdd-predictor-6d6f7496f9-q52ch"
Sep 17 16:13:35.755708 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:35.755588    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/75234626-a956-480b-ad13-872fe1042e2e-kserve-provision-location\") pod \"isvc-secondary-68dcdd-predictor-6d6f7496f9-q52ch\" (UID: \"75234626-a956-480b-ad13-872fe1042e2e\") " pod="kserve-ci-e2e-test/isvc-secondary-68dcdd-predictor-6d6f7496f9-q52ch"
Sep 17 16:13:35.755708 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:35.755632    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/75234626-a956-480b-ad13-872fe1042e2e-kube-rbac-proxy-sar-config\") pod \"isvc-secondary-68dcdd-predictor-6d6f7496f9-q52ch\" (UID: \"75234626-a956-480b-ad13-872fe1042e2e\") " pod="kserve-ci-e2e-test/isvc-secondary-68dcdd-predictor-6d6f7496f9-q52ch"
Sep 17 16:13:35.755708 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:35.755659    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/75234626-a956-480b-ad13-872fe1042e2e-cabundle-cert\") pod \"isvc-secondary-68dcdd-predictor-6d6f7496f9-q52ch\" (UID: \"75234626-a956-480b-ad13-872fe1042e2e\") " pod="kserve-ci-e2e-test/isvc-secondary-68dcdd-predictor-6d6f7496f9-q52ch"
Sep 17 16:13:35.856633 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:35.856603    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/75234626-a956-480b-ad13-872fe1042e2e-kube-rbac-proxy-sar-config\") pod \"isvc-secondary-68dcdd-predictor-6d6f7496f9-q52ch\" (UID: \"75234626-a956-480b-ad13-872fe1042e2e\") " pod="kserve-ci-e2e-test/isvc-secondary-68dcdd-predictor-6d6f7496f9-q52ch"
Sep 17 16:13:35.856809 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:35.856657    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/75234626-a956-480b-ad13-872fe1042e2e-cabundle-cert\") pod \"isvc-secondary-68dcdd-predictor-6d6f7496f9-q52ch\" (UID: \"75234626-a956-480b-ad13-872fe1042e2e\") " pod="kserve-ci-e2e-test/isvc-secondary-68dcdd-predictor-6d6f7496f9-q52ch"
Sep 17 16:13:35.856809 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:35.856706    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/75234626-a956-480b-ad13-872fe1042e2e-proxy-tls\") pod \"isvc-secondary-68dcdd-predictor-6d6f7496f9-q52ch\" (UID: \"75234626-a956-480b-ad13-872fe1042e2e\") " pod="kserve-ci-e2e-test/isvc-secondary-68dcdd-predictor-6d6f7496f9-q52ch"
Sep 17 16:13:35.856920 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:35.856860    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s8bt\" (UniqueName: \"kubernetes.io/projected/75234626-a956-480b-ad13-872fe1042e2e-kube-api-access-6s8bt\") pod \"isvc-secondary-68dcdd-predictor-6d6f7496f9-q52ch\" (UID: \"75234626-a956-480b-ad13-872fe1042e2e\") " pod="kserve-ci-e2e-test/isvc-secondary-68dcdd-predictor-6d6f7496f9-q52ch"
Sep 17 16:13:35.856920 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:35.856901    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/75234626-a956-480b-ad13-872fe1042e2e-kserve-provision-location\") pod \"isvc-secondary-68dcdd-predictor-6d6f7496f9-q52ch\" (UID: \"75234626-a956-480b-ad13-872fe1042e2e\") " pod="kserve-ci-e2e-test/isvc-secondary-68dcdd-predictor-6d6f7496f9-q52ch"
Sep 17 16:13:35.857237 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:35.857216    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/75234626-a956-480b-ad13-872fe1042e2e-kserve-provision-location\") pod \"isvc-secondary-68dcdd-predictor-6d6f7496f9-q52ch\" (UID: \"75234626-a956-480b-ad13-872fe1042e2e\") " pod="kserve-ci-e2e-test/isvc-secondary-68dcdd-predictor-6d6f7496f9-q52ch"
Sep 17 16:13:35.857460 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:35.857402    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/75234626-a956-480b-ad13-872fe1042e2e-kube-rbac-proxy-sar-config\") pod \"isvc-secondary-68dcdd-predictor-6d6f7496f9-q52ch\" (UID: \"75234626-a956-480b-ad13-872fe1042e2e\") " pod="kserve-ci-e2e-test/isvc-secondary-68dcdd-predictor-6d6f7496f9-q52ch"
Sep 17 16:13:35.857460 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:35.857402    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/75234626-a956-480b-ad13-872fe1042e2e-cabundle-cert\") pod \"isvc-secondary-68dcdd-predictor-6d6f7496f9-q52ch\" (UID: \"75234626-a956-480b-ad13-872fe1042e2e\") " pod="kserve-ci-e2e-test/isvc-secondary-68dcdd-predictor-6d6f7496f9-q52ch"
Sep 17 16:13:35.859402 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:35.859379    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/75234626-a956-480b-ad13-872fe1042e2e-proxy-tls\") pod \"isvc-secondary-68dcdd-predictor-6d6f7496f9-q52ch\" (UID: \"75234626-a956-480b-ad13-872fe1042e2e\") " pod="kserve-ci-e2e-test/isvc-secondary-68dcdd-predictor-6d6f7496f9-q52ch"
Sep 17 16:13:35.871055 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:35.871036    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6s8bt\" (UniqueName: \"kubernetes.io/projected/75234626-a956-480b-ad13-872fe1042e2e-kube-api-access-6s8bt\") pod \"isvc-secondary-68dcdd-predictor-6d6f7496f9-q52ch\" (UID: \"75234626-a956-480b-ad13-872fe1042e2e\") " pod="kserve-ci-e2e-test/isvc-secondary-68dcdd-predictor-6d6f7496f9-q52ch"
Sep 17 16:13:35.935809 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:35.935778    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-secondary-68dcdd-predictor-6d6f7496f9-q52ch"
Sep 17 16:13:36.234505 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:36.234395    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-secondary-68dcdd-predictor-6d6f7496f9-q52ch"]
Sep 17 16:13:36.238171 ip-10-0-128-191 kubenswrapper[2584]: W0917 16:13:36.238131    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75234626_a956_480b_ad13_872fe1042e2e.slice/crio-4b23707b681a402914df60c355a1e3185531de06b065abbb120aeb23cd7454e1 WatchSource:0}: Error finding container 4b23707b681a402914df60c355a1e3185531de06b065abbb120aeb23cd7454e1: Status 404 returned error can't find the container with id 4b23707b681a402914df60c355a1e3185531de06b065abbb120aeb23cd7454e1
Sep 17 16:13:36.267808 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:36.267781    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-secondary-68dcdd-predictor-6d6f7496f9-q52ch" event={"ID":"75234626-a956-480b-ad13-872fe1042e2e","Type":"ContainerStarted","Data":"4b23707b681a402914df60c355a1e3185531de06b065abbb120aeb23cd7454e1"}
Sep 17 16:13:37.273367 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:37.273331    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-secondary-68dcdd-predictor-6d6f7496f9-q52ch" event={"ID":"75234626-a956-480b-ad13-872fe1042e2e","Type":"ContainerStarted","Data":"903a30be1452df6135d5d784fa40fe55ef30336b371ebfa25c23444a89202ec0"}
Sep 17 16:13:42.294016 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:42.293991    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-secondary-68dcdd-predictor-6d6f7496f9-q52ch_75234626-a956-480b-ad13-872fe1042e2e/storage-initializer/0.log"
Sep 17 16:13:42.294420 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:42.294031    2584 generic.go:356] "Generic (PLEG): container finished" podID="75234626-a956-480b-ad13-872fe1042e2e" containerID="903a30be1452df6135d5d784fa40fe55ef30336b371ebfa25c23444a89202ec0" exitCode=1
Sep 17 16:13:42.294420 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:42.294117    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-secondary-68dcdd-predictor-6d6f7496f9-q52ch" event={"ID":"75234626-a956-480b-ad13-872fe1042e2e","Type":"ContainerDied","Data":"903a30be1452df6135d5d784fa40fe55ef30336b371ebfa25c23444a89202ec0"}
Sep 17 16:13:43.299984 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:43.299957    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-secondary-68dcdd-predictor-6d6f7496f9-q52ch_75234626-a956-480b-ad13-872fe1042e2e/storage-initializer/0.log"
Sep 17 16:13:43.300466 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:43.300038    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-secondary-68dcdd-predictor-6d6f7496f9-q52ch" event={"ID":"75234626-a956-480b-ad13-872fe1042e2e","Type":"ContainerStarted","Data":"4994ab5be0129c0f829027850a7e81ace954581c7b7dcadcadbf5f2779a250cd"}
Sep 17 16:13:49.326258 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:49.326229    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-secondary-68dcdd-predictor-6d6f7496f9-q52ch_75234626-a956-480b-ad13-872fe1042e2e/storage-initializer/1.log"
Sep 17 16:13:49.326698 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:49.326677    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-secondary-68dcdd-predictor-6d6f7496f9-q52ch_75234626-a956-480b-ad13-872fe1042e2e/storage-initializer/0.log"
Sep 17 16:13:49.326742 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:49.326711    2584 generic.go:356] "Generic (PLEG): container finished" podID="75234626-a956-480b-ad13-872fe1042e2e" containerID="4994ab5be0129c0f829027850a7e81ace954581c7b7dcadcadbf5f2779a250cd" exitCode=1
Sep 17 16:13:49.326795 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:49.326779    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-secondary-68dcdd-predictor-6d6f7496f9-q52ch" event={"ID":"75234626-a956-480b-ad13-872fe1042e2e","Type":"ContainerDied","Data":"4994ab5be0129c0f829027850a7e81ace954581c7b7dcadcadbf5f2779a250cd"}
Sep 17 16:13:49.326854 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:49.326841    2584 scope.go:117] "RemoveContainer" containerID="903a30be1452df6135d5d784fa40fe55ef30336b371ebfa25c23444a89202ec0"
Sep 17 16:13:49.327206 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:49.327187    2584 scope.go:117] "RemoveContainer" containerID="903a30be1452df6135d5d784fa40fe55ef30336b371ebfa25c23444a89202ec0"
Sep 17 16:13:49.337820 ip-10-0-128-191 kubenswrapper[2584]: E0917 16:13:49.337797    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"storage-initializer\" with CrashLoopBackOff: \"back-off 10s restarting failed container=storage-initializer pod=isvc-secondary-68dcdd-predictor-6d6f7496f9-q52ch_kserve-ci-e2e-test(75234626-a956-480b-ad13-872fe1042e2e)\"" pod="kserve-ci-e2e-test/isvc-secondary-68dcdd-predictor-6d6f7496f9-q52ch" podUID="75234626-a956-480b-ad13-872fe1042e2e"
Sep 17 16:13:49.338309 ip-10-0-128-191 kubenswrapper[2584]: E0917 16:13:49.338282    2584 log.go:32] "RemoveContainer from runtime service failed" err="rpc error: code = Unknown desc = failed to delete container k8s_storage-initializer_isvc-secondary-68dcdd-predictor-6d6f7496f9-q52ch_kserve-ci-e2e-test_75234626-a956-480b-ad13-872fe1042e2e_0 in pod sandbox 4b23707b681a402914df60c355a1e3185531de06b065abbb120aeb23cd7454e1 from index: no such id: '903a30be1452df6135d5d784fa40fe55ef30336b371ebfa25c23444a89202ec0'" containerID="903a30be1452df6135d5d784fa40fe55ef30336b371ebfa25c23444a89202ec0"
Sep 17 16:13:49.338362 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:49.338320    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"903a30be1452df6135d5d784fa40fe55ef30336b371ebfa25c23444a89202ec0"} err="rpc error: code = Unknown desc = failed to delete container k8s_storage-initializer_isvc-secondary-68dcdd-predictor-6d6f7496f9-q52ch_kserve-ci-e2e-test_75234626-a956-480b-ad13-872fe1042e2e_0 in pod sandbox 4b23707b681a402914df60c355a1e3185531de06b065abbb120aeb23cd7454e1 from index: no such id: '903a30be1452df6135d5d784fa40fe55ef30336b371ebfa25c23444a89202ec0'"
Sep 17 16:13:50.331986 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:50.331956    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-secondary-68dcdd-predictor-6d6f7496f9-q52ch_75234626-a956-480b-ad13-872fe1042e2e/storage-initializer/1.log"
Sep 17 16:13:53.584086 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:53.584049    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-secondary-68dcdd-predictor-6d6f7496f9-q52ch"]
Sep 17 16:13:53.708952 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:53.708931    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-secondary-68dcdd-predictor-6d6f7496f9-q52ch_75234626-a956-480b-ad13-872fe1042e2e/storage-initializer/1.log"
Sep 17 16:13:53.712708 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:53.712692    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-secondary-68dcdd-predictor-6d6f7496f9-q52ch"
Sep 17 16:13:53.799158 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:53.799133    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6s8bt\" (UniqueName: \"kubernetes.io/projected/75234626-a956-480b-ad13-872fe1042e2e-kube-api-access-6s8bt\") pod \"75234626-a956-480b-ad13-872fe1042e2e\" (UID: \"75234626-a956-480b-ad13-872fe1042e2e\") "
Sep 17 16:13:53.799284 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:53.799173    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/75234626-a956-480b-ad13-872fe1042e2e-cabundle-cert\") pod \"75234626-a956-480b-ad13-872fe1042e2e\" (UID: \"75234626-a956-480b-ad13-872fe1042e2e\") "
Sep 17 16:13:53.799284 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:53.799207    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/75234626-a956-480b-ad13-872fe1042e2e-kube-rbac-proxy-sar-config\") pod \"75234626-a956-480b-ad13-872fe1042e2e\" (UID: \"75234626-a956-480b-ad13-872fe1042e2e\") "
Sep 17 16:13:53.799284 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:53.799268    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/75234626-a956-480b-ad13-872fe1042e2e-kserve-provision-location\") pod \"75234626-a956-480b-ad13-872fe1042e2e\" (UID: \"75234626-a956-480b-ad13-872fe1042e2e\") "
Sep 17 16:13:53.799410 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:53.799315    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/75234626-a956-480b-ad13-872fe1042e2e-proxy-tls\") pod \"75234626-a956-480b-ad13-872fe1042e2e\" (UID: \"75234626-a956-480b-ad13-872fe1042e2e\") "
Sep 17 16:13:53.799585 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:53.799555    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75234626-a956-480b-ad13-872fe1042e2e-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "75234626-a956-480b-ad13-872fe1042e2e" (UID: "75234626-a956-480b-ad13-872fe1042e2e"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 16:13:53.799669 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:53.799566    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75234626-a956-480b-ad13-872fe1042e2e-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "75234626-a956-480b-ad13-872fe1042e2e" (UID: "75234626-a956-480b-ad13-872fe1042e2e"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 16:13:53.799669 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:53.799613    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75234626-a956-480b-ad13-872fe1042e2e-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "75234626-a956-480b-ad13-872fe1042e2e" (UID: "75234626-a956-480b-ad13-872fe1042e2e"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 16:13:53.801362 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:53.801343    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75234626-a956-480b-ad13-872fe1042e2e-kube-api-access-6s8bt" (OuterVolumeSpecName: "kube-api-access-6s8bt") pod "75234626-a956-480b-ad13-872fe1042e2e" (UID: "75234626-a956-480b-ad13-872fe1042e2e"). InnerVolumeSpecName "kube-api-access-6s8bt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 16:13:53.801459 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:53.801433    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75234626-a956-480b-ad13-872fe1042e2e-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "75234626-a956-480b-ad13-872fe1042e2e" (UID: "75234626-a956-480b-ad13-872fe1042e2e"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:13:53.900267 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:53.900241    2584 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/75234626-a956-480b-ad13-872fe1042e2e-cabundle-cert\") on node \"ip-10-0-128-191.ec2.internal\" DevicePath \"\""
Sep 17 16:13:53.900267 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:53.900267    2584 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/75234626-a956-480b-ad13-872fe1042e2e-kube-rbac-proxy-sar-config\") on node \"ip-10-0-128-191.ec2.internal\" DevicePath \"\""
Sep 17 16:13:53.900418 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:53.900281    2584 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/75234626-a956-480b-ad13-872fe1042e2e-kserve-provision-location\") on node \"ip-10-0-128-191.ec2.internal\" DevicePath \"\""
Sep 17 16:13:53.900418 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:53.900295    2584 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/75234626-a956-480b-ad13-872fe1042e2e-proxy-tls\") on node \"ip-10-0-128-191.ec2.internal\" DevicePath \"\""
Sep 17 16:13:53.900418 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:53.900306    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6s8bt\" (UniqueName: \"kubernetes.io/projected/75234626-a956-480b-ad13-872fe1042e2e-kube-api-access-6s8bt\") on node \"ip-10-0-128-191.ec2.internal\" DevicePath \"\""
Sep 17 16:13:54.348745 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:54.348645    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-secondary-68dcdd-predictor-6d6f7496f9-q52ch_75234626-a956-480b-ad13-872fe1042e2e/storage-initializer/1.log"
Sep 17 16:13:54.348894 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:54.348741    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-secondary-68dcdd-predictor-6d6f7496f9-q52ch"
Sep 17 16:13:54.348894 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:54.348762    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-secondary-68dcdd-predictor-6d6f7496f9-q52ch" event={"ID":"75234626-a956-480b-ad13-872fe1042e2e","Type":"ContainerDied","Data":"4b23707b681a402914df60c355a1e3185531de06b065abbb120aeb23cd7454e1"}
Sep 17 16:13:54.348894 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:54.348819    2584 scope.go:117] "RemoveContainer" containerID="4994ab5be0129c0f829027850a7e81ace954581c7b7dcadcadbf5f2779a250cd"
Sep 17 16:13:54.389064 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:54.389037    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-secondary-68dcdd-predictor-6d6f7496f9-q52ch"]
Sep 17 16:13:54.392896 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:54.392869    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-secondary-68dcdd-predictor-6d6f7496f9-q52ch"]
Sep 17 16:13:54.516486 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:13:54.516453    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75234626-a956-480b-ad13-872fe1042e2e" path="/var/lib/kubelet/pods/75234626-a956-480b-ad13-872fe1042e2e/volumes"
Sep 17 16:17:11.236480 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:17:11.236442    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-canary-create-predictor-66d85d8bfb-vsjpj"]
Sep 17 16:17:11.237025 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:17:11.236932    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75234626-a956-480b-ad13-872fe1042e2e" containerName="storage-initializer"
Sep 17 16:17:11.237025 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:17:11.236948    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="75234626-a956-480b-ad13-872fe1042e2e" containerName="storage-initializer"
Sep 17 16:17:11.237025 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:17:11.236998    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75234626-a956-480b-ad13-872fe1042e2e" containerName="storage-initializer"
Sep 17 16:17:11.237025 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:17:11.237007    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="75234626-a956-480b-ad13-872fe1042e2e" containerName="storage-initializer"
Sep 17 16:17:11.237227 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:17:11.237081    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="75234626-a956-480b-ad13-872fe1042e2e" containerName="storage-initializer"
Sep 17 16:17:11.237227 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:17:11.237222    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="75234626-a956-480b-ad13-872fe1042e2e" containerName="storage-initializer"
Sep 17 16:17:11.240733 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:17:11.240711    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-66d85d8bfb-vsjpj"
Sep 17 16:17:11.243620 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:17:11.243598    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-create-predictor-serving-cert\""
Sep 17 16:17:11.243917 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:17:11.243896    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Sep 17 16:17:11.244188 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:17:11.244167    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Sep 17 16:17:11.244275 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:17:11.244204    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-create-kube-rbac-proxy-sar-config\""
Sep 17 16:17:11.244275 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:17:11.244215    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Sep 17 16:17:11.244388 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:17:11.244221    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Sep 17 16:17:11.245025 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:17:11.245007    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-z8dwv\""
Sep 17 16:17:11.251382 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:17:11.251355    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-create-predictor-66d85d8bfb-vsjpj"]
Sep 17 16:17:11.299919 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:17:11.299887    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/62ff4cc8-9594-45d4-ad84-66a9cc65829f-proxy-tls\") pod \"isvc-canary-create-predictor-66d85d8bfb-vsjpj\" (UID: \"62ff4cc8-9594-45d4-ad84-66a9cc65829f\") " pod="kserve-ci-e2e-test/isvc-canary-create-predictor-66d85d8bfb-vsjpj"
Sep 17 16:17:11.300058 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:17:11.299938    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxp7t\" (UniqueName: \"kubernetes.io/projected/62ff4cc8-9594-45d4-ad84-66a9cc65829f-kube-api-access-vxp7t\") pod \"isvc-canary-create-predictor-66d85d8bfb-vsjpj\" (UID: \"62ff4cc8-9594-45d4-ad84-66a9cc65829f\") " pod="kserve-ci-e2e-test/isvc-canary-create-predictor-66d85d8bfb-vsjpj"
Sep 17 16:17:11.300058 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:17:11.299965    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/62ff4cc8-9594-45d4-ad84-66a9cc65829f-cabundle-cert\") pod \"isvc-canary-create-predictor-66d85d8bfb-vsjpj\" (UID: \"62ff4cc8-9594-45d4-ad84-66a9cc65829f\") " pod="kserve-ci-e2e-test/isvc-canary-create-predictor-66d85d8bfb-vsjpj"
Sep 17 16:17:11.300058 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:17:11.300050    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/62ff4cc8-9594-45d4-ad84-66a9cc65829f-kserve-provision-location\") pod \"isvc-canary-create-predictor-66d85d8bfb-vsjpj\" (UID: \"62ff4cc8-9594-45d4-ad84-66a9cc65829f\") " pod="kserve-ci-e2e-test/isvc-canary-create-predictor-66d85d8bfb-vsjpj"
Sep 17 16:17:11.300225 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:17:11.300104    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/62ff4cc8-9594-45d4-ad84-66a9cc65829f-kube-rbac-proxy-sar-config\") pod \"isvc-canary-create-predictor-66d85d8bfb-vsjpj\" (UID: \"62ff4cc8-9594-45d4-ad84-66a9cc65829f\") " pod="kserve-ci-e2e-test/isvc-canary-create-predictor-66d85d8bfb-vsjpj"
Sep 17 16:17:11.401433 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:17:11.401406    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/62ff4cc8-9594-45d4-ad84-66a9cc65829f-proxy-tls\") pod \"isvc-canary-create-predictor-66d85d8bfb-vsjpj\" (UID: \"62ff4cc8-9594-45d4-ad84-66a9cc65829f\") " pod="kserve-ci-e2e-test/isvc-canary-create-predictor-66d85d8bfb-vsjpj"
Sep 17 16:17:11.401594 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:17:11.401445    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxp7t\" (UniqueName: \"kubernetes.io/projected/62ff4cc8-9594-45d4-ad84-66a9cc65829f-kube-api-access-vxp7t\") pod \"isvc-canary-create-predictor-66d85d8bfb-vsjpj\" (UID: \"62ff4cc8-9594-45d4-ad84-66a9cc65829f\") " pod="kserve-ci-e2e-test/isvc-canary-create-predictor-66d85d8bfb-vsjpj"
Sep 17 16:17:11.401594 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:17:11.401466    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/62ff4cc8-9594-45d4-ad84-66a9cc65829f-cabundle-cert\") pod \"isvc-canary-create-predictor-66d85d8bfb-vsjpj\" (UID: \"62ff4cc8-9594-45d4-ad84-66a9cc65829f\") " pod="kserve-ci-e2e-test/isvc-canary-create-predictor-66d85d8bfb-vsjpj"
Sep 17 16:17:11.401594 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:17:11.401560    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/62ff4cc8-9594-45d4-ad84-66a9cc65829f-kserve-provision-location\") pod \"isvc-canary-create-predictor-66d85d8bfb-vsjpj\" (UID: \"62ff4cc8-9594-45d4-ad84-66a9cc65829f\") " pod="kserve-ci-e2e-test/isvc-canary-create-predictor-66d85d8bfb-vsjpj"
Sep 17 16:17:11.401739 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:17:11.401606    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/62ff4cc8-9594-45d4-ad84-66a9cc65829f-kube-rbac-proxy-sar-config\") pod \"isvc-canary-create-predictor-66d85d8bfb-vsjpj\" (UID: \"62ff4cc8-9594-45d4-ad84-66a9cc65829f\") " pod="kserve-ci-e2e-test/isvc-canary-create-predictor-66d85d8bfb-vsjpj"
Sep 17 16:17:11.402058 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:17:11.402036    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/62ff4cc8-9594-45d4-ad84-66a9cc65829f-kserve-provision-location\") pod \"isvc-canary-create-predictor-66d85d8bfb-vsjpj\" (UID: \"62ff4cc8-9594-45d4-ad84-66a9cc65829f\") " pod="kserve-ci-e2e-test/isvc-canary-create-predictor-66d85d8bfb-vsjpj"
Sep 17 16:17:11.402293 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:17:11.402276    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/62ff4cc8-9594-45d4-ad84-66a9cc65829f-cabundle-cert\") pod \"isvc-canary-create-predictor-66d85d8bfb-vsjpj\" (UID: \"62ff4cc8-9594-45d4-ad84-66a9cc65829f\") " pod="kserve-ci-e2e-test/isvc-canary-create-predictor-66d85d8bfb-vsjpj"
Sep 17 16:17:11.402347 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:17:11.402279    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/62ff4cc8-9594-45d4-ad84-66a9cc65829f-kube-rbac-proxy-sar-config\") pod \"isvc-canary-create-predictor-66d85d8bfb-vsjpj\" (UID: \"62ff4cc8-9594-45d4-ad84-66a9cc65829f\") " pod="kserve-ci-e2e-test/isvc-canary-create-predictor-66d85d8bfb-vsjpj"
Sep 17 16:17:11.404091 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:17:11.404075    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/62ff4cc8-9594-45d4-ad84-66a9cc65829f-proxy-tls\") pod \"isvc-canary-create-predictor-66d85d8bfb-vsjpj\" (UID: \"62ff4cc8-9594-45d4-ad84-66a9cc65829f\") " pod="kserve-ci-e2e-test/isvc-canary-create-predictor-66d85d8bfb-vsjpj"
Sep 17 16:17:11.410183 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:17:11.410162    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxp7t\" (UniqueName: \"kubernetes.io/projected/62ff4cc8-9594-45d4-ad84-66a9cc65829f-kube-api-access-vxp7t\") pod \"isvc-canary-create-predictor-66d85d8bfb-vsjpj\" (UID: \"62ff4cc8-9594-45d4-ad84-66a9cc65829f\") " pod="kserve-ci-e2e-test/isvc-canary-create-predictor-66d85d8bfb-vsjpj"
Sep 17 16:17:11.552337 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:17:11.552252    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-66d85d8bfb-vsjpj"
Sep 17 16:17:11.829285 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:17:11.829219    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-create-predictor-66d85d8bfb-vsjpj"]
Sep 17 16:17:11.831525 ip-10-0-128-191 kubenswrapper[2584]: W0917 16:17:11.831478    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62ff4cc8_9594_45d4_ad84_66a9cc65829f.slice/crio-8d19e3a9cc8c7447627badd5fe5fdbaed40d8fa843059a171a1880663d307f97 WatchSource:0}: Error finding container 8d19e3a9cc8c7447627badd5fe5fdbaed40d8fa843059a171a1880663d307f97: Status 404 returned error can't find the container with id 8d19e3a9cc8c7447627badd5fe5fdbaed40d8fa843059a171a1880663d307f97
Sep 17 16:17:12.107354 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:17:12.107262    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-66d85d8bfb-vsjpj" event={"ID":"62ff4cc8-9594-45d4-ad84-66a9cc65829f","Type":"ContainerStarted","Data":"a1e6b850dee61915425779d2e64d9b11c607a19ab3c13cf109035441088b19df"}
Sep 17 16:17:12.107354 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:17:12.107329    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-66d85d8bfb-vsjpj" event={"ID":"62ff4cc8-9594-45d4-ad84-66a9cc65829f","Type":"ContainerStarted","Data":"8d19e3a9cc8c7447627badd5fe5fdbaed40d8fa843059a171a1880663d307f97"}
Sep 17 16:17:16.123924 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:17:16.123888    2584 generic.go:356] "Generic (PLEG): container finished" podID="62ff4cc8-9594-45d4-ad84-66a9cc65829f" containerID="a1e6b850dee61915425779d2e64d9b11c607a19ab3c13cf109035441088b19df" exitCode=0
Sep 17 16:17:16.124432 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:17:16.123967    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-66d85d8bfb-vsjpj" event={"ID":"62ff4cc8-9594-45d4-ad84-66a9cc65829f","Type":"ContainerDied","Data":"a1e6b850dee61915425779d2e64d9b11c607a19ab3c13cf109035441088b19df"}
Sep 17 16:17:17.129784 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:17:17.129746    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-66d85d8bfb-vsjpj" event={"ID":"62ff4cc8-9594-45d4-ad84-66a9cc65829f","Type":"ContainerStarted","Data":"3603e552c10ea3a92253a8d758751c979ac0cb91b515ab7f37f38a328b0f894b"}
Sep 17 16:17:17.130155 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:17:17.129812    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-66d85d8bfb-vsjpj" event={"ID":"62ff4cc8-9594-45d4-ad84-66a9cc65829f","Type":"ContainerStarted","Data":"d32d369760750852007aa7002a716a2876899a027520574d7827fa32bc7d202b"}
Sep 17 16:17:17.130155 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:17:17.129999    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-66d85d8bfb-vsjpj"
Sep 17 16:17:17.152391 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:17:17.152338    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-66d85d8bfb-vsjpj" podStartSLOduration=2.148850534 podStartE2EDuration="6.152325367s" totalImagesPullingTime="0s" totalInitContainerRuntime="4.003474833s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:17:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:17:17.150963221 +0000 UTC m=+1354.764894733" watchObservedRunningTime="2026-09-17 16:17:17.152325367 +0000 UTC m=+1354.766256878"
Sep 17 16:17:18.135291 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:17:18.135255    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-66d85d8bfb-vsjpj"
Sep 17 16:17:18.136664 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:17:18.136628    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-66d85d8bfb-vsjpj" podUID="62ff4cc8-9594-45d4-ad84-66a9cc65829f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Sep 17 16:17:19.139583 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:17:19.139542    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-66d85d8bfb-vsjpj" podUID="62ff4cc8-9594-45d4-ad84-66a9cc65829f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Sep 17 16:17:24.144376 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:17:24.144349    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-66d85d8bfb-vsjpj"
Sep 17 16:17:24.144864 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:17:24.144833    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-66d85d8bfb-vsjpj" podUID="62ff4cc8-9594-45d4-ad84-66a9cc65829f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Sep 17 16:17:34.144928 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:17:34.144882    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-66d85d8bfb-vsjpj" podUID="62ff4cc8-9594-45d4-ad84-66a9cc65829f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Sep 17 16:17:44.145024 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:17:44.144984    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-66d85d8bfb-vsjpj" podUID="62ff4cc8-9594-45d4-ad84-66a9cc65829f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Sep 17 16:17:54.145611 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:17:54.145571    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-66d85d8bfb-vsjpj" podUID="62ff4cc8-9594-45d4-ad84-66a9cc65829f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Sep 17 16:18:04.145728 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:18:04.145684    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-66d85d8bfb-vsjpj" podUID="62ff4cc8-9594-45d4-ad84-66a9cc65829f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Sep 17 16:18:14.145511 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:18:14.145462    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-66d85d8bfb-vsjpj" podUID="62ff4cc8-9594-45d4-ad84-66a9cc65829f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Sep 17 16:18:24.145073 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:18:24.145035    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-66d85d8bfb-vsjpj" podUID="62ff4cc8-9594-45d4-ad84-66a9cc65829f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.27:8080: connect: connection refused"
Sep 17 16:18:29.512709 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:18:29.512676    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-66d85d8bfb-vsjpj"
Sep 17 16:18:41.411695 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:18:41.411662    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-create-predictor-66d85d8bfb-vsjpj"]
Sep 17 16:18:41.412120 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:18:41.411939    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-66d85d8bfb-vsjpj" podUID="62ff4cc8-9594-45d4-ad84-66a9cc65829f" containerName="kserve-container" containerID="cri-o://d32d369760750852007aa7002a716a2876899a027520574d7827fa32bc7d202b" gracePeriod=30
Sep 17 16:18:41.412120 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:18:41.411948    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-66d85d8bfb-vsjpj" podUID="62ff4cc8-9594-45d4-ad84-66a9cc65829f" containerName="kube-rbac-proxy" containerID="cri-o://3603e552c10ea3a92253a8d758751c979ac0cb91b515ab7f37f38a328b0f894b" gracePeriod=30
Sep 17 16:18:42.471816 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:18:42.471781    2584 generic.go:356] "Generic (PLEG): container finished" podID="62ff4cc8-9594-45d4-ad84-66a9cc65829f" containerID="3603e552c10ea3a92253a8d758751c979ac0cb91b515ab7f37f38a328b0f894b" exitCode=2
Sep 17 16:18:42.472184 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:18:42.471851    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-66d85d8bfb-vsjpj" event={"ID":"62ff4cc8-9594-45d4-ad84-66a9cc65829f","Type":"ContainerDied","Data":"3603e552c10ea3a92253a8d758751c979ac0cb91b515ab7f37f38a328b0f894b"}
Sep 17 16:18:44.139784 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:18:44.139738    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-66d85d8bfb-vsjpj" podUID="62ff4cc8-9594-45d4-ad84-66a9cc65829f" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.27:8643/healthz\": dial tcp 10.134.0.27:8643: connect: connection refused"
Sep 17 16:18:46.157802 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:18:46.157768    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-66d85d8bfb-vsjpj"
Sep 17 16:18:46.262630 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:18:46.262560    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/62ff4cc8-9594-45d4-ad84-66a9cc65829f-cabundle-cert\") pod \"62ff4cc8-9594-45d4-ad84-66a9cc65829f\" (UID: \"62ff4cc8-9594-45d4-ad84-66a9cc65829f\") "
Sep 17 16:18:46.262630 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:18:46.262625    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/62ff4cc8-9594-45d4-ad84-66a9cc65829f-kube-rbac-proxy-sar-config\") pod \"62ff4cc8-9594-45d4-ad84-66a9cc65829f\" (UID: \"62ff4cc8-9594-45d4-ad84-66a9cc65829f\") "
Sep 17 16:18:46.262861 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:18:46.262654    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/62ff4cc8-9594-45d4-ad84-66a9cc65829f-proxy-tls\") pod \"62ff4cc8-9594-45d4-ad84-66a9cc65829f\" (UID: \"62ff4cc8-9594-45d4-ad84-66a9cc65829f\") "
Sep 17 16:18:46.262861 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:18:46.262692    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vxp7t\" (UniqueName: \"kubernetes.io/projected/62ff4cc8-9594-45d4-ad84-66a9cc65829f-kube-api-access-vxp7t\") pod \"62ff4cc8-9594-45d4-ad84-66a9cc65829f\" (UID: \"62ff4cc8-9594-45d4-ad84-66a9cc65829f\") "
Sep 17 16:18:46.262861 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:18:46.262715    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/62ff4cc8-9594-45d4-ad84-66a9cc65829f-kserve-provision-location\") pod \"62ff4cc8-9594-45d4-ad84-66a9cc65829f\" (UID: \"62ff4cc8-9594-45d4-ad84-66a9cc65829f\") "
Sep 17 16:18:46.263105 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:18:46.263056    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62ff4cc8-9594-45d4-ad84-66a9cc65829f-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "62ff4cc8-9594-45d4-ad84-66a9cc65829f" (UID: "62ff4cc8-9594-45d4-ad84-66a9cc65829f"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 16:18:46.263105 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:18:46.263086    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62ff4cc8-9594-45d4-ad84-66a9cc65829f-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "62ff4cc8-9594-45d4-ad84-66a9cc65829f" (UID: "62ff4cc8-9594-45d4-ad84-66a9cc65829f"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 16:18:46.263105 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:18:46.263063    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62ff4cc8-9594-45d4-ad84-66a9cc65829f-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "62ff4cc8-9594-45d4-ad84-66a9cc65829f" (UID: "62ff4cc8-9594-45d4-ad84-66a9cc65829f"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 16:18:46.264964 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:18:46.264942    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62ff4cc8-9594-45d4-ad84-66a9cc65829f-kube-api-access-vxp7t" (OuterVolumeSpecName: "kube-api-access-vxp7t") pod "62ff4cc8-9594-45d4-ad84-66a9cc65829f" (UID: "62ff4cc8-9594-45d4-ad84-66a9cc65829f"). InnerVolumeSpecName "kube-api-access-vxp7t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 16:18:46.265028 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:18:46.264961    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62ff4cc8-9594-45d4-ad84-66a9cc65829f-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "62ff4cc8-9594-45d4-ad84-66a9cc65829f" (UID: "62ff4cc8-9594-45d4-ad84-66a9cc65829f"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:18:46.363900 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:18:46.363865    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vxp7t\" (UniqueName: \"kubernetes.io/projected/62ff4cc8-9594-45d4-ad84-66a9cc65829f-kube-api-access-vxp7t\") on node \"ip-10-0-128-191.ec2.internal\" DevicePath \"\""
Sep 17 16:18:46.363900 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:18:46.363893    2584 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/62ff4cc8-9594-45d4-ad84-66a9cc65829f-kserve-provision-location\") on node \"ip-10-0-128-191.ec2.internal\" DevicePath \"\""
Sep 17 16:18:46.363900 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:18:46.363903    2584 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/62ff4cc8-9594-45d4-ad84-66a9cc65829f-cabundle-cert\") on node \"ip-10-0-128-191.ec2.internal\" DevicePath \"\""
Sep 17 16:18:46.364118 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:18:46.363911    2584 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/62ff4cc8-9594-45d4-ad84-66a9cc65829f-kube-rbac-proxy-sar-config\") on node \"ip-10-0-128-191.ec2.internal\" DevicePath \"\""
Sep 17 16:18:46.364118 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:18:46.363920    2584 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/62ff4cc8-9594-45d4-ad84-66a9cc65829f-proxy-tls\") on node \"ip-10-0-128-191.ec2.internal\" DevicePath \"\""
Sep 17 16:18:46.496818 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:18:46.496773    2584 generic.go:356] "Generic (PLEG): container finished" podID="62ff4cc8-9594-45d4-ad84-66a9cc65829f" containerID="d32d369760750852007aa7002a716a2876899a027520574d7827fa32bc7d202b" exitCode=0
Sep 17 16:18:46.496818 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:18:46.496816    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-66d85d8bfb-vsjpj" event={"ID":"62ff4cc8-9594-45d4-ad84-66a9cc65829f","Type":"ContainerDied","Data":"d32d369760750852007aa7002a716a2876899a027520574d7827fa32bc7d202b"}
Sep 17 16:18:46.497049 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:18:46.496848    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-66d85d8bfb-vsjpj"
Sep 17 16:18:46.497049 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:18:46.496869    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-66d85d8bfb-vsjpj" event={"ID":"62ff4cc8-9594-45d4-ad84-66a9cc65829f","Type":"ContainerDied","Data":"8d19e3a9cc8c7447627badd5fe5fdbaed40d8fa843059a171a1880663d307f97"}
Sep 17 16:18:46.497049 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:18:46.496896    2584 scope.go:117] "RemoveContainer" containerID="3603e552c10ea3a92253a8d758751c979ac0cb91b515ab7f37f38a328b0f894b"
Sep 17 16:18:46.505693 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:18:46.505580    2584 scope.go:117] "RemoveContainer" containerID="d32d369760750852007aa7002a716a2876899a027520574d7827fa32bc7d202b"
Sep 17 16:18:46.514836 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:18:46.514816    2584 scope.go:117] "RemoveContainer" containerID="a1e6b850dee61915425779d2e64d9b11c607a19ab3c13cf109035441088b19df"
Sep 17 16:18:46.523337 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:18:46.523318    2584 scope.go:117] "RemoveContainer" containerID="3603e552c10ea3a92253a8d758751c979ac0cb91b515ab7f37f38a328b0f894b"
Sep 17 16:18:46.523537 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:18:46.523513    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-create-predictor-66d85d8bfb-vsjpj"]
Sep 17 16:18:46.523694 ip-10-0-128-191 kubenswrapper[2584]: E0917 16:18:46.523674    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3603e552c10ea3a92253a8d758751c979ac0cb91b515ab7f37f38a328b0f894b\": container with ID starting with 3603e552c10ea3a92253a8d758751c979ac0cb91b515ab7f37f38a328b0f894b not found: ID does not exist" containerID="3603e552c10ea3a92253a8d758751c979ac0cb91b515ab7f37f38a328b0f894b"
Sep 17 16:18:46.523767 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:18:46.523707    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3603e552c10ea3a92253a8d758751c979ac0cb91b515ab7f37f38a328b0f894b"} err="failed to get container status \"3603e552c10ea3a92253a8d758751c979ac0cb91b515ab7f37f38a328b0f894b\": rpc error: code = NotFound desc = could not find container \"3603e552c10ea3a92253a8d758751c979ac0cb91b515ab7f37f38a328b0f894b\": container with ID starting with 3603e552c10ea3a92253a8d758751c979ac0cb91b515ab7f37f38a328b0f894b not found: ID does not exist"
Sep 17 16:18:46.523767 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:18:46.523732    2584 scope.go:117] "RemoveContainer" containerID="d32d369760750852007aa7002a716a2876899a027520574d7827fa32bc7d202b"
Sep 17 16:18:46.524027 ip-10-0-128-191 kubenswrapper[2584]: E0917 16:18:46.524009    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d32d369760750852007aa7002a716a2876899a027520574d7827fa32bc7d202b\": container with ID starting with d32d369760750852007aa7002a716a2876899a027520574d7827fa32bc7d202b not found: ID does not exist" containerID="d32d369760750852007aa7002a716a2876899a027520574d7827fa32bc7d202b"
Sep 17 16:18:46.524091 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:18:46.524033    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d32d369760750852007aa7002a716a2876899a027520574d7827fa32bc7d202b"} err="failed to get container status \"d32d369760750852007aa7002a716a2876899a027520574d7827fa32bc7d202b\": rpc error: code = NotFound desc = could not find container \"d32d369760750852007aa7002a716a2876899a027520574d7827fa32bc7d202b\": container with ID starting with d32d369760750852007aa7002a716a2876899a027520574d7827fa32bc7d202b not found: ID does not exist"
Sep 17 16:18:46.524091 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:18:46.524049    2584 scope.go:117] "RemoveContainer" containerID="a1e6b850dee61915425779d2e64d9b11c607a19ab3c13cf109035441088b19df"
Sep 17 16:18:46.524330 ip-10-0-128-191 kubenswrapper[2584]: E0917 16:18:46.524311    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1e6b850dee61915425779d2e64d9b11c607a19ab3c13cf109035441088b19df\": container with ID starting with a1e6b850dee61915425779d2e64d9b11c607a19ab3c13cf109035441088b19df not found: ID does not exist" containerID="a1e6b850dee61915425779d2e64d9b11c607a19ab3c13cf109035441088b19df"
Sep 17 16:18:46.524392 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:18:46.524339    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1e6b850dee61915425779d2e64d9b11c607a19ab3c13cf109035441088b19df"} err="failed to get container status \"a1e6b850dee61915425779d2e64d9b11c607a19ab3c13cf109035441088b19df\": rpc error: code = NotFound desc = could not find container \"a1e6b850dee61915425779d2e64d9b11c607a19ab3c13cf109035441088b19df\": container with ID starting with a1e6b850dee61915425779d2e64d9b11c607a19ab3c13cf109035441088b19df not found: ID does not exist"
Sep 17 16:18:46.527438 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:18:46.527415    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-create-predictor-66d85d8bfb-vsjpj"]
Sep 17 16:18:48.515583 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:18:48.515551    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62ff4cc8-9594-45d4-ad84-66a9cc65829f" path="/var/lib/kubelet/pods/62ff4cc8-9594-45d4-ad84-66a9cc65829f/volumes"
Sep 17 16:23:58.718538 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:23:58.718488    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-r5xzc/must-gather-n8c46"]
Sep 17 16:23:58.719003 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:23:58.718785    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62ff4cc8-9594-45d4-ad84-66a9cc65829f" containerName="kserve-container"
Sep 17 16:23:58.719003 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:23:58.718795    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="62ff4cc8-9594-45d4-ad84-66a9cc65829f" containerName="kserve-container"
Sep 17 16:23:58.719003 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:23:58.718811    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62ff4cc8-9594-45d4-ad84-66a9cc65829f" containerName="storage-initializer"
Sep 17 16:23:58.719003 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:23:58.718817    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="62ff4cc8-9594-45d4-ad84-66a9cc65829f" containerName="storage-initializer"
Sep 17 16:23:58.719003 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:23:58.718833    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62ff4cc8-9594-45d4-ad84-66a9cc65829f" containerName="kube-rbac-proxy"
Sep 17 16:23:58.719003 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:23:58.718839    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="62ff4cc8-9594-45d4-ad84-66a9cc65829f" containerName="kube-rbac-proxy"
Sep 17 16:23:58.719003 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:23:58.718883    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="62ff4cc8-9594-45d4-ad84-66a9cc65829f" containerName="kserve-container"
Sep 17 16:23:58.719003 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:23:58.718891    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="62ff4cc8-9594-45d4-ad84-66a9cc65829f" containerName="kube-rbac-proxy"
Sep 17 16:23:58.721936 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:23:58.721921    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-r5xzc/must-gather-n8c46"
Sep 17 16:23:58.724993 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:23:58.724971    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-r5xzc\"/\"default-dockercfg-wwmwg\""
Sep 17 16:23:58.725719 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:23:58.725701    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-r5xzc\"/\"kube-root-ca.crt\""
Sep 17 16:23:58.725808 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:23:58.725735    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-r5xzc\"/\"openshift-service-ca.crt\""
Sep 17 16:23:58.738456 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:23:58.738432    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-r5xzc/must-gather-n8c46"]
Sep 17 16:23:58.892511 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:23:58.892459    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3838bfc8-f0a2-4291-873f-18ad8924a9c9-must-gather-output\") pod \"must-gather-n8c46\" (UID: \"3838bfc8-f0a2-4291-873f-18ad8924a9c9\") " pod="openshift-must-gather-r5xzc/must-gather-n8c46"
Sep 17 16:23:58.892695 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:23:58.892555    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hc87\" (UniqueName: \"kubernetes.io/projected/3838bfc8-f0a2-4291-873f-18ad8924a9c9-kube-api-access-6hc87\") pod \"must-gather-n8c46\" (UID: \"3838bfc8-f0a2-4291-873f-18ad8924a9c9\") " pod="openshift-must-gather-r5xzc/must-gather-n8c46"
Sep 17 16:23:58.993817 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:23:58.993733    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hc87\" (UniqueName: \"kubernetes.io/projected/3838bfc8-f0a2-4291-873f-18ad8924a9c9-kube-api-access-6hc87\") pod \"must-gather-n8c46\" (UID: \"3838bfc8-f0a2-4291-873f-18ad8924a9c9\") " pod="openshift-must-gather-r5xzc/must-gather-n8c46"
Sep 17 16:23:58.993965 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:23:58.993834    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3838bfc8-f0a2-4291-873f-18ad8924a9c9-must-gather-output\") pod \"must-gather-n8c46\" (UID: \"3838bfc8-f0a2-4291-873f-18ad8924a9c9\") " pod="openshift-must-gather-r5xzc/must-gather-n8c46"
Sep 17 16:23:58.994176 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:23:58.994154    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3838bfc8-f0a2-4291-873f-18ad8924a9c9-must-gather-output\") pod \"must-gather-n8c46\" (UID: \"3838bfc8-f0a2-4291-873f-18ad8924a9c9\") " pod="openshift-must-gather-r5xzc/must-gather-n8c46"
Sep 17 16:23:59.003294 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:23:59.003266    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hc87\" (UniqueName: \"kubernetes.io/projected/3838bfc8-f0a2-4291-873f-18ad8924a9c9-kube-api-access-6hc87\") pod \"must-gather-n8c46\" (UID: \"3838bfc8-f0a2-4291-873f-18ad8924a9c9\") " pod="openshift-must-gather-r5xzc/must-gather-n8c46"
Sep 17 16:23:59.043267 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:23:59.043242    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-r5xzc/must-gather-n8c46"
Sep 17 16:23:59.318263 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:23:59.318188    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-r5xzc/must-gather-n8c46"]
Sep 17 16:23:59.321294 ip-10-0-128-191 kubenswrapper[2584]: W0917 16:23:59.321266    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3838bfc8_f0a2_4291_873f_18ad8924a9c9.slice/crio-c45a3ea005cd7737c7273f6227854e79165cd293d6fdf6df74184d31729a5d17 WatchSource:0}: Error finding container c45a3ea005cd7737c7273f6227854e79165cd293d6fdf6df74184d31729a5d17: Status 404 returned error can't find the container with id c45a3ea005cd7737c7273f6227854e79165cd293d6fdf6df74184d31729a5d17
Sep 17 16:23:59.323080 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:23:59.323062    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 16:23:59.723457 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:23:59.723418    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-r5xzc/must-gather-n8c46" event={"ID":"3838bfc8-f0a2-4291-873f-18ad8924a9c9","Type":"ContainerStarted","Data":"c45a3ea005cd7737c7273f6227854e79165cd293d6fdf6df74184d31729a5d17"}
Sep 17 16:24:05.753915 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:05.753824    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-r5xzc/must-gather-n8c46" event={"ID":"3838bfc8-f0a2-4291-873f-18ad8924a9c9","Type":"ContainerStarted","Data":"c4a7322afcb58f04f23d2e441266529b700570376c97505f1e983e8ad659522b"}
Sep 17 16:24:05.753915 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:05.753880    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-r5xzc/must-gather-n8c46" event={"ID":"3838bfc8-f0a2-4291-873f-18ad8924a9c9","Type":"ContainerStarted","Data":"dc7d9b1d5bb6f5736057259e9fb3a56570b8018efebc8ae14b771358b0f46816"}
Sep 17 16:24:05.772465 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:05.772416    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-r5xzc/must-gather-n8c46" podStartSLOduration=1.692065559 podStartE2EDuration="7.772399263s" totalImagesPullingTime="6.080333704s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:23:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:24:05.771093779 +0000 UTC m=+1763.385025294" watchObservedRunningTime="2026-09-17 16:24:05.772399263 +0000 UTC m=+1763.386330773"
Sep 17 16:24:28.862870 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:28.862791    2584 generic.go:356] "Generic (PLEG): container finished" podID="3838bfc8-f0a2-4291-873f-18ad8924a9c9" containerID="dc7d9b1d5bb6f5736057259e9fb3a56570b8018efebc8ae14b771358b0f46816" exitCode=0
Sep 17 16:24:28.863251 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:28.862864    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-r5xzc/must-gather-n8c46" event={"ID":"3838bfc8-f0a2-4291-873f-18ad8924a9c9","Type":"ContainerDied","Data":"dc7d9b1d5bb6f5736057259e9fb3a56570b8018efebc8ae14b771358b0f46816"}
Sep 17 16:24:28.863251 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:28.863166    2584 scope.go:117] "RemoveContainer" containerID="dc7d9b1d5bb6f5736057259e9fb3a56570b8018efebc8ae14b771358b0f46816"
Sep 17 16:24:29.573597 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:29.573562    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-r5xzc_must-gather-n8c46_3838bfc8-f0a2-4291-873f-18ad8924a9c9/gather/0.log"
Sep 17 16:24:33.058644 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:33.058611    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-7xl8l_46630785-5a7e-496b-86fe-d32e237c8c1b/global-pull-secret-syncer/0.log"
Sep 17 16:24:33.272010 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:33.271981    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zlcqk_9e359937-2c4a-45c6-92b6-3c82ee32c922/konnectivity-agent/0.log"
Sep 17 16:24:33.322602 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:33.322539    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-191.ec2.internal_311e9dffa75dc15b9f976eb249bd6092/haproxy/0.log"
Sep 17 16:24:35.049524 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:35.049478    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-r5xzc/must-gather-n8c46"]
Sep 17 16:24:35.049914 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:35.049687    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-r5xzc/must-gather-n8c46" podUID="3838bfc8-f0a2-4291-873f-18ad8924a9c9" containerName="copy" containerID="cri-o://c4a7322afcb58f04f23d2e441266529b700570376c97505f1e983e8ad659522b" gracePeriod=2
Sep 17 16:24:35.053130 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:35.053101    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-r5xzc/must-gather-n8c46"]
Sep 17 16:24:35.285156 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:35.285132    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-r5xzc_must-gather-n8c46_3838bfc8-f0a2-4291-873f-18ad8924a9c9/copy/0.log"
Sep 17 16:24:35.287702 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:35.287685    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-r5xzc/must-gather-n8c46"
Sep 17 16:24:35.290162 ip-10-0-128-191 kubenswrapper[2584]: E0917 16:24:35.290140    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-n8c46\" is forbidden: User \"system:node:ip-10-0-128-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-r5xzc\": no relationship found between node 'ip-10-0-128-191.ec2.internal' and this object" podUID="3838bfc8-f0a2-4291-873f-18ad8924a9c9" pod="openshift-must-gather-r5xzc/must-gather-n8c46"
Sep 17 16:24:35.392927 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:35.392906    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3838bfc8-f0a2-4291-873f-18ad8924a9c9-must-gather-output\") pod \"3838bfc8-f0a2-4291-873f-18ad8924a9c9\" (UID: \"3838bfc8-f0a2-4291-873f-18ad8924a9c9\") "
Sep 17 16:24:35.393044 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:35.392946    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6hc87\" (UniqueName: \"kubernetes.io/projected/3838bfc8-f0a2-4291-873f-18ad8924a9c9-kube-api-access-6hc87\") pod \"3838bfc8-f0a2-4291-873f-18ad8924a9c9\" (UID: \"3838bfc8-f0a2-4291-873f-18ad8924a9c9\") "
Sep 17 16:24:35.395016 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:35.394993    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3838bfc8-f0a2-4291-873f-18ad8924a9c9-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "3838bfc8-f0a2-4291-873f-18ad8924a9c9" (UID: "3838bfc8-f0a2-4291-873f-18ad8924a9c9"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 16:24:35.395237 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:35.395220    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3838bfc8-f0a2-4291-873f-18ad8924a9c9-kube-api-access-6hc87" (OuterVolumeSpecName: "kube-api-access-6hc87") pod "3838bfc8-f0a2-4291-873f-18ad8924a9c9" (UID: "3838bfc8-f0a2-4291-873f-18ad8924a9c9"). InnerVolumeSpecName "kube-api-access-6hc87". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 16:24:35.494098 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:35.494070    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6hc87\" (UniqueName: \"kubernetes.io/projected/3838bfc8-f0a2-4291-873f-18ad8924a9c9-kube-api-access-6hc87\") on node \"ip-10-0-128-191.ec2.internal\" DevicePath \"\""
Sep 17 16:24:35.494098 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:35.494092    2584 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3838bfc8-f0a2-4291-873f-18ad8924a9c9-must-gather-output\") on node \"ip-10-0-128-191.ec2.internal\" DevicePath \"\""
Sep 17 16:24:35.891535 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:35.891487    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-r5xzc_must-gather-n8c46_3838bfc8-f0a2-4291-873f-18ad8924a9c9/copy/0.log"
Sep 17 16:24:35.891934 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:35.891908    2584 generic.go:356] "Generic (PLEG): container finished" podID="3838bfc8-f0a2-4291-873f-18ad8924a9c9" containerID="c4a7322afcb58f04f23d2e441266529b700570376c97505f1e983e8ad659522b" exitCode=143
Sep 17 16:24:35.892029 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:35.891955    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-r5xzc/must-gather-n8c46"
Sep 17 16:24:35.892029 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:35.891970    2584 scope.go:117] "RemoveContainer" containerID="c4a7322afcb58f04f23d2e441266529b700570376c97505f1e983e8ad659522b"
Sep 17 16:24:35.894447 ip-10-0-128-191 kubenswrapper[2584]: E0917 16:24:35.894419    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-n8c46\" is forbidden: User \"system:node:ip-10-0-128-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-r5xzc\": no relationship found between node 'ip-10-0-128-191.ec2.internal' and this object" podUID="3838bfc8-f0a2-4291-873f-18ad8924a9c9" pod="openshift-must-gather-r5xzc/must-gather-n8c46"
Sep 17 16:24:35.901451 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:35.901424    2584 scope.go:117] "RemoveContainer" containerID="dc7d9b1d5bb6f5736057259e9fb3a56570b8018efebc8ae14b771358b0f46816"
Sep 17 16:24:35.903546 ip-10-0-128-191 kubenswrapper[2584]: E0917 16:24:35.903512    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-n8c46\" is forbidden: User \"system:node:ip-10-0-128-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-r5xzc\": no relationship found between node 'ip-10-0-128-191.ec2.internal' and this object" podUID="3838bfc8-f0a2-4291-873f-18ad8924a9c9" pod="openshift-must-gather-r5xzc/must-gather-n8c46"
Sep 17 16:24:35.913793 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:35.913773    2584 scope.go:117] "RemoveContainer" containerID="c4a7322afcb58f04f23d2e441266529b700570376c97505f1e983e8ad659522b"
Sep 17 16:24:35.914072 ip-10-0-128-191 kubenswrapper[2584]: E0917 16:24:35.914054    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4a7322afcb58f04f23d2e441266529b700570376c97505f1e983e8ad659522b\": container with ID starting with c4a7322afcb58f04f23d2e441266529b700570376c97505f1e983e8ad659522b not found: ID does not exist" containerID="c4a7322afcb58f04f23d2e441266529b700570376c97505f1e983e8ad659522b"
Sep 17 16:24:35.914142 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:35.914080    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4a7322afcb58f04f23d2e441266529b700570376c97505f1e983e8ad659522b"} err="failed to get container status \"c4a7322afcb58f04f23d2e441266529b700570376c97505f1e983e8ad659522b\": rpc error: code = NotFound desc = could not find container \"c4a7322afcb58f04f23d2e441266529b700570376c97505f1e983e8ad659522b\": container with ID starting with c4a7322afcb58f04f23d2e441266529b700570376c97505f1e983e8ad659522b not found: ID does not exist"
Sep 17 16:24:35.914142 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:35.914097    2584 scope.go:117] "RemoveContainer" containerID="dc7d9b1d5bb6f5736057259e9fb3a56570b8018efebc8ae14b771358b0f46816"
Sep 17 16:24:35.914376 ip-10-0-128-191 kubenswrapper[2584]: E0917 16:24:35.914358    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc7d9b1d5bb6f5736057259e9fb3a56570b8018efebc8ae14b771358b0f46816\": container with ID starting with dc7d9b1d5bb6f5736057259e9fb3a56570b8018efebc8ae14b771358b0f46816 not found: ID does not exist" containerID="dc7d9b1d5bb6f5736057259e9fb3a56570b8018efebc8ae14b771358b0f46816"
Sep 17 16:24:35.914432 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:35.914381    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc7d9b1d5bb6f5736057259e9fb3a56570b8018efebc8ae14b771358b0f46816"} err="failed to get container status \"dc7d9b1d5bb6f5736057259e9fb3a56570b8018efebc8ae14b771358b0f46816\": rpc error: code = NotFound desc = could not find container \"dc7d9b1d5bb6f5736057259e9fb3a56570b8018efebc8ae14b771358b0f46816\": container with ID starting with dc7d9b1d5bb6f5736057259e9fb3a56570b8018efebc8ae14b771358b0f46816 not found: ID does not exist"
Sep 17 16:24:36.516249 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:36.516216    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3838bfc8-f0a2-4291-873f-18ad8924a9c9" path="/var/lib/kubelet/pods/3838bfc8-f0a2-4291-873f-18ad8924a9c9/volumes"
Sep 17 16:24:37.155217 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:37.155186    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-7q45d_792e2670-e133-4ad2-b739-4a11a314a37c/kube-state-metrics/0.log"
Sep 17 16:24:37.191470 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:37.191436    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-7q45d_792e2670-e133-4ad2-b739-4a11a314a37c/kube-rbac-proxy-main/0.log"
Sep 17 16:24:37.242505 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:37.242456    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-7q45d_792e2670-e133-4ad2-b739-4a11a314a37c/kube-rbac-proxy-self/0.log"
Sep 17 16:24:37.290400 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:37.290367    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-698fbc5854-jf54h_43584f09-84be-4cb8-8a5f-5398bcad4c74/metrics-server/0.log"
Sep 17 16:24:37.355985 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:37.355961    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-766qq_317ab750-2c95-4a60-ba94-738339edab42/node-exporter/0.log"
Sep 17 16:24:37.383142 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:37.383092    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-766qq_317ab750-2c95-4a60-ba94-738339edab42/kube-rbac-proxy/0.log"
Sep 17 16:24:37.412827 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:37.412806    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-766qq_317ab750-2c95-4a60-ba94-738339edab42/init-textfile/0.log"
Sep 17 16:24:37.807166 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:37.807143    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bf0343d0-75f3-4950-85d3-223e116316d5/prometheus/0.log"
Sep 17 16:24:37.845361 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:37.845338    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bf0343d0-75f3-4950-85d3-223e116316d5/config-reloader/0.log"
Sep 17 16:24:37.906242 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:37.906220    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bf0343d0-75f3-4950-85d3-223e116316d5/thanos-sidecar/0.log"
Sep 17 16:24:37.934483 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:37.934460    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bf0343d0-75f3-4950-85d3-223e116316d5/kube-rbac-proxy-web/0.log"
Sep 17 16:24:37.964817 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:37.964797    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bf0343d0-75f3-4950-85d3-223e116316d5/kube-rbac-proxy/0.log"
Sep 17 16:24:37.992726 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:37.992706    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bf0343d0-75f3-4950-85d3-223e116316d5/kube-rbac-proxy-thanos/0.log"
Sep 17 16:24:38.028402 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:38.028383    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bf0343d0-75f3-4950-85d3-223e116316d5/init-config-reloader/0.log"
Sep 17 16:24:38.062813 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:38.062793    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-s2vgq_8afb0437-a7da-41aa-b723-60b16f938e25/prometheus-operator/0.log"
Sep 17 16:24:38.089100 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:38.089082    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-s2vgq_8afb0437-a7da-41aa-b723-60b16f938e25/kube-rbac-proxy/0.log"
Sep 17 16:24:40.850177 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:40.850152    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6594f4c75-pb7nf_18bcc485-4178-40a4-b51d-0ec2d8ef2430/download-server/0.log"
Sep 17 16:24:41.129075 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:41.129004    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vp8j5/perf-node-gather-daemonset-r2sdm"]
Sep 17 16:24:41.129311 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:41.129299    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3838bfc8-f0a2-4291-873f-18ad8924a9c9" containerName="gather"
Sep 17 16:24:41.129370 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:41.129313    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="3838bfc8-f0a2-4291-873f-18ad8924a9c9" containerName="gather"
Sep 17 16:24:41.129370 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:41.129327    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3838bfc8-f0a2-4291-873f-18ad8924a9c9" containerName="copy"
Sep 17 16:24:41.129370 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:41.129333    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="3838bfc8-f0a2-4291-873f-18ad8924a9c9" containerName="copy"
Sep 17 16:24:41.129475 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:41.129385    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="3838bfc8-f0a2-4291-873f-18ad8924a9c9" containerName="copy"
Sep 17 16:24:41.129475 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:41.129394    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="3838bfc8-f0a2-4291-873f-18ad8924a9c9" containerName="gather"
Sep 17 16:24:41.134173 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:41.134157    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vp8j5/perf-node-gather-daemonset-r2sdm"
Sep 17 16:24:41.137206 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:41.137187    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vp8j5\"/\"kube-root-ca.crt\""
Sep 17 16:24:41.137306 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:41.137252    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vp8j5\"/\"openshift-service-ca.crt\""
Sep 17 16:24:41.138010 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:41.137994    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-vp8j5\"/\"default-dockercfg-lbwkw\""
Sep 17 16:24:41.145876 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:41.145852    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vp8j5/perf-node-gather-daemonset-r2sdm"]
Sep 17 16:24:41.238878 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:41.238843    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9ec6ddb0-709f-4ca7-9825-b41de5343f5e-podres\") pod \"perf-node-gather-daemonset-r2sdm\" (UID: \"9ec6ddb0-709f-4ca7-9825-b41de5343f5e\") " pod="openshift-must-gather-vp8j5/perf-node-gather-daemonset-r2sdm"
Sep 17 16:24:41.238878 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:41.238881    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9ec6ddb0-709f-4ca7-9825-b41de5343f5e-lib-modules\") pod \"perf-node-gather-daemonset-r2sdm\" (UID: \"9ec6ddb0-709f-4ca7-9825-b41de5343f5e\") " pod="openshift-must-gather-vp8j5/perf-node-gather-daemonset-r2sdm"
Sep 17 16:24:41.239056 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:41.238909    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9ec6ddb0-709f-4ca7-9825-b41de5343f5e-sys\") pod \"perf-node-gather-daemonset-r2sdm\" (UID: \"9ec6ddb0-709f-4ca7-9825-b41de5343f5e\") " pod="openshift-must-gather-vp8j5/perf-node-gather-daemonset-r2sdm"
Sep 17 16:24:41.239056 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:41.238965    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9ec6ddb0-709f-4ca7-9825-b41de5343f5e-proc\") pod \"perf-node-gather-daemonset-r2sdm\" (UID: \"9ec6ddb0-709f-4ca7-9825-b41de5343f5e\") " pod="openshift-must-gather-vp8j5/perf-node-gather-daemonset-r2sdm"
Sep 17 16:24:41.239056 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:41.239011    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25499\" (UniqueName: \"kubernetes.io/projected/9ec6ddb0-709f-4ca7-9825-b41de5343f5e-kube-api-access-25499\") pod \"perf-node-gather-daemonset-r2sdm\" (UID: \"9ec6ddb0-709f-4ca7-9825-b41de5343f5e\") " pod="openshift-must-gather-vp8j5/perf-node-gather-daemonset-r2sdm"
Sep 17 16:24:41.339804 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:41.339778    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9ec6ddb0-709f-4ca7-9825-b41de5343f5e-proc\") pod \"perf-node-gather-daemonset-r2sdm\" (UID: \"9ec6ddb0-709f-4ca7-9825-b41de5343f5e\") " pod="openshift-must-gather-vp8j5/perf-node-gather-daemonset-r2sdm"
Sep 17 16:24:41.339885 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:41.339821    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25499\" (UniqueName: \"kubernetes.io/projected/9ec6ddb0-709f-4ca7-9825-b41de5343f5e-kube-api-access-25499\") pod \"perf-node-gather-daemonset-r2sdm\" (UID: \"9ec6ddb0-709f-4ca7-9825-b41de5343f5e\") " pod="openshift-must-gather-vp8j5/perf-node-gather-daemonset-r2sdm"
Sep 17 16:24:41.339885 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:41.339848    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9ec6ddb0-709f-4ca7-9825-b41de5343f5e-podres\") pod \"perf-node-gather-daemonset-r2sdm\" (UID: \"9ec6ddb0-709f-4ca7-9825-b41de5343f5e\") " pod="openshift-must-gather-vp8j5/perf-node-gather-daemonset-r2sdm"
Sep 17 16:24:41.339885 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:41.339877    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9ec6ddb0-709f-4ca7-9825-b41de5343f5e-lib-modules\") pod \"perf-node-gather-daemonset-r2sdm\" (UID: \"9ec6ddb0-709f-4ca7-9825-b41de5343f5e\") " pod="openshift-must-gather-vp8j5/perf-node-gather-daemonset-r2sdm"
Sep 17 16:24:41.339992 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:41.339904    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9ec6ddb0-709f-4ca7-9825-b41de5343f5e-proc\") pod \"perf-node-gather-daemonset-r2sdm\" (UID: \"9ec6ddb0-709f-4ca7-9825-b41de5343f5e\") " pod="openshift-must-gather-vp8j5/perf-node-gather-daemonset-r2sdm"
Sep 17 16:24:41.339992 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:41.339916    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9ec6ddb0-709f-4ca7-9825-b41de5343f5e-sys\") pod \"perf-node-gather-daemonset-r2sdm\" (UID: \"9ec6ddb0-709f-4ca7-9825-b41de5343f5e\") " pod="openshift-must-gather-vp8j5/perf-node-gather-daemonset-r2sdm"
Sep 17 16:24:41.339992 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:41.339961    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9ec6ddb0-709f-4ca7-9825-b41de5343f5e-sys\") pod \"perf-node-gather-daemonset-r2sdm\" (UID: \"9ec6ddb0-709f-4ca7-9825-b41de5343f5e\") " pod="openshift-must-gather-vp8j5/perf-node-gather-daemonset-r2sdm"
Sep 17 16:24:41.340108 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:41.339989    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9ec6ddb0-709f-4ca7-9825-b41de5343f5e-podres\") pod \"perf-node-gather-daemonset-r2sdm\" (UID: \"9ec6ddb0-709f-4ca7-9825-b41de5343f5e\") " pod="openshift-must-gather-vp8j5/perf-node-gather-daemonset-r2sdm"
Sep 17 16:24:41.340108 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:41.340044    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9ec6ddb0-709f-4ca7-9825-b41de5343f5e-lib-modules\") pod \"perf-node-gather-daemonset-r2sdm\" (UID: \"9ec6ddb0-709f-4ca7-9825-b41de5343f5e\") " pod="openshift-must-gather-vp8j5/perf-node-gather-daemonset-r2sdm"
Sep 17 16:24:41.357952 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:41.357930    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-25499\" (UniqueName: \"kubernetes.io/projected/9ec6ddb0-709f-4ca7-9825-b41de5343f5e-kube-api-access-25499\") pod \"perf-node-gather-daemonset-r2sdm\" (UID: \"9ec6ddb0-709f-4ca7-9825-b41de5343f5e\") " pod="openshift-must-gather-vp8j5/perf-node-gather-daemonset-r2sdm"
Sep 17 16:24:41.444119 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:41.444088    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vp8j5/perf-node-gather-daemonset-r2sdm"
Sep 17 16:24:41.544157 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:41.544130    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5c4db8bdf9-mxggm_7b599201-0bbd-4686-a57c-d10286df77ba/volume-data-source-validator/0.log"
Sep 17 16:24:41.718291 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:41.718264    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vp8j5/perf-node-gather-daemonset-r2sdm"]
Sep 17 16:24:41.720925 ip-10-0-128-191 kubenswrapper[2584]: W0917 16:24:41.720896    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9ec6ddb0_709f_4ca7_9825_b41de5343f5e.slice/crio-a36b1cd8d21e3dcfea83b2a0bd499645033e606e3ee0c1570e77469409647456 WatchSource:0}: Error finding container a36b1cd8d21e3dcfea83b2a0bd499645033e606e3ee0c1570e77469409647456: Status 404 returned error can't find the container with id a36b1cd8d21e3dcfea83b2a0bd499645033e606e3ee0c1570e77469409647456
Sep 17 16:24:41.916639 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:41.916602    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vp8j5/perf-node-gather-daemonset-r2sdm" event={"ID":"9ec6ddb0-709f-4ca7-9825-b41de5343f5e","Type":"ContainerStarted","Data":"8fd907b13a8a077b620dc215b68fc2e7712d53c217486ba76ea9ef90ee3464c9"}
Sep 17 16:24:41.917017 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:41.916653    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vp8j5/perf-node-gather-daemonset-r2sdm" event={"ID":"9ec6ddb0-709f-4ca7-9825-b41de5343f5e","Type":"ContainerStarted","Data":"a36b1cd8d21e3dcfea83b2a0bd499645033e606e3ee0c1570e77469409647456"}
Sep 17 16:24:41.917017 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:41.916751    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-vp8j5/perf-node-gather-daemonset-r2sdm"
Sep 17 16:24:41.934616 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:41.934519    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vp8j5/perf-node-gather-daemonset-r2sdm" podStartSLOduration=0.934474205 podStartE2EDuration="934.474205ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:24:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:24:41.93345533 +0000 UTC m=+1799.547386841" watchObservedRunningTime="2026-09-17 16:24:41.934474205 +0000 UTC m=+1799.548405717"
Sep 17 16:24:42.580699 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:42.580671    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-f4g57_4ef9814f-616a-47e8-b1b2-7994485705f0/dns/0.log"
Sep 17 16:24:42.607101 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:42.607077    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-f4g57_4ef9814f-616a-47e8-b1b2-7994485705f0/kube-rbac-proxy/0.log"
Sep 17 16:24:42.734650 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:42.734622    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-x4mhf_b9fd9b22-055f-4540-92c9-6c75c0c14fe3/dns-node-resolver/0.log"
Sep 17 16:24:43.292811 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:43.292776    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9f2dg_d7d3c798-4b01-4814-8e5c-c200c69dca8f/node-ca/0.log"
Sep 17 16:24:44.144299 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:44.144270    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-69d9cc557b-99lzw_ed6896ba-27eb-4ba3-a9df-bdb614fca6c1/router/0.log"
Sep 17 16:24:44.511453 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:44.511376    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-h84cz_d6dfa59f-620e-4edf-a630-d1e1dad50650/serve-healthcheck-canary/0.log"
Sep 17 16:24:44.961936 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:44.961909    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-72tfl_753ea6fe-3f4b-4449-9be0-e35dcd8601b0/kube-rbac-proxy/0.log"
Sep 17 16:24:44.982595 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:44.982573    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-72tfl_753ea6fe-3f4b-4449-9be0-e35dcd8601b0/exporter/0.log"
Sep 17 16:24:45.005358 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:45.005339    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-72tfl_753ea6fe-3f4b-4449-9be0-e35dcd8601b0/extractor/0.log"
Sep 17 16:24:47.870975 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:47.870942    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-qwns4_1489cb8e-d55a-4d7a-a397-1e6ead376e44/s3-init/0.log"
Sep 17 16:24:47.888083 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:47.888061    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-qwns4_1489cb8e-d55a-4d7a-a397-1e6ead376e44/download-hf-model/0.log"
Sep 17 16:24:47.930333 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:47.930313    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-vp8j5/perf-node-gather-daemonset-r2sdm"
Sep 17 16:24:52.405226 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:52.405189    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-s9tlv_c896a89e-55eb-4a94-b771-3d767805c68d/migrator/0.log"
Sep 17 16:24:52.434590 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:52.434562    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-s9tlv_c896a89e-55eb-4a94-b771-3d767805c68d/graceful-termination/0.log"
Sep 17 16:24:53.879638 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:53.879606    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bjftc_df579004-3b28-44fd-ac97-05faf9b54dad/kube-multus-additional-cni-plugins/0.log"
Sep 17 16:24:53.902094 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:53.902035    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bjftc_df579004-3b28-44fd-ac97-05faf9b54dad/egress-router-binary-copy/0.log"
Sep 17 16:24:53.924071 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:53.924053    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bjftc_df579004-3b28-44fd-ac97-05faf9b54dad/cni-plugins/0.log"
Sep 17 16:24:53.946861 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:53.946838    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bjftc_df579004-3b28-44fd-ac97-05faf9b54dad/bond-cni-plugin/0.log"
Sep 17 16:24:53.968962 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:53.968939    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bjftc_df579004-3b28-44fd-ac97-05faf9b54dad/routeoverride-cni/0.log"
Sep 17 16:24:53.991692 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:53.991676    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bjftc_df579004-3b28-44fd-ac97-05faf9b54dad/whereabouts-cni-bincopy/0.log"
Sep 17 16:24:54.017344 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:54.017326    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bjftc_df579004-3b28-44fd-ac97-05faf9b54dad/whereabouts-cni/0.log"
Sep 17 16:24:54.419337 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:54.419313    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-fpptq_ffe5f446-e608-459a-90f3-de1bcccba341/kube-multus/0.log"
Sep 17 16:24:54.482154 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:54.482107    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-nldm2_b550e969-e4dd-4602-8d26-4a6275359d68/network-metrics-daemon/0.log"
Sep 17 16:24:54.514455 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:54.514433    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-nldm2_b550e969-e4dd-4602-8d26-4a6275359d68/kube-rbac-proxy/0.log"
Sep 17 16:24:55.964809 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:55.964782    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z8nmw_54d8c06c-72e7-4b77-b3b2-6698b7653944/ovn-controller/0.log"
Sep 17 16:24:55.996454 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:55.996431    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z8nmw_54d8c06c-72e7-4b77-b3b2-6698b7653944/ovn-acl-logging/0.log"
Sep 17 16:24:56.028196 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:56.028177    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z8nmw_54d8c06c-72e7-4b77-b3b2-6698b7653944/kube-rbac-proxy-node/0.log"
Sep 17 16:24:56.060059 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:56.060037    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z8nmw_54d8c06c-72e7-4b77-b3b2-6698b7653944/kube-rbac-proxy-ovn-metrics/0.log"
Sep 17 16:24:56.084743 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:56.084720    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z8nmw_54d8c06c-72e7-4b77-b3b2-6698b7653944/northd/0.log"
Sep 17 16:24:56.108969 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:56.108943    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z8nmw_54d8c06c-72e7-4b77-b3b2-6698b7653944/nbdb/0.log"
Sep 17 16:24:56.138855 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:56.138838    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z8nmw_54d8c06c-72e7-4b77-b3b2-6698b7653944/sbdb/0.log"
Sep 17 16:24:56.183104 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:56.183071    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z8nmw_54d8c06c-72e7-4b77-b3b2-6698b7653944/ovnkube-controller/0.log"
Sep 17 16:24:57.283366 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:57.283326    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-gg77s_34abf0a1-5178-487d-93af-577b29705d96/network-check-target-container/0.log"
Sep 17 16:24:58.373236 ip-10-0-128-191 kubenswrapper[2584]: I0917 16:24:58.373207    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-hp2s4_d28f991c-888d-4396-8c52-e7dcb503799c/iptables-alerter/0.log"