Sep 15 16:24:44.243284 ip-10-0-128-222 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 15 16:24:44.243441 ip-10-0-128-222 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 15 16:24:44.243537 ip-10-0-128-222 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 15 16:24:44.244019 ip-10-0-128-222 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 15 16:24:54.350794 ip-10-0-128-222 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 15 16:24:54.350806 ip-10-0-128-222 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot f82a87030a1f4730998861505eb15e11 --
Sep 15 16:26:46.620445 ip-10-0-128-222 systemd[1]: Starting Kubernetes Kubelet...
Sep 15 16:26:46.981552 ip-10-0-128-222 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 16:26:46.981552 ip-10-0-128-222 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 15 16:26:46.981552 ip-10-0-128-222 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 16:26:46.981552 ip-10-0-128-222 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 15 16:26:46.981552 ip-10-0-128-222 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 16:26:46.983294 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.983182    2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 15 16:26:46.989153 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989126    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 16:26:46.989153 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989147    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 16:26:46.989153 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989152    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 16:26:46.989153 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989156    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 16:26:46.989153 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989159    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 16:26:46.989153 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989163    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 16:26:46.989398 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989166    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 16:26:46.989398 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989169    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 16:26:46.989398 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989172    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 16:26:46.989398 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989175    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 16:26:46.989398 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989178    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 16:26:46.989398 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989180    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 16:26:46.989398 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989183    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 16:26:46.989398 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989185    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 16:26:46.989398 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989201    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 16:26:46.989398 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989204    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 16:26:46.989398 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989207    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 16:26:46.989398 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989210    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 16:26:46.989398 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989212    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 16:26:46.989398 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989215    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 16:26:46.989398 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989218    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 16:26:46.989398 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989220    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 16:26:46.989398 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989223    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 16:26:46.989398 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989226    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 16:26:46.989398 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989228    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 16:26:46.989398 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989230    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 16:26:46.989862 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989233    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 16:26:46.989862 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989236    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 16:26:46.989862 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989238    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 16:26:46.989862 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989241    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 16:26:46.989862 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989244    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 16:26:46.989862 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989246    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 16:26:46.989862 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989254    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 16:26:46.989862 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989256    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 16:26:46.989862 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989259    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 16:26:46.989862 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989262    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 16:26:46.989862 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989264    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 16:26:46.989862 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989267    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 16:26:46.989862 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989269    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 16:26:46.989862 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989272    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 16:26:46.989862 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989275    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 16:26:46.989862 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989278    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 16:26:46.989862 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989280    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 16:26:46.989862 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989283    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 16:26:46.989862 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989285    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 16:26:46.989862 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989288    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 16:26:46.990385 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989291    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 16:26:46.990385 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989294    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 16:26:46.990385 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989296    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 16:26:46.990385 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989299    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 16:26:46.990385 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989301    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 16:26:46.990385 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989304    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 16:26:46.990385 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989306    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 16:26:46.990385 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989309    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 16:26:46.990385 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989312    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 16:26:46.990385 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989315    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 16:26:46.990385 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989318    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 16:26:46.990385 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989322    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 16:26:46.990385 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989327    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 16:26:46.990385 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989330    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 16:26:46.990385 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989333    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 16:26:46.990385 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989336    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 16:26:46.990385 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989339    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 16:26:46.990385 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989341    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 16:26:46.990385 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989344    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 16:26:46.990823 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989347    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 16:26:46.990823 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989349    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 16:26:46.990823 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989351    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 16:26:46.990823 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989354    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 16:26:46.990823 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989356    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 16:26:46.990823 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989359    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 16:26:46.990823 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989367    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 16:26:46.990823 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989370    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 16:26:46.990823 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989373    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 16:26:46.990823 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989375    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 16:26:46.990823 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989378    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 16:26:46.990823 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989381    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 16:26:46.990823 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989383    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 16:26:46.990823 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989386    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 16:26:46.990823 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989388    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 16:26:46.990823 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989391    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 16:26:46.990823 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989393    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 16:26:46.990823 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989397    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 16:26:46.990823 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989402    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 16:26:46.991305 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989406    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 16:26:46.991305 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989410    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 16:26:46.991305 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989413    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 16:26:46.991305 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989416    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 16:26:46.991305 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989418    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 16:26:46.991305 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989421    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 16:26:46.991305 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989424    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 16:26:46.991305 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989426    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 16:26:46.991305 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989429    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 16:26:46.991305 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989432    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 16:26:46.991305 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989435    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 16:26:46.991305 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989437    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 16:26:46.991305 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989440    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 16:26:46.991305 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989443    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 16:26:46.991305 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.989445    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 16:26:46.991305 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.990895    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 16:26:46.991305 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.990902    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 16:26:46.991305 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.990905    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 16:26:46.991305 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.990909    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 16:26:46.991751 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.990911    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 16:26:46.991751 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.990914    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 16:26:46.991751 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.990917    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 16:26:46.991751 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.990920    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 16:26:46.991751 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.990922    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 16:26:46.991751 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.990924    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 16:26:46.991751 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.990927    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 16:26:46.991751 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.990930    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 16:26:46.991751 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.990932    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 16:26:46.991751 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.990935    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 16:26:46.991751 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.990938    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 16:26:46.991751 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.990940    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 16:26:46.991751 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.990943    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 16:26:46.991751 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.990946    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 16:26:46.991751 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.990950    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 16:26:46.991751 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.990953    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 16:26:46.991751 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.990957    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 16:26:46.991751 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.990962    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 16:26:46.991751 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.990966    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 16:26:46.992277 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.990969    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 16:26:46.992277 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.990972    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 16:26:46.992277 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.990975    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 16:26:46.992277 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.990978    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 16:26:46.992277 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.990981    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 16:26:46.992277 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.990984    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 16:26:46.992277 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.990987    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 16:26:46.992277 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.990990    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 16:26:46.992277 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.990993    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 16:26:46.992277 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.990995    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 16:26:46.992277 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.990998    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 16:26:46.992277 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991001    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 16:26:46.992277 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991004    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 16:26:46.992277 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991008    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 16:26:46.992277 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991011    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 16:26:46.992277 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991013    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 16:26:46.992277 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991016    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 16:26:46.992277 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991018    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 16:26:46.992277 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991021    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 16:26:46.992277 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991023    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 16:26:46.992772 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991026    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 16:26:46.992772 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991029    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 16:26:46.992772 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991032    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 16:26:46.992772 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991034    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 16:26:46.992772 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991037    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 16:26:46.992772 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991039    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 16:26:46.992772 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991042    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 16:26:46.992772 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991046    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 16:26:46.992772 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991048    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 16:26:46.992772 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991051    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 16:26:46.992772 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991054    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 16:26:46.992772 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991056    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 16:26:46.992772 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991059    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 16:26:46.992772 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991062    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 16:26:46.992772 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991064    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 16:26:46.992772 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991067    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 16:26:46.992772 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991069    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 16:26:46.992772 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991072    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 16:26:46.992772 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991074    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 16:26:46.992772 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991077    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 16:26:46.993285 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991079    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 16:26:46.993285 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991082    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 16:26:46.993285 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991086    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 16:26:46.993285 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991089    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 16:26:46.993285 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991092    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 16:26:46.993285 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991095    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 16:26:46.993285 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991098    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 16:26:46.993285 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991100    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 16:26:46.993285 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991104    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 16:26:46.993285 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991106    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 16:26:46.993285 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991108    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 16:26:46.993285 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991111    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 16:26:46.993285 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991114    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 16:26:46.993285 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991116    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 16:26:46.993285 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991119    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 16:26:46.993285 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991122    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 16:26:46.993285 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991124    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 16:26:46.993285 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991126    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 16:26:46.993285 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991129    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 16:26:46.993285 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991132    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 16:26:46.993780 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991135    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 16:26:46.993780 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991138    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 16:26:46.993780 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991140    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 16:26:46.993780 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991143    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 16:26:46.993780 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991146    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 16:26:46.993780 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991148    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 16:26:46.993780 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991151    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 16:26:46.993780 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991153    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 16:26:46.993780 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991156    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 16:26:46.993780 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991158    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 16:26:46.993780 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991161    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 16:26:46.993780 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991163    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 16:26:46.993780 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991166    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 16:26:46.993780 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991168    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 16:26:46.993780 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991171    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 16:26:46.993780 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991173    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 16:26:46.993780 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991596    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 16:26:46.993780 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991601    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 16:26:46.993780 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991604    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 16:26:46.993780 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991607    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 16:26:46.994301 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991609    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 16:26:46.994301 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991612    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 16:26:46.994301 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991614    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 16:26:46.994301 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991617    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 16:26:46.994301 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991620    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 16:26:46.994301 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991622    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 16:26:46.994301 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991625    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 16:26:46.994301 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991627    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 16:26:46.994301 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991630    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 16:26:46.994301 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991633    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 16:26:46.994301 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991636    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 16:26:46.994301 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991639    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 16:26:46.994301 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991642    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 16:26:46.994301 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991645    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 16:26:46.994301 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991648    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 16:26:46.994301 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991650    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 16:26:46.994301 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991653    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 16:26:46.994301 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991656    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 16:26:46.994301 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991659    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 16:26:46.994301 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991661    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 16:26:46.994811 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991664    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 16:26:46.994811 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991666    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 16:26:46.994811 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991668    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 16:26:46.994811 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991671    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 16:26:46.994811 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991673    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 16:26:46.994811 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991676    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 16:26:46.994811 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991678    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 16:26:46.994811 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991681    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 16:26:46.994811 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991684    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 16:26:46.994811 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991686    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 16:26:46.994811 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991688    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 16:26:46.994811 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991691    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 16:26:46.994811 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991693    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 16:26:46.994811 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991696    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 16:26:46.994811 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991698    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 16:26:46.994811 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991701    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 16:26:46.994811 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991703    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 16:26:46.994811 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991707    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 16:26:46.994811 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991711    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 16:26:46.995281 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991714    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 16:26:46.995281 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991716    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 16:26:46.995281 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991721    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 16:26:46.995281 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991724    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 16:26:46.995281 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991729    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 16:26:46.995281 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991731    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 16:26:46.995281 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991734    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 16:26:46.995281 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991737    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 16:26:46.995281 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991740    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 16:26:46.995281 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991742    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 16:26:46.995281 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991745    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 16:26:46.995281 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991747    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 16:26:46.995281 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991750    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 16:26:46.995281 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991754    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 16:26:46.995281 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991757    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 16:26:46.995281 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991759    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 16:26:46.995281 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991762    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 16:26:46.995281 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991765    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 16:26:46.995281 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991767    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 16:26:46.995281 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991769    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 16:26:46.995763 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991772    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 16:26:46.995763 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991774    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 16:26:46.995763 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991777    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 16:26:46.995763 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991779    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 16:26:46.995763 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991782    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 16:26:46.995763 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991784    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 16:26:46.995763 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991787    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 16:26:46.995763 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991789    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 16:26:46.995763 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991792    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 16:26:46.995763 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991794    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 16:26:46.995763 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991797    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 16:26:46.995763 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991800    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 16:26:46.995763 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991803    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 16:26:46.995763 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991805    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 16:26:46.995763 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991809    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 16:26:46.995763 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991811    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 16:26:46.995763 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991814    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 16:26:46.995763 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991817    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 16:26:46.995763 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991821    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 16:26:46.996260 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991825    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 16:26:46.996260 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991828    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 16:26:46.996260 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991831    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 16:26:46.996260 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991834    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 16:26:46.996260 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991837    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 16:26:46.996260 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991839    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 16:26:46.996260 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991842    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 16:26:46.996260 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991844    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 16:26:46.996260 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991847    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 16:26:46.996260 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991849    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 16:26:46.996260 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991852    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 16:26:46.996260 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991854    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 16:26:46.996260 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991857    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 16:26:46.996260 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991859    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 16:26:46.996260 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991861    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 16:26:46.996260 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991864    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 16:26:46.996260 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.991866    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 16:26:46.996260 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.991942    2577 flags.go:64] FLAG: --address="0.0.0.0"
Sep 15 16:26:46.996260 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.991977    2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 15 16:26:46.996260 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.991984    2577 flags.go:64] FLAG: --anonymous-auth="true"
Sep 15 16:26:46.996260 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.991988    2577 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 15 16:26:46.996774 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.991992    2577 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 15 16:26:46.996774 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.991995    2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 15 16:26:46.996774 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.991999    2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 15 16:26:46.996774 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992003    2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 15 16:26:46.996774 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992006    2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 15 16:26:46.996774 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992009    2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 15 16:26:46.996774 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992014    2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 15 16:26:46.996774 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992018    2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 15 16:26:46.996774 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992021    2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 15 16:26:46.996774 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992024    2577 flags.go:64] FLAG: --cgroup-root=""
Sep 15 16:26:46.996774 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992027    2577 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 15 16:26:46.996774 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992030    2577 flags.go:64] FLAG: --client-ca-file=""
Sep 15 16:26:46.996774 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992033    2577 flags.go:64] FLAG: --cloud-provider="external"
Sep 15 16:26:46.996774 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992036    2577 flags.go:64] FLAG: --cluster-dns="[]"
Sep 15 16:26:46.996774 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992040    2577 flags.go:64] FLAG: --cluster-domain=""
Sep 15 16:26:46.996774 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992043    2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 15 16:26:46.996774 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992046    2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 15 16:26:46.996774 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992049    2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 15 16:26:46.996774 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992052    2577 flags.go:64] FLAG: --container-log-max-files="5"
Sep 15 16:26:46.996774 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992056    2577 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 15 16:26:46.996774 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992059    2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 15 16:26:46.996774 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992062    2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 15 16:26:46.996774 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992065    2577 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 15 16:26:46.997353 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992068    2577 flags.go:64] FLAG: --contention-profiling="false"
Sep 15 16:26:46.997353 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992071    2577 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 15 16:26:46.997353 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992074    2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 15 16:26:46.997353 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992077    2577 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 15 16:26:46.997353 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992080    2577 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 15 16:26:46.997353 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992084    2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 15 16:26:46.997353 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992087    2577 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 15 16:26:46.997353 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992090    2577 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 15 16:26:46.997353 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992093    2577 flags.go:64] FLAG: --enable-load-reader="false"
Sep 15 16:26:46.997353 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992096    2577 flags.go:64] FLAG: --enable-server="true"
Sep 15 16:26:46.997353 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992099    2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 15 16:26:46.997353 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992104    2577 flags.go:64] FLAG: --event-burst="100"
Sep 15 16:26:46.997353 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992107    2577 flags.go:64] FLAG: --event-qps="50"
Sep 15 16:26:46.997353 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992109    2577 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 15 16:26:46.997353 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992112    2577 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 15 16:26:46.997353 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992117    2577 flags.go:64] FLAG: --eviction-hard=""
Sep 15 16:26:46.997353 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992120    2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 15 16:26:46.997353 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992124    2577 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 15 16:26:46.997353 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992127    2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 15 16:26:46.997353 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992129    2577 flags.go:64] FLAG: --eviction-soft=""
Sep 15 16:26:46.997353 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992132    2577 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 15 16:26:46.997353 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992135    2577 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 15 16:26:46.997353 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992139    2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 15 16:26:46.997353 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992142    2577 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 15 16:26:46.997353 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992145    2577 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 15 16:26:46.997964 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992148    2577 flags.go:64] FLAG: --fail-swap-on="true"
Sep 15 16:26:46.997964 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992151    2577 flags.go:64] FLAG: --feature-gates=""
Sep 15 16:26:46.997964 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992155    2577 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 15 16:26:46.997964 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992157    2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 15 16:26:46.997964 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992160    2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 15 16:26:46.997964 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992163    2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 15 16:26:46.997964 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992166    2577 flags.go:64] FLAG: --healthz-port="10248"
Sep 15 16:26:46.997964 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992169    2577 flags.go:64] FLAG: --help="false"
Sep 15 16:26:46.997964 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992172    2577 flags.go:64] FLAG: --hostname-override="ip-10-0-128-222.ec2.internal"
Sep 15 16:26:46.997964 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992175    2577 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 15 16:26:46.997964 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992178    2577 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 15 16:26:46.997964 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992180    2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 15 16:26:46.997964 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992184    2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 15 16:26:46.997964 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992204    2577 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 15 16:26:46.997964 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992208    2577 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 15 16:26:46.997964 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992211    2577 flags.go:64] FLAG: --image-service-endpoint=""
Sep 15 16:26:46.997964 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992214    2577 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 15 16:26:46.997964 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992217    2577 flags.go:64] FLAG: --kube-api-burst="100"
Sep 15 16:26:46.997964 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992220    2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 15 16:26:46.997964 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992223    2577 flags.go:64] FLAG: --kube-api-qps="50"
Sep 15 16:26:46.997964 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992226    2577 flags.go:64] FLAG: --kube-reserved=""
Sep 15 16:26:46.997964 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992228    2577 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 15 16:26:46.997964 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992233    2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 15 16:26:46.997964 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992236    2577 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 15 16:26:46.998563 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992241    2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 15 16:26:46.998563 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992244    2577 flags.go:64] FLAG: --lock-file=""
Sep 15 16:26:46.998563 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992246    2577 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 15 16:26:46.998563 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992249    2577 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 15 16:26:46.998563 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992252    2577 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 15 16:26:46.998563 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992258    2577 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 15 16:26:46.998563 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992261    2577 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 15 16:26:46.998563 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992264    2577 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 15 16:26:46.998563 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992267    2577 flags.go:64] FLAG: --logging-format="text"
Sep 15 16:26:46.998563 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992270    2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 15 16:26:46.998563 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992273    2577 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 15 16:26:46.998563 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992276    2577 flags.go:64] FLAG: --manifest-url=""
Sep 15 16:26:46.998563 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992279    2577 flags.go:64] FLAG: --manifest-url-header=""
Sep 15 16:26:46.998563 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992283    2577 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 15 16:26:46.998563 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992287    2577 flags.go:64] FLAG: --max-open-files="1000000"
Sep 15 16:26:46.998563 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992291    2577 flags.go:64] FLAG: --max-pods="110"
Sep 15 16:26:46.998563 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992294    2577 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 15 16:26:46.998563 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992297    2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 15 16:26:46.998563 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992300    2577 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 15 16:26:46.998563 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992303    2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 15 16:26:46.998563 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992306    2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 15 16:26:46.998563 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992309    2577 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 15 16:26:46.998563 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992312    2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 15 16:26:46.998563 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992319    2577 flags.go:64] FLAG: --node-status-max-images="50"
Sep 15 16:26:46.998563 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992322    2577 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 15 16:26:46.999202 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992325    2577 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 15 16:26:46.999202 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992328    2577 flags.go:64] FLAG: --pod-cidr=""
Sep 15 16:26:46.999202 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992331    2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 15 16:26:46.999202 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992336    2577 flags.go:64] FLAG: --pod-manifest-path=""
Sep 15 16:26:46.999202 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992339    2577 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 15 16:26:46.999202 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992342    2577 flags.go:64] FLAG: --pods-per-core="0"
Sep 15 16:26:46.999202 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992346    2577 flags.go:64] FLAG: --port="10250"
Sep 15 16:26:46.999202 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992350    2577 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 15 16:26:46.999202 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992353    2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c9b12fd184f7fdb3"
Sep 15 16:26:46.999202 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992357    2577 flags.go:64] FLAG: --qos-reserved=""
Sep 15 16:26:46.999202 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992360    2577 flags.go:64] FLAG: --read-only-port="10255"
Sep 15 16:26:46.999202 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992363    2577 flags.go:64] FLAG: --register-node="true"
Sep 15 16:26:46.999202 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992366    2577 flags.go:64] FLAG: --register-with-taints=""
Sep 15 16:26:46.999202 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992370    2577 flags.go:64] FLAG: --registry-burst="10"
Sep 15 16:26:46.999202 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992373    2577 flags.go:64] FLAG: --registry-qps="5"
Sep 15 16:26:46.999202 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992376    2577 flags.go:64] FLAG: --reserved-cpus=""
Sep 15 16:26:46.999202 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992379    2577 flags.go:64] FLAG: --reserved-memory=""
Sep 15 16:26:46.999202 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992382    2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 15 16:26:46.999202 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992385    2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 15 16:26:46.999202 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992388    2577 flags.go:64] FLAG: --rotate-certificates="false"
Sep 15 16:26:46.999202 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992391    2577 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 15 16:26:46.999202 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992394    2577 flags.go:64] FLAG: --runonce="false"
Sep 15 16:26:46.999202 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992396    2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 15 16:26:46.999202 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992399    2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 15 16:26:46.999202 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992402    2577 flags.go:64] FLAG: --seccomp-default="false"
Sep 15 16:26:46.999866 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992405    2577 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 15 16:26:46.999866 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992408    2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 15 16:26:46.999866 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992411    2577 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 15 16:26:46.999866 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992414    2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 15 16:26:46.999866 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992417    2577 flags.go:64] FLAG: --storage-driver-password="root"
Sep 15 16:26:46.999866 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992420    2577 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 15 16:26:46.999866 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992423    2577 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 15 16:26:46.999866 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992426    2577 flags.go:64] FLAG: --storage-driver-user="root"
Sep 15 16:26:46.999866 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992428    2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 15 16:26:46.999866 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992431    2577 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 15 16:26:46.999866 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992434    2577 flags.go:64] FLAG: --system-cgroups=""
Sep 15 16:26:46.999866 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992437    2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 15 16:26:46.999866 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992443    2577 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 15 16:26:46.999866 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992447    2577 flags.go:64] FLAG: --tls-cert-file=""
Sep 15 16:26:46.999866 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992451    2577 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 15 16:26:46.999866 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992455    2577 flags.go:64] FLAG: --tls-min-version=""
Sep 15 16:26:46.999866 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992458    2577 flags.go:64] FLAG: --tls-private-key-file=""
Sep 15 16:26:46.999866 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992461    2577 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 15 16:26:46.999866 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992464    2577 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 15 16:26:46.999866 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992467    2577 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 15 16:26:46.999866 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992470    2577 flags.go:64] FLAG: --v="2"
Sep 15 16:26:46.999866 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992473    2577 flags.go:64] FLAG: --version="false"
Sep 15 16:26:46.999866 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992478    2577 flags.go:64] FLAG: --vmodule=""
Sep 15 16:26:46.999866 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992486    2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 15 16:26:46.999866 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992490    2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 15 16:26:47.000482 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992605    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 16:26:47.000482 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992608    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 16:26:47.000482 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992613    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 16:26:47.000482 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992616    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 16:26:47.000482 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992620    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 16:26:47.000482 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992623    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 16:26:47.000482 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992626    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 16:26:47.000482 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992629    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 16:26:47.000482 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992632    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 16:26:47.000482 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992634    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 16:26:47.000482 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992637    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 16:26:47.000482 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992640    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 16:26:47.000482 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992642    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 16:26:47.000482 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992645    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 16:26:47.000482 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992647    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 16:26:47.000482 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992650    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 16:26:47.000482 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992652    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 16:26:47.000482 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992655    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 16:26:47.000482 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992658    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 16:26:47.000482 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992660    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 16:26:47.000971 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992664    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 16:26:47.000971 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992668    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 16:26:47.000971 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992671    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 16:26:47.000971 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992674    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 16:26:47.000971 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992676    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 16:26:47.000971 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992679    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 16:26:47.000971 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992681    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 16:26:47.000971 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992684    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 16:26:47.000971 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992686    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 16:26:47.000971 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992689    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 16:26:47.000971 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992692    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 16:26:47.000971 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992694    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 16:26:47.000971 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992697    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 16:26:47.000971 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992699    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 16:26:47.000971 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992702    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 16:26:47.000971 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992704    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 16:26:47.000971 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992707    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 16:26:47.000971 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992709    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 16:26:47.000971 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992712    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 16:26:47.000971 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992715    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 16:26:47.001478 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992717    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 16:26:47.001478 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992720    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 16:26:47.001478 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992722    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 16:26:47.001478 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992725    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 16:26:47.001478 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992727    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 16:26:47.001478 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992730    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 16:26:47.001478 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992732    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 16:26:47.001478 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992735    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 16:26:47.001478 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992737    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 16:26:47.001478 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992740    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 16:26:47.001478 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992742    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 16:26:47.001478 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992746    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 16:26:47.001478 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992751    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 16:26:47.001478 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992754    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 16:26:47.001478 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992757    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 16:26:47.001478 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992759    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 16:26:47.001478 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992762    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 16:26:47.001478 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992765    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 16:26:47.001478 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992767    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 16:26:47.001478 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992770    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 16:26:47.001960 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992772    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 16:26:47.001960 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992775    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 16:26:47.001960 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992777    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 16:26:47.001960 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992780    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 16:26:47.001960 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992783    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 16:26:47.001960 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992786    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 16:26:47.001960 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992790    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 16:26:47.001960 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992793    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 16:26:47.001960 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992796    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 16:26:47.001960 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992799    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 16:26:47.001960 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992802    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 16:26:47.001960 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992805    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 16:26:47.001960 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992807    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 16:26:47.001960 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992810    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 16:26:47.001960 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992813    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 16:26:47.001960 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992815    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 16:26:47.001960 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992818    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 16:26:47.001960 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992820    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 16:26:47.001960 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992823    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 16:26:47.002451 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992825    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 16:26:47.002451 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992828    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 16:26:47.002451 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992830    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 16:26:47.002451 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992833    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 16:26:47.002451 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992835    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 16:26:47.002451 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992838    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 16:26:47.002451 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992842    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 16:26:47.002451 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992845    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 16:26:47.002451 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992847    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 16:26:47.002451 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992850    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 16:26:47.002451 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992852    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 16:26:47.002451 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992855    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 16:26:47.002451 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992857    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 16:26:47.002451 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992860    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 16:26:47.002451 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992863    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 16:26:47.002451 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992865    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 16:26:47.002451 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992868    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 16:26:47.002451 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992870    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 16:26:47.002451 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992873    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 16:26:47.002451 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:46.992875    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 16:26:47.002952 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:46.992881    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 16:26:47.002952 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.000644    2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 15 16:26:47.002952 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.000662    2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 15 16:26:47.002952 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.001396    2577 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 15 16:26:47.002952 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.001404    2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 15 16:26:47.002952 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001466    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 16:26:47.002952 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001473    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 16:26:47.002952 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001477    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 16:26:47.002952 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001480    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 16:26:47.002952 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001484    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 16:26:47.002952 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001486    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 16:26:47.002952 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001489    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 16:26:47.002952 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001492    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 16:26:47.002952 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001495    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 16:26:47.003354 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001498    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 16:26:47.003354 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001501    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 16:26:47.003354 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001503    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 16:26:47.003354 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001506    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 16:26:47.003354 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001509    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 16:26:47.003354 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001511    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 16:26:47.003354 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001514    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 16:26:47.003354 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001516    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 16:26:47.003354 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001519    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 16:26:47.003354 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001521    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 16:26:47.003354 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001524    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 16:26:47.003354 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001526    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 16:26:47.003354 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001529    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 16:26:47.003354 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001532    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 16:26:47.003354 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001536    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 16:26:47.003354 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001540    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 16:26:47.003354 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001543    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 16:26:47.003354 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001546    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 16:26:47.003354 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001549    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 16:26:47.003813 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001551    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 16:26:47.003813 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001555    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 16:26:47.003813 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001558    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 16:26:47.003813 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001561    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 16:26:47.003813 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001564    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 16:26:47.003813 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001568    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 16:26:47.003813 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001570    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 16:26:47.003813 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001573    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 16:26:47.003813 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001576    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 16:26:47.003813 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001579    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 16:26:47.003813 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001582    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 16:26:47.003813 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001585    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 16:26:47.003813 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001588    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 16:26:47.003813 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001590    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 16:26:47.003813 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001593    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 16:26:47.003813 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001595    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 16:26:47.003813 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001598    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 16:26:47.003813 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001600    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 16:26:47.003813 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001602    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 16:26:47.004285 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001605    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 16:26:47.004285 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001608    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 16:26:47.004285 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001610    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 16:26:47.004285 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001613    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 16:26:47.004285 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001615    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 16:26:47.004285 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001618    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 16:26:47.004285 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001621    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 16:26:47.004285 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001624    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 16:26:47.004285 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001626    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 16:26:47.004285 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001629    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 16:26:47.004285 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001632    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 16:26:47.004285 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001635    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 16:26:47.004285 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001638    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 16:26:47.004285 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001640    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 16:26:47.004285 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001643    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 16:26:47.004285 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001646    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 16:26:47.004285 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001648    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 16:26:47.004285 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001651    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 16:26:47.004285 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001653    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 16:26:47.004285 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001656    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 16:26:47.004762 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001658    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 16:26:47.004762 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001661    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 16:26:47.004762 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001664    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 16:26:47.004762 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001666    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 16:26:47.004762 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001669    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 16:26:47.004762 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001671    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 16:26:47.004762 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001674    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 16:26:47.004762 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001676    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 16:26:47.004762 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001679    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 16:26:47.004762 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001681    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 16:26:47.004762 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001683    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 16:26:47.004762 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001686    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 16:26:47.004762 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001688    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 16:26:47.004762 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001691    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 16:26:47.004762 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001693    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 16:26:47.004762 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001696    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 16:26:47.004762 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001698    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 16:26:47.004762 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001701    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 16:26:47.004762 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001704    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 16:26:47.004762 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001707    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 16:26:47.005284 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001709    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 16:26:47.005284 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001712    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 16:26:47.005284 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001714    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 16:26:47.005284 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001717    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 16:26:47.005284 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001720    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 16:26:47.005284 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001722    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 16:26:47.005284 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001725    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 16:26:47.005284 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001728    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 16:26:47.005284 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001730    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 16:26:47.005284 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001733    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 16:26:47.005284 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001735    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 16:26:47.005284 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001737    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 16:26:47.005284 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.001743    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 16:26:47.005284 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001852    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 16:26:47.005284 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001857    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 16:26:47.005773 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001860    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 16:26:47.005773 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001863    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 16:26:47.005773 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001865    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 16:26:47.005773 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001868    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 16:26:47.005773 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001871    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 16:26:47.005773 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001874    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 16:26:47.005773 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001877    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 16:26:47.005773 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001880    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 16:26:47.005773 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001883    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 16:26:47.005773 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001885    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 16:26:47.005773 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001888    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 16:26:47.005773 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001890    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 16:26:47.005773 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001893    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 16:26:47.005773 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001895    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 16:26:47.005773 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001898    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 16:26:47.005773 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001901    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 16:26:47.005773 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001903    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 16:26:47.005773 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001906    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 16:26:47.005773 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001908    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 16:26:47.005773 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001911    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 16:26:47.006304 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001913    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 16:26:47.006304 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001916    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 16:26:47.006304 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001919    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 16:26:47.006304 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001922    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 16:26:47.006304 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001924    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 16:26:47.006304 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001927    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 16:26:47.006304 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001929    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 16:26:47.006304 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001932    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 16:26:47.006304 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001934    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 16:26:47.006304 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001938    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 16:26:47.006304 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001942    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 16:26:47.006304 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001945    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 16:26:47.006304 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001947    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 16:26:47.006304 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001951    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 16:26:47.006304 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001955    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 16:26:47.006304 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001958    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 16:26:47.006304 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001961    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 16:26:47.006304 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001964    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 16:26:47.006304 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001967    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 16:26:47.006754 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001970    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 16:26:47.006754 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001972    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 16:26:47.006754 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001975    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 16:26:47.006754 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001978    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 16:26:47.006754 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001981    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 16:26:47.006754 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001983    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 16:26:47.006754 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001986    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 16:26:47.006754 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001989    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 16:26:47.006754 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001992    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 16:26:47.006754 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001995    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 16:26:47.006754 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.001997    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 16:26:47.006754 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.002000    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 16:26:47.006754 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.002002    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 16:26:47.006754 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.002004    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 16:26:47.006754 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.002007    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 16:26:47.006754 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.002010    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 16:26:47.006754 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.002013    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 16:26:47.006754 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.002016    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 16:26:47.006754 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.002018    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 16:26:47.006754 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.002021    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 16:26:47.007268 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.002023    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 16:26:47.007268 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.002025    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 16:26:47.007268 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.002028    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 16:26:47.007268 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.002030    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 16:26:47.007268 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.002033    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 16:26:47.007268 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.002035    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 16:26:47.007268 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.002038    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 16:26:47.007268 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.002040    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 16:26:47.007268 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.002042    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 16:26:47.007268 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.002045    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 16:26:47.007268 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.002047    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 16:26:47.007268 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.002050    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 16:26:47.007268 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.002052    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 16:26:47.007268 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.002055    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 16:26:47.007268 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.002057    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 16:26:47.007268 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.002060    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 16:26:47.007268 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.002062    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 16:26:47.007268 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.002064    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 16:26:47.007268 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.002067    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 16:26:47.007268 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.002070    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 16:26:47.007762 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.002072    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 16:26:47.007762 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.002075    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 16:26:47.007762 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.002077    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 16:26:47.007762 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.002080    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 16:26:47.007762 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.002082    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 16:26:47.007762 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.002084    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 16:26:47.007762 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.002087    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 16:26:47.007762 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.002089    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 16:26:47.007762 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.002093    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 16:26:47.007762 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.002095    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 16:26:47.007762 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.002098    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 16:26:47.007762 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.002100    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 16:26:47.007762 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.002103    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 16:26:47.007762 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.002105    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 16:26:47.007762 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.002109    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 16:26:47.007762 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.002111    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 16:26:47.007762 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.002114    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 16:26:47.007762 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:47.002118    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 16:26:47.008210 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.002123    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 16:26:47.008210 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.002261    2577 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 15 16:26:47.008210 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.005258    2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 15 16:26:47.008210 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.006117    2577 server.go:1019] "Starting client certificate rotation"
Sep 15 16:26:47.008210 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.006226    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 15 16:26:47.008210 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.006267    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 15 16:26:47.008523 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.008509    2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 15 16:26:47.010032 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.010009    2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 15 16:26:47.022243 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.022218    2577 log.go:25] "Validated CRI v1 runtime API"
Sep 15 16:26:47.025203 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.025170    2577 log.go:25] "Validated CRI v1 image API"
Sep 15 16:26:47.026795 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.026779    2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 15 16:26:47.029722 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.029703    2577 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 83156351-b23e-4e50-a02e-0946aff570b3:/dev/nvme0n1p3 fa28f50f-c622-4e3f-8ebf-f122d8bb1d2f:/dev/nvme0n1p4]
Sep 15 16:26:47.029765 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.029722    2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 15 16:26:47.035459 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.035352    2577 manager.go:216] Machine: {Timestamp:2026-09-15 16:26:47.033390131 +0000 UTC m=+0.300627599 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100177 MemoryCapacity:32812150784 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b4404d78055d9cc7494e697d4ebc7 SystemUUID:ec2b4404-d780-55d9-cc74-94e697d4ebc7 BootID:f82a8703-0a1f-4730-9988-61505eb15e11 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406073344 Type:vfs Inodes:4005389 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562430976 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406077440 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:d3:d3:71:9f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:d3:d3:71:9f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:36:20:70:f0:3b:58 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812150784 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 15 16:26:47.035459 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.035452    2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 15 16:26:47.035556 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.035544    2577 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 15 16:26:47.038281 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.038254    2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 15 16:26:47.038442 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.038286    2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-222.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 15 16:26:47.038731 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.038714    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 15 16:26:47.038986 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.038975    2577 topology_manager.go:138] "Creating topology manager with none policy"
Sep 15 16:26:47.039017 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.038990    2577 container_manager_linux.go:309] "Creating device plugin manager"
Sep 15 16:26:47.039017 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.039003    2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 15 16:26:47.039661 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.039651    2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 15 16:26:47.040575 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.040565    2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 15 16:26:47.044633 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.044620    2577 state_mem.go:36] "Initialized new in-memory state store"
Sep 15 16:26:47.044753 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.044744    2577 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 15 16:26:47.044785 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.044774    2577 kubelet.go:486] "Attempting to sync node with API server"
Sep 15 16:26:47.044785 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.044783    2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 15 16:26:47.044838 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.044797    2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 15 16:26:47.044838 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.044807    2577 kubelet.go:398] "Adding apiserver pod source"
Sep 15 16:26:47.044838 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.044816    2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 15 16:26:47.045221 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.045208    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 15 16:26:47.045260 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.045230    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 15 16:26:47.047375 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.047357    2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 15 16:26:47.049893 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.049879    2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 15 16:26:47.049955 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.049910    2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 15 16:26:47.051608 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.051596    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 15 16:26:47.051647 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.051613    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 15 16:26:47.051647 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.051620    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 15 16:26:47.051647 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.051625    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 15 16:26:47.051647 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.051633    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 15 16:26:47.051647 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.051638    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 15 16:26:47.051777 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.051651    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 15 16:26:47.051777 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.051657    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 15 16:26:47.051777 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.051664    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 15 16:26:47.051777 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.051670    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 15 16:26:47.051777 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.051678    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 15 16:26:47.051777 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.051684    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 15 16:26:47.052335 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.052326    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 15 16:26:47.052378 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.052336    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 15 16:26:47.055713 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.055520    2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-222.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 15 16:26:47.055713 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:47.055553    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-222.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 15 16:26:47.055863 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:47.055678    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 15 16:26:47.056297 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.056286    2577 server.go:1268] "Started kubelet"
Sep 15 16:26:47.056392 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.056367    2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 15 16:26:47.056531 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.056418    2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 15 16:26:47.056642 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.056633    2577 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 15 16:26:47.057381 ip-10-0-128-222 systemd[1]: Started Kubernetes Kubelet.
Sep 15 16:26:47.061323 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.060981    2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 15 16:26:47.063383 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.062107    2577 server.go:310] "Adding debug handlers to kubelet server"
Sep 15 16:26:47.063704 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:47.063679    2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 15 16:26:47.066063 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:47.064231    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-222.ec2.internal.18d58b5105d77778  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-222.ec2.internal,UID:ip-10-0-128-222.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-222.ec2.internal,},FirstTimestamp:2026-09-15 16:26:47.056258936 +0000 UTC m=+0.323496403,LastTimestamp:2026-09-15 16:26:47.056258936 +0000 UTC m=+0.323496403,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-222.ec2.internal,}"
Sep 15 16:26:47.067799 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.067784    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 15 16:26:47.068315 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.068296    2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 15 16:26:47.068458 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:47.068436    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-222.ec2.internal\" not found"
Sep 15 16:26:47.069115 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.069097    2577 factory.go:55] Registering systemd factory
Sep 15 16:26:47.069115 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.069118    2577 factory.go:223] Registration of the systemd container factory successfully
Sep 15 16:26:47.069271 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.069124    2577 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 15 16:26:47.069271 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.069154    2577 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 15 16:26:47.069271 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.069212    2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 15 16:26:47.069387 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.069279    2577 reconstruct.go:97] "Volume reconstruction finished"
Sep 15 16:26:47.069387 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.069288    2577 reconciler.go:29] "Reconciler: start to sync state"
Sep 15 16:26:47.069387 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.069332    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bnvnm"
Sep 15 16:26:47.069682 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.069666    2577 factory.go:153] Registering CRI-O factory
Sep 15 16:26:47.069682 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.069683    2577 factory.go:223] Registration of the crio container factory successfully
Sep 15 16:26:47.069770 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.069734    2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 15 16:26:47.069770 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.069753    2577 factory.go:103] Registering Raw factory
Sep 15 16:26:47.069770 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.069770    2577 manager.go:1196] Started watching for new ooms in manager
Sep 15 16:26:47.070333 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.070320    2577 manager.go:349] Starting recovery of all containers
Sep 15 16:26:47.070396 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:47.070374    2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-222.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 15 16:26:47.070596 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:47.070563    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 15 16:26:47.075410 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.075383    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bnvnm"
Sep 15 16:26:47.082387 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.082287    2577 manager.go:354] Recovery completed
Sep 15 16:26:47.086465 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.086452    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 16:26:47.088374 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.088352    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-222.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 16:26:47.088455 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.088387    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-222.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 16:26:47.088455 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.088404    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-222.ec2.internal" event="NodeHasSufficientPID"
Sep 15 16:26:47.089053 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.089038    2577 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 15 16:26:47.089053 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.089051    2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 15 16:26:47.089177 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.089069    2577 state_mem.go:36] "Initialized new in-memory state store"
Sep 15 16:26:47.089177 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.089074    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 16:26:47.089768 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.089756    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-222.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 16:26:47.089817 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.089781    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-222.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 16:26:47.089817 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.089794    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-222.ec2.internal" event="NodeHasSufficientPID"
Sep 15 16:26:47.091269 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.091256    2577 policy_none.go:49] "None policy: Start"
Sep 15 16:26:47.091326 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.091276    2577 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 15 16:26:47.091326 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.091289    2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 15 16:26:47.093375 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.093361    2577 policy_none.go:47] "Start"
Sep 15 16:26:47.124823 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.124805    2577 manager.go:337] "Starting Device Plugin manager"
Sep 15 16:26:47.149078 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:47.124862    2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 15 16:26:47.149078 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.124893    2577 server.go:87] "Starting device plugin registration server"
Sep 15 16:26:47.149078 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.125272    2577 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 15 16:26:47.149078 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.125287    2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 15 16:26:47.149078 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.125391    2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 15 16:26:47.149078 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.125461    2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 15 16:26:47.149078 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.125472    2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 15 16:26:47.149078 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:47.126035    2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 15 16:26:47.149078 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:47.126078    2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-222.ec2.internal\" not found"
Sep 15 16:26:47.162433 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.162404    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 15 16:26:47.163796 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.163767    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 15 16:26:47.163899 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.163838    2577 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 15 16:26:47.163899 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.163865    2577 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 15 16:26:47.163979 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:47.163916    2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 15 16:26:47.166296 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.166273    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 16:26:47.225550 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.225515    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 16:26:47.226670 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.226650    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-222.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 16:26:47.226775 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.226684    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-222.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 16:26:47.226775 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.226696    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-222.ec2.internal" event="NodeHasSufficientPID"
Sep 15 16:26:47.226775 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.226720    2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-222.ec2.internal"
Sep 15 16:26:47.235030 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.234920    2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-222.ec2.internal"
Sep 15 16:26:47.235030 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:47.234950    2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-222.ec2.internal\": node \"ip-10-0-128-222.ec2.internal\" not found"
Sep 15 16:26:47.248875 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:47.248854    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-222.ec2.internal\" not found"
Sep 15 16:26:47.264490 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.264457    2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-222.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-222.ec2.internal"]
Sep 15 16:26:47.264564 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.264554    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 16:26:47.266253 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.266234    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-222.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 16:26:47.266336 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.266266    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-222.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 16:26:47.266336 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.266276    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-222.ec2.internal" event="NodeHasSufficientPID"
Sep 15 16:26:47.268685 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.268672    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 16:26:47.268829 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.268800    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-222.ec2.internal"
Sep 15 16:26:47.268887 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.268840    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 16:26:47.269498 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.269479    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a3c1b6418d61b672718063704460a13f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-222.ec2.internal\" (UID: \"a3c1b6418d61b672718063704460a13f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-222.ec2.internal"
Sep 15 16:26:47.269498 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.269483    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-222.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 16:26:47.269669 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.269514    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-222.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 16:26:47.269669 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.269523    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-222.ec2.internal" event="NodeHasSufficientPID"
Sep 15 16:26:47.269669 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.269486    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-222.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 16:26:47.269669 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.269540    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a3c1b6418d61b672718063704460a13f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-222.ec2.internal\" (UID: \"a3c1b6418d61b672718063704460a13f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-222.ec2.internal"
Sep 15 16:26:47.269669 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.269562    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-222.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 16:26:47.269669 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.269582    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-222.ec2.internal" event="NodeHasSufficientPID"
Sep 15 16:26:47.269669 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.269565    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/254bd750f9fd800e2c1818cb4a5d50a1-config\") pod \"kube-apiserver-proxy-ip-10-0-128-222.ec2.internal\" (UID: \"254bd750f9fd800e2c1818cb4a5d50a1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-222.ec2.internal"
Sep 15 16:26:47.271745 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.271729    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-222.ec2.internal"
Sep 15 16:26:47.271837 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.271754    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 16:26:47.274239 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.274225    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-222.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 16:26:47.274302 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.274251    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-222.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 16:26:47.274302 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.274262    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-222.ec2.internal" event="NodeHasSufficientPID"
Sep 15 16:26:47.286779 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:47.286752    2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-222.ec2.internal\" not found" node="ip-10-0-128-222.ec2.internal"
Sep 15 16:26:47.292276 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:47.292258    2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-222.ec2.internal\" not found" node="ip-10-0-128-222.ec2.internal"
Sep 15 16:26:47.349470 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:47.349438    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-222.ec2.internal\" not found"
Sep 15 16:26:47.369973 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.369943    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a3c1b6418d61b672718063704460a13f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-222.ec2.internal\" (UID: \"a3c1b6418d61b672718063704460a13f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-222.ec2.internal"
Sep 15 16:26:47.370119 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.369979    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a3c1b6418d61b672718063704460a13f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-222.ec2.internal\" (UID: \"a3c1b6418d61b672718063704460a13f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-222.ec2.internal"
Sep 15 16:26:47.370119 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.370009    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/254bd750f9fd800e2c1818cb4a5d50a1-config\") pod \"kube-apiserver-proxy-ip-10-0-128-222.ec2.internal\" (UID: \"254bd750f9fd800e2c1818cb4a5d50a1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-222.ec2.internal"
Sep 15 16:26:47.370119 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.370015    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a3c1b6418d61b672718063704460a13f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-222.ec2.internal\" (UID: \"a3c1b6418d61b672718063704460a13f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-222.ec2.internal"
Sep 15 16:26:47.370119 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.370061    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/254bd750f9fd800e2c1818cb4a5d50a1-config\") pod \"kube-apiserver-proxy-ip-10-0-128-222.ec2.internal\" (UID: \"254bd750f9fd800e2c1818cb4a5d50a1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-222.ec2.internal"
Sep 15 16:26:47.370119 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.370060    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a3c1b6418d61b672718063704460a13f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-222.ec2.internal\" (UID: \"a3c1b6418d61b672718063704460a13f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-222.ec2.internal"
Sep 15 16:26:47.449584 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:47.449548    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-222.ec2.internal\" not found"
Sep 15 16:26:47.550449 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:47.550355    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-222.ec2.internal\" not found"
Sep 15 16:26:47.589857 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.589817    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-222.ec2.internal"
Sep 15 16:26:47.595957 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.595937    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-222.ec2.internal"
Sep 15 16:26:47.650687 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:47.650653    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-222.ec2.internal\" not found"
Sep 15 16:26:47.751282 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:47.751239    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-222.ec2.internal\" not found"
Sep 15 16:26:47.851786 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:47.851707    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-222.ec2.internal\" not found"
Sep 15 16:26:47.938969 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:47.938939    2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 16:26:47.952776 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:47.952753    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-222.ec2.internal\" not found"
Sep 15 16:26:48.006305 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:48.006275    2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 15 16:26:48.006739 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:48.006427    2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 15 16:26:48.006739 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:48.006459    2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 15 16:26:48.053753 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:48.053717    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-222.ec2.internal\" not found"
Sep 15 16:26:48.081446 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:48.081411    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-14 16:21:48 +0000 UTC" deadline="2028-03-26 10:30:29.543008769 +0000 UTC"
Sep 15 16:26:48.081446 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:48.081439    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13386h3m41.461572822s"
Sep 15 16:26:48.154797 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:48.154722    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-222.ec2.internal\" not found"
Sep 15 16:26:48.201693 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:48.201665    2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 16:26:48.229061 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:48.229030    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod254bd750f9fd800e2c1818cb4a5d50a1.slice/crio-baf6fb569cc09890480f2f774adc41e694ebc0f44552ba60f2155ecf78bea5c8 WatchSource:0}: Error finding container baf6fb569cc09890480f2f774adc41e694ebc0f44552ba60f2155ecf78bea5c8: Status 404 returned error can't find the container with id baf6fb569cc09890480f2f774adc41e694ebc0f44552ba60f2155ecf78bea5c8
Sep 15 16:26:48.234298 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:48.234282    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 16:26:48.255474 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:48.255443    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-222.ec2.internal\" not found"
Sep 15 16:26:48.356069 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:48.356039    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-222.ec2.internal\" not found"
Sep 15 16:26:48.456638 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:48.456565    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-222.ec2.internal\" not found"
Sep 15 16:26:48.556854 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:48.556822    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-222.ec2.internal\" not found"
Sep 15 16:26:48.557772 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:48.557754    2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 16:26:48.569006 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:48.568982    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-222.ec2.internal"
Sep 15 16:26:48.579444 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:48.579419    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 15 16:26:48.580278 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:48.580264    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-222.ec2.internal"
Sep 15 16:26:48.589248 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:48.589229    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 15 16:26:50.268358 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.268330    2577 apiserver.go:52] "Watching apiserver"
Sep 15 16:26:50.278672 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.278643    2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 15 16:26:50.279397 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.279368    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-l4f6l","openshift-multus/multus-additional-cni-plugins-rtmw2","openshift-multus/network-metrics-daemon-md7hc","openshift-network-diagnostics/network-check-target-4mbmd","openshift-dns/node-resolver-v4dlm","openshift-image-registry/node-ca-59vps","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-222.ec2.internal","openshift-multus/multus-s8z2k","openshift-network-operator/iptables-alerter-9s6p7","openshift-ovn-kubernetes/ovnkube-node-q4krz","kube-system/global-pull-secret-syncer-n4g7x","kube-system/konnectivity-agent-txx8b","kube-system/kube-apiserver-proxy-ip-10-0-128-222.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f959f"]
Sep 15 16:26:50.282667 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.282632    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:26:50.284814 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.284780    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4g7x"
Sep 15 16:26:50.284934 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:50.284871    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4g7x" podUID="9683ce85-f982-4a05-83d0-a6ace6c05fd0"
Sep 15 16:26:50.285920 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.285680    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 15 16:26:50.285920 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.285745    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 15 16:26:50.285920 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.285752    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 15 16:26:50.285920 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.285789    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 15 16:26:50.285920 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.285746    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 15 16:26:50.285920 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.285846    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 15 16:26:50.286227 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.286179    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-shsr5\""
Sep 15 16:26:50.287290 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.287268    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-md7hc"
Sep 15 16:26:50.287388 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:50.287351    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-md7hc" podUID="3da3c8f3-fcce-45f3-9756-43be57b887a1"
Sep 15 16:26:50.289547 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.289529    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mbmd"
Sep 15 16:26:50.289646 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:50.289593    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mbmd" podUID="9665201c-0ad3-4ba4-8bdb-beee79795c0e"
Sep 15 16:26:50.290420 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.290401    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 15 16:26:50.292020 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.291987    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v4dlm"
Sep 15 16:26:50.294420 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.294398    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-59vps"
Sep 15 16:26:50.294542 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.294521    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-79pft\""
Sep 15 16:26:50.294653 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.294631    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 15 16:26:50.294742 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.294669    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 15 16:26:50.296960 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.296604    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9s6p7"
Sep 15 16:26:50.297295 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.297281    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 15 16:26:50.297381 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.297360    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 15 16:26:50.297438 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.297425    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 15 16:26:50.298203 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.298183    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hdq26\""
Sep 15 16:26:50.299066 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.299047    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f959f"
Sep 15 16:26:50.299901 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.299635    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 15 16:26:50.299901 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.299652    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 15 16:26:50.299901 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.299690    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xpm5p\""
Sep 15 16:26:50.300108 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.300061    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 15 16:26:50.301387 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.301365    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9683ce85-f982-4a05-83d0-a6ace6c05fd0-original-pull-secret\") pod \"global-pull-secret-syncer-n4g7x\" (UID: \"9683ce85-f982-4a05-83d0-a6ace6c05fd0\") " pod="kube-system/global-pull-secret-syncer-n4g7x"
Sep 15 16:26:50.301489 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.301400    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/314c32cc-a844-4d14-9ac8-c33379de1cdd-host-kubelet\") pod \"ovnkube-node-q4krz\" (UID: \"314c32cc-a844-4d14-9ac8-c33379de1cdd\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:26:50.301489 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.301425    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/314c32cc-a844-4d14-9ac8-c33379de1cdd-host-slash\") pod \"ovnkube-node-q4krz\" (UID: \"314c32cc-a844-4d14-9ac8-c33379de1cdd\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:26:50.301489 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.301447    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/314c32cc-a844-4d14-9ac8-c33379de1cdd-run-openvswitch\") pod \"ovnkube-node-q4krz\" (UID: \"314c32cc-a844-4d14-9ac8-c33379de1cdd\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:26:50.301489 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.301453    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rtmw2"
Sep 15 16:26:50.301489 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.301472    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/314c32cc-a844-4d14-9ac8-c33379de1cdd-log-socket\") pod \"ovnkube-node-q4krz\" (UID: \"314c32cc-a844-4d14-9ac8-c33379de1cdd\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:26:50.301489 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.301488    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/314c32cc-a844-4d14-9ac8-c33379de1cdd-host-run-ovn-kubernetes\") pod \"ovnkube-node-q4krz\" (UID: \"314c32cc-a844-4d14-9ac8-c33379de1cdd\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:26:50.301777 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.301509    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/314c32cc-a844-4d14-9ac8-c33379de1cdd-host-cni-netd\") pod \"ovnkube-node-q4krz\" (UID: \"314c32cc-a844-4d14-9ac8-c33379de1cdd\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:26:50.301777 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.301525    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/22a84780-b244-4fa8-8b6b-60337f595112-hosts-file\") pod \"node-resolver-v4dlm\" (UID: \"22a84780-b244-4fa8-8b6b-60337f595112\") " pod="openshift-dns/node-resolver-v4dlm"
Sep 15 16:26:50.301777 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.301540    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/314c32cc-a844-4d14-9ac8-c33379de1cdd-var-lib-openvswitch\") pod \"ovnkube-node-q4krz\" (UID: \"314c32cc-a844-4d14-9ac8-c33379de1cdd\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:26:50.301777 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.301559    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/314c32cc-a844-4d14-9ac8-c33379de1cdd-etc-openvswitch\") pod \"ovnkube-node-q4krz\" (UID: \"314c32cc-a844-4d14-9ac8-c33379de1cdd\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:26:50.301777 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.301599    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/314c32cc-a844-4d14-9ac8-c33379de1cdd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q4krz\" (UID: \"314c32cc-a844-4d14-9ac8-c33379de1cdd\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:26:50.301777 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.301615    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/314c32cc-a844-4d14-9ac8-c33379de1cdd-ovnkube-script-lib\") pod \"ovnkube-node-q4krz\" (UID: \"314c32cc-a844-4d14-9ac8-c33379de1cdd\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:26:50.301777 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.301629    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3da3c8f3-fcce-45f3-9756-43be57b887a1-metrics-certs\") pod \"network-metrics-daemon-md7hc\" (UID: \"3da3c8f3-fcce-45f3-9756-43be57b887a1\") " pod="openshift-multus/network-metrics-daemon-md7hc"
Sep 15 16:26:50.301777 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.301646    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/314c32cc-a844-4d14-9ac8-c33379de1cdd-run-systemd\") pod \"ovnkube-node-q4krz\" (UID: \"314c32cc-a844-4d14-9ac8-c33379de1cdd\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:26:50.301777 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.301670    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/314c32cc-a844-4d14-9ac8-c33379de1cdd-node-log\") pod \"ovnkube-node-q4krz\" (UID: \"314c32cc-a844-4d14-9ac8-c33379de1cdd\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:26:50.301777 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.301688    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/314c32cc-a844-4d14-9ac8-c33379de1cdd-host-cni-bin\") pod \"ovnkube-node-q4krz\" (UID: \"314c32cc-a844-4d14-9ac8-c33379de1cdd\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:26:50.301777 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.301701    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/314c32cc-a844-4d14-9ac8-c33379de1cdd-ovnkube-config\") pod \"ovnkube-node-q4krz\" (UID: \"314c32cc-a844-4d14-9ac8-c33379de1cdd\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:26:50.301777 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.301716    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/314c32cc-a844-4d14-9ac8-c33379de1cdd-env-overrides\") pod \"ovnkube-node-q4krz\" (UID: \"314c32cc-a844-4d14-9ac8-c33379de1cdd\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:26:50.301777 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.301734    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9683ce85-f982-4a05-83d0-a6ace6c05fd0-kubelet-config\") pod \"global-pull-secret-syncer-n4g7x\" (UID: \"9683ce85-f982-4a05-83d0-a6ace6c05fd0\") " pod="kube-system/global-pull-secret-syncer-n4g7x"
Sep 15 16:26:50.301777 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.301747    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 15 16:26:50.301777 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.301767    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bgg5\" (UniqueName: \"kubernetes.io/projected/3da3c8f3-fcce-45f3-9756-43be57b887a1-kube-api-access-8bgg5\") pod \"network-metrics-daemon-md7hc\" (UID: \"3da3c8f3-fcce-45f3-9756-43be57b887a1\") " pod="openshift-multus/network-metrics-daemon-md7hc"
Sep 15 16:26:50.301777 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.301781    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/314c32cc-a844-4d14-9ac8-c33379de1cdd-systemd-units\") pod \"ovnkube-node-q4krz\" (UID: \"314c32cc-a844-4d14-9ac8-c33379de1cdd\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:26:50.302377 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.301794    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/314c32cc-a844-4d14-9ac8-c33379de1cdd-run-ovn\") pod \"ovnkube-node-q4krz\" (UID: \"314c32cc-a844-4d14-9ac8-c33379de1cdd\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:26:50.302377 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.301827    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/314c32cc-a844-4d14-9ac8-c33379de1cdd-ovn-node-metrics-cert\") pod \"ovnkube-node-q4krz\" (UID: \"314c32cc-a844-4d14-9ac8-c33379de1cdd\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:26:50.302377 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.301847    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xg65j\" (UniqueName: \"kubernetes.io/projected/22a84780-b244-4fa8-8b6b-60337f595112-kube-api-access-xg65j\") pod \"node-resolver-v4dlm\" (UID: \"22a84780-b244-4fa8-8b6b-60337f595112\") " pod="openshift-dns/node-resolver-v4dlm"
Sep 15 16:26:50.302377 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.301862    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/314c32cc-a844-4d14-9ac8-c33379de1cdd-host-run-netns\") pod \"ovnkube-node-q4krz\" (UID: \"314c32cc-a844-4d14-9ac8-c33379de1cdd\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:26:50.302377 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.301876    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trrb9\" (UniqueName: \"kubernetes.io/projected/314c32cc-a844-4d14-9ac8-c33379de1cdd-kube-api-access-trrb9\") pod \"ovnkube-node-q4krz\" (UID: \"314c32cc-a844-4d14-9ac8-c33379de1cdd\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:26:50.302377 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.301892    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9683ce85-f982-4a05-83d0-a6ace6c05fd0-dbus\") pod \"global-pull-secret-syncer-n4g7x\" (UID: \"9683ce85-f982-4a05-83d0-a6ace6c05fd0\") " pod="kube-system/global-pull-secret-syncer-n4g7x"
Sep 15 16:26:50.302377 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.301921    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pn9l\" (UniqueName: \"kubernetes.io/projected/9665201c-0ad3-4ba4-8bdb-beee79795c0e-kube-api-access-9pn9l\") pod \"network-check-target-4mbmd\" (UID: \"9665201c-0ad3-4ba4-8bdb-beee79795c0e\") " pod="openshift-network-diagnostics/network-check-target-4mbmd"
Sep 15 16:26:50.302377 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.301953    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22a84780-b244-4fa8-8b6b-60337f595112-tmp-dir\") pod \"node-resolver-v4dlm\" (UID: \"22a84780-b244-4fa8-8b6b-60337f595112\") " pod="openshift-dns/node-resolver-v4dlm"
Sep 15 16:26:50.302377 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.302102    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-mgtgz\""
Sep 15 16:26:50.302377 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.302159    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 15 16:26:50.302722 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.302396    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 15 16:26:50.304511 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.304108    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-l4f6l"
Sep 15 16:26:50.304511 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.304176    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 15 16:26:50.304511 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.304204    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 15 16:26:50.304511 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.304114    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 15 16:26:50.304511 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.304344    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-trdvs\""
Sep 15 16:26:50.304511 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.304483    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 15 16:26:50.304961 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.304936    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 15 16:26:50.305050 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.304935    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 15 16:26:50.306565 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.306545    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-s8z2k"
Sep 15 16:26:50.306735 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.306716    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4jxq9\""
Sep 15 16:26:50.306997 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.306980    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 15 16:26:50.307139 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.306983    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 15 16:26:50.308727 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.308709    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 15 16:26:50.308812 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.308800    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-txx8b"
Sep 15 16:26:50.309170 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.309154    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-d9cqm\""
Sep 15 16:26:50.314452 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.314172    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-trxkn\""
Sep 15 16:26:50.314598 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.314260    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 15 16:26:50.316813 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.314306    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 15 16:26:50.326699 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.326677    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-cfnvx"
Sep 15 16:26:50.334525 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.334505    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-cfnvx"
Sep 15 16:26:50.390762 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.390708    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-222.ec2.internal" event={"ID":"254bd750f9fd800e2c1818cb4a5d50a1","Type":"ContainerStarted","Data":"baf6fb569cc09890480f2f774adc41e694ebc0f44552ba60f2155ecf78bea5c8"}
Sep 15 16:26:50.392550 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.392492    2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 15 16:26:50.403036 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.402950    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3aea9285-dc6b-4584-a146-3cebd64a5d83-system-cni-dir\") pod \"multus-s8z2k\" (UID: \"3aea9285-dc6b-4584-a146-3cebd64a5d83\") " pod="openshift-multus/multus-s8z2k"
Sep 15 16:26:50.403036 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.402987    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3aea9285-dc6b-4584-a146-3cebd64a5d83-multus-socket-dir-parent\") pod \"multus-s8z2k\" (UID: \"3aea9285-dc6b-4584-a146-3cebd64a5d83\") " pod="openshift-multus/multus-s8z2k"
Sep 15 16:26:50.403207 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.403033    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/314c32cc-a844-4d14-9ac8-c33379de1cdd-run-systemd\") pod \"ovnkube-node-q4krz\" (UID: \"314c32cc-a844-4d14-9ac8-c33379de1cdd\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:26:50.403207 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.403082    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/314c32cc-a844-4d14-9ac8-c33379de1cdd-node-log\") pod \"ovnkube-node-q4krz\" (UID: \"314c32cc-a844-4d14-9ac8-c33379de1cdd\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:26:50.403207 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.403146    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/314c32cc-a844-4d14-9ac8-c33379de1cdd-node-log\") pod \"ovnkube-node-q4krz\" (UID: \"314c32cc-a844-4d14-9ac8-c33379de1cdd\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:26:50.403207 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.403147    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/314c32cc-a844-4d14-9ac8-c33379de1cdd-ovnkube-config\") pod \"ovnkube-node-q4krz\" (UID: \"314c32cc-a844-4d14-9ac8-c33379de1cdd\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:26:50.403207 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.403181    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/314c32cc-a844-4d14-9ac8-c33379de1cdd-env-overrides\") pod \"ovnkube-node-q4krz\" (UID: \"314c32cc-a844-4d14-9ac8-c33379de1cdd\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:26:50.403207 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.403206    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3aea9285-dc6b-4584-a146-3cebd64a5d83-hostroot\") pod \"multus-s8z2k\" (UID: \"3aea9285-dc6b-4584-a146-3cebd64a5d83\") " pod="openshift-multus/multus-s8z2k"
Sep 15 16:26:50.403484 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.403229    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3aea9285-dc6b-4584-a146-3cebd64a5d83-multus-daemon-config\") pod \"multus-s8z2k\" (UID: \"3aea9285-dc6b-4584-a146-3cebd64a5d83\") " pod="openshift-multus/multus-s8z2k"
Sep 15 16:26:50.403484 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.403239    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/314c32cc-a844-4d14-9ac8-c33379de1cdd-run-systemd\") pod \"ovnkube-node-q4krz\" (UID: \"314c32cc-a844-4d14-9ac8-c33379de1cdd\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:26:50.403484 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.403251    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/97eb67a3-7048-4d86-9521-f76c77cf9166-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rtmw2\" (UID: \"97eb67a3-7048-4d86-9521-f76c77cf9166\") " pod="openshift-multus/multus-additional-cni-plugins-rtmw2"
Sep 15 16:26:50.403484 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.403274    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c576ac52-148e-4877-8b32-3ca845e01acf-var-lib-kubelet\") pod \"tuned-l4f6l\" (UID: \"c576ac52-148e-4877-8b32-3ca845e01acf\") " pod="openshift-cluster-node-tuning-operator/tuned-l4f6l"
Sep 15 16:26:50.403484 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.403390    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/314c32cc-a844-4d14-9ac8-c33379de1cdd-run-ovn\") pod \"ovnkube-node-q4krz\" (UID: \"314c32cc-a844-4d14-9ac8-c33379de1cdd\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:26:50.403484 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.403418    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/314c32cc-a844-4d14-9ac8-c33379de1cdd-ovn-node-metrics-cert\") pod \"ovnkube-node-q4krz\" (UID: \"314c32cc-a844-4d14-9ac8-c33379de1cdd\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:26:50.403484 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.403443    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3aea9285-dc6b-4584-a146-3cebd64a5d83-host-var-lib-cni-bin\") pod \"multus-s8z2k\" (UID: \"3aea9285-dc6b-4584-a146-3cebd64a5d83\") " pod="openshift-multus/multus-s8z2k"
Sep 15 16:26:50.403484 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.403458    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/314c32cc-a844-4d14-9ac8-c33379de1cdd-run-ovn\") pod \"ovnkube-node-q4krz\" (UID: \"314c32cc-a844-4d14-9ac8-c33379de1cdd\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:26:50.403484 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.403470    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3aea9285-dc6b-4584-a146-3cebd64a5d83-host-run-multus-certs\") pod \"multus-s8z2k\" (UID: \"3aea9285-dc6b-4584-a146-3cebd64a5d83\") " pod="openshift-multus/multus-s8z2k"
Sep 15 16:26:50.403888 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.403491    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c576ac52-148e-4877-8b32-3ca845e01acf-etc-sysctl-conf\") pod \"tuned-l4f6l\" (UID: \"c576ac52-148e-4877-8b32-3ca845e01acf\") " pod="openshift-cluster-node-tuning-operator/tuned-l4f6l"
Sep 15 16:26:50.403888 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.403514    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c576ac52-148e-4877-8b32-3ca845e01acf-run\") pod \"tuned-l4f6l\" (UID: \"c576ac52-148e-4877-8b32-3ca845e01acf\") " pod="openshift-cluster-node-tuning-operator/tuned-l4f6l"
Sep 15 16:26:50.403888 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.403536    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/314c32cc-a844-4d14-9ac8-c33379de1cdd-host-run-netns\") pod \"ovnkube-node-q4krz\" (UID: \"314c32cc-a844-4d14-9ac8-c33379de1cdd\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:26:50.403888 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.403564    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pn9l\" (UniqueName: \"kubernetes.io/projected/9665201c-0ad3-4ba4-8bdb-beee79795c0e-kube-api-access-9pn9l\") pod \"network-check-target-4mbmd\" (UID: \"9665201c-0ad3-4ba4-8bdb-beee79795c0e\") " pod="openshift-network-diagnostics/network-check-target-4mbmd"
Sep 15 16:26:50.403888 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.403591    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e26b5e43-b2b7-43dd-a078-e7cad5f5952a-socket-dir\") pod \"aws-ebs-csi-driver-node-f959f\" (UID: \"e26b5e43-b2b7-43dd-a078-e7cad5f5952a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f959f"
Sep 15 16:26:50.403888 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.403614    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3aea9285-dc6b-4584-a146-3cebd64a5d83-multus-cni-dir\") pod \"multus-s8z2k\" (UID: \"3aea9285-dc6b-4584-a146-3cebd64a5d83\") " pod="openshift-multus/multus-s8z2k"
Sep 15 16:26:50.403888 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.403632    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgpbd\" (UniqueName: \"kubernetes.io/projected/97eb67a3-7048-4d86-9521-f76c77cf9166-kube-api-access-zgpbd\") pod \"multus-additional-cni-plugins-rtmw2\" (UID: \"97eb67a3-7048-4d86-9521-f76c77cf9166\") " pod="openshift-multus/multus-additional-cni-plugins-rtmw2"
Sep 15 16:26:50.403888 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.403648    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3aea9285-dc6b-4584-a146-3cebd64a5d83-host-run-k8s-cni-cncf-io\") pod \"multus-s8z2k\" (UID: \"3aea9285-dc6b-4584-a146-3cebd64a5d83\") " pod="openshift-multus/multus-s8z2k"
Sep 15 16:26:50.403888 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.403663    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c576ac52-148e-4877-8b32-3ca845e01acf-etc-sysconfig\") pod \"tuned-l4f6l\" (UID: \"c576ac52-148e-4877-8b32-3ca845e01acf\") " pod="openshift-cluster-node-tuning-operator/tuned-l4f6l"
Sep 15 16:26:50.403888 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.403679    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9683ce85-f982-4a05-83d0-a6ace6c05fd0-original-pull-secret\") pod \"global-pull-secret-syncer-n4g7x\" (UID: \"9683ce85-f982-4a05-83d0-a6ace6c05fd0\") " pod="kube-system/global-pull-secret-syncer-n4g7x"
Sep 15 16:26:50.403888 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.403702    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e26b5e43-b2b7-43dd-a078-e7cad5f5952a-device-dir\") pod \"aws-ebs-csi-driver-node-f959f\" (UID: \"e26b5e43-b2b7-43dd-a078-e7cad5f5952a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f959f"
Sep 15 16:26:50.403888 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.403725    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3aea9285-dc6b-4584-a146-3cebd64a5d83-host-var-lib-cni-multus\") pod \"multus-s8z2k\" (UID: \"3aea9285-dc6b-4584-a146-3cebd64a5d83\") " pod="openshift-multus/multus-s8z2k"
Sep 15 16:26:50.403888 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.403748    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c576ac52-148e-4877-8b32-3ca845e01acf-host\") pod \"tuned-l4f6l\" (UID: \"c576ac52-148e-4877-8b32-3ca845e01acf\") " pod="openshift-cluster-node-tuning-operator/tuned-l4f6l"
Sep 15 16:26:50.403888 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.403772    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/314c32cc-a844-4d14-9ac8-c33379de1cdd-env-overrides\") pod \"ovnkube-node-q4krz\" (UID: \"314c32cc-a844-4d14-9ac8-c33379de1cdd\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:26:50.403888 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.403810    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/314c32cc-a844-4d14-9ac8-c33379de1cdd-host-run-netns\") pod \"ovnkube-node-q4krz\" (UID: \"314c32cc-a844-4d14-9ac8-c33379de1cdd\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:26:50.403888 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.403823    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/314c32cc-a844-4d14-9ac8-c33379de1cdd-host-kubelet\") pod \"ovnkube-node-q4krz\" (UID: \"314c32cc-a844-4d14-9ac8-c33379de1cdd\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:26:50.403888 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.403773    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/314c32cc-a844-4d14-9ac8-c33379de1cdd-host-kubelet\") pod \"ovnkube-node-q4krz\" (UID: \"314c32cc-a844-4d14-9ac8-c33379de1cdd\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:26:50.404738 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.403854    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/314c32cc-a844-4d14-9ac8-c33379de1cdd-run-openvswitch\") pod \"ovnkube-node-q4krz\" (UID: \"314c32cc-a844-4d14-9ac8-c33379de1cdd\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:26:50.404738 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.403887    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/314c32cc-a844-4d14-9ac8-c33379de1cdd-log-socket\") pod \"ovnkube-node-q4krz\" (UID: \"314c32cc-a844-4d14-9ac8-c33379de1cdd\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:26:50.404738 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.403907    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/314c32cc-a844-4d14-9ac8-c33379de1cdd-host-run-ovn-kubernetes\") pod \"ovnkube-node-q4krz\" (UID: \"314c32cc-a844-4d14-9ac8-c33379de1cdd\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:26:50.404738 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.403928    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/22a84780-b244-4fa8-8b6b-60337f595112-hosts-file\") pod \"node-resolver-v4dlm\" (UID: \"22a84780-b244-4fa8-8b6b-60337f595112\") " pod="openshift-dns/node-resolver-v4dlm"
Sep 15 16:26:50.404738 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.403950    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e26b5e43-b2b7-43dd-a078-e7cad5f5952a-registration-dir\") pod \"aws-ebs-csi-driver-node-f959f\" (UID: \"e26b5e43-b2b7-43dd-a078-e7cad5f5952a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f959f"
Sep 15 16:26:50.404738 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.403982    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3aea9285-dc6b-4584-a146-3cebd64a5d83-cnibin\") pod \"multus-s8z2k\" (UID: \"3aea9285-dc6b-4584-a146-3cebd64a5d83\") " pod="openshift-multus/multus-s8z2k"
Sep 15 16:26:50.404738 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.403883    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/314c32cc-a844-4d14-9ac8-c33379de1cdd-ovnkube-config\") pod \"ovnkube-node-q4krz\" (UID: \"314c32cc-a844-4d14-9ac8-c33379de1cdd\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:26:50.404738 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.404072    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97eb67a3-7048-4d86-9521-f76c77cf9166-system-cni-dir\") pod \"multus-additional-cni-plugins-rtmw2\" (UID: \"97eb67a3-7048-4d86-9521-f76c77cf9166\") " pod="openshift-multus/multus-additional-cni-plugins-rtmw2"
Sep 15 16:26:50.404738 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.404079    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/314c32cc-a844-4d14-9ac8-c33379de1cdd-host-run-ovn-kubernetes\") pod \"ovnkube-node-q4krz\" (UID: \"314c32cc-a844-4d14-9ac8-c33379de1cdd\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:26:50.404738 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.404103    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/314c32cc-a844-4d14-9ac8-c33379de1cdd-var-lib-openvswitch\") pod \"ovnkube-node-q4krz\" (UID: \"314c32cc-a844-4d14-9ac8-c33379de1cdd\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:26:50.404738 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.404118    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/22a84780-b244-4fa8-8b6b-60337f595112-hosts-file\") pod \"node-resolver-v4dlm\" (UID: \"22a84780-b244-4fa8-8b6b-60337f595112\") " pod="openshift-dns/node-resolver-v4dlm"
Sep 15 16:26:50.404738 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.404153    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/314c32cc-a844-4d14-9ac8-c33379de1cdd-log-socket\") pod \"ovnkube-node-q4krz\" (UID: \"314c32cc-a844-4d14-9ac8-c33379de1cdd\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:26:50.404738 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.404170    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/314c32cc-a844-4d14-9ac8-c33379de1cdd-run-openvswitch\") pod \"ovnkube-node-q4krz\" (UID: \"314c32cc-a844-4d14-9ac8-c33379de1cdd\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:26:50.404738 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.404207    2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 15 16:26:50.404738 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:50.404225    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 16:26:50.404738 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.404235    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/314c32cc-a844-4d14-9ac8-c33379de1cdd-var-lib-openvswitch\") pod \"ovnkube-node-q4krz\" (UID: \"314c32cc-a844-4d14-9ac8-c33379de1cdd\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:26:50.404738 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.404264    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/314c32cc-a844-4d14-9ac8-c33379de1cdd-etc-openvswitch\") pod \"ovnkube-node-q4krz\" (UID: \"314c32cc-a844-4d14-9ac8-c33379de1cdd\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:26:50.404738 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.404288    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3da3c8f3-fcce-45f3-9756-43be57b887a1-metrics-certs\") pod \"network-metrics-daemon-md7hc\" (UID: \"3da3c8f3-fcce-45f3-9756-43be57b887a1\") " pod="openshift-multus/network-metrics-daemon-md7hc"
Sep 15 16:26:50.405547 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.404305    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c576ac52-148e-4877-8b32-3ca845e01acf-etc-kubernetes\") pod \"tuned-l4f6l\" (UID: \"c576ac52-148e-4877-8b32-3ca845e01acf\") " pod="openshift-cluster-node-tuning-operator/tuned-l4f6l"
Sep 15 16:26:50.405547 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.404336    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c576ac52-148e-4877-8b32-3ca845e01acf-etc-systemd\") pod \"tuned-l4f6l\" (UID: \"c576ac52-148e-4877-8b32-3ca845e01acf\") " pod="openshift-cluster-node-tuning-operator/tuned-l4f6l"
Sep 15 16:26:50.405547 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.404352    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c576ac52-148e-4877-8b32-3ca845e01acf-lib-modules\") pod \"tuned-l4f6l\" (UID: \"c576ac52-148e-4877-8b32-3ca845e01acf\") " pod="openshift-cluster-node-tuning-operator/tuned-l4f6l"
Sep 15 16:26:50.405547 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:50.404459    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9683ce85-f982-4a05-83d0-a6ace6c05fd0-original-pull-secret podName:9683ce85-f982-4a05-83d0-a6ace6c05fd0 nodeName:}" failed. No retries permitted until 2026-09-15 16:26:50.904410614 +0000 UTC m=+2.949828941 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9683ce85-f982-4a05-83d0-a6ace6c05fd0-original-pull-secret") pod "global-pull-secret-syncer-n4g7x" (UID: "9683ce85-f982-4a05-83d0-a6ace6c05fd0") : object "kube-system"/"original-pull-secret" not registered
Sep 15 16:26:50.405547 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:50.404548    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 16:26:50.405547 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:50.404589    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3da3c8f3-fcce-45f3-9756-43be57b887a1-metrics-certs podName:3da3c8f3-fcce-45f3-9756-43be57b887a1 nodeName:}" failed. No retries permitted until 2026-09-15 16:26:50.904576136 +0000 UTC m=+2.949994464 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3da3c8f3-fcce-45f3-9756-43be57b887a1-metrics-certs") pod "network-metrics-daemon-md7hc" (UID: "3da3c8f3-fcce-45f3-9756-43be57b887a1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 16:26:50.405547 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.404639    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/314c32cc-a844-4d14-9ac8-c33379de1cdd-etc-openvswitch\") pod \"ovnkube-node-q4krz\" (UID: \"314c32cc-a844-4d14-9ac8-c33379de1cdd\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:26:50.405547 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.404678    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/314c32cc-a844-4d14-9ac8-c33379de1cdd-host-cni-bin\") pod \"ovnkube-node-q4krz\" (UID: \"314c32cc-a844-4d14-9ac8-c33379de1cdd\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:26:50.405547 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.404705    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9683ce85-f982-4a05-83d0-a6ace6c05fd0-kubelet-config\") pod \"global-pull-secret-syncer-n4g7x\" (UID: \"9683ce85-f982-4a05-83d0-a6ace6c05fd0\") " pod="kube-system/global-pull-secret-syncer-n4g7x"
Sep 15 16:26:50.405547 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.404726    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bgg5\" (UniqueName: \"kubernetes.io/projected/3da3c8f3-fcce-45f3-9756-43be57b887a1-kube-api-access-8bgg5\") pod \"network-metrics-daemon-md7hc\" (UID: \"3da3c8f3-fcce-45f3-9756-43be57b887a1\") " pod="openshift-multus/network-metrics-daemon-md7hc"
Sep 15 16:26:50.405547 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.404757    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/314c32cc-a844-4d14-9ac8-c33379de1cdd-host-cni-bin\") pod \"ovnkube-node-q4krz\" (UID: \"314c32cc-a844-4d14-9ac8-c33379de1cdd\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:26:50.405547 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.404768    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4a10ffb9-f241-40dc-8db4-c4813201e65d-host\") pod \"node-ca-59vps\" (UID: \"4a10ffb9-f241-40dc-8db4-c4813201e65d\") " pod="openshift-image-registry/node-ca-59vps"
Sep 15 16:26:50.405547 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.404806    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqkrx\" (UniqueName: \"kubernetes.io/projected/4a10ffb9-f241-40dc-8db4-c4813201e65d-kube-api-access-dqkrx\") pod \"node-ca-59vps\" (UID: \"4a10ffb9-f241-40dc-8db4-c4813201e65d\") " pod="openshift-image-registry/node-ca-59vps"
Sep 15 16:26:50.405547 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.404848    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9683ce85-f982-4a05-83d0-a6ace6c05fd0-kubelet-config\") pod \"global-pull-secret-syncer-n4g7x\" (UID: \"9683ce85-f982-4a05-83d0-a6ace6c05fd0\") " pod="kube-system/global-pull-secret-syncer-n4g7x"
Sep 15 16:26:50.405547 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.404895    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgtr8\" (UniqueName: \"kubernetes.io/projected/e26b5e43-b2b7-43dd-a078-e7cad5f5952a-kube-api-access-mgtr8\") pod \"aws-ebs-csi-driver-node-f959f\" (UID: \"e26b5e43-b2b7-43dd-a078-e7cad5f5952a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f959f"
Sep 15 16:26:50.405547 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.404924    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/97eb67a3-7048-4d86-9521-f76c77cf9166-cnibin\") pod \"multus-additional-cni-plugins-rtmw2\" (UID: \"97eb67a3-7048-4d86-9521-f76c77cf9166\") " pod="openshift-multus/multus-additional-cni-plugins-rtmw2"
Sep 15 16:26:50.406255 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.404962    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/314c32cc-a844-4d14-9ac8-c33379de1cdd-systemd-units\") pod \"ovnkube-node-q4krz\" (UID: \"314c32cc-a844-4d14-9ac8-c33379de1cdd\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:26:50.406255 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.405049    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xg65j\" (UniqueName: \"kubernetes.io/projected/22a84780-b244-4fa8-8b6b-60337f595112-kube-api-access-xg65j\") pod \"node-resolver-v4dlm\" (UID: \"22a84780-b244-4fa8-8b6b-60337f595112\") " pod="openshift-dns/node-resolver-v4dlm"
Sep 15 16:26:50.406255 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.405052    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/314c32cc-a844-4d14-9ac8-c33379de1cdd-systemd-units\") pod \"ovnkube-node-q4krz\" (UID: \"314c32cc-a844-4d14-9ac8-c33379de1cdd\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:26:50.406255 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.405116    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e26b5e43-b2b7-43dd-a078-e7cad5f5952a-etc-selinux\") pod \"aws-ebs-csi-driver-node-f959f\" (UID: \"e26b5e43-b2b7-43dd-a078-e7cad5f5952a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f959f"
Sep 15 16:26:50.406255 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.405161    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/97eb67a3-7048-4d86-9521-f76c77cf9166-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rtmw2\" (UID: \"97eb67a3-7048-4d86-9521-f76c77cf9166\") " pod="openshift-multus/multus-additional-cni-plugins-rtmw2"
Sep 15 16:26:50.406255 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.405183    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c576ac52-148e-4877-8b32-3ca845e01acf-etc-modprobe-d\") pod \"tuned-l4f6l\" (UID: \"c576ac52-148e-4877-8b32-3ca845e01acf\") " pod="openshift-cluster-node-tuning-operator/tuned-l4f6l"
Sep 15 16:26:50.406255 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.405197    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c576ac52-148e-4877-8b32-3ca845e01acf-etc-sysctl-d\") pod \"tuned-l4f6l\" (UID: \"c576ac52-148e-4877-8b32-3ca845e01acf\") " pod="openshift-cluster-node-tuning-operator/tuned-l4f6l"
Sep 15 16:26:50.406255 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.405231    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c576ac52-148e-4877-8b32-3ca845e01acf-tmp\") pod \"tuned-l4f6l\" (UID: \"c576ac52-148e-4877-8b32-3ca845e01acf\") " pod="openshift-cluster-node-tuning-operator/tuned-l4f6l"
Sep 15 16:26:50.406255 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.405269    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c576ac52-148e-4877-8b32-3ca845e01acf-etc-tuned\") pod \"tuned-l4f6l\" (UID: \"c576ac52-148e-4877-8b32-3ca845e01acf\") " pod="openshift-cluster-node-tuning-operator/tuned-l4f6l"
Sep 15 16:26:50.406255 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.405307    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trrb9\" (UniqueName: \"kubernetes.io/projected/314c32cc-a844-4d14-9ac8-c33379de1cdd-kube-api-access-trrb9\") pod \"ovnkube-node-q4krz\" (UID: \"314c32cc-a844-4d14-9ac8-c33379de1cdd\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:26:50.406255 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.405340    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9683ce85-f982-4a05-83d0-a6ace6c05fd0-dbus\") pod \"global-pull-secret-syncer-n4g7x\" (UID: \"9683ce85-f982-4a05-83d0-a6ace6c05fd0\") " pod="kube-system/global-pull-secret-syncer-n4g7x"
Sep 15 16:26:50.406255 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.405368    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e26b5e43-b2b7-43dd-a078-e7cad5f5952a-sys-fs\") pod \"aws-ebs-csi-driver-node-f959f\" (UID: \"e26b5e43-b2b7-43dd-a078-e7cad5f5952a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f959f"
Sep 15 16:26:50.406255 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.405446    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3aea9285-dc6b-4584-a146-3cebd64a5d83-host-run-netns\") pod \"multus-s8z2k\" (UID: \"3aea9285-dc6b-4584-a146-3cebd64a5d83\") " pod="openshift-multus/multus-s8z2k"
Sep 15 16:26:50.406255 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.405474    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3aea9285-dc6b-4584-a146-3cebd64a5d83-multus-conf-dir\") pod \"multus-s8z2k\" (UID: \"3aea9285-dc6b-4584-a146-3cebd64a5d83\") " pod="openshift-multus/multus-s8z2k"
Sep 15 16:26:50.406255 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.405504    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3aea9285-dc6b-4584-a146-3cebd64a5d83-etc-kubernetes\") pod \"multus-s8z2k\" (UID: \"3aea9285-dc6b-4584-a146-3cebd64a5d83\") " pod="openshift-multus/multus-s8z2k"
Sep 15 16:26:50.406255 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.405536    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a5da2ef5-4cda-424d-8618-79d3d4b6fe1c-konnectivity-ca\") pod \"konnectivity-agent-txx8b\" (UID: \"a5da2ef5-4cda-424d-8618-79d3d4b6fe1c\") " pod="kube-system/konnectivity-agent-txx8b"
Sep 15 16:26:50.406255 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.405565    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22a84780-b244-4fa8-8b6b-60337f595112-tmp-dir\") pod \"node-resolver-v4dlm\" (UID: \"22a84780-b244-4fa8-8b6b-60337f595112\") " pod="openshift-dns/node-resolver-v4dlm"
Sep 15 16:26:50.406967 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.405622    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0024ce65-5059-4c76-b912-fee018cb987c-iptables-alerter-script\") pod \"iptables-alerter-9s6p7\" (UID: \"0024ce65-5059-4c76-b912-fee018cb987c\") " pod="openshift-network-operator/iptables-alerter-9s6p7"
Sep 15 16:26:50.406967 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.405670    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d55kl\" (UniqueName: \"kubernetes.io/projected/0024ce65-5059-4c76-b912-fee018cb987c-kube-api-access-d55kl\") pod \"iptables-alerter-9s6p7\" (UID: \"0024ce65-5059-4c76-b912-fee018cb987c\") " pod="openshift-network-operator/iptables-alerter-9s6p7"
Sep 15 16:26:50.406967 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.405697    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfxqb\" (UniqueName: \"kubernetes.io/projected/3aea9285-dc6b-4584-a146-3cebd64a5d83-kube-api-access-zfxqb\") pod \"multus-s8z2k\" (UID: \"3aea9285-dc6b-4584-a146-3cebd64a5d83\") " pod="openshift-multus/multus-s8z2k"
Sep 15 16:26:50.406967 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.405718    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c576ac52-148e-4877-8b32-3ca845e01acf-sys\") pod \"tuned-l4f6l\" (UID: \"c576ac52-148e-4877-8b32-3ca845e01acf\") " pod="openshift-cluster-node-tuning-operator/tuned-l4f6l"
Sep 15 16:26:50.406967 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.405613    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9683ce85-f982-4a05-83d0-a6ace6c05fd0-dbus\") pod \"global-pull-secret-syncer-n4g7x\" (UID: \"9683ce85-f982-4a05-83d0-a6ace6c05fd0\") " pod="kube-system/global-pull-secret-syncer-n4g7x"
Sep 15 16:26:50.406967 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.405760    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3aea9285-dc6b-4584-a146-3cebd64a5d83-host-var-lib-kubelet\") pod \"multus-s8z2k\" (UID: \"3aea9285-dc6b-4584-a146-3cebd64a5d83\") " pod="openshift-multus/multus-s8z2k"
Sep 15 16:26:50.406967 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.405784    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/97eb67a3-7048-4d86-9521-f76c77cf9166-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rtmw2\" (UID: \"97eb67a3-7048-4d86-9521-f76c77cf9166\") " pod="openshift-multus/multus-additional-cni-plugins-rtmw2"
Sep 15 16:26:50.406967 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.405809    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbf69\" (UniqueName: \"kubernetes.io/projected/c576ac52-148e-4877-8b32-3ca845e01acf-kube-api-access-jbf69\") pod \"tuned-l4f6l\" (UID: \"c576ac52-148e-4877-8b32-3ca845e01acf\") " pod="openshift-cluster-node-tuning-operator/tuned-l4f6l"
Sep 15 16:26:50.406967 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.405833    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a5da2ef5-4cda-424d-8618-79d3d4b6fe1c-agent-certs\") pod \"konnectivity-agent-txx8b\" (UID: \"a5da2ef5-4cda-424d-8618-79d3d4b6fe1c\") " pod="kube-system/konnectivity-agent-txx8b"
Sep 15 16:26:50.406967 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.405851    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22a84780-b244-4fa8-8b6b-60337f595112-tmp-dir\") pod \"node-resolver-v4dlm\" (UID: \"22a84780-b244-4fa8-8b6b-60337f595112\") " pod="openshift-dns/node-resolver-v4dlm"
Sep 15 16:26:50.406967 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.405861    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/314c32cc-a844-4d14-9ac8-c33379de1cdd-host-slash\") pod \"ovnkube-node-q4krz\" (UID: \"314c32cc-a844-4d14-9ac8-c33379de1cdd\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:26:50.406967 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.405889    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/314c32cc-a844-4d14-9ac8-c33379de1cdd-host-cni-netd\") pod \"ovnkube-node-q4krz\" (UID: \"314c32cc-a844-4d14-9ac8-c33379de1cdd\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:26:50.406967 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.405913    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3aea9285-dc6b-4584-a146-3cebd64a5d83-cni-binary-copy\") pod \"multus-s8z2k\" (UID: \"3aea9285-dc6b-4584-a146-3cebd64a5d83\") " pod="openshift-multus/multus-s8z2k"
Sep 15 16:26:50.406967 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.405969    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/97eb67a3-7048-4d86-9521-f76c77cf9166-cni-binary-copy\") pod \"multus-additional-cni-plugins-rtmw2\" (UID: \"97eb67a3-7048-4d86-9521-f76c77cf9166\") " pod="openshift-multus/multus-additional-cni-plugins-rtmw2"
Sep 15 16:26:50.406967 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.406081    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/314c32cc-a844-4d14-9ac8-c33379de1cdd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q4krz\" (UID: \"314c32cc-a844-4d14-9ac8-c33379de1cdd\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:26:50.406967 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.406116    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/314c32cc-a844-4d14-9ac8-c33379de1cdd-ovnkube-script-lib\") pod \"ovnkube-node-q4krz\" (UID: \"314c32cc-a844-4d14-9ac8-c33379de1cdd\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:26:50.406967 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.406108    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/314c32cc-a844-4d14-9ac8-c33379de1cdd-host-slash\") pod \"ovnkube-node-q4krz\" (UID: \"314c32cc-a844-4d14-9ac8-c33379de1cdd\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:26:50.407638 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.406155    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4a10ffb9-f241-40dc-8db4-c4813201e65d-serviceca\") pod \"node-ca-59vps\" (UID: \"4a10ffb9-f241-40dc-8db4-c4813201e65d\") " pod="openshift-image-registry/node-ca-59vps"
Sep 15 16:26:50.407638 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.406239    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0024ce65-5059-4c76-b912-fee018cb987c-host-slash\") pod \"iptables-alerter-9s6p7\" (UID: \"0024ce65-5059-4c76-b912-fee018cb987c\") " pod="openshift-network-operator/iptables-alerter-9s6p7"
Sep 15 16:26:50.407638 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.406266    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e26b5e43-b2b7-43dd-a078-e7cad5f5952a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f959f\" (UID: \"e26b5e43-b2b7-43dd-a078-e7cad5f5952a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f959f"
Sep 15 16:26:50.407638 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.406352    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/314c32cc-a844-4d14-9ac8-c33379de1cdd-host-cni-netd\") pod \"ovnkube-node-q4krz\" (UID: \"314c32cc-a844-4d14-9ac8-c33379de1cdd\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:26:50.407638 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.406402    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/314c32cc-a844-4d14-9ac8-c33379de1cdd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q4krz\" (UID: \"314c32cc-a844-4d14-9ac8-c33379de1cdd\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:26:50.407638 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.406570    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/314c32cc-a844-4d14-9ac8-c33379de1cdd-ovnkube-script-lib\") pod \"ovnkube-node-q4krz\" (UID: \"314c32cc-a844-4d14-9ac8-c33379de1cdd\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:26:50.408565 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.408537    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/314c32cc-a844-4d14-9ac8-c33379de1cdd-ovn-node-metrics-cert\") pod \"ovnkube-node-q4krz\" (UID: \"314c32cc-a844-4d14-9ac8-c33379de1cdd\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:26:50.411979 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:50.411946    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 16:26:50.412101 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:50.411985    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 16:26:50.412101 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:50.412000    2577 projected.go:196] Error preparing data for projected volume kube-api-access-9pn9l for pod openshift-network-diagnostics/network-check-target-4mbmd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 16:26:50.412101 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:50.412071    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9665201c-0ad3-4ba4-8bdb-beee79795c0e-kube-api-access-9pn9l podName:9665201c-0ad3-4ba4-8bdb-beee79795c0e nodeName:}" failed. No retries permitted until 2026-09-15 16:26:50.912053455 +0000 UTC m=+2.957471801 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9pn9l" (UniqueName: "kubernetes.io/projected/9665201c-0ad3-4ba4-8bdb-beee79795c0e-kube-api-access-9pn9l") pod "network-check-target-4mbmd" (UID: "9665201c-0ad3-4ba4-8bdb-beee79795c0e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 16:26:50.414446 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.414419    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bgg5\" (UniqueName: \"kubernetes.io/projected/3da3c8f3-fcce-45f3-9756-43be57b887a1-kube-api-access-8bgg5\") pod \"network-metrics-daemon-md7hc\" (UID: \"3da3c8f3-fcce-45f3-9756-43be57b887a1\") " pod="openshift-multus/network-metrics-daemon-md7hc"
Sep 15 16:26:50.415404 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.415386    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trrb9\" (UniqueName: \"kubernetes.io/projected/314c32cc-a844-4d14-9ac8-c33379de1cdd-kube-api-access-trrb9\") pod \"ovnkube-node-q4krz\" (UID: \"314c32cc-a844-4d14-9ac8-c33379de1cdd\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:26:50.415678 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.415658    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xg65j\" (UniqueName: \"kubernetes.io/projected/22a84780-b244-4fa8-8b6b-60337f595112-kube-api-access-xg65j\") pod \"node-resolver-v4dlm\" (UID: \"22a84780-b244-4fa8-8b6b-60337f595112\") " pod="openshift-dns/node-resolver-v4dlm"
Sep 15 16:26:50.506589 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.506555    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3aea9285-dc6b-4584-a146-3cebd64a5d83-multus-socket-dir-parent\") pod \"multus-s8z2k\" (UID: \"3aea9285-dc6b-4584-a146-3cebd64a5d83\") " pod="openshift-multus/multus-s8z2k"
Sep 15 16:26:50.506779 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.506599    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3aea9285-dc6b-4584-a146-3cebd64a5d83-hostroot\") pod \"multus-s8z2k\" (UID: \"3aea9285-dc6b-4584-a146-3cebd64a5d83\") " pod="openshift-multus/multus-s8z2k"
Sep 15 16:26:50.506779 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.506623    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3aea9285-dc6b-4584-a146-3cebd64a5d83-multus-daemon-config\") pod \"multus-s8z2k\" (UID: \"3aea9285-dc6b-4584-a146-3cebd64a5d83\") " pod="openshift-multus/multus-s8z2k"
Sep 15 16:26:50.506779 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.506675    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/97eb67a3-7048-4d86-9521-f76c77cf9166-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rtmw2\" (UID: \"97eb67a3-7048-4d86-9521-f76c77cf9166\") " pod="openshift-multus/multus-additional-cni-plugins-rtmw2"
Sep 15 16:26:50.506779 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.506699    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c576ac52-148e-4877-8b32-3ca845e01acf-var-lib-kubelet\") pod \"tuned-l4f6l\" (UID: \"c576ac52-148e-4877-8b32-3ca845e01acf\") " pod="openshift-cluster-node-tuning-operator/tuned-l4f6l"
Sep 15 16:26:50.506779 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.506710    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3aea9285-dc6b-4584-a146-3cebd64a5d83-multus-socket-dir-parent\") pod \"multus-s8z2k\" (UID: \"3aea9285-dc6b-4584-a146-3cebd64a5d83\") " pod="openshift-multus/multus-s8z2k"
Sep 15 16:26:50.506779 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.506711    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3aea9285-dc6b-4584-a146-3cebd64a5d83-hostroot\") pod \"multus-s8z2k\" (UID: \"3aea9285-dc6b-4584-a146-3cebd64a5d83\") " pod="openshift-multus/multus-s8z2k"
Sep 15 16:26:50.506779 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.506722    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3aea9285-dc6b-4584-a146-3cebd64a5d83-host-var-lib-cni-bin\") pod \"multus-s8z2k\" (UID: \"3aea9285-dc6b-4584-a146-3cebd64a5d83\") " pod="openshift-multus/multus-s8z2k"
Sep 15 16:26:50.507154 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.506785    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c576ac52-148e-4877-8b32-3ca845e01acf-var-lib-kubelet\") pod \"tuned-l4f6l\" (UID: \"c576ac52-148e-4877-8b32-3ca845e01acf\") " pod="openshift-cluster-node-tuning-operator/tuned-l4f6l"
Sep 15 16:26:50.507154 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.506786    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3aea9285-dc6b-4584-a146-3cebd64a5d83-host-run-multus-certs\") pod \"multus-s8z2k\" (UID: \"3aea9285-dc6b-4584-a146-3cebd64a5d83\") " pod="openshift-multus/multus-s8z2k"
Sep 15 16:26:50.507154 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.506813    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c576ac52-148e-4877-8b32-3ca845e01acf-etc-sysctl-conf\") pod \"tuned-l4f6l\" (UID: \"c576ac52-148e-4877-8b32-3ca845e01acf\") " pod="openshift-cluster-node-tuning-operator/tuned-l4f6l"
Sep 15 16:26:50.507154 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.506829    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3aea9285-dc6b-4584-a146-3cebd64a5d83-host-var-lib-cni-bin\") pod \"multus-s8z2k\" (UID: \"3aea9285-dc6b-4584-a146-3cebd64a5d83\") " pod="openshift-multus/multus-s8z2k"
Sep 15 16:26:50.507154 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.506838    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c576ac52-148e-4877-8b32-3ca845e01acf-run\") pod \"tuned-l4f6l\" (UID: \"c576ac52-148e-4877-8b32-3ca845e01acf\") " pod="openshift-cluster-node-tuning-operator/tuned-l4f6l"
Sep 15 16:26:50.507154 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.506869    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3aea9285-dc6b-4584-a146-3cebd64a5d83-host-run-multus-certs\") pod \"multus-s8z2k\" (UID: \"3aea9285-dc6b-4584-a146-3cebd64a5d83\") " pod="openshift-multus/multus-s8z2k"
Sep 15 16:26:50.507154 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.506874    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e26b5e43-b2b7-43dd-a078-e7cad5f5952a-socket-dir\") pod \"aws-ebs-csi-driver-node-f959f\" (UID: \"e26b5e43-b2b7-43dd-a078-e7cad5f5952a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f959f"
Sep 15 16:26:50.507154 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.506903    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3aea9285-dc6b-4584-a146-3cebd64a5d83-multus-cni-dir\") pod \"multus-s8z2k\" (UID: \"3aea9285-dc6b-4584-a146-3cebd64a5d83\") " pod="openshift-multus/multus-s8z2k"
Sep 15 16:26:50.507154 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.506978    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgpbd\" (UniqueName: \"kubernetes.io/projected/97eb67a3-7048-4d86-9521-f76c77cf9166-kube-api-access-zgpbd\") pod \"multus-additional-cni-plugins-rtmw2\" (UID: \"97eb67a3-7048-4d86-9521-f76c77cf9166\") " pod="openshift-multus/multus-additional-cni-plugins-rtmw2"
Sep 15 16:26:50.507154 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.507005    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3aea9285-dc6b-4584-a146-3cebd64a5d83-host-run-k8s-cni-cncf-io\") pod \"multus-s8z2k\" (UID: \"3aea9285-dc6b-4584-a146-3cebd64a5d83\") " pod="openshift-multus/multus-s8z2k"
Sep 15 16:26:50.507154 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.507039    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e26b5e43-b2b7-43dd-a078-e7cad5f5952a-socket-dir\") pod \"aws-ebs-csi-driver-node-f959f\" (UID: \"e26b5e43-b2b7-43dd-a078-e7cad5f5952a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f959f"
Sep 15 16:26:50.507154 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.507050    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c576ac52-148e-4877-8b32-3ca845e01acf-etc-sysconfig\") pod \"tuned-l4f6l\" (UID: \"c576ac52-148e-4877-8b32-3ca845e01acf\") " pod="openshift-cluster-node-tuning-operator/tuned-l4f6l"
Sep 15 16:26:50.507154 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.507095    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e26b5e43-b2b7-43dd-a078-e7cad5f5952a-device-dir\") pod \"aws-ebs-csi-driver-node-f959f\" (UID: \"e26b5e43-b2b7-43dd-a078-e7cad5f5952a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f959f"
Sep 15 16:26:50.507154 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.507100    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c576ac52-148e-4877-8b32-3ca845e01acf-etc-sysconfig\") pod \"tuned-l4f6l\" (UID: \"c576ac52-148e-4877-8b32-3ca845e01acf\") " pod="openshift-cluster-node-tuning-operator/tuned-l4f6l"
Sep 15 16:26:50.507154 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.507121    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3aea9285-dc6b-4584-a146-3cebd64a5d83-host-var-lib-cni-multus\") pod \"multus-s8z2k\" (UID: \"3aea9285-dc6b-4584-a146-3cebd64a5d83\") " pod="openshift-multus/multus-s8z2k"
Sep 15 16:26:50.507154 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.507143    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c576ac52-148e-4877-8b32-3ca845e01acf-host\") pod \"tuned-l4f6l\" (UID: \"c576ac52-148e-4877-8b32-3ca845e01acf\") " pod="openshift-cluster-node-tuning-operator/tuned-l4f6l"
Sep 15 16:26:50.507154 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.507163    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e26b5e43-b2b7-43dd-a078-e7cad5f5952a-registration-dir\") pod \"aws-ebs-csi-driver-node-f959f\" (UID: \"e26b5e43-b2b7-43dd-a078-e7cad5f5952a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f959f"
Sep 15 16:26:50.507896 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.507171    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3aea9285-dc6b-4584-a146-3cebd64a5d83-multus-cni-dir\") pod \"multus-s8z2k\" (UID: \"3aea9285-dc6b-4584-a146-3cebd64a5d83\") " pod="openshift-multus/multus-s8z2k"
Sep 15 16:26:50.507896 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.507177    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3aea9285-dc6b-4584-a146-3cebd64a5d83-cnibin\") pod \"multus-s8z2k\" (UID: \"3aea9285-dc6b-4584-a146-3cebd64a5d83\") " pod="openshift-multus/multus-s8z2k"
Sep 15 16:26:50.507896 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.507215    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97eb67a3-7048-4d86-9521-f76c77cf9166-system-cni-dir\") pod \"multus-additional-cni-plugins-rtmw2\" (UID: \"97eb67a3-7048-4d86-9521-f76c77cf9166\") " pod="openshift-multus/multus-additional-cni-plugins-rtmw2"
Sep 15 16:26:50.507896 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.507249    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c576ac52-148e-4877-8b32-3ca845e01acf-etc-kubernetes\") pod \"tuned-l4f6l\" (UID: \"c576ac52-148e-4877-8b32-3ca845e01acf\") " pod="openshift-cluster-node-tuning-operator/tuned-l4f6l"
Sep 15 16:26:50.507896 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.507273    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c576ac52-148e-4877-8b32-3ca845e01acf-etc-systemd\") pod \"tuned-l4f6l\" (UID: \"c576ac52-148e-4877-8b32-3ca845e01acf\") " pod="openshift-cluster-node-tuning-operator/tuned-l4f6l"
Sep 15 16:26:50.507896 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.507296    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c576ac52-148e-4877-8b32-3ca845e01acf-lib-modules\") pod \"tuned-l4f6l\" (UID: \"c576ac52-148e-4877-8b32-3ca845e01acf\") " pod="openshift-cluster-node-tuning-operator/tuned-l4f6l"
Sep 15 16:26:50.507896 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.507324    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4a10ffb9-f241-40dc-8db4-c4813201e65d-host\") pod \"node-ca-59vps\" (UID: \"4a10ffb9-f241-40dc-8db4-c4813201e65d\") " pod="openshift-image-registry/node-ca-59vps"
Sep 15 16:26:50.507896 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.507335    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3aea9285-dc6b-4584-a146-3cebd64a5d83-host-run-k8s-cni-cncf-io\") pod \"multus-s8z2k\" (UID: \"3aea9285-dc6b-4584-a146-3cebd64a5d83\") " pod="openshift-multus/multus-s8z2k"
Sep 15 16:26:50.507896 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.507347    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqkrx\" (UniqueName: \"kubernetes.io/projected/4a10ffb9-f241-40dc-8db4-c4813201e65d-kube-api-access-dqkrx\") pod \"node-ca-59vps\" (UID: \"4a10ffb9-f241-40dc-8db4-c4813201e65d\") " pod="openshift-image-registry/node-ca-59vps"
Sep 15 16:26:50.507896 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.507363    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/97eb67a3-7048-4d86-9521-f76c77cf9166-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rtmw2\" (UID: \"97eb67a3-7048-4d86-9521-f76c77cf9166\") " pod="openshift-multus/multus-additional-cni-plugins-rtmw2"
Sep 15 16:26:50.507896 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.507363    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3aea9285-dc6b-4584-a146-3cebd64a5d83-multus-daemon-config\") pod \"multus-s8z2k\" (UID: \"3aea9285-dc6b-4584-a146-3cebd64a5d83\") " pod="openshift-multus/multus-s8z2k"
Sep 15 16:26:50.507896 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.507385    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgtr8\" (UniqueName: \"kubernetes.io/projected/e26b5e43-b2b7-43dd-a078-e7cad5f5952a-kube-api-access-mgtr8\") pod \"aws-ebs-csi-driver-node-f959f\" (UID: \"e26b5e43-b2b7-43dd-a078-e7cad5f5952a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f959f"
Sep 15 16:26:50.507896 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.507433    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/97eb67a3-7048-4d86-9521-f76c77cf9166-cnibin\") pod \"multus-additional-cni-plugins-rtmw2\" (UID: \"97eb67a3-7048-4d86-9521-f76c77cf9166\") " pod="openshift-multus/multus-additional-cni-plugins-rtmw2"
Sep 15 16:26:50.507896 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.507460    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e26b5e43-b2b7-43dd-a078-e7cad5f5952a-etc-selinux\") pod \"aws-ebs-csi-driver-node-f959f\" (UID: \"e26b5e43-b2b7-43dd-a078-e7cad5f5952a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f959f"
Sep 15 16:26:50.507896 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.507487    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/97eb67a3-7048-4d86-9521-f76c77cf9166-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rtmw2\" (UID: \"97eb67a3-7048-4d86-9521-f76c77cf9166\") " pod="openshift-multus/multus-additional-cni-plugins-rtmw2"
Sep 15 16:26:50.507896 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.507513    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c576ac52-148e-4877-8b32-3ca845e01acf-etc-modprobe-d\") pod \"tuned-l4f6l\" (UID: \"c576ac52-148e-4877-8b32-3ca845e01acf\") " pod="openshift-cluster-node-tuning-operator/tuned-l4f6l"
Sep 15 16:26:50.507896 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.507531    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e26b5e43-b2b7-43dd-a078-e7cad5f5952a-device-dir\") pod \"aws-ebs-csi-driver-node-f959f\" (UID: \"e26b5e43-b2b7-43dd-a078-e7cad5f5952a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f959f"
Sep 15 16:26:50.508744 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.507537    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c576ac52-148e-4877-8b32-3ca845e01acf-etc-sysctl-d\") pod \"tuned-l4f6l\" (UID: \"c576ac52-148e-4877-8b32-3ca845e01acf\") " pod="openshift-cluster-node-tuning-operator/tuned-l4f6l"
Sep 15 16:26:50.508744 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.507569    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97eb67a3-7048-4d86-9521-f76c77cf9166-system-cni-dir\") pod \"multus-additional-cni-plugins-rtmw2\" (UID: \"97eb67a3-7048-4d86-9521-f76c77cf9166\") " pod="openshift-multus/multus-additional-cni-plugins-rtmw2"
Sep 15 16:26:50.508744 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.507574    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c576ac52-148e-4877-8b32-3ca845e01acf-etc-sysctl-conf\") pod \"tuned-l4f6l\" (UID: \"c576ac52-148e-4877-8b32-3ca845e01acf\") " pod="openshift-cluster-node-tuning-operator/tuned-l4f6l"
Sep 15 16:26:50.508744 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.507592    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c576ac52-148e-4877-8b32-3ca845e01acf-tmp\") pod \"tuned-l4f6l\" (UID: \"c576ac52-148e-4877-8b32-3ca845e01acf\") " pod="openshift-cluster-node-tuning-operator/tuned-l4f6l"
Sep 15 16:26:50.508744 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.507596    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3aea9285-dc6b-4584-a146-3cebd64a5d83-host-var-lib-cni-multus\") pod \"multus-s8z2k\" (UID: \"3aea9285-dc6b-4584-a146-3cebd64a5d83\") " pod="openshift-multus/multus-s8z2k"
Sep 15 16:26:50.508744 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.507632    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c576ac52-148e-4877-8b32-3ca845e01acf-etc-kubernetes\") pod \"tuned-l4f6l\" (UID: \"c576ac52-148e-4877-8b32-3ca845e01acf\") " pod="openshift-cluster-node-tuning-operator/tuned-l4f6l"
Sep 15 16:26:50.508744 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.507644    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c576ac52-148e-4877-8b32-3ca845e01acf-etc-sysctl-d\") pod \"tuned-l4f6l\" (UID: \"c576ac52-148e-4877-8b32-3ca845e01acf\") " pod="openshift-cluster-node-tuning-operator/tuned-l4f6l"
Sep 15 16:26:50.508744 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.507653    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c576ac52-148e-4877-8b32-3ca845e01acf-run\") pod \"tuned-l4f6l\" (UID: \"c576ac52-148e-4877-8b32-3ca845e01acf\") " pod="openshift-cluster-node-tuning-operator/tuned-l4f6l"
Sep 15 16:26:50.508744 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.507489    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e26b5e43-b2b7-43dd-a078-e7cad5f5952a-registration-dir\") pod \"aws-ebs-csi-driver-node-f959f\" (UID: \"e26b5e43-b2b7-43dd-a078-e7cad5f5952a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f959f"
Sep 15 16:26:50.508744 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.507669    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c576ac52-148e-4877-8b32-3ca845e01acf-host\") pod \"tuned-l4f6l\" (UID: \"c576ac52-148e-4877-8b32-3ca845e01acf\") " pod="openshift-cluster-node-tuning-operator/tuned-l4f6l"
Sep 15 16:26:50.508744 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.507674    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c576ac52-148e-4877-8b32-3ca845e01acf-etc-tuned\") pod \"tuned-l4f6l\" (UID: \"c576ac52-148e-4877-8b32-3ca845e01acf\") " pod="openshift-cluster-node-tuning-operator/tuned-l4f6l"
Sep 15 16:26:50.508744 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.507711    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e26b5e43-b2b7-43dd-a078-e7cad5f5952a-sys-fs\") pod \"aws-ebs-csi-driver-node-f959f\" (UID: \"e26b5e43-b2b7-43dd-a078-e7cad5f5952a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f959f"
Sep 15 16:26:50.508744 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.507726    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c576ac52-148e-4877-8b32-3ca845e01acf-lib-modules\") pod \"tuned-l4f6l\" (UID: \"c576ac52-148e-4877-8b32-3ca845e01acf\") " pod="openshift-cluster-node-tuning-operator/tuned-l4f6l"
Sep 15 16:26:50.508744 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.507731    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c576ac52-148e-4877-8b32-3ca845e01acf-etc-modprobe-d\") pod \"tuned-l4f6l\" (UID: \"c576ac52-148e-4877-8b32-3ca845e01acf\") " pod="openshift-cluster-node-tuning-operator/tuned-l4f6l"
Sep 15 16:26:50.508744 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.507737    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3aea9285-dc6b-4584-a146-3cebd64a5d83-host-run-netns\") pod \"multus-s8z2k\" (UID: \"3aea9285-dc6b-4584-a146-3cebd64a5d83\") " pod="openshift-multus/multus-s8z2k"
Sep 15 16:26:50.508744 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.507532    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3aea9285-dc6b-4584-a146-3cebd64a5d83-cnibin\") pod \"multus-s8z2k\" (UID: \"3aea9285-dc6b-4584-a146-3cebd64a5d83\") " pod="openshift-multus/multus-s8z2k"
Sep 15 16:26:50.508744 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.507763    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3aea9285-dc6b-4584-a146-3cebd64a5d83-multus-conf-dir\") pod \"multus-s8z2k\" (UID: \"3aea9285-dc6b-4584-a146-3cebd64a5d83\") " pod="openshift-multus/multus-s8z2k"
Sep 15 16:26:50.508744 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.507767    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4a10ffb9-f241-40dc-8db4-c4813201e65d-host\") pod \"node-ca-59vps\" (UID: \"4a10ffb9-f241-40dc-8db4-c4813201e65d\") " pod="openshift-image-registry/node-ca-59vps"
Sep 15 16:26:50.509594 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.507779    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/97eb67a3-7048-4d86-9521-f76c77cf9166-cnibin\") pod \"multus-additional-cni-plugins-rtmw2\" (UID: \"97eb67a3-7048-4d86-9521-f76c77cf9166\") " pod="openshift-multus/multus-additional-cni-plugins-rtmw2"
Sep 15 16:26:50.509594 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.507786    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3aea9285-dc6b-4584-a146-3cebd64a5d83-etc-kubernetes\") pod \"multus-s8z2k\" (UID: \"3aea9285-dc6b-4584-a146-3cebd64a5d83\") " pod="openshift-multus/multus-s8z2k"
Sep 15 16:26:50.509594 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.507811    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a5da2ef5-4cda-424d-8618-79d3d4b6fe1c-konnectivity-ca\") pod \"konnectivity-agent-txx8b\" (UID: \"a5da2ef5-4cda-424d-8618-79d3d4b6fe1c\") " pod="kube-system/konnectivity-agent-txx8b"
Sep 15 16:26:50.509594 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.507818    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3aea9285-dc6b-4584-a146-3cebd64a5d83-host-run-netns\") pod \"multus-s8z2k\" (UID: \"3aea9285-dc6b-4584-a146-3cebd64a5d83\") " pod="openshift-multus/multus-s8z2k"
Sep 15 16:26:50.509594 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.507837    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e26b5e43-b2b7-43dd-a078-e7cad5f5952a-etc-selinux\") pod \"aws-ebs-csi-driver-node-f959f\" (UID: \"e26b5e43-b2b7-43dd-a078-e7cad5f5952a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f959f"
Sep 15 16:26:50.509594 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.507840    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0024ce65-5059-4c76-b912-fee018cb987c-iptables-alerter-script\") pod \"iptables-alerter-9s6p7\" (UID: \"0024ce65-5059-4c76-b912-fee018cb987c\") " pod="openshift-network-operator/iptables-alerter-9s6p7"
Sep 15 16:26:50.509594 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.507864    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e26b5e43-b2b7-43dd-a078-e7cad5f5952a-sys-fs\") pod \"aws-ebs-csi-driver-node-f959f\" (UID: \"e26b5e43-b2b7-43dd-a078-e7cad5f5952a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f959f"
Sep 15 16:26:50.509594 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.507872    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d55kl\" (UniqueName: \"kubernetes.io/projected/0024ce65-5059-4c76-b912-fee018cb987c-kube-api-access-d55kl\") pod \"iptables-alerter-9s6p7\" (UID: \"0024ce65-5059-4c76-b912-fee018cb987c\") " pod="openshift-network-operator/iptables-alerter-9s6p7"
Sep 15 16:26:50.509594 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.507877    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3aea9285-dc6b-4584-a146-3cebd64a5d83-multus-conf-dir\") pod \"multus-s8z2k\" (UID: \"3aea9285-dc6b-4584-a146-3cebd64a5d83\") " pod="openshift-multus/multus-s8z2k"
Sep 15 16:26:50.509594 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.507896    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfxqb\" (UniqueName: \"kubernetes.io/projected/3aea9285-dc6b-4584-a146-3cebd64a5d83-kube-api-access-zfxqb\") pod \"multus-s8z2k\" (UID: \"3aea9285-dc6b-4584-a146-3cebd64a5d83\") " pod="openshift-multus/multus-s8z2k"
Sep 15 16:26:50.509594 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.507906    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c576ac52-148e-4877-8b32-3ca845e01acf-etc-systemd\") pod \"tuned-l4f6l\" (UID: \"c576ac52-148e-4877-8b32-3ca845e01acf\") " pod="openshift-cluster-node-tuning-operator/tuned-l4f6l"
Sep 15 16:26:50.509594 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.507911    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3aea9285-dc6b-4584-a146-3cebd64a5d83-etc-kubernetes\") pod \"multus-s8z2k\" (UID: \"3aea9285-dc6b-4584-a146-3cebd64a5d83\") " pod="openshift-multus/multus-s8z2k"
Sep 15 16:26:50.509594 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.507918    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c576ac52-148e-4877-8b32-3ca845e01acf-sys\") pod \"tuned-l4f6l\" (UID: \"c576ac52-148e-4877-8b32-3ca845e01acf\") " pod="openshift-cluster-node-tuning-operator/tuned-l4f6l"
Sep 15 16:26:50.509594 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.507936    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/97eb67a3-7048-4d86-9521-f76c77cf9166-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rtmw2\" (UID: \"97eb67a3-7048-4d86-9521-f76c77cf9166\") " pod="openshift-multus/multus-additional-cni-plugins-rtmw2"
Sep 15 16:26:50.509594 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.507985    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c576ac52-148e-4877-8b32-3ca845e01acf-sys\") pod \"tuned-l4f6l\" (UID: \"c576ac52-148e-4877-8b32-3ca845e01acf\") " pod="openshift-cluster-node-tuning-operator/tuned-l4f6l"
Sep 15 16:26:50.509594 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.508384    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a5da2ef5-4cda-424d-8618-79d3d4b6fe1c-konnectivity-ca\") pod \"konnectivity-agent-txx8b\" (UID: \"a5da2ef5-4cda-424d-8618-79d3d4b6fe1c\") " pod="kube-system/konnectivity-agent-txx8b"
Sep 15 16:26:50.509594 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.508426    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3aea9285-dc6b-4584-a146-3cebd64a5d83-host-var-lib-kubelet\") pod \"multus-s8z2k\" (UID: \"3aea9285-dc6b-4584-a146-3cebd64a5d83\") " pod="openshift-multus/multus-s8z2k"
Sep 15 16:26:50.510264 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.508505    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0024ce65-5059-4c76-b912-fee018cb987c-iptables-alerter-script\") pod \"iptables-alerter-9s6p7\" (UID: \"0024ce65-5059-4c76-b912-fee018cb987c\") " pod="openshift-network-operator/iptables-alerter-9s6p7"
Sep 15 16:26:50.510264 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.508512    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/97eb67a3-7048-4d86-9521-f76c77cf9166-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rtmw2\" (UID: \"97eb67a3-7048-4d86-9521-f76c77cf9166\") " pod="openshift-multus/multus-additional-cni-plugins-rtmw2"
Sep 15 16:26:50.510264 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.508559    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3aea9285-dc6b-4584-a146-3cebd64a5d83-host-var-lib-kubelet\") pod \"multus-s8z2k\" (UID: \"3aea9285-dc6b-4584-a146-3cebd64a5d83\") " pod="openshift-multus/multus-s8z2k"
Sep 15 16:26:50.510264 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.508639    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbf69\" (UniqueName: \"kubernetes.io/projected/c576ac52-148e-4877-8b32-3ca845e01acf-kube-api-access-jbf69\") pod \"tuned-l4f6l\" (UID: \"c576ac52-148e-4877-8b32-3ca845e01acf\") " pod="openshift-cluster-node-tuning-operator/tuned-l4f6l"
Sep 15 16:26:50.510264 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.508677    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a5da2ef5-4cda-424d-8618-79d3d4b6fe1c-agent-certs\") pod \"konnectivity-agent-txx8b\" (UID: \"a5da2ef5-4cda-424d-8618-79d3d4b6fe1c\") " pod="kube-system/konnectivity-agent-txx8b"
Sep 15 16:26:50.510264 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.508712    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3aea9285-dc6b-4584-a146-3cebd64a5d83-cni-binary-copy\") pod \"multus-s8z2k\" (UID: \"3aea9285-dc6b-4584-a146-3cebd64a5d83\") " pod="openshift-multus/multus-s8z2k"
Sep 15 16:26:50.510264 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.508737    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/97eb67a3-7048-4d86-9521-f76c77cf9166-cni-binary-copy\") pod \"multus-additional-cni-plugins-rtmw2\" (UID: \"97eb67a3-7048-4d86-9521-f76c77cf9166\") " pod="openshift-multus/multus-additional-cni-plugins-rtmw2"
Sep 15 16:26:50.510264 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.508764    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4a10ffb9-f241-40dc-8db4-c4813201e65d-serviceca\") pod \"node-ca-59vps\" (UID: \"4a10ffb9-f241-40dc-8db4-c4813201e65d\") " pod="openshift-image-registry/node-ca-59vps"
Sep 15 16:26:50.510264 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.508788    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0024ce65-5059-4c76-b912-fee018cb987c-host-slash\") pod \"iptables-alerter-9s6p7\" (UID: \"0024ce65-5059-4c76-b912-fee018cb987c\") " pod="openshift-network-operator/iptables-alerter-9s6p7"
Sep 15 16:26:50.510264 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.508813    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e26b5e43-b2b7-43dd-a078-e7cad5f5952a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f959f\" (UID: \"e26b5e43-b2b7-43dd-a078-e7cad5f5952a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f959f"
Sep 15 16:26:50.510264 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.508762    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/97eb67a3-7048-4d86-9521-f76c77cf9166-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rtmw2\" (UID: \"97eb67a3-7048-4d86-9521-f76c77cf9166\") " pod="openshift-multus/multus-additional-cni-plugins-rtmw2"
Sep 15 16:26:50.510264 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.508840    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3aea9285-dc6b-4584-a146-3cebd64a5d83-system-cni-dir\") pod \"multus-s8z2k\" (UID: \"3aea9285-dc6b-4584-a146-3cebd64a5d83\") " pod="openshift-multus/multus-s8z2k"
Sep 15 16:26:50.510264 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.508896    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e26b5e43-b2b7-43dd-a078-e7cad5f5952a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f959f\" (UID: \"e26b5e43-b2b7-43dd-a078-e7cad5f5952a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f959f"
Sep 15 16:26:50.510264 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.508951    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3aea9285-dc6b-4584-a146-3cebd64a5d83-system-cni-dir\") pod \"multus-s8z2k\" (UID: \"3aea9285-dc6b-4584-a146-3cebd64a5d83\") " pod="openshift-multus/multus-s8z2k"
Sep 15 16:26:50.510264 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.508999    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0024ce65-5059-4c76-b912-fee018cb987c-host-slash\") pod \"iptables-alerter-9s6p7\" (UID: \"0024ce65-5059-4c76-b912-fee018cb987c\") " pod="openshift-network-operator/iptables-alerter-9s6p7"
Sep 15 16:26:50.510264 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.509297    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3aea9285-dc6b-4584-a146-3cebd64a5d83-cni-binary-copy\") pod \"multus-s8z2k\" (UID: \"3aea9285-dc6b-4584-a146-3cebd64a5d83\") " pod="openshift-multus/multus-s8z2k"
Sep 15 16:26:50.510264 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.509296    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4a10ffb9-f241-40dc-8db4-c4813201e65d-serviceca\") pod \"node-ca-59vps\" (UID: \"4a10ffb9-f241-40dc-8db4-c4813201e65d\") " pod="openshift-image-registry/node-ca-59vps"
Sep 15 16:26:50.510953 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.509368    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/97eb67a3-7048-4d86-9521-f76c77cf9166-cni-binary-copy\") pod \"multus-additional-cni-plugins-rtmw2\" (UID: \"97eb67a3-7048-4d86-9521-f76c77cf9166\") " pod="openshift-multus/multus-additional-cni-plugins-rtmw2"
Sep 15 16:26:50.510953 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.510429    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c576ac52-148e-4877-8b32-3ca845e01acf-tmp\") pod \"tuned-l4f6l\" (UID: \"c576ac52-148e-4877-8b32-3ca845e01acf\") " pod="openshift-cluster-node-tuning-operator/tuned-l4f6l"
Sep 15 16:26:50.510953 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.510534    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 16:26:50.512168 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.512145    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a5da2ef5-4cda-424d-8618-79d3d4b6fe1c-agent-certs\") pod \"konnectivity-agent-txx8b\" (UID: \"a5da2ef5-4cda-424d-8618-79d3d4b6fe1c\") " pod="kube-system/konnectivity-agent-txx8b"
Sep 15 16:26:50.516090 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.516039    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgtr8\" (UniqueName: \"kubernetes.io/projected/e26b5e43-b2b7-43dd-a078-e7cad5f5952a-kube-api-access-mgtr8\") pod \"aws-ebs-csi-driver-node-f959f\" (UID: \"e26b5e43-b2b7-43dd-a078-e7cad5f5952a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f959f"
Sep 15 16:26:50.516213 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.516102    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqkrx\" (UniqueName: \"kubernetes.io/projected/4a10ffb9-f241-40dc-8db4-c4813201e65d-kube-api-access-dqkrx\") pod \"node-ca-59vps\" (UID: \"4a10ffb9-f241-40dc-8db4-c4813201e65d\") " pod="openshift-image-registry/node-ca-59vps"
Sep 15 16:26:50.516770 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.516746    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d55kl\" (UniqueName: \"kubernetes.io/projected/0024ce65-5059-4c76-b912-fee018cb987c-kube-api-access-d55kl\") pod \"iptables-alerter-9s6p7\" (UID: \"0024ce65-5059-4c76-b912-fee018cb987c\") " pod="openshift-network-operator/iptables-alerter-9s6p7"
Sep 15 16:26:50.517105 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.517080    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgpbd\" (UniqueName: \"kubernetes.io/projected/97eb67a3-7048-4d86-9521-f76c77cf9166-kube-api-access-zgpbd\") pod \"multus-additional-cni-plugins-rtmw2\" (UID: \"97eb67a3-7048-4d86-9521-f76c77cf9166\") " pod="openshift-multus/multus-additional-cni-plugins-rtmw2"
Sep 15 16:26:50.517409 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.517379    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfxqb\" (UniqueName: \"kubernetes.io/projected/3aea9285-dc6b-4584-a146-3cebd64a5d83-kube-api-access-zfxqb\") pod \"multus-s8z2k\" (UID: \"3aea9285-dc6b-4584-a146-3cebd64a5d83\") " pod="openshift-multus/multus-s8z2k"
Sep 15 16:26:50.517512 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.517434    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c576ac52-148e-4877-8b32-3ca845e01acf-etc-tuned\") pod \"tuned-l4f6l\" (UID: \"c576ac52-148e-4877-8b32-3ca845e01acf\") " pod="openshift-cluster-node-tuning-operator/tuned-l4f6l"
Sep 15 16:26:50.518403 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.518382    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbf69\" (UniqueName: \"kubernetes.io/projected/c576ac52-148e-4877-8b32-3ca845e01acf-kube-api-access-jbf69\") pod \"tuned-l4f6l\" (UID: \"c576ac52-148e-4877-8b32-3ca845e01acf\") " pod="openshift-cluster-node-tuning-operator/tuned-l4f6l"
Sep 15 16:26:50.593366 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.593329    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:26:50.602861 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.602835    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v4dlm"
Sep 15 16:26:50.613672 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.613647    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-59vps"
Sep 15 16:26:50.621423 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.621396    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9s6p7"
Sep 15 16:26:50.627079 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.627058    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f959f"
Sep 15 16:26:50.632793 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.632772    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rtmw2"
Sep 15 16:26:50.638459 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.638438    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-l4f6l"
Sep 15 16:26:50.644666 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.644648    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-s8z2k"
Sep 15 16:26:50.649436 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.649415    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-txx8b"
Sep 15 16:26:50.911727 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.911549    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9683ce85-f982-4a05-83d0-a6ace6c05fd0-original-pull-secret\") pod \"global-pull-secret-syncer-n4g7x\" (UID: \"9683ce85-f982-4a05-83d0-a6ace6c05fd0\") " pod="kube-system/global-pull-secret-syncer-n4g7x"
Sep 15 16:26:50.911727 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:50.911623    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3da3c8f3-fcce-45f3-9756-43be57b887a1-metrics-certs\") pod \"network-metrics-daemon-md7hc\" (UID: \"3da3c8f3-fcce-45f3-9756-43be57b887a1\") " pod="openshift-multus/network-metrics-daemon-md7hc"
Sep 15 16:26:50.911727 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:50.911690    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 16:26:50.911989 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:50.911759    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9683ce85-f982-4a05-83d0-a6ace6c05fd0-original-pull-secret podName:9683ce85-f982-4a05-83d0-a6ace6c05fd0 nodeName:}" failed. No retries permitted until 2026-09-15 16:26:51.911741447 +0000 UTC m=+3.957159776 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9683ce85-f982-4a05-83d0-a6ace6c05fd0-original-pull-secret") pod "global-pull-secret-syncer-n4g7x" (UID: "9683ce85-f982-4a05-83d0-a6ace6c05fd0") : object "kube-system"/"original-pull-secret" not registered
Sep 15 16:26:50.911989 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:50.911787    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 16:26:50.911989 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:50.911853    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3da3c8f3-fcce-45f3-9756-43be57b887a1-metrics-certs podName:3da3c8f3-fcce-45f3-9756-43be57b887a1 nodeName:}" failed. No retries permitted until 2026-09-15 16:26:51.911836267 +0000 UTC m=+3.957254611 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3da3c8f3-fcce-45f3-9756-43be57b887a1-metrics-certs") pod "network-metrics-daemon-md7hc" (UID: "3da3c8f3-fcce-45f3-9756-43be57b887a1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 16:26:51.012517 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:51.012489    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pn9l\" (UniqueName: \"kubernetes.io/projected/9665201c-0ad3-4ba4-8bdb-beee79795c0e-kube-api-access-9pn9l\") pod \"network-check-target-4mbmd\" (UID: \"9665201c-0ad3-4ba4-8bdb-beee79795c0e\") " pod="openshift-network-diagnostics/network-check-target-4mbmd"
Sep 15 16:26:51.012668 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:51.012647    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 16:26:51.012708 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:51.012677    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 16:26:51.012708 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:51.012691    2577 projected.go:196] Error preparing data for projected volume kube-api-access-9pn9l for pod openshift-network-diagnostics/network-check-target-4mbmd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 16:26:51.012773 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:51.012746    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9665201c-0ad3-4ba4-8bdb-beee79795c0e-kube-api-access-9pn9l podName:9665201c-0ad3-4ba4-8bdb-beee79795c0e nodeName:}" failed. No retries permitted until 2026-09-15 16:26:52.012732306 +0000 UTC m=+4.058150634 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9pn9l" (UniqueName: "kubernetes.io/projected/9665201c-0ad3-4ba4-8bdb-beee79795c0e-kube-api-access-9pn9l") pod "network-check-target-4mbmd" (UID: "9665201c-0ad3-4ba4-8bdb-beee79795c0e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 16:26:51.024076 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:51.024050    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod314c32cc_a844_4d14_9ac8_c33379de1cdd.slice/crio-4ed49cab0dc6faef9fca5e655af7ead5481455611d032c60563d7b491e52ddab WatchSource:0}: Error finding container 4ed49cab0dc6faef9fca5e655af7ead5481455611d032c60563d7b491e52ddab: Status 404 returned error can't find the container with id 4ed49cab0dc6faef9fca5e655af7ead5481455611d032c60563d7b491e52ddab
Sep 15 16:26:51.028837 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:51.028795    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5da2ef5_4cda_424d_8618_79d3d4b6fe1c.slice/crio-0e6760e44a632511b85c9fe683772391681f9b858f8070db4098f61f21424225 WatchSource:0}: Error finding container 0e6760e44a632511b85c9fe683772391681f9b858f8070db4098f61f21424225: Status 404 returned error can't find the container with id 0e6760e44a632511b85c9fe683772391681f9b858f8070db4098f61f21424225
Sep 15 16:26:51.029744 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:51.029708    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97eb67a3_7048_4d86_9521_f76c77cf9166.slice/crio-b1cd94b36422d460c9c379a563bcd6d6fa70883133465343ccf8597e25f8f296 WatchSource:0}: Error finding container b1cd94b36422d460c9c379a563bcd6d6fa70883133465343ccf8597e25f8f296: Status 404 returned error can't find the container with id b1cd94b36422d460c9c379a563bcd6d6fa70883133465343ccf8597e25f8f296
Sep 15 16:26:51.030001 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:51.029978    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22a84780_b244_4fa8_8b6b_60337f595112.slice/crio-2ac02297d80536fa038a0f62d7d019e9a6a6846b1d63652e2e9f05f9e377c579 WatchSource:0}: Error finding container 2ac02297d80536fa038a0f62d7d019e9a6a6846b1d63652e2e9f05f9e377c579: Status 404 returned error can't find the container with id 2ac02297d80536fa038a0f62d7d019e9a6a6846b1d63652e2e9f05f9e377c579
Sep 15 16:26:51.031694 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:51.031466    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0024ce65_5059_4c76_b912_fee018cb987c.slice/crio-da3d325ece2f754b3e6c76860c583554d8dc24dc7fde4a654a8dda53ae5531ce WatchSource:0}: Error finding container da3d325ece2f754b3e6c76860c583554d8dc24dc7fde4a654a8dda53ae5531ce: Status 404 returned error can't find the container with id da3d325ece2f754b3e6c76860c583554d8dc24dc7fde4a654a8dda53ae5531ce
Sep 15 16:26:51.078972 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:26:51.078947    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3c1b6418d61b672718063704460a13f.slice/crio-80276da837311789aae303e38ce15084d9637245e7c5674613bd317d1a9e4a2d WatchSource:0}: Error finding container 80276da837311789aae303e38ce15084d9637245e7c5674613bd317d1a9e4a2d: Status 404 returned error can't find the container with id 80276da837311789aae303e38ce15084d9637245e7c5674613bd317d1a9e4a2d
Sep 15 16:26:51.115460 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:51.115437    2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 16:26:51.338214 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:51.338125    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-14 16:21:50 +0000 UTC" deadline="2028-05-05 14:11:02.610983305 +0000 UTC"
Sep 15 16:26:51.338214 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:51.338156    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14349h44m11.272830185s"
Sep 15 16:26:51.386610 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:51.386580    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-md7hc"
Sep 15 16:26:51.386745 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:51.386621    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4g7x"
Sep 15 16:26:51.386745 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:51.386727    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-md7hc" podUID="3da3c8f3-fcce-45f3-9756-43be57b887a1"
Sep 15 16:26:51.386859 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:51.386843    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4g7x" podUID="9683ce85-f982-4a05-83d0-a6ace6c05fd0"
Sep 15 16:26:51.394095 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:51.394067    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-59vps" event={"ID":"4a10ffb9-f241-40dc-8db4-c4813201e65d","Type":"ContainerStarted","Data":"9c5c9a2e89ed491de012e8e11be03282201509b05162a2a290fc41e552814e53"}
Sep 15 16:26:51.395162 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:51.395135    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rtmw2" event={"ID":"97eb67a3-7048-4d86-9521-f76c77cf9166","Type":"ContainerStarted","Data":"b1cd94b36422d460c9c379a563bcd6d6fa70883133465343ccf8597e25f8f296"}
Sep 15 16:26:51.396291 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:51.396266    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q4krz" event={"ID":"314c32cc-a844-4d14-9ac8-c33379de1cdd","Type":"ContainerStarted","Data":"4ed49cab0dc6faef9fca5e655af7ead5481455611d032c60563d7b491e52ddab"}
Sep 15 16:26:51.398285 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:51.398262    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-222.ec2.internal" event={"ID":"254bd750f9fd800e2c1818cb4a5d50a1","Type":"ContainerStarted","Data":"5d11d87d26d735ab37d82e5e43fed79500cc892bbb0a8f3c2f3a86aa27223138"}
Sep 15 16:26:51.399390 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:51.399368    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-222.ec2.internal" event={"ID":"a3c1b6418d61b672718063704460a13f","Type":"ContainerStarted","Data":"80276da837311789aae303e38ce15084d9637245e7c5674613bd317d1a9e4a2d"}
Sep 15 16:26:51.400298 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:51.400281    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-s8z2k" event={"ID":"3aea9285-dc6b-4584-a146-3cebd64a5d83","Type":"ContainerStarted","Data":"69748f55dc4bc345e201914243d88a3b7c4eff33b8c8e64dea8e69ad9076dc01"}
Sep 15 16:26:51.401315 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:51.401295    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f959f" event={"ID":"e26b5e43-b2b7-43dd-a078-e7cad5f5952a","Type":"ContainerStarted","Data":"26e00ecf4efb32ab2feb6ea73392a9d6e2958c213ec68c569d9cd1587c9047d4"}
Sep 15 16:26:51.402301 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:51.402279    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9s6p7" event={"ID":"0024ce65-5059-4c76-b912-fee018cb987c","Type":"ContainerStarted","Data":"da3d325ece2f754b3e6c76860c583554d8dc24dc7fde4a654a8dda53ae5531ce"}
Sep 15 16:26:51.403521 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:51.403499    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v4dlm" event={"ID":"22a84780-b244-4fa8-8b6b-60337f595112","Type":"ContainerStarted","Data":"2ac02297d80536fa038a0f62d7d019e9a6a6846b1d63652e2e9f05f9e377c579"}
Sep 15 16:26:51.404568 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:51.404550    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-txx8b" event={"ID":"a5da2ef5-4cda-424d-8618-79d3d4b6fe1c","Type":"ContainerStarted","Data":"0e6760e44a632511b85c9fe683772391681f9b858f8070db4098f61f21424225"}
Sep 15 16:26:51.405533 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:51.405504    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-l4f6l" event={"ID":"c576ac52-148e-4877-8b32-3ca845e01acf","Type":"ContainerStarted","Data":"b4f5149339b102fe7dfac78c322bc391c3cb86255edccd7defe92b707ee3c6f8"}
Sep 15 16:26:51.413687 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:51.413640    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-222.ec2.internal" podStartSLOduration=2.41362857 podStartE2EDuration="2.41362857s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 16:26:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 16:26:51.413590406 +0000 UTC m=+3.459008755" watchObservedRunningTime="2026-09-15 16:26:51.41362857 +0000 UTC m=+3.459046919"
Sep 15 16:26:51.919402 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:51.919297    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9683ce85-f982-4a05-83d0-a6ace6c05fd0-original-pull-secret\") pod \"global-pull-secret-syncer-n4g7x\" (UID: \"9683ce85-f982-4a05-83d0-a6ace6c05fd0\") " pod="kube-system/global-pull-secret-syncer-n4g7x"
Sep 15 16:26:51.919402 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:51.919355    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3da3c8f3-fcce-45f3-9756-43be57b887a1-metrics-certs\") pod \"network-metrics-daemon-md7hc\" (UID: \"3da3c8f3-fcce-45f3-9756-43be57b887a1\") " pod="openshift-multus/network-metrics-daemon-md7hc"
Sep 15 16:26:51.925260 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:51.925185    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 16:26:51.925432 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:51.925274    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9683ce85-f982-4a05-83d0-a6ace6c05fd0-original-pull-secret podName:9683ce85-f982-4a05-83d0-a6ace6c05fd0 nodeName:}" failed. No retries permitted until 2026-09-15 16:26:53.925253579 +0000 UTC m=+5.970671913 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9683ce85-f982-4a05-83d0-a6ace6c05fd0-original-pull-secret") pod "global-pull-secret-syncer-n4g7x" (UID: "9683ce85-f982-4a05-83d0-a6ace6c05fd0") : object "kube-system"/"original-pull-secret" not registered
Sep 15 16:26:51.925432 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:51.925300    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 16:26:51.925432 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:51.925381    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3da3c8f3-fcce-45f3-9756-43be57b887a1-metrics-certs podName:3da3c8f3-fcce-45f3-9756-43be57b887a1 nodeName:}" failed. No retries permitted until 2026-09-15 16:26:53.925361108 +0000 UTC m=+5.970779439 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3da3c8f3-fcce-45f3-9756-43be57b887a1-metrics-certs") pod "network-metrics-daemon-md7hc" (UID: "3da3c8f3-fcce-45f3-9756-43be57b887a1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 16:26:52.021807 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:52.021165    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pn9l\" (UniqueName: \"kubernetes.io/projected/9665201c-0ad3-4ba4-8bdb-beee79795c0e-kube-api-access-9pn9l\") pod \"network-check-target-4mbmd\" (UID: \"9665201c-0ad3-4ba4-8bdb-beee79795c0e\") " pod="openshift-network-diagnostics/network-check-target-4mbmd"
Sep 15 16:26:52.021807 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:52.021385    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 16:26:52.021807 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:52.021405    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 16:26:52.021807 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:52.021417    2577 projected.go:196] Error preparing data for projected volume kube-api-access-9pn9l for pod openshift-network-diagnostics/network-check-target-4mbmd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 16:26:52.021807 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:52.021474    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9665201c-0ad3-4ba4-8bdb-beee79795c0e-kube-api-access-9pn9l podName:9665201c-0ad3-4ba4-8bdb-beee79795c0e nodeName:}" failed. No retries permitted until 2026-09-15 16:26:54.021457098 +0000 UTC m=+6.066875433 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9pn9l" (UniqueName: "kubernetes.io/projected/9665201c-0ad3-4ba4-8bdb-beee79795c0e-kube-api-access-9pn9l") pod "network-check-target-4mbmd" (UID: "9665201c-0ad3-4ba4-8bdb-beee79795c0e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 16:26:52.338456 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:52.338333    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-14 16:21:50 +0000 UTC" deadline="2028-06-26 05:37:59.15224839 +0000 UTC"
Sep 15 16:26:52.338456 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:52.338403    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15589h11m6.813849617s"
Sep 15 16:26:52.386423 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:52.386392    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mbmd"
Sep 15 16:26:52.386603 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:52.386553    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mbmd" podUID="9665201c-0ad3-4ba4-8bdb-beee79795c0e"
Sep 15 16:26:53.386484 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:53.386443    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-md7hc"
Sep 15 16:26:53.387091 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:53.386599    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-md7hc" podUID="3da3c8f3-fcce-45f3-9756-43be57b887a1"
Sep 15 16:26:53.387091 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:53.386987    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4g7x"
Sep 15 16:26:53.387213 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:53.387117    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4g7x" podUID="9683ce85-f982-4a05-83d0-a6ace6c05fd0"
Sep 15 16:26:53.937003 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:53.936965    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9683ce85-f982-4a05-83d0-a6ace6c05fd0-original-pull-secret\") pod \"global-pull-secret-syncer-n4g7x\" (UID: \"9683ce85-f982-4a05-83d0-a6ace6c05fd0\") " pod="kube-system/global-pull-secret-syncer-n4g7x"
Sep 15 16:26:53.937208 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:53.937038    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3da3c8f3-fcce-45f3-9756-43be57b887a1-metrics-certs\") pod \"network-metrics-daemon-md7hc\" (UID: \"3da3c8f3-fcce-45f3-9756-43be57b887a1\") " pod="openshift-multus/network-metrics-daemon-md7hc"
Sep 15 16:26:53.937208 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:53.937150    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 16:26:53.937301 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:53.937218    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9683ce85-f982-4a05-83d0-a6ace6c05fd0-original-pull-secret podName:9683ce85-f982-4a05-83d0-a6ace6c05fd0 nodeName:}" failed. No retries permitted until 2026-09-15 16:26:57.937197388 +0000 UTC m=+9.982615719 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9683ce85-f982-4a05-83d0-a6ace6c05fd0-original-pull-secret") pod "global-pull-secret-syncer-n4g7x" (UID: "9683ce85-f982-4a05-83d0-a6ace6c05fd0") : object "kube-system"/"original-pull-secret" not registered
Sep 15 16:26:53.937301 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:53.937150    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 16:26:53.937301 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:53.937298    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3da3c8f3-fcce-45f3-9756-43be57b887a1-metrics-certs podName:3da3c8f3-fcce-45f3-9756-43be57b887a1 nodeName:}" failed. No retries permitted until 2026-09-15 16:26:57.937285213 +0000 UTC m=+9.982703547 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3da3c8f3-fcce-45f3-9756-43be57b887a1-metrics-certs") pod "network-metrics-daemon-md7hc" (UID: "3da3c8f3-fcce-45f3-9756-43be57b887a1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 16:26:54.038293 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:54.038256    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pn9l\" (UniqueName: \"kubernetes.io/projected/9665201c-0ad3-4ba4-8bdb-beee79795c0e-kube-api-access-9pn9l\") pod \"network-check-target-4mbmd\" (UID: \"9665201c-0ad3-4ba4-8bdb-beee79795c0e\") " pod="openshift-network-diagnostics/network-check-target-4mbmd"
Sep 15 16:26:54.038499 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:54.038481    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 16:26:54.038562 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:54.038508    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 16:26:54.038562 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:54.038522    2577 projected.go:196] Error preparing data for projected volume kube-api-access-9pn9l for pod openshift-network-diagnostics/network-check-target-4mbmd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 16:26:54.038654 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:54.038579    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9665201c-0ad3-4ba4-8bdb-beee79795c0e-kube-api-access-9pn9l podName:9665201c-0ad3-4ba4-8bdb-beee79795c0e nodeName:}" failed. No retries permitted until 2026-09-15 16:26:58.038562122 +0000 UTC m=+10.083980472 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9pn9l" (UniqueName: "kubernetes.io/projected/9665201c-0ad3-4ba4-8bdb-beee79795c0e-kube-api-access-9pn9l") pod "network-check-target-4mbmd" (UID: "9665201c-0ad3-4ba4-8bdb-beee79795c0e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 16:26:54.388509 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:54.388467    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mbmd"
Sep 15 16:26:54.388972 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:54.388597    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mbmd" podUID="9665201c-0ad3-4ba4-8bdb-beee79795c0e"
Sep 15 16:26:55.386130 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:55.386095    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-md7hc"
Sep 15 16:26:55.386312 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:55.386103    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4g7x"
Sep 15 16:26:55.386312 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:55.386248    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-md7hc" podUID="3da3c8f3-fcce-45f3-9756-43be57b887a1"
Sep 15 16:26:55.386312 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:55.386298    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4g7x" podUID="9683ce85-f982-4a05-83d0-a6ace6c05fd0"
Sep 15 16:26:56.386156 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:56.386117    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mbmd"
Sep 15 16:26:56.386543 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:56.386258    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mbmd" podUID="9665201c-0ad3-4ba4-8bdb-beee79795c0e"
Sep 15 16:26:57.386199 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:57.386157    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-md7hc"
Sep 15 16:26:57.386678 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:57.386314    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-md7hc" podUID="3da3c8f3-fcce-45f3-9756-43be57b887a1"
Sep 15 16:26:57.386678 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:57.386632    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4g7x"
Sep 15 16:26:57.386786 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:57.386694    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4g7x" podUID="9683ce85-f982-4a05-83d0-a6ace6c05fd0"
Sep 15 16:26:57.979993 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:57.979268    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9683ce85-f982-4a05-83d0-a6ace6c05fd0-original-pull-secret\") pod \"global-pull-secret-syncer-n4g7x\" (UID: \"9683ce85-f982-4a05-83d0-a6ace6c05fd0\") " pod="kube-system/global-pull-secret-syncer-n4g7x"
Sep 15 16:26:57.979993 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:57.979326    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3da3c8f3-fcce-45f3-9756-43be57b887a1-metrics-certs\") pod \"network-metrics-daemon-md7hc\" (UID: \"3da3c8f3-fcce-45f3-9756-43be57b887a1\") " pod="openshift-multus/network-metrics-daemon-md7hc"
Sep 15 16:26:57.979993 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:57.979497    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 16:26:57.979993 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:57.979557    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3da3c8f3-fcce-45f3-9756-43be57b887a1-metrics-certs podName:3da3c8f3-fcce-45f3-9756-43be57b887a1 nodeName:}" failed. No retries permitted until 2026-09-15 16:27:05.979539331 +0000 UTC m=+18.024957665 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3da3c8f3-fcce-45f3-9756-43be57b887a1-metrics-certs") pod "network-metrics-daemon-md7hc" (UID: "3da3c8f3-fcce-45f3-9756-43be57b887a1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 16:26:57.979993 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:57.979900    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 16:26:57.979993 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:57.979960    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9683ce85-f982-4a05-83d0-a6ace6c05fd0-original-pull-secret podName:9683ce85-f982-4a05-83d0-a6ace6c05fd0 nodeName:}" failed. No retries permitted until 2026-09-15 16:27:05.979925186 +0000 UTC m=+18.025343513 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9683ce85-f982-4a05-83d0-a6ace6c05fd0-original-pull-secret") pod "global-pull-secret-syncer-n4g7x" (UID: "9683ce85-f982-4a05-83d0-a6ace6c05fd0") : object "kube-system"/"original-pull-secret" not registered
Sep 15 16:26:58.080068 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:58.080024    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pn9l\" (UniqueName: \"kubernetes.io/projected/9665201c-0ad3-4ba4-8bdb-beee79795c0e-kube-api-access-9pn9l\") pod \"network-check-target-4mbmd\" (UID: \"9665201c-0ad3-4ba4-8bdb-beee79795c0e\") " pod="openshift-network-diagnostics/network-check-target-4mbmd"
Sep 15 16:26:58.080790 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:58.080253    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 16:26:58.080790 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:58.080283    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 16:26:58.080790 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:58.080297    2577 projected.go:196] Error preparing data for projected volume kube-api-access-9pn9l for pod openshift-network-diagnostics/network-check-target-4mbmd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 16:26:58.080790 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:58.080384    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9665201c-0ad3-4ba4-8bdb-beee79795c0e-kube-api-access-9pn9l podName:9665201c-0ad3-4ba4-8bdb-beee79795c0e nodeName:}" failed. No retries permitted until 2026-09-15 16:27:06.08034951 +0000 UTC m=+18.125767849 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9pn9l" (UniqueName: "kubernetes.io/projected/9665201c-0ad3-4ba4-8bdb-beee79795c0e-kube-api-access-9pn9l") pod "network-check-target-4mbmd" (UID: "9665201c-0ad3-4ba4-8bdb-beee79795c0e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 16:26:58.387583 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:58.387109    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mbmd"
Sep 15 16:26:58.387583 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:58.387231    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mbmd" podUID="9665201c-0ad3-4ba4-8bdb-beee79795c0e"
Sep 15 16:26:59.386397 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:59.386358    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-md7hc"
Sep 15 16:26:59.386397 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:26:59.386378    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4g7x"
Sep 15 16:26:59.386636 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:59.386494    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4g7x" podUID="9683ce85-f982-4a05-83d0-a6ace6c05fd0"
Sep 15 16:26:59.386636 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:26:59.386622    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-md7hc" podUID="3da3c8f3-fcce-45f3-9756-43be57b887a1"
Sep 15 16:27:00.386123 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:00.386091    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mbmd"
Sep 15 16:27:00.386530 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:00.386194    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mbmd" podUID="9665201c-0ad3-4ba4-8bdb-beee79795c0e"
Sep 15 16:27:01.386508 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:01.386464    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4g7x"
Sep 15 16:27:01.386934 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:01.386605    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4g7x" podUID="9683ce85-f982-4a05-83d0-a6ace6c05fd0"
Sep 15 16:27:01.386934 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:01.386660    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-md7hc"
Sep 15 16:27:01.386934 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:01.386774    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-md7hc" podUID="3da3c8f3-fcce-45f3-9756-43be57b887a1"
Sep 15 16:27:02.386853 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:02.386816    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mbmd"
Sep 15 16:27:02.387495 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:02.386933    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mbmd" podUID="9665201c-0ad3-4ba4-8bdb-beee79795c0e"
Sep 15 16:27:03.386234 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:03.386191    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-md7hc"
Sep 15 16:27:03.386424 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:03.386242    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4g7x"
Sep 15 16:27:03.386424 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:03.386352    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-md7hc" podUID="3da3c8f3-fcce-45f3-9756-43be57b887a1"
Sep 15 16:27:03.386502 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:03.386461    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4g7x" podUID="9683ce85-f982-4a05-83d0-a6ace6c05fd0"
Sep 15 16:27:04.385940 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:04.385903    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mbmd"
Sep 15 16:27:04.386427 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:04.386045    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mbmd" podUID="9665201c-0ad3-4ba4-8bdb-beee79795c0e"
Sep 15 16:27:05.386232 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:05.386195    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4g7x"
Sep 15 16:27:05.386232 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:05.386227    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-md7hc"
Sep 15 16:27:05.386777 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:05.386333    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4g7x" podUID="9683ce85-f982-4a05-83d0-a6ace6c05fd0"
Sep 15 16:27:05.386777 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:05.386468    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-md7hc" podUID="3da3c8f3-fcce-45f3-9756-43be57b887a1"
Sep 15 16:27:06.036219 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:06.036177    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9683ce85-f982-4a05-83d0-a6ace6c05fd0-original-pull-secret\") pod \"global-pull-secret-syncer-n4g7x\" (UID: \"9683ce85-f982-4a05-83d0-a6ace6c05fd0\") " pod="kube-system/global-pull-secret-syncer-n4g7x"
Sep 15 16:27:06.036401 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:06.036234    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3da3c8f3-fcce-45f3-9756-43be57b887a1-metrics-certs\") pod \"network-metrics-daemon-md7hc\" (UID: \"3da3c8f3-fcce-45f3-9756-43be57b887a1\") " pod="openshift-multus/network-metrics-daemon-md7hc"
Sep 15 16:27:06.036401 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:06.036338    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 16:27:06.036498 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:06.036413    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9683ce85-f982-4a05-83d0-a6ace6c05fd0-original-pull-secret podName:9683ce85-f982-4a05-83d0-a6ace6c05fd0 nodeName:}" failed. No retries permitted until 2026-09-15 16:27:22.036398304 +0000 UTC m=+34.081816657 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9683ce85-f982-4a05-83d0-a6ace6c05fd0-original-pull-secret") pod "global-pull-secret-syncer-n4g7x" (UID: "9683ce85-f982-4a05-83d0-a6ace6c05fd0") : object "kube-system"/"original-pull-secret" not registered
Sep 15 16:27:06.036498 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:06.036346    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 16:27:06.036565 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:06.036515    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3da3c8f3-fcce-45f3-9756-43be57b887a1-metrics-certs podName:3da3c8f3-fcce-45f3-9756-43be57b887a1 nodeName:}" failed. No retries permitted until 2026-09-15 16:27:22.036489344 +0000 UTC m=+34.081907675 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3da3c8f3-fcce-45f3-9756-43be57b887a1-metrics-certs") pod "network-metrics-daemon-md7hc" (UID: "3da3c8f3-fcce-45f3-9756-43be57b887a1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 16:27:06.137500 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:06.137464    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pn9l\" (UniqueName: \"kubernetes.io/projected/9665201c-0ad3-4ba4-8bdb-beee79795c0e-kube-api-access-9pn9l\") pod \"network-check-target-4mbmd\" (UID: \"9665201c-0ad3-4ba4-8bdb-beee79795c0e\") " pod="openshift-network-diagnostics/network-check-target-4mbmd"
Sep 15 16:27:06.137666 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:06.137641    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 16:27:06.137666 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:06.137659    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 16:27:06.137666 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:06.137668    2577 projected.go:196] Error preparing data for projected volume kube-api-access-9pn9l for pod openshift-network-diagnostics/network-check-target-4mbmd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 16:27:06.137808 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:06.137729    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9665201c-0ad3-4ba4-8bdb-beee79795c0e-kube-api-access-9pn9l podName:9665201c-0ad3-4ba4-8bdb-beee79795c0e nodeName:}" failed. No retries permitted until 2026-09-15 16:27:22.137709372 +0000 UTC m=+34.183127735 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9pn9l" (UniqueName: "kubernetes.io/projected/9665201c-0ad3-4ba4-8bdb-beee79795c0e-kube-api-access-9pn9l") pod "network-check-target-4mbmd" (UID: "9665201c-0ad3-4ba4-8bdb-beee79795c0e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 16:27:06.386278 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:06.386249    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mbmd"
Sep 15 16:27:06.386743 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:06.386375    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mbmd" podUID="9665201c-0ad3-4ba4-8bdb-beee79795c0e"
Sep 15 16:27:07.386999 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:07.386702    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-md7hc"
Sep 15 16:27:07.386999 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:07.386740    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4g7x"
Sep 15 16:27:07.386999 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:07.386860    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-md7hc" podUID="3da3c8f3-fcce-45f3-9756-43be57b887a1"
Sep 15 16:27:07.387552 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:07.387001    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4g7x" podUID="9683ce85-f982-4a05-83d0-a6ace6c05fd0"
Sep 15 16:27:08.387140 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:08.387097    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mbmd"
Sep 15 16:27:08.387517 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:08.387217    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mbmd" podUID="9665201c-0ad3-4ba4-8bdb-beee79795c0e"
Sep 15 16:27:09.386830 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:09.386789    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-md7hc"
Sep 15 16:27:09.386830 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:09.386819    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4g7x"
Sep 15 16:27:09.387067 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:09.386905    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-md7hc" podUID="3da3c8f3-fcce-45f3-9756-43be57b887a1"
Sep 15 16:27:09.387067 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:09.387029    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4g7x" podUID="9683ce85-f982-4a05-83d0-a6ace6c05fd0"
Sep 15 16:27:10.387144 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:10.386752    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mbmd"
Sep 15 16:27:10.387646 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:10.387164    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mbmd" podUID="9665201c-0ad3-4ba4-8bdb-beee79795c0e"
Sep 15 16:27:10.452979 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:10.452949    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-s8z2k" event={"ID":"3aea9285-dc6b-4584-a146-3cebd64a5d83","Type":"ContainerStarted","Data":"02edaa93d4ed87c2c136cd44cea775637ea2cc41d78f00d0f35848d28c2acbaf"}
Sep 15 16:27:10.454550 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:10.454525    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f959f" event={"ID":"e26b5e43-b2b7-43dd-a078-e7cad5f5952a","Type":"ContainerStarted","Data":"6b3eef286d79604d7a4f887557f96968558fbf4c246d846133c118409ab5ec6c"}
Sep 15 16:27:10.455927 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:10.455902    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v4dlm" event={"ID":"22a84780-b244-4fa8-8b6b-60337f595112","Type":"ContainerStarted","Data":"2c5f8e88e002ac6eb3207d50d10ac7cae21f27a0123bd264e4c1c530dfa126a6"}
Sep 15 16:27:10.457355 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:10.457332    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-txx8b" event={"ID":"a5da2ef5-4cda-424d-8618-79d3d4b6fe1c","Type":"ContainerStarted","Data":"f45c59d036473f67d1db4aeda414111b531c64a7225764b52c0b43d9696dd6d3"}
Sep 15 16:27:10.458693 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:10.458670    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-l4f6l" event={"ID":"c576ac52-148e-4877-8b32-3ca845e01acf","Type":"ContainerStarted","Data":"cd663b64e2173e5c06d079302954929c1263dbc3ca5cf7564876d28a057bc2b6"}
Sep 15 16:27:10.460272 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:10.460242    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-59vps" event={"ID":"4a10ffb9-f241-40dc-8db4-c4813201e65d","Type":"ContainerStarted","Data":"464d5bab0a6aa04889a4dbe14e02e4a6f42813a78bd90ef58e5c426027586fdb"}
Sep 15 16:27:10.461875 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:10.461854    2577 generic.go:356] "Generic (PLEG): container finished" podID="97eb67a3-7048-4d86-9521-f76c77cf9166" containerID="fdc83cfe870b70764a028dd572729057e816dc5b99f303a9e6e7bf950febf1c3" exitCode=0
Sep 15 16:27:10.461969 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:10.461921    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rtmw2" event={"ID":"97eb67a3-7048-4d86-9521-f76c77cf9166","Type":"ContainerDied","Data":"fdc83cfe870b70764a028dd572729057e816dc5b99f303a9e6e7bf950febf1c3"}
Sep 15 16:27:10.464995 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:10.464974    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q4krz" event={"ID":"314c32cc-a844-4d14-9ac8-c33379de1cdd","Type":"ContainerStarted","Data":"7d31e26bcac7d6ff38868f0cd8734b75033b872774eee8ff531f7b12836ba31f"}
Sep 15 16:27:10.465110 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:10.465095    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q4krz" event={"ID":"314c32cc-a844-4d14-9ac8-c33379de1cdd","Type":"ContainerStarted","Data":"5f6810e9eb6eb0fcd5561430523d1b9b9eb5aa65b979dd98913fd4d3edefe1ac"}
Sep 15 16:27:10.465171 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:10.465150    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q4krz" event={"ID":"314c32cc-a844-4d14-9ac8-c33379de1cdd","Type":"ContainerStarted","Data":"ef4c4234fe10d0f31217ce9d6c7daf950c1735d94727637f9cf761c8d988c8ed"}
Sep 15 16:27:10.465224 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:10.465201    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q4krz" event={"ID":"314c32cc-a844-4d14-9ac8-c33379de1cdd","Type":"ContainerStarted","Data":"958da621c79362ee83833bea9d3c5a1c3a8a83cbf9104f198b3e74d3ec0fcded"}
Sep 15 16:27:10.465275 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:10.465251    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q4krz" event={"ID":"314c32cc-a844-4d14-9ac8-c33379de1cdd","Type":"ContainerStarted","Data":"7eeb6687241fbaaf47dcecda50b1a4487168950799164d55d37322ce11419e71"}
Sep 15 16:27:10.466698 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:10.466678    2577 generic.go:356] "Generic (PLEG): container finished" podID="a3c1b6418d61b672718063704460a13f" containerID="736ceb323b0a72828699238191527a86343bd7886dab4659570bd181680b473f" exitCode=0
Sep 15 16:27:10.466774 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:10.466709    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-222.ec2.internal" event={"ID":"a3c1b6418d61b672718063704460a13f","Type":"ContainerDied","Data":"736ceb323b0a72828699238191527a86343bd7886dab4659570bd181680b473f"}
Sep 15 16:27:10.470509 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:10.470472    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-s8z2k" podStartSLOduration=3.697663533 podStartE2EDuration="22.470459499s" totalImagesPullingTime="18.772795966s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 16:26:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 16:27:10.470291164 +0000 UTC m=+22.515709515" watchObservedRunningTime="2026-09-15 16:27:10.470459499 +0000 UTC m=+22.515877848"
Sep 15 16:27:10.484719 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:10.484675    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-txx8b" podStartSLOduration=3.718613496 podStartE2EDuration="22.484661853s" totalImagesPullingTime="18.766048357s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 16:26:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 16:27:10.484230229 +0000 UTC m=+22.529648626" watchObservedRunningTime="2026-09-15 16:27:10.484661853 +0000 UTC m=+22.530080202"
Sep 15 16:27:10.500856 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:10.500810    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-v4dlm" podStartSLOduration=3.7695672719999997 podStartE2EDuration="22.500796449s" totalImagesPullingTime="18.731229177s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 16:26:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 16:27:10.500495347 +0000 UTC m=+22.545913700" watchObservedRunningTime="2026-09-15 16:27:10.500796449 +0000 UTC m=+22.546214799"
Sep 15 16:27:10.563117 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:10.563000    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-59vps" podStartSLOduration=3.8588567769999997 podStartE2EDuration="22.562984351s" totalImagesPullingTime="18.704127574s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 16:26:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 16:27:10.562908465 +0000 UTC m=+22.608326825" watchObservedRunningTime="2026-09-15 16:27:10.562984351 +0000 UTC m=+22.608402701"
Sep 15 16:27:10.563473 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:10.563452    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-l4f6l" podStartSLOduration=3.798863096 podStartE2EDuration="22.563441783s" totalImagesPullingTime="18.764578687s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 16:26:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 16:27:10.547260948 +0000 UTC m=+22.592679297" watchObservedRunningTime="2026-09-15 16:27:10.563441783 +0000 UTC m=+22.608860133"
Sep 15 16:27:11.386749 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:11.386705    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-md7hc"
Sep 15 16:27:11.386749 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:11.386748    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4g7x"
Sep 15 16:27:11.387077 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:11.386854    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-md7hc" podUID="3da3c8f3-fcce-45f3-9756-43be57b887a1"
Sep 15 16:27:11.387077 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:11.386950    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4g7x" podUID="9683ce85-f982-4a05-83d0-a6ace6c05fd0"
Sep 15 16:27:11.475092 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:11.475056    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q4krz" event={"ID":"314c32cc-a844-4d14-9ac8-c33379de1cdd","Type":"ContainerStarted","Data":"fc14371bf401b546ba3d516e0e19bccff506090d12a427a2d5ce64f28361632a"}
Sep 15 16:27:11.476835 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:11.476798    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9s6p7" event={"ID":"0024ce65-5059-4c76-b912-fee018cb987c","Type":"ContainerStarted","Data":"a1d2d6d75bc630c7e546d506648f9d0eac96e8c848938e70745831e177424ee8"}
Sep 15 16:27:11.492241 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:11.492185    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-9s6p7" podStartSLOduration=4.763538742 podStartE2EDuration="23.492163994s" totalImagesPullingTime="18.728625252s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 16:26:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 16:27:11.491431667 +0000 UTC m=+23.536850017" watchObservedRunningTime="2026-09-15 16:27:11.492163994 +0000 UTC m=+23.537582346"
Sep 15 16:27:11.554466 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:11.554255    2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 15 16:27:12.040114 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:12.039946    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-txx8b"
Sep 15 16:27:12.040552 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:12.040525    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-txx8b"
Sep 15 16:27:12.362433 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:12.362325    2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-15T16:27:11.554460225Z","UUID":"4f6e2445-63c5-4577-8829-5c38a55ee1ec","Handler":null,"Name":"","Endpoint":""}
Sep 15 16:27:12.364667 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:12.364640    2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 15 16:27:12.364820 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:12.364685    2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 15 16:27:12.388878 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:12.386588    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mbmd"
Sep 15 16:27:12.388878 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:12.386717    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mbmd" podUID="9665201c-0ad3-4ba4-8bdb-beee79795c0e"
Sep 15 16:27:12.482545 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:12.482501    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f959f" event={"ID":"e26b5e43-b2b7-43dd-a078-e7cad5f5952a","Type":"ContainerStarted","Data":"dcbab865bdbd0df3b8bf5d2915a2c036b09e4f9ff87adb9959f0a0550ae4d5db"}
Sep 15 16:27:12.484780 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:12.484748    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-222.ec2.internal" event={"ID":"a3c1b6418d61b672718063704460a13f","Type":"ContainerStarted","Data":"3f70f72352d6eebf943ca9523def749eca5d12fdd67dd378c917e6ee55faec19"}
Sep 15 16:27:12.485272 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:12.485221    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-txx8b"
Sep 15 16:27:12.485651 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:12.485630    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-txx8b"
Sep 15 16:27:12.502752 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:12.502700    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-222.ec2.internal" podStartSLOduration=23.502684411 podStartE2EDuration="23.502684411s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 16:26:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 16:27:12.501867157 +0000 UTC m=+24.547285523" watchObservedRunningTime="2026-09-15 16:27:12.502684411 +0000 UTC m=+24.548102760"
Sep 15 16:27:13.386753 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:13.386715    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-md7hc"
Sep 15 16:27:13.386919 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:13.386715    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4g7x"
Sep 15 16:27:13.386919 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:13.386825    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-md7hc" podUID="3da3c8f3-fcce-45f3-9756-43be57b887a1"
Sep 15 16:27:13.386919 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:13.386903    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4g7x" podUID="9683ce85-f982-4a05-83d0-a6ace6c05fd0"
Sep 15 16:27:13.491129 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:13.491089    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q4krz" event={"ID":"314c32cc-a844-4d14-9ac8-c33379de1cdd","Type":"ContainerStarted","Data":"e2aac7c6cc771899ecf68fdc3964d8437c6570964d808d80425a29973cd48774"}
Sep 15 16:27:13.493683 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:13.493652    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f959f" event={"ID":"e26b5e43-b2b7-43dd-a078-e7cad5f5952a","Type":"ContainerStarted","Data":"b8d64356dc1f41937fd4de50882e5dbb3b28fdb4cc064ac2744bc180c9483ea9"}
Sep 15 16:27:13.514224 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:13.514173    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f959f" podStartSLOduration=4.598035878 podStartE2EDuration="25.514156442s" totalImagesPullingTime="20.916120564s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 16:26:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 16:27:13.513745759 +0000 UTC m=+25.559164110" watchObservedRunningTime="2026-09-15 16:27:13.514156442 +0000 UTC m=+25.559574807"
Sep 15 16:27:14.386871 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:14.386833    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mbmd"
Sep 15 16:27:14.387079 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:14.386970    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mbmd" podUID="9665201c-0ad3-4ba4-8bdb-beee79795c0e"
Sep 15 16:27:15.386968 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:15.386728    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-md7hc"
Sep 15 16:27:15.387451 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:15.386796    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4g7x"
Sep 15 16:27:15.387451 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:15.387033    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-md7hc" podUID="3da3c8f3-fcce-45f3-9756-43be57b887a1"
Sep 15 16:27:15.387451 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:15.387086    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4g7x" podUID="9683ce85-f982-4a05-83d0-a6ace6c05fd0"
Sep 15 16:27:15.500362 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:15.500332    2577 generic.go:356] "Generic (PLEG): container finished" podID="97eb67a3-7048-4d86-9521-f76c77cf9166" containerID="4bcd03ab3eb9d4a5c310986ce4c1f3e44cdb0782bb723aacbb5d3a6013cfc1fc" exitCode=0
Sep 15 16:27:15.500503 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:15.500405    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rtmw2" event={"ID":"97eb67a3-7048-4d86-9521-f76c77cf9166","Type":"ContainerDied","Data":"4bcd03ab3eb9d4a5c310986ce4c1f3e44cdb0782bb723aacbb5d3a6013cfc1fc"}
Sep 15 16:27:15.504522 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:15.504490    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q4krz" event={"ID":"314c32cc-a844-4d14-9ac8-c33379de1cdd","Type":"ContainerStarted","Data":"a7d4014b852636b97a5ac07109b7480693b5ea1613947783967d270dfb030e1e"}
Sep 15 16:27:15.504850 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:15.504829    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:27:15.504951 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:15.504898    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:27:15.504951 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:15.504939    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:27:15.520673 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:15.520648    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:27:15.520805 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:15.520754    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:27:15.549523 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:15.549466    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-q4krz" podStartSLOduration=8.735404799 podStartE2EDuration="27.549451294s" totalImagesPullingTime="18.814046495s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 16:26:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 16:27:15.54771599 +0000 UTC m=+27.593134340" watchObservedRunningTime="2026-09-15 16:27:15.549451294 +0000 UTC m=+27.594869683"
Sep 15 16:27:16.387956 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:16.387915    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mbmd"
Sep 15 16:27:16.388650 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:16.388090    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mbmd" podUID="9665201c-0ad3-4ba4-8bdb-beee79795c0e"
Sep 15 16:27:17.058069 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:17.058036    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-md7hc"]
Sep 15 16:27:17.058283 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:17.058148    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-md7hc"
Sep 15 16:27:17.058283 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:17.058239    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-md7hc" podUID="3da3c8f3-fcce-45f3-9756-43be57b887a1"
Sep 15 16:27:17.060887 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:17.060862    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4mbmd"]
Sep 15 16:27:17.061064 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:17.060943    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mbmd"
Sep 15 16:27:17.061064 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:17.061029    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mbmd" podUID="9665201c-0ad3-4ba4-8bdb-beee79795c0e"
Sep 15 16:27:17.075401 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:17.075336    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-n4g7x"]
Sep 15 16:27:17.075503 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:17.075439    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4g7x"
Sep 15 16:27:17.075550 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:17.075529    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4g7x" podUID="9683ce85-f982-4a05-83d0-a6ace6c05fd0"
Sep 15 16:27:17.512368 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:17.512311    2577 generic.go:356] "Generic (PLEG): container finished" podID="97eb67a3-7048-4d86-9521-f76c77cf9166" containerID="377becc6ecca178263b7fb2b1fe431e44542751ee2ead87407522d706102e8fb" exitCode=0
Sep 15 16:27:17.513931 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:17.513887    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rtmw2" event={"ID":"97eb67a3-7048-4d86-9521-f76c77cf9166","Type":"ContainerDied","Data":"377becc6ecca178263b7fb2b1fe431e44542751ee2ead87407522d706102e8fb"}
Sep 15 16:27:18.386742 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:18.386554    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4g7x"
Sep 15 16:27:18.386928 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:18.386827    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4g7x" podUID="9683ce85-f982-4a05-83d0-a6ace6c05fd0"
Sep 15 16:27:19.386671 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:19.386640    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mbmd"
Sep 15 16:27:19.387105 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:19.386642    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-md7hc"
Sep 15 16:27:19.387105 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:19.386788    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mbmd" podUID="9665201c-0ad3-4ba4-8bdb-beee79795c0e"
Sep 15 16:27:19.387105 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:19.386892    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-md7hc" podUID="3da3c8f3-fcce-45f3-9756-43be57b887a1"
Sep 15 16:27:19.520021 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:19.519919    2577 generic.go:356] "Generic (PLEG): container finished" podID="97eb67a3-7048-4d86-9521-f76c77cf9166" containerID="cde4576e61cac28681e3acd1b72244d2b59efbe0cd295b8118e19a707baf7ada" exitCode=0
Sep 15 16:27:19.520021 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:19.519975    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rtmw2" event={"ID":"97eb67a3-7048-4d86-9521-f76c77cf9166","Type":"ContainerDied","Data":"cde4576e61cac28681e3acd1b72244d2b59efbe0cd295b8118e19a707baf7ada"}
Sep 15 16:27:20.386431 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:20.386395    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4g7x"
Sep 15 16:27:20.386614 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:20.386542    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4g7x" podUID="9683ce85-f982-4a05-83d0-a6ace6c05fd0"
Sep 15 16:27:21.386922 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:21.386891    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-md7hc"
Sep 15 16:27:21.387435 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:21.386892    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mbmd"
Sep 15 16:27:21.387435 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:21.387069    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-md7hc" podUID="3da3c8f3-fcce-45f3-9756-43be57b887a1"
Sep 15 16:27:21.387435 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:21.387142    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mbmd" podUID="9665201c-0ad3-4ba4-8bdb-beee79795c0e"
Sep 15 16:27:22.046998 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:22.046960    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9683ce85-f982-4a05-83d0-a6ace6c05fd0-original-pull-secret\") pod \"global-pull-secret-syncer-n4g7x\" (UID: \"9683ce85-f982-4a05-83d0-a6ace6c05fd0\") " pod="kube-system/global-pull-secret-syncer-n4g7x"
Sep 15 16:27:22.047211 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:22.047031    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3da3c8f3-fcce-45f3-9756-43be57b887a1-metrics-certs\") pod \"network-metrics-daemon-md7hc\" (UID: \"3da3c8f3-fcce-45f3-9756-43be57b887a1\") " pod="openshift-multus/network-metrics-daemon-md7hc"
Sep 15 16:27:22.047211 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:22.047109    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 16:27:22.047211 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:22.047143    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 16:27:22.047211 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:22.047170    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9683ce85-f982-4a05-83d0-a6ace6c05fd0-original-pull-secret podName:9683ce85-f982-4a05-83d0-a6ace6c05fd0 nodeName:}" failed. No retries permitted until 2026-09-15 16:27:54.047153879 +0000 UTC m=+66.092572207 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9683ce85-f982-4a05-83d0-a6ace6c05fd0-original-pull-secret") pod "global-pull-secret-syncer-n4g7x" (UID: "9683ce85-f982-4a05-83d0-a6ace6c05fd0") : object "kube-system"/"original-pull-secret" not registered
Sep 15 16:27:22.047211 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:22.047195    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3da3c8f3-fcce-45f3-9756-43be57b887a1-metrics-certs podName:3da3c8f3-fcce-45f3-9756-43be57b887a1 nodeName:}" failed. No retries permitted until 2026-09-15 16:27:54.0471787 +0000 UTC m=+66.092597045 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3da3c8f3-fcce-45f3-9756-43be57b887a1-metrics-certs") pod "network-metrics-daemon-md7hc" (UID: "3da3c8f3-fcce-45f3-9756-43be57b887a1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 16:27:22.147952 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:22.147914    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pn9l\" (UniqueName: \"kubernetes.io/projected/9665201c-0ad3-4ba4-8bdb-beee79795c0e-kube-api-access-9pn9l\") pod \"network-check-target-4mbmd\" (UID: \"9665201c-0ad3-4ba4-8bdb-beee79795c0e\") " pod="openshift-network-diagnostics/network-check-target-4mbmd"
Sep 15 16:27:22.148145 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:22.148098    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 16:27:22.148145 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:22.148118    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 16:27:22.148145 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:22.148130    2577 projected.go:196] Error preparing data for projected volume kube-api-access-9pn9l for pod openshift-network-diagnostics/network-check-target-4mbmd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 16:27:22.148294 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:22.148192    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9665201c-0ad3-4ba4-8bdb-beee79795c0e-kube-api-access-9pn9l podName:9665201c-0ad3-4ba4-8bdb-beee79795c0e nodeName:}" failed. No retries permitted until 2026-09-15 16:27:54.148174846 +0000 UTC m=+66.193593189 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9pn9l" (UniqueName: "kubernetes.io/projected/9665201c-0ad3-4ba4-8bdb-beee79795c0e-kube-api-access-9pn9l") pod "network-check-target-4mbmd" (UID: "9665201c-0ad3-4ba4-8bdb-beee79795c0e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 16:27:22.386759 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:22.386727    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4g7x"
Sep 15 16:27:22.386914 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:22.386850    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4g7x" podUID="9683ce85-f982-4a05-83d0-a6ace6c05fd0"
Sep 15 16:27:23.386186 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:23.386156    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mbmd"
Sep 15 16:27:23.386570 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:23.386288    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4mbmd" podUID="9665201c-0ad3-4ba4-8bdb-beee79795c0e"
Sep 15 16:27:23.386570 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:23.386325    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-md7hc"
Sep 15 16:27:23.386570 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:23.386420    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-md7hc" podUID="3da3c8f3-fcce-45f3-9756-43be57b887a1"
Sep 15 16:27:23.778158 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:23.778129    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-222.ec2.internal" event="NodeReady"
Sep 15 16:27:23.778338 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:23.778277    2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 15 16:27:23.827624 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:23.827551    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-bhdfv"]
Sep 15 16:27:23.832725 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:23.832705    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-98f494d66-gnrc9"]
Sep 15 16:27:23.832829 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:23.832812    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bhdfv"
Sep 15 16:27:23.835150 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:23.835130    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-f2blw"]
Sep 15 16:27:23.835256 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:23.835241    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-98f494d66-gnrc9"
Sep 15 16:27:23.835519 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:23.835496    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xg4rz\""
Sep 15 16:27:23.835691 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:23.835563    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 15 16:27:23.835779 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:23.835759    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 15 16:27:23.838264 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:23.838246    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-f2blw"
Sep 15 16:27:23.838648 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:23.838627    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 15 16:27:23.838648 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:23.838625    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 15 16:27:23.838968 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:23.838950    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 15 16:27:23.839195 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:23.839176    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7jbp8\""
Sep 15 16:27:23.840368 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:23.840348    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 15 16:27:23.840666 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:23.840642    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 15 16:27:23.841650 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:23.841636    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 15 16:27:23.841863 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:23.841849    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-55j2f\""
Sep 15 16:27:23.846462 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:23.846444    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 15 16:27:23.847257 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:23.846834    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bhdfv"]
Sep 15 16:27:23.851698 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:23.851601    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-98f494d66-gnrc9"]
Sep 15 16:27:23.859567 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:23.859543    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-f2blw"]
Sep 15 16:27:23.962094 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:23.962056    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d046ec2b-6b1e-4f34-aa14-fa14f51c225d-metrics-tls\") pod \"dns-default-bhdfv\" (UID: \"d046ec2b-6b1e-4f34-aa14-fa14f51c225d\") " pod="openshift-dns/dns-default-bhdfv"
Sep 15 16:27:23.962094 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:23.962091    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/da9bad7d-dfae-478c-ab1a-f387fb52f503-ca-trust-extracted\") pod \"image-registry-98f494d66-gnrc9\" (UID: \"da9bad7d-dfae-478c-ab1a-f387fb52f503\") " pod="openshift-image-registry/image-registry-98f494d66-gnrc9"
Sep 15 16:27:23.962288 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:23.962115    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/da9bad7d-dfae-478c-ab1a-f387fb52f503-trusted-ca\") pod \"image-registry-98f494d66-gnrc9\" (UID: \"da9bad7d-dfae-478c-ab1a-f387fb52f503\") " pod="openshift-image-registry/image-registry-98f494d66-gnrc9"
Sep 15 16:27:23.962288 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:23.962133    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tzdm\" (UniqueName: \"kubernetes.io/projected/da9bad7d-dfae-478c-ab1a-f387fb52f503-kube-api-access-5tzdm\") pod \"image-registry-98f494d66-gnrc9\" (UID: \"da9bad7d-dfae-478c-ab1a-f387fb52f503\") " pod="openshift-image-registry/image-registry-98f494d66-gnrc9"
Sep 15 16:27:23.962288 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:23.962151    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da9bad7d-dfae-478c-ab1a-f387fb52f503-registry-tls\") pod \"image-registry-98f494d66-gnrc9\" (UID: \"da9bad7d-dfae-478c-ab1a-f387fb52f503\") " pod="openshift-image-registry/image-registry-98f494d66-gnrc9"
Sep 15 16:27:23.962288 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:23.962168    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9a7fe522-bb6a-43e1-b526-4b73776efaee-cert\") pod \"ingress-canary-f2blw\" (UID: \"9a7fe522-bb6a-43e1-b526-4b73776efaee\") " pod="openshift-ingress-canary/ingress-canary-f2blw"
Sep 15 16:27:23.962288 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:23.962222    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/da9bad7d-dfae-478c-ab1a-f387fb52f503-bound-sa-token\") pod \"image-registry-98f494d66-gnrc9\" (UID: \"da9bad7d-dfae-478c-ab1a-f387fb52f503\") " pod="openshift-image-registry/image-registry-98f494d66-gnrc9"
Sep 15 16:27:23.962288 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:23.962249    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/da9bad7d-dfae-478c-ab1a-f387fb52f503-image-registry-private-configuration\") pod \"image-registry-98f494d66-gnrc9\" (UID: \"da9bad7d-dfae-478c-ab1a-f387fb52f503\") " pod="openshift-image-registry/image-registry-98f494d66-gnrc9"
Sep 15 16:27:23.962288 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:23.962268    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/da9bad7d-dfae-478c-ab1a-f387fb52f503-installation-pull-secrets\") pod \"image-registry-98f494d66-gnrc9\" (UID: \"da9bad7d-dfae-478c-ab1a-f387fb52f503\") " pod="openshift-image-registry/image-registry-98f494d66-gnrc9"
Sep 15 16:27:23.962569 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:23.962293    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlgfn\" (UniqueName: \"kubernetes.io/projected/d046ec2b-6b1e-4f34-aa14-fa14f51c225d-kube-api-access-tlgfn\") pod \"dns-default-bhdfv\" (UID: \"d046ec2b-6b1e-4f34-aa14-fa14f51c225d\") " pod="openshift-dns/dns-default-bhdfv"
Sep 15 16:27:23.962569 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:23.962308    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d046ec2b-6b1e-4f34-aa14-fa14f51c225d-config-volume\") pod \"dns-default-bhdfv\" (UID: \"d046ec2b-6b1e-4f34-aa14-fa14f51c225d\") " pod="openshift-dns/dns-default-bhdfv"
Sep 15 16:27:23.962569 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:23.962345    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d046ec2b-6b1e-4f34-aa14-fa14f51c225d-tmp-dir\") pod \"dns-default-bhdfv\" (UID: \"d046ec2b-6b1e-4f34-aa14-fa14f51c225d\") " pod="openshift-dns/dns-default-bhdfv"
Sep 15 16:27:23.962569 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:23.962383    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/da9bad7d-dfae-478c-ab1a-f387fb52f503-registry-certificates\") pod \"image-registry-98f494d66-gnrc9\" (UID: \"da9bad7d-dfae-478c-ab1a-f387fb52f503\") " pod="openshift-image-registry/image-registry-98f494d66-gnrc9"
Sep 15 16:27:23.962569 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:23.962432    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dk5w\" (UniqueName: \"kubernetes.io/projected/9a7fe522-bb6a-43e1-b526-4b73776efaee-kube-api-access-4dk5w\") pod \"ingress-canary-f2blw\" (UID: \"9a7fe522-bb6a-43e1-b526-4b73776efaee\") " pod="openshift-ingress-canary/ingress-canary-f2blw"
Sep 15 16:27:24.063818 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:24.063789    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da9bad7d-dfae-478c-ab1a-f387fb52f503-registry-tls\") pod \"image-registry-98f494d66-gnrc9\" (UID: \"da9bad7d-dfae-478c-ab1a-f387fb52f503\") " pod="openshift-image-registry/image-registry-98f494d66-gnrc9"
Sep 15 16:27:24.063938 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:24.063826    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9a7fe522-bb6a-43e1-b526-4b73776efaee-cert\") pod \"ingress-canary-f2blw\" (UID: \"9a7fe522-bb6a-43e1-b526-4b73776efaee\") " pod="openshift-ingress-canary/ingress-canary-f2blw"
Sep 15 16:27:24.063938 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:24.063846    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/da9bad7d-dfae-478c-ab1a-f387fb52f503-bound-sa-token\") pod \"image-registry-98f494d66-gnrc9\" (UID: \"da9bad7d-dfae-478c-ab1a-f387fb52f503\") " pod="openshift-image-registry/image-registry-98f494d66-gnrc9"
Sep 15 16:27:24.063938 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:24.063865    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/da9bad7d-dfae-478c-ab1a-f387fb52f503-image-registry-private-configuration\") pod \"image-registry-98f494d66-gnrc9\" (UID: \"da9bad7d-dfae-478c-ab1a-f387fb52f503\") " pod="openshift-image-registry/image-registry-98f494d66-gnrc9"
Sep 15 16:27:24.063938 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:24.063886    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/da9bad7d-dfae-478c-ab1a-f387fb52f503-installation-pull-secrets\") pod \"image-registry-98f494d66-gnrc9\" (UID: \"da9bad7d-dfae-478c-ab1a-f387fb52f503\") " pod="openshift-image-registry/image-registry-98f494d66-gnrc9"
Sep 15 16:27:24.064165 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:24.063977    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 16:27:24.064165 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:24.064027    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-98f494d66-gnrc9: secret "image-registry-tls" not found
Sep 15 16:27:24.064165 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:24.064030    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlgfn\" (UniqueName: \"kubernetes.io/projected/d046ec2b-6b1e-4f34-aa14-fa14f51c225d-kube-api-access-tlgfn\") pod \"dns-default-bhdfv\" (UID: \"d046ec2b-6b1e-4f34-aa14-fa14f51c225d\") " pod="openshift-dns/dns-default-bhdfv"
Sep 15 16:27:24.064165 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:24.064078    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d046ec2b-6b1e-4f34-aa14-fa14f51c225d-config-volume\") pod \"dns-default-bhdfv\" (UID: \"d046ec2b-6b1e-4f34-aa14-fa14f51c225d\") " pod="openshift-dns/dns-default-bhdfv"
Sep 15 16:27:24.064165 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:24.064101    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da9bad7d-dfae-478c-ab1a-f387fb52f503-registry-tls podName:da9bad7d-dfae-478c-ab1a-f387fb52f503 nodeName:}" failed. No retries permitted until 2026-09-15 16:27:24.564080226 +0000 UTC m=+36.609498566 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/da9bad7d-dfae-478c-ab1a-f387fb52f503-registry-tls") pod "image-registry-98f494d66-gnrc9" (UID: "da9bad7d-dfae-478c-ab1a-f387fb52f503") : secret "image-registry-tls" not found
Sep 15 16:27:24.064406 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:24.064167    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d046ec2b-6b1e-4f34-aa14-fa14f51c225d-tmp-dir\") pod \"dns-default-bhdfv\" (UID: \"d046ec2b-6b1e-4f34-aa14-fa14f51c225d\") " pod="openshift-dns/dns-default-bhdfv"
Sep 15 16:27:24.064406 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:24.064191    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/da9bad7d-dfae-478c-ab1a-f387fb52f503-registry-certificates\") pod \"image-registry-98f494d66-gnrc9\" (UID: \"da9bad7d-dfae-478c-ab1a-f387fb52f503\") " pod="openshift-image-registry/image-registry-98f494d66-gnrc9"
Sep 15 16:27:24.064406 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:24.064215    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dk5w\" (UniqueName: \"kubernetes.io/projected/9a7fe522-bb6a-43e1-b526-4b73776efaee-kube-api-access-4dk5w\") pod \"ingress-canary-f2blw\" (UID: \"9a7fe522-bb6a-43e1-b526-4b73776efaee\") " pod="openshift-ingress-canary/ingress-canary-f2blw"
Sep 15 16:27:24.064406 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:24.064256    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d046ec2b-6b1e-4f34-aa14-fa14f51c225d-metrics-tls\") pod \"dns-default-bhdfv\" (UID: \"d046ec2b-6b1e-4f34-aa14-fa14f51c225d\") " pod="openshift-dns/dns-default-bhdfv"
Sep 15 16:27:24.064406 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:24.064275    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/da9bad7d-dfae-478c-ab1a-f387fb52f503-ca-trust-extracted\") pod \"image-registry-98f494d66-gnrc9\" (UID: \"da9bad7d-dfae-478c-ab1a-f387fb52f503\") " pod="openshift-image-registry/image-registry-98f494d66-gnrc9"
Sep 15 16:27:24.064406 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:24.064311    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/da9bad7d-dfae-478c-ab1a-f387fb52f503-trusted-ca\") pod \"image-registry-98f494d66-gnrc9\" (UID: \"da9bad7d-dfae-478c-ab1a-f387fb52f503\") " pod="openshift-image-registry/image-registry-98f494d66-gnrc9"
Sep 15 16:27:24.064406 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:24.064331    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tzdm\" (UniqueName: \"kubernetes.io/projected/da9bad7d-dfae-478c-ab1a-f387fb52f503-kube-api-access-5tzdm\") pod \"image-registry-98f494d66-gnrc9\" (UID: \"da9bad7d-dfae-478c-ab1a-f387fb52f503\") " pod="openshift-image-registry/image-registry-98f494d66-gnrc9"
Sep 15 16:27:24.064406 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:24.064386    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 16:27:24.064763 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:24.064437    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d046ec2b-6b1e-4f34-aa14-fa14f51c225d-metrics-tls podName:d046ec2b-6b1e-4f34-aa14-fa14f51c225d nodeName:}" failed. No retries permitted until 2026-09-15 16:27:24.564421405 +0000 UTC m=+36.609839734 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d046ec2b-6b1e-4f34-aa14-fa14f51c225d-metrics-tls") pod "dns-default-bhdfv" (UID: "d046ec2b-6b1e-4f34-aa14-fa14f51c225d") : secret "dns-default-metrics-tls" not found
Sep 15 16:27:24.064763 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:24.064689    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d046ec2b-6b1e-4f34-aa14-fa14f51c225d-config-volume\") pod \"dns-default-bhdfv\" (UID: \"d046ec2b-6b1e-4f34-aa14-fa14f51c225d\") " pod="openshift-dns/dns-default-bhdfv"
Sep 15 16:27:24.064882 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:24.064794    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d046ec2b-6b1e-4f34-aa14-fa14f51c225d-tmp-dir\") pod \"dns-default-bhdfv\" (UID: \"d046ec2b-6b1e-4f34-aa14-fa14f51c225d\") " pod="openshift-dns/dns-default-bhdfv"
Sep 15 16:27:24.064882 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:24.064813    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/da9bad7d-dfae-478c-ab1a-f387fb52f503-registry-certificates\") pod \"image-registry-98f494d66-gnrc9\" (UID: \"da9bad7d-dfae-478c-ab1a-f387fb52f503\") " pod="openshift-image-registry/image-registry-98f494d66-gnrc9"
Sep 15 16:27:24.064980 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:24.064930    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/da9bad7d-dfae-478c-ab1a-f387fb52f503-ca-trust-extracted\") pod \"image-registry-98f494d66-gnrc9\" (UID: \"da9bad7d-dfae-478c-ab1a-f387fb52f503\") " pod="openshift-image-registry/image-registry-98f494d66-gnrc9"
Sep 15 16:27:24.065799 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:24.065681    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/da9bad7d-dfae-478c-ab1a-f387fb52f503-trusted-ca\") pod \"image-registry-98f494d66-gnrc9\" (UID: \"da9bad7d-dfae-478c-ab1a-f387fb52f503\") " pod="openshift-image-registry/image-registry-98f494d66-gnrc9"
Sep 15 16:27:24.068171 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:24.068152    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/da9bad7d-dfae-478c-ab1a-f387fb52f503-installation-pull-secrets\") pod \"image-registry-98f494d66-gnrc9\" (UID: \"da9bad7d-dfae-478c-ab1a-f387fb52f503\") " pod="openshift-image-registry/image-registry-98f494d66-gnrc9"
Sep 15 16:27:24.068171 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:24.068162    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/da9bad7d-dfae-478c-ab1a-f387fb52f503-image-registry-private-configuration\") pod \"image-registry-98f494d66-gnrc9\" (UID: \"da9bad7d-dfae-478c-ab1a-f387fb52f503\") " pod="openshift-image-registry/image-registry-98f494d66-gnrc9"
Sep 15 16:27:24.068302 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:24.068205    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9a7fe522-bb6a-43e1-b526-4b73776efaee-cert\") pod \"ingress-canary-f2blw\" (UID: \"9a7fe522-bb6a-43e1-b526-4b73776efaee\") " pod="openshift-ingress-canary/ingress-canary-f2blw"
Sep 15 16:27:24.076040 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:24.075994    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/da9bad7d-dfae-478c-ab1a-f387fb52f503-bound-sa-token\") pod \"image-registry-98f494d66-gnrc9\" (UID: \"da9bad7d-dfae-478c-ab1a-f387fb52f503\") " pod="openshift-image-registry/image-registry-98f494d66-gnrc9"
Sep 15 16:27:24.076371 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:24.076352    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlgfn\" (UniqueName: \"kubernetes.io/projected/d046ec2b-6b1e-4f34-aa14-fa14f51c225d-kube-api-access-tlgfn\") pod \"dns-default-bhdfv\" (UID: \"d046ec2b-6b1e-4f34-aa14-fa14f51c225d\") " pod="openshift-dns/dns-default-bhdfv"
Sep 15 16:27:24.076608 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:24.076592    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dk5w\" (UniqueName: \"kubernetes.io/projected/9a7fe522-bb6a-43e1-b526-4b73776efaee-kube-api-access-4dk5w\") pod \"ingress-canary-f2blw\" (UID: \"9a7fe522-bb6a-43e1-b526-4b73776efaee\") " pod="openshift-ingress-canary/ingress-canary-f2blw"
Sep 15 16:27:24.076992 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:24.076977    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tzdm\" (UniqueName: \"kubernetes.io/projected/da9bad7d-dfae-478c-ab1a-f387fb52f503-kube-api-access-5tzdm\") pod \"image-registry-98f494d66-gnrc9\" (UID: \"da9bad7d-dfae-478c-ab1a-f387fb52f503\") " pod="openshift-image-registry/image-registry-98f494d66-gnrc9"
Sep 15 16:27:24.165348 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:24.165291    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-f2blw"
Sep 15 16:27:24.389950 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:24.389925    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4g7x"
Sep 15 16:27:24.392607 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:24.392587    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 15 16:27:24.445506 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:24.445467    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-f2blw"]
Sep 15 16:27:24.449713 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:27:24.449691    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a7fe522_bb6a_43e1_b526_4b73776efaee.slice/crio-973f6cb9ae6eecb8bd6f80c5b69b71f20b4e8c4e753e3e99c0986c0a4f87d784 WatchSource:0}: Error finding container 973f6cb9ae6eecb8bd6f80c5b69b71f20b4e8c4e753e3e99c0986c0a4f87d784: Status 404 returned error can't find the container with id 973f6cb9ae6eecb8bd6f80c5b69b71f20b4e8c4e753e3e99c0986c0a4f87d784
Sep 15 16:27:24.536505 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:24.536466    2577 generic.go:356] "Generic (PLEG): container finished" podID="97eb67a3-7048-4d86-9521-f76c77cf9166" containerID="52ff379d424826548526b06f1c2bdb22c3fd958664b0cff0c6eb2aa317cb930f" exitCode=0
Sep 15 16:27:24.536686 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:24.536559    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rtmw2" event={"ID":"97eb67a3-7048-4d86-9521-f76c77cf9166","Type":"ContainerDied","Data":"52ff379d424826548526b06f1c2bdb22c3fd958664b0cff0c6eb2aa317cb930f"}
Sep 15 16:27:24.537828 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:24.537799    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-f2blw" event={"ID":"9a7fe522-bb6a-43e1-b526-4b73776efaee","Type":"ContainerStarted","Data":"973f6cb9ae6eecb8bd6f80c5b69b71f20b4e8c4e753e3e99c0986c0a4f87d784"}
Sep 15 16:27:24.568775 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:24.568720    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da9bad7d-dfae-478c-ab1a-f387fb52f503-registry-tls\") pod \"image-registry-98f494d66-gnrc9\" (UID: \"da9bad7d-dfae-478c-ab1a-f387fb52f503\") " pod="openshift-image-registry/image-registry-98f494d66-gnrc9"
Sep 15 16:27:24.568943 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:24.568860    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d046ec2b-6b1e-4f34-aa14-fa14f51c225d-metrics-tls\") pod \"dns-default-bhdfv\" (UID: \"d046ec2b-6b1e-4f34-aa14-fa14f51c225d\") " pod="openshift-dns/dns-default-bhdfv"
Sep 15 16:27:24.568943 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:24.568905    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 16:27:24.568943 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:24.568929    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-98f494d66-gnrc9: secret "image-registry-tls" not found
Sep 15 16:27:24.569128 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:24.568975    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 16:27:24.569128 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:24.568990    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da9bad7d-dfae-478c-ab1a-f387fb52f503-registry-tls podName:da9bad7d-dfae-478c-ab1a-f387fb52f503 nodeName:}" failed. No retries permitted until 2026-09-15 16:27:25.56897431 +0000 UTC m=+37.614392658 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/da9bad7d-dfae-478c-ab1a-f387fb52f503-registry-tls") pod "image-registry-98f494d66-gnrc9" (UID: "da9bad7d-dfae-478c-ab1a-f387fb52f503") : secret "image-registry-tls" not found
Sep 15 16:27:24.569128 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:24.569049    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d046ec2b-6b1e-4f34-aa14-fa14f51c225d-metrics-tls podName:d046ec2b-6b1e-4f34-aa14-fa14f51c225d nodeName:}" failed. No retries permitted until 2026-09-15 16:27:25.56903331 +0000 UTC m=+37.614451652 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d046ec2b-6b1e-4f34-aa14-fa14f51c225d-metrics-tls") pod "dns-default-bhdfv" (UID: "d046ec2b-6b1e-4f34-aa14-fa14f51c225d") : secret "dns-default-metrics-tls" not found
Sep 15 16:27:25.386632 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:25.386601    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-md7hc"
Sep 15 16:27:25.386823 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:25.386648    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mbmd"
Sep 15 16:27:25.389629 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:25.389608    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 15 16:27:25.390557 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:25.390534    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vcckz\""
Sep 15 16:27:25.390557 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:25.390546    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9w9qq\""
Sep 15 16:27:25.391204 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:25.390580    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 15 16:27:25.391204 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:25.390546    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 15 16:27:25.544435 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:25.544400    2577 generic.go:356] "Generic (PLEG): container finished" podID="97eb67a3-7048-4d86-9521-f76c77cf9166" containerID="58251594f03a4edc0c78fb4c209b6d46c3f0044ec5179eb77ad135895b449584" exitCode=0
Sep 15 16:27:25.544592 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:25.544447    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rtmw2" event={"ID":"97eb67a3-7048-4d86-9521-f76c77cf9166","Type":"ContainerDied","Data":"58251594f03a4edc0c78fb4c209b6d46c3f0044ec5179eb77ad135895b449584"}
Sep 15 16:27:25.576599 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:25.576560    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d046ec2b-6b1e-4f34-aa14-fa14f51c225d-metrics-tls\") pod \"dns-default-bhdfv\" (UID: \"d046ec2b-6b1e-4f34-aa14-fa14f51c225d\") " pod="openshift-dns/dns-default-bhdfv"
Sep 15 16:27:25.576599 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:25.576604    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da9bad7d-dfae-478c-ab1a-f387fb52f503-registry-tls\") pod \"image-registry-98f494d66-gnrc9\" (UID: \"da9bad7d-dfae-478c-ab1a-f387fb52f503\") " pod="openshift-image-registry/image-registry-98f494d66-gnrc9"
Sep 15 16:27:25.576807 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:25.576743    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 16:27:25.576807 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:25.576757    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-98f494d66-gnrc9: secret "image-registry-tls" not found
Sep 15 16:27:25.576807 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:25.576797    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da9bad7d-dfae-478c-ab1a-f387fb52f503-registry-tls podName:da9bad7d-dfae-478c-ab1a-f387fb52f503 nodeName:}" failed. No retries permitted until 2026-09-15 16:27:27.57678619 +0000 UTC m=+39.622204518 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/da9bad7d-dfae-478c-ab1a-f387fb52f503-registry-tls") pod "image-registry-98f494d66-gnrc9" (UID: "da9bad7d-dfae-478c-ab1a-f387fb52f503") : secret "image-registry-tls" not found
Sep 15 16:27:25.576912 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:25.576844    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 16:27:25.576912 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:25.576864    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d046ec2b-6b1e-4f34-aa14-fa14f51c225d-metrics-tls podName:d046ec2b-6b1e-4f34-aa14-fa14f51c225d nodeName:}" failed. No retries permitted until 2026-09-15 16:27:27.576857397 +0000 UTC m=+39.622275725 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d046ec2b-6b1e-4f34-aa14-fa14f51c225d-metrics-tls") pod "dns-default-bhdfv" (UID: "d046ec2b-6b1e-4f34-aa14-fa14f51c225d") : secret "dns-default-metrics-tls" not found
Sep 15 16:27:26.551912 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:26.551662    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rtmw2" event={"ID":"97eb67a3-7048-4d86-9521-f76c77cf9166","Type":"ContainerStarted","Data":"74a4b5d3c55309b95708f3e0288a90b8a6cf19ce1f66670792f367c7b1520430"}
Sep 15 16:27:26.585429 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:26.585366    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-rtmw2" podStartSLOduration=8.878671936 podStartE2EDuration="38.585348252s" totalImagesPullingTime="29.706676316s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 16:26:48 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 16:27:26.585281234 +0000 UTC m=+38.630699588" watchObservedRunningTime="2026-09-15 16:27:26.585348252 +0000 UTC m=+38.630766602"
Sep 15 16:27:27.555853 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:27.555818    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-f2blw" event={"ID":"9a7fe522-bb6a-43e1-b526-4b73776efaee","Type":"ContainerStarted","Data":"7634daa421a524a06d3f1fbcc84025ef4de9795e0f6c1522fc4621b0ba4ca437"}
Sep 15 16:27:27.575175 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:27.575129    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-f2blw" podStartSLOduration=1.94892119 podStartE2EDuration="4.575114182s" totalImagesPullingTime="2.626192992s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 16:27:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 16:27:27.574305101 +0000 UTC m=+39.619723453" watchObservedRunningTime="2026-09-15 16:27:27.575114182 +0000 UTC m=+39.620532538"
Sep 15 16:27:27.593165 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:27.593135    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d046ec2b-6b1e-4f34-aa14-fa14f51c225d-metrics-tls\") pod \"dns-default-bhdfv\" (UID: \"d046ec2b-6b1e-4f34-aa14-fa14f51c225d\") " pod="openshift-dns/dns-default-bhdfv"
Sep 15 16:27:27.593317 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:27.593180    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da9bad7d-dfae-478c-ab1a-f387fb52f503-registry-tls\") pod \"image-registry-98f494d66-gnrc9\" (UID: \"da9bad7d-dfae-478c-ab1a-f387fb52f503\") " pod="openshift-image-registry/image-registry-98f494d66-gnrc9"
Sep 15 16:27:27.593317 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:27.593280    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 16:27:27.593317 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:27.593282    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 16:27:27.593317 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:27.593291    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-98f494d66-gnrc9: secret "image-registry-tls" not found
Sep 15 16:27:27.593429 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:27.593345    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da9bad7d-dfae-478c-ab1a-f387fb52f503-registry-tls podName:da9bad7d-dfae-478c-ab1a-f387fb52f503 nodeName:}" failed. No retries permitted until 2026-09-15 16:27:31.593330685 +0000 UTC m=+43.638749012 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/da9bad7d-dfae-478c-ab1a-f387fb52f503-registry-tls") pod "image-registry-98f494d66-gnrc9" (UID: "da9bad7d-dfae-478c-ab1a-f387fb52f503") : secret "image-registry-tls" not found
Sep 15 16:27:27.593429 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:27.593357    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d046ec2b-6b1e-4f34-aa14-fa14f51c225d-metrics-tls podName:d046ec2b-6b1e-4f34-aa14-fa14f51c225d nodeName:}" failed. No retries permitted until 2026-09-15 16:27:31.59335116 +0000 UTC m=+43.638769488 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d046ec2b-6b1e-4f34-aa14-fa14f51c225d-metrics-tls") pod "dns-default-bhdfv" (UID: "d046ec2b-6b1e-4f34-aa14-fa14f51c225d") : secret "dns-default-metrics-tls" not found
Sep 15 16:27:29.787103 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:29.787066    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-7wnbg"]
Sep 15 16:27:29.806838 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:29.806804    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7wnbg"]
Sep 15 16:27:29.806964 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:29.806893    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7wnbg"
Sep 15 16:27:29.812272 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:29.812237    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 15 16:27:29.812428 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:29.812251    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 15 16:27:29.812428 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:29.812253    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 15 16:27:29.812428 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:29.812410    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jpbwt\""
Sep 15 16:27:29.812760 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:29.812727    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 15 16:27:29.909456 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:29.909415    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0-crio-socket\") pod \"insights-runtime-extractor-7wnbg\" (UID: \"e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0\") " pod="openshift-insights/insights-runtime-extractor-7wnbg"
Sep 15 16:27:29.909456 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:29.909462    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7wnbg\" (UID: \"e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0\") " pod="openshift-insights/insights-runtime-extractor-7wnbg"
Sep 15 16:27:29.909708 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:29.909491    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0-data-volume\") pod \"insights-runtime-extractor-7wnbg\" (UID: \"e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0\") " pod="openshift-insights/insights-runtime-extractor-7wnbg"
Sep 15 16:27:29.909708 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:29.909584    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfbr8\" (UniqueName: \"kubernetes.io/projected/e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0-kube-api-access-gfbr8\") pod \"insights-runtime-extractor-7wnbg\" (UID: \"e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0\") " pod="openshift-insights/insights-runtime-extractor-7wnbg"
Sep 15 16:27:29.909708 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:29.909695    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7wnbg\" (UID: \"e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0\") " pod="openshift-insights/insights-runtime-extractor-7wnbg"
Sep 15 16:27:30.010807 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:30.010767    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7wnbg\" (UID: \"e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0\") " pod="openshift-insights/insights-runtime-extractor-7wnbg"
Sep 15 16:27:30.010985 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:30.010815    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0-crio-socket\") pod \"insights-runtime-extractor-7wnbg\" (UID: \"e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0\") " pod="openshift-insights/insights-runtime-extractor-7wnbg"
Sep 15 16:27:30.010985 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:30.010927    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 16:27:30.010985 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:30.010974    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 16:27:30.011163 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:30.010930    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7wnbg\" (UID: \"e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0\") " pod="openshift-insights/insights-runtime-extractor-7wnbg"
Sep 15 16:27:30.011163 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:30.011045    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0-insights-runtime-extractor-tls podName:e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0 nodeName:}" failed. No retries permitted until 2026-09-15 16:27:30.510987271 +0000 UTC m=+42.556405616 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7wnbg" (UID: "e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0") : secret "insights-runtime-extractor-tls" not found
Sep 15 16:27:30.011163 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:30.011043    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0-crio-socket\") pod \"insights-runtime-extractor-7wnbg\" (UID: \"e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0\") " pod="openshift-insights/insights-runtime-extractor-7wnbg"
Sep 15 16:27:30.011163 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:30.011070    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0-kube-rbac-proxy-cm podName:e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0 nodeName:}" failed. No retries permitted until 2026-09-15 16:27:30.511056306 +0000 UTC m=+42.556474633 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7wnbg" (UID: "e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0") : configmap "kube-rbac-proxy" not found
Sep 15 16:27:30.011163 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:30.011112    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0-data-volume\") pod \"insights-runtime-extractor-7wnbg\" (UID: \"e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0\") " pod="openshift-insights/insights-runtime-extractor-7wnbg"
Sep 15 16:27:30.011163 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:30.011141    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfbr8\" (UniqueName: \"kubernetes.io/projected/e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0-kube-api-access-gfbr8\") pod \"insights-runtime-extractor-7wnbg\" (UID: \"e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0\") " pod="openshift-insights/insights-runtime-extractor-7wnbg"
Sep 15 16:27:30.011445 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:30.011429    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0-data-volume\") pod \"insights-runtime-extractor-7wnbg\" (UID: \"e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0\") " pod="openshift-insights/insights-runtime-extractor-7wnbg"
Sep 15 16:27:30.021896 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:30.021873    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfbr8\" (UniqueName: \"kubernetes.io/projected/e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0-kube-api-access-gfbr8\") pod \"insights-runtime-extractor-7wnbg\" (UID: \"e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0\") " pod="openshift-insights/insights-runtime-extractor-7wnbg"
Sep 15 16:27:30.514965 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:30.514935    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7wnbg\" (UID: \"e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0\") " pod="openshift-insights/insights-runtime-extractor-7wnbg"
Sep 15 16:27:30.515155 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:30.514978    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7wnbg\" (UID: \"e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0\") " pod="openshift-insights/insights-runtime-extractor-7wnbg"
Sep 15 16:27:30.515155 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:30.515091    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 16:27:30.515155 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:30.515119    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 16:27:30.515258 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:30.515159    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0-kube-rbac-proxy-cm podName:e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0 nodeName:}" failed. No retries permitted until 2026-09-15 16:27:31.515139821 +0000 UTC m=+43.560558166 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7wnbg" (UID: "e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0") : configmap "kube-rbac-proxy" not found
Sep 15 16:27:30.515258 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:30.515175    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0-insights-runtime-extractor-tls podName:e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0 nodeName:}" failed. No retries permitted until 2026-09-15 16:27:31.515167307 +0000 UTC m=+43.560585636 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7wnbg" (UID: "e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0") : secret "insights-runtime-extractor-tls" not found
Sep 15 16:27:31.522080 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:31.522045    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7wnbg\" (UID: \"e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0\") " pod="openshift-insights/insights-runtime-extractor-7wnbg"
Sep 15 16:27:31.522450 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:31.522100    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7wnbg\" (UID: \"e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0\") " pod="openshift-insights/insights-runtime-extractor-7wnbg"
Sep 15 16:27:31.522450 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:31.522162    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 16:27:31.522450 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:31.522194    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 16:27:31.522450 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:31.522209    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0-kube-rbac-proxy-cm podName:e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0 nodeName:}" failed. No retries permitted until 2026-09-15 16:27:33.522195697 +0000 UTC m=+45.567614024 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7wnbg" (UID: "e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0") : configmap "kube-rbac-proxy" not found
Sep 15 16:27:31.522450 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:31.522245    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0-insights-runtime-extractor-tls podName:e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0 nodeName:}" failed. No retries permitted until 2026-09-15 16:27:33.522232566 +0000 UTC m=+45.567650909 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7wnbg" (UID: "e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0") : secret "insights-runtime-extractor-tls" not found
Sep 15 16:27:31.622926 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:31.622896    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da9bad7d-dfae-478c-ab1a-f387fb52f503-registry-tls\") pod \"image-registry-98f494d66-gnrc9\" (UID: \"da9bad7d-dfae-478c-ab1a-f387fb52f503\") " pod="openshift-image-registry/image-registry-98f494d66-gnrc9"
Sep 15 16:27:31.623118 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:31.623029    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d046ec2b-6b1e-4f34-aa14-fa14f51c225d-metrics-tls\") pod \"dns-default-bhdfv\" (UID: \"d046ec2b-6b1e-4f34-aa14-fa14f51c225d\") " pod="openshift-dns/dns-default-bhdfv"
Sep 15 16:27:31.623118 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:31.623087    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 16:27:31.623118 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:31.623103    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-98f494d66-gnrc9: secret "image-registry-tls" not found
Sep 15 16:27:31.623330 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:31.623128    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 16:27:31.623330 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:31.623165    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da9bad7d-dfae-478c-ab1a-f387fb52f503-registry-tls podName:da9bad7d-dfae-478c-ab1a-f387fb52f503 nodeName:}" failed. No retries permitted until 2026-09-15 16:27:39.623147562 +0000 UTC m=+51.668565910 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/da9bad7d-dfae-478c-ab1a-f387fb52f503-registry-tls") pod "image-registry-98f494d66-gnrc9" (UID: "da9bad7d-dfae-478c-ab1a-f387fb52f503") : secret "image-registry-tls" not found
Sep 15 16:27:31.623330 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:31.623180    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d046ec2b-6b1e-4f34-aa14-fa14f51c225d-metrics-tls podName:d046ec2b-6b1e-4f34-aa14-fa14f51c225d nodeName:}" failed. No retries permitted until 2026-09-15 16:27:39.623174364 +0000 UTC m=+51.668592692 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d046ec2b-6b1e-4f34-aa14-fa14f51c225d-metrics-tls") pod "dns-default-bhdfv" (UID: "d046ec2b-6b1e-4f34-aa14-fa14f51c225d") : secret "dns-default-metrics-tls" not found
Sep 15 16:27:31.920931 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:31.920905    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v4dlm_22a84780-b244-4fa8-8b6b-60337f595112/dns-node-resolver/0.log"
Sep 15 16:27:32.521372 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:32.521345    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-59vps_4a10ffb9-f241-40dc-8db4-c4813201e65d/node-ca/0.log"
Sep 15 16:27:33.341631 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:33.341595    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-f2blw_9a7fe522-bb6a-43e1-b526-4b73776efaee/serve-healthcheck-canary/0.log"
Sep 15 16:27:33.537770 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:33.537732    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7wnbg\" (UID: \"e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0\") " pod="openshift-insights/insights-runtime-extractor-7wnbg"
Sep 15 16:27:33.537770 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:33.537786    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7wnbg\" (UID: \"e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0\") " pod="openshift-insights/insights-runtime-extractor-7wnbg"
Sep 15 16:27:33.538005 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:33.537887    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 16:27:33.538005 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:33.537961    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0-insights-runtime-extractor-tls podName:e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0 nodeName:}" failed. No retries permitted until 2026-09-15 16:27:37.537946215 +0000 UTC m=+49.583364542 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7wnbg" (UID: "e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0") : secret "insights-runtime-extractor-tls" not found
Sep 15 16:27:33.538352 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:33.538335    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7wnbg\" (UID: \"e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0\") " pod="openshift-insights/insights-runtime-extractor-7wnbg"
Sep 15 16:27:37.574311 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:37.574268    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7wnbg\" (UID: \"e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0\") " pod="openshift-insights/insights-runtime-extractor-7wnbg"
Sep 15 16:27:37.574688 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:37.574389    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 16:27:37.574688 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:37.574443    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0-insights-runtime-extractor-tls podName:e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0 nodeName:}" failed. No retries permitted until 2026-09-15 16:27:45.574428761 +0000 UTC m=+57.619847089 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7wnbg" (UID: "e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0") : secret "insights-runtime-extractor-tls" not found
Sep 15 16:27:39.690186 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:39.690154    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d046ec2b-6b1e-4f34-aa14-fa14f51c225d-metrics-tls\") pod \"dns-default-bhdfv\" (UID: \"d046ec2b-6b1e-4f34-aa14-fa14f51c225d\") " pod="openshift-dns/dns-default-bhdfv"
Sep 15 16:27:39.690581 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:39.690199    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da9bad7d-dfae-478c-ab1a-f387fb52f503-registry-tls\") pod \"image-registry-98f494d66-gnrc9\" (UID: \"da9bad7d-dfae-478c-ab1a-f387fb52f503\") " pod="openshift-image-registry/image-registry-98f494d66-gnrc9"
Sep 15 16:27:39.690581 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:39.690322    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 16:27:39.690581 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:39.690400    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d046ec2b-6b1e-4f34-aa14-fa14f51c225d-metrics-tls podName:d046ec2b-6b1e-4f34-aa14-fa14f51c225d nodeName:}" failed. No retries permitted until 2026-09-15 16:27:55.690384882 +0000 UTC m=+67.735803210 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d046ec2b-6b1e-4f34-aa14-fa14f51c225d-metrics-tls") pod "dns-default-bhdfv" (UID: "d046ec2b-6b1e-4f34-aa14-fa14f51c225d") : secret "dns-default-metrics-tls" not found
Sep 15 16:27:39.690581 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:39.690328    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 16:27:39.690581 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:39.690430    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-98f494d66-gnrc9: secret "image-registry-tls" not found
Sep 15 16:27:39.690581 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:39.690474    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da9bad7d-dfae-478c-ab1a-f387fb52f503-registry-tls podName:da9bad7d-dfae-478c-ab1a-f387fb52f503 nodeName:}" failed. No retries permitted until 2026-09-15 16:27:55.690458077 +0000 UTC m=+67.735876406 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/da9bad7d-dfae-478c-ab1a-f387fb52f503-registry-tls") pod "image-registry-98f494d66-gnrc9" (UID: "da9bad7d-dfae-478c-ab1a-f387fb52f503") : secret "image-registry-tls" not found
Sep 15 16:27:45.635864 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:45.635822    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7wnbg\" (UID: \"e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0\") " pod="openshift-insights/insights-runtime-extractor-7wnbg"
Sep 15 16:27:45.638271 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:45.638244    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7wnbg\" (UID: \"e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0\") " pod="openshift-insights/insights-runtime-extractor-7wnbg"
Sep 15 16:27:45.720388 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:45.720346    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7wnbg"
Sep 15 16:27:45.998646 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:45.998621    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7wnbg"]
Sep 15 16:27:46.001055 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:27:46.001025    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8ee17ce_78ec_4c17_9aa4_eccfbf50f8e0.slice/crio-4060aa1d176cb14fae5d30027557a5c31a7f5f3277436d2ecc1ee9c6581f5fe1 WatchSource:0}: Error finding container 4060aa1d176cb14fae5d30027557a5c31a7f5f3277436d2ecc1ee9c6581f5fe1: Status 404 returned error can't find the container with id 4060aa1d176cb14fae5d30027557a5c31a7f5f3277436d2ecc1ee9c6581f5fe1
Sep 15 16:27:46.605275 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:46.605249    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7wnbg" event={"ID":"e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0","Type":"ContainerStarted","Data":"1cf2d3fb90cc5c053725a77521988be2af80c324710acb5f600f83bc373ff769"}
Sep 15 16:27:46.605378 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:46.605301    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7wnbg" event={"ID":"e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0","Type":"ContainerStarted","Data":"4060aa1d176cb14fae5d30027557a5c31a7f5f3277436d2ecc1ee9c6581f5fe1"}
Sep 15 16:27:47.534704 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:47.534663    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q4krz"
Sep 15 16:27:47.609765 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:47.609735    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7wnbg" event={"ID":"e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0","Type":"ContainerStarted","Data":"3f2a2d011d5e41286d6c03605acb39a324d1f91c9a4557930434bf402a8f57b5"}
Sep 15 16:27:48.614414 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:48.614327    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7wnbg" event={"ID":"e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0","Type":"ContainerStarted","Data":"0dc7822a2134895b90542629ce647bb3d518876381a5736e161624326bc48abb"}
Sep 15 16:27:48.634456 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:48.634404    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-7wnbg" podStartSLOduration=17.394367308 podStartE2EDuration="19.63438825s" totalImagesPullingTime="2.240020942s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 16:27:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 16:27:48.633768778 +0000 UTC m=+60.679187127" watchObservedRunningTime="2026-09-15 16:27:48.63438825 +0000 UTC m=+60.679806600"
Sep 15 16:27:53.289844 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.289809    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b469d88dd-mt4bs"]
Sep 15 16:27:53.295339 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.295313    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b469d88dd-mt4bs"
Sep 15 16:27:53.298855 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.298822    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 15 16:27:53.299000 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.298885    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 15 16:27:53.299000 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.298896    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 15 16:27:53.299000 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.298887    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-44pn8\""
Sep 15 16:27:53.299228 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.299213    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 15 16:27:53.303928 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.303906    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b469d88dd-mt4bs"]
Sep 15 16:27:53.307524 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.307501    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-98f494d66-gnrc9"]
Sep 15 16:27:53.307686 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:53.307664    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-98f494d66-gnrc9" podUID="da9bad7d-dfae-478c-ab1a-f387fb52f503"
Sep 15 16:27:53.397527 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.397494    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfgdk\" (UniqueName: \"kubernetes.io/projected/5ad63276-f8e2-480b-a072-ad81559f2e93-kube-api-access-tfgdk\") pod \"managed-serviceaccount-addon-agent-b469d88dd-mt4bs\" (UID: \"5ad63276-f8e2-480b-a072-ad81559f2e93\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b469d88dd-mt4bs"
Sep 15 16:27:53.397696 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.397549    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5ad63276-f8e2-480b-a072-ad81559f2e93-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-b469d88dd-mt4bs\" (UID: \"5ad63276-f8e2-480b-a072-ad81559f2e93\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b469d88dd-mt4bs"
Sep 15 16:27:53.400756 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.400735    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5687879956-gt2bl"]
Sep 15 16:27:53.403523 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.403508    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5687879956-gt2bl"
Sep 15 16:27:53.432339 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.432306    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5687879956-gt2bl"]
Sep 15 16:27:53.498100 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.498062    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0acbceae-7952-4c2b-90bd-b9fecd18e8e9-registry-certificates\") pod \"image-registry-5687879956-gt2bl\" (UID: \"0acbceae-7952-4c2b-90bd-b9fecd18e8e9\") " pod="openshift-image-registry/image-registry-5687879956-gt2bl"
Sep 15 16:27:53.498100 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.498098    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0acbceae-7952-4c2b-90bd-b9fecd18e8e9-trusted-ca\") pod \"image-registry-5687879956-gt2bl\" (UID: \"0acbceae-7952-4c2b-90bd-b9fecd18e8e9\") " pod="openshift-image-registry/image-registry-5687879956-gt2bl"
Sep 15 16:27:53.498321 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.498116    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0acbceae-7952-4c2b-90bd-b9fecd18e8e9-registry-tls\") pod \"image-registry-5687879956-gt2bl\" (UID: \"0acbceae-7952-4c2b-90bd-b9fecd18e8e9\") " pod="openshift-image-registry/image-registry-5687879956-gt2bl"
Sep 15 16:27:53.498321 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.498145    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0acbceae-7952-4c2b-90bd-b9fecd18e8e9-image-registry-private-configuration\") pod \"image-registry-5687879956-gt2bl\" (UID: \"0acbceae-7952-4c2b-90bd-b9fecd18e8e9\") " pod="openshift-image-registry/image-registry-5687879956-gt2bl"
Sep 15 16:27:53.498321 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.498241    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfgdk\" (UniqueName: \"kubernetes.io/projected/5ad63276-f8e2-480b-a072-ad81559f2e93-kube-api-access-tfgdk\") pod \"managed-serviceaccount-addon-agent-b469d88dd-mt4bs\" (UID: \"5ad63276-f8e2-480b-a072-ad81559f2e93\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b469d88dd-mt4bs"
Sep 15 16:27:53.498321 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.498275    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0acbceae-7952-4c2b-90bd-b9fecd18e8e9-ca-trust-extracted\") pod \"image-registry-5687879956-gt2bl\" (UID: \"0acbceae-7952-4c2b-90bd-b9fecd18e8e9\") " pod="openshift-image-registry/image-registry-5687879956-gt2bl"
Sep 15 16:27:53.498321 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.498304    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0acbceae-7952-4c2b-90bd-b9fecd18e8e9-installation-pull-secrets\") pod \"image-registry-5687879956-gt2bl\" (UID: \"0acbceae-7952-4c2b-90bd-b9fecd18e8e9\") " pod="openshift-image-registry/image-registry-5687879956-gt2bl"
Sep 15 16:27:53.498487 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.498348    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5ad63276-f8e2-480b-a072-ad81559f2e93-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-b469d88dd-mt4bs\" (UID: \"5ad63276-f8e2-480b-a072-ad81559f2e93\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b469d88dd-mt4bs"
Sep 15 16:27:53.498487 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.498394    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0acbceae-7952-4c2b-90bd-b9fecd18e8e9-bound-sa-token\") pod \"image-registry-5687879956-gt2bl\" (UID: \"0acbceae-7952-4c2b-90bd-b9fecd18e8e9\") " pod="openshift-image-registry/image-registry-5687879956-gt2bl"
Sep 15 16:27:53.498487 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.498412    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knpgj\" (UniqueName: \"kubernetes.io/projected/0acbceae-7952-4c2b-90bd-b9fecd18e8e9-kube-api-access-knpgj\") pod \"image-registry-5687879956-gt2bl\" (UID: \"0acbceae-7952-4c2b-90bd-b9fecd18e8e9\") " pod="openshift-image-registry/image-registry-5687879956-gt2bl"
Sep 15 16:27:53.501114 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.501094    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5ad63276-f8e2-480b-a072-ad81559f2e93-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-b469d88dd-mt4bs\" (UID: \"5ad63276-f8e2-480b-a072-ad81559f2e93\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b469d88dd-mt4bs"
Sep 15 16:27:53.521886 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.521853    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfgdk\" (UniqueName: \"kubernetes.io/projected/5ad63276-f8e2-480b-a072-ad81559f2e93-kube-api-access-tfgdk\") pod \"managed-serviceaccount-addon-agent-b469d88dd-mt4bs\" (UID: \"5ad63276-f8e2-480b-a072-ad81559f2e93\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b469d88dd-mt4bs"
Sep 15 16:27:53.599416 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.599337    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0acbceae-7952-4c2b-90bd-b9fecd18e8e9-trusted-ca\") pod \"image-registry-5687879956-gt2bl\" (UID: \"0acbceae-7952-4c2b-90bd-b9fecd18e8e9\") " pod="openshift-image-registry/image-registry-5687879956-gt2bl"
Sep 15 16:27:53.599416 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.599375    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0acbceae-7952-4c2b-90bd-b9fecd18e8e9-registry-tls\") pod \"image-registry-5687879956-gt2bl\" (UID: \"0acbceae-7952-4c2b-90bd-b9fecd18e8e9\") " pod="openshift-image-registry/image-registry-5687879956-gt2bl"
Sep 15 16:27:53.599416 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.599417    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0acbceae-7952-4c2b-90bd-b9fecd18e8e9-image-registry-private-configuration\") pod \"image-registry-5687879956-gt2bl\" (UID: \"0acbceae-7952-4c2b-90bd-b9fecd18e8e9\") " pod="openshift-image-registry/image-registry-5687879956-gt2bl"
Sep 15 16:27:53.599648 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.599473    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0acbceae-7952-4c2b-90bd-b9fecd18e8e9-ca-trust-extracted\") pod \"image-registry-5687879956-gt2bl\" (UID: \"0acbceae-7952-4c2b-90bd-b9fecd18e8e9\") " pod="openshift-image-registry/image-registry-5687879956-gt2bl"
Sep 15 16:27:53.599648 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.599517    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0acbceae-7952-4c2b-90bd-b9fecd18e8e9-installation-pull-secrets\") pod \"image-registry-5687879956-gt2bl\" (UID: \"0acbceae-7952-4c2b-90bd-b9fecd18e8e9\") " pod="openshift-image-registry/image-registry-5687879956-gt2bl"
Sep 15 16:27:53.599648 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.599576    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0acbceae-7952-4c2b-90bd-b9fecd18e8e9-bound-sa-token\") pod \"image-registry-5687879956-gt2bl\" (UID: \"0acbceae-7952-4c2b-90bd-b9fecd18e8e9\") " pod="openshift-image-registry/image-registry-5687879956-gt2bl"
Sep 15 16:27:53.599648 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.599602    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knpgj\" (UniqueName: \"kubernetes.io/projected/0acbceae-7952-4c2b-90bd-b9fecd18e8e9-kube-api-access-knpgj\") pod \"image-registry-5687879956-gt2bl\" (UID: \"0acbceae-7952-4c2b-90bd-b9fecd18e8e9\") " pod="openshift-image-registry/image-registry-5687879956-gt2bl"
Sep 15 16:27:53.599648 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.599641    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0acbceae-7952-4c2b-90bd-b9fecd18e8e9-registry-certificates\") pod \"image-registry-5687879956-gt2bl\" (UID: \"0acbceae-7952-4c2b-90bd-b9fecd18e8e9\") " pod="openshift-image-registry/image-registry-5687879956-gt2bl"
Sep 15 16:27:53.600206 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.600176    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0acbceae-7952-4c2b-90bd-b9fecd18e8e9-ca-trust-extracted\") pod \"image-registry-5687879956-gt2bl\" (UID: \"0acbceae-7952-4c2b-90bd-b9fecd18e8e9\") " pod="openshift-image-registry/image-registry-5687879956-gt2bl"
Sep 15 16:27:53.600653 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.600478    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0acbceae-7952-4c2b-90bd-b9fecd18e8e9-registry-certificates\") pod \"image-registry-5687879956-gt2bl\" (UID: \"0acbceae-7952-4c2b-90bd-b9fecd18e8e9\") " pod="openshift-image-registry/image-registry-5687879956-gt2bl"
Sep 15 16:27:53.600653 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.600510    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0acbceae-7952-4c2b-90bd-b9fecd18e8e9-trusted-ca\") pod \"image-registry-5687879956-gt2bl\" (UID: \"0acbceae-7952-4c2b-90bd-b9fecd18e8e9\") " pod="openshift-image-registry/image-registry-5687879956-gt2bl"
Sep 15 16:27:53.602307 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.602281    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0acbceae-7952-4c2b-90bd-b9fecd18e8e9-installation-pull-secrets\") pod \"image-registry-5687879956-gt2bl\" (UID: \"0acbceae-7952-4c2b-90bd-b9fecd18e8e9\") " pod="openshift-image-registry/image-registry-5687879956-gt2bl"
Sep 15 16:27:53.602394 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.602295    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0acbceae-7952-4c2b-90bd-b9fecd18e8e9-image-registry-private-configuration\") pod \"image-registry-5687879956-gt2bl\" (UID: \"0acbceae-7952-4c2b-90bd-b9fecd18e8e9\") " pod="openshift-image-registry/image-registry-5687879956-gt2bl"
Sep 15 16:27:53.602394 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.602357    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0acbceae-7952-4c2b-90bd-b9fecd18e8e9-registry-tls\") pod \"image-registry-5687879956-gt2bl\" (UID: \"0acbceae-7952-4c2b-90bd-b9fecd18e8e9\") " pod="openshift-image-registry/image-registry-5687879956-gt2bl"
Sep 15 16:27:53.611504 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.611479    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knpgj\" (UniqueName: \"kubernetes.io/projected/0acbceae-7952-4c2b-90bd-b9fecd18e8e9-kube-api-access-knpgj\") pod \"image-registry-5687879956-gt2bl\" (UID: \"0acbceae-7952-4c2b-90bd-b9fecd18e8e9\") " pod="openshift-image-registry/image-registry-5687879956-gt2bl"
Sep 15 16:27:53.611787 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.611769    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0acbceae-7952-4c2b-90bd-b9fecd18e8e9-bound-sa-token\") pod \"image-registry-5687879956-gt2bl\" (UID: \"0acbceae-7952-4c2b-90bd-b9fecd18e8e9\") " pod="openshift-image-registry/image-registry-5687879956-gt2bl"
Sep 15 16:27:53.614701 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.614679    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b469d88dd-mt4bs"
Sep 15 16:27:53.627971 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.627947    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-98f494d66-gnrc9"
Sep 15 16:27:53.635243 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.635217    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-98f494d66-gnrc9"
Sep 15 16:27:53.700815 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.700776    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/da9bad7d-dfae-478c-ab1a-f387fb52f503-ca-trust-extracted\") pod \"da9bad7d-dfae-478c-ab1a-f387fb52f503\" (UID: \"da9bad7d-dfae-478c-ab1a-f387fb52f503\") "
Sep 15 16:27:53.700992 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.700831    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/da9bad7d-dfae-478c-ab1a-f387fb52f503-image-registry-private-configuration\") pod \"da9bad7d-dfae-478c-ab1a-f387fb52f503\" (UID: \"da9bad7d-dfae-478c-ab1a-f387fb52f503\") "
Sep 15 16:27:53.700992 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.700855    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/da9bad7d-dfae-478c-ab1a-f387fb52f503-registry-certificates\") pod \"da9bad7d-dfae-478c-ab1a-f387fb52f503\" (UID: \"da9bad7d-dfae-478c-ab1a-f387fb52f503\") "
Sep 15 16:27:53.700992 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.700880    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/da9bad7d-dfae-478c-ab1a-f387fb52f503-trusted-ca\") pod \"da9bad7d-dfae-478c-ab1a-f387fb52f503\" (UID: \"da9bad7d-dfae-478c-ab1a-f387fb52f503\") "
Sep 15 16:27:53.700992 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.700914    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5tzdm\" (UniqueName: \"kubernetes.io/projected/da9bad7d-dfae-478c-ab1a-f387fb52f503-kube-api-access-5tzdm\") pod \"da9bad7d-dfae-478c-ab1a-f387fb52f503\" (UID: \"da9bad7d-dfae-478c-ab1a-f387fb52f503\") "
Sep 15 16:27:53.700992 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.700930    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/da9bad7d-dfae-478c-ab1a-f387fb52f503-bound-sa-token\") pod \"da9bad7d-dfae-478c-ab1a-f387fb52f503\" (UID: \"da9bad7d-dfae-478c-ab1a-f387fb52f503\") "
Sep 15 16:27:53.700992 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.700957    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/da9bad7d-dfae-478c-ab1a-f387fb52f503-installation-pull-secrets\") pod \"da9bad7d-dfae-478c-ab1a-f387fb52f503\" (UID: \"da9bad7d-dfae-478c-ab1a-f387fb52f503\") "
Sep 15 16:27:53.701307 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.701094    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da9bad7d-dfae-478c-ab1a-f387fb52f503-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "da9bad7d-dfae-478c-ab1a-f387fb52f503" (UID: "da9bad7d-dfae-478c-ab1a-f387fb52f503"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 16:27:53.701307 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.701178    2577 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/da9bad7d-dfae-478c-ab1a-f387fb52f503-ca-trust-extracted\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\""
Sep 15 16:27:53.701420 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.701389    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da9bad7d-dfae-478c-ab1a-f387fb52f503-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "da9bad7d-dfae-478c-ab1a-f387fb52f503" (UID: "da9bad7d-dfae-478c-ab1a-f387fb52f503"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 16:27:53.701483 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.701444    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da9bad7d-dfae-478c-ab1a-f387fb52f503-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "da9bad7d-dfae-478c-ab1a-f387fb52f503" (UID: "da9bad7d-dfae-478c-ab1a-f387fb52f503"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 16:27:53.703319 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.703294    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da9bad7d-dfae-478c-ab1a-f387fb52f503-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "da9bad7d-dfae-478c-ab1a-f387fb52f503" (UID: "da9bad7d-dfae-478c-ab1a-f387fb52f503"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 16:27:53.703319 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.703311    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da9bad7d-dfae-478c-ab1a-f387fb52f503-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "da9bad7d-dfae-478c-ab1a-f387fb52f503" (UID: "da9bad7d-dfae-478c-ab1a-f387fb52f503"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 16:27:53.703701 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.703673    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da9bad7d-dfae-478c-ab1a-f387fb52f503-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "da9bad7d-dfae-478c-ab1a-f387fb52f503" (UID: "da9bad7d-dfae-478c-ab1a-f387fb52f503"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 16:27:53.703701 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.703686    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da9bad7d-dfae-478c-ab1a-f387fb52f503-kube-api-access-5tzdm" (OuterVolumeSpecName: "kube-api-access-5tzdm") pod "da9bad7d-dfae-478c-ab1a-f387fb52f503" (UID: "da9bad7d-dfae-478c-ab1a-f387fb52f503"). InnerVolumeSpecName "kube-api-access-5tzdm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 16:27:53.714322 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.714301    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7jbp8\""
Sep 15 16:27:53.722357 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.722336    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5687879956-gt2bl"
Sep 15 16:27:53.801804 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.801772    2577 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/da9bad7d-dfae-478c-ab1a-f387fb52f503-image-registry-private-configuration\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\""
Sep 15 16:27:53.801804 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.801803    2577 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/da9bad7d-dfae-478c-ab1a-f387fb52f503-registry-certificates\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\""
Sep 15 16:27:53.801994 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.801817    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/da9bad7d-dfae-478c-ab1a-f387fb52f503-trusted-ca\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\""
Sep 15 16:27:53.801994 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.801826    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5tzdm\" (UniqueName: \"kubernetes.io/projected/da9bad7d-dfae-478c-ab1a-f387fb52f503-kube-api-access-5tzdm\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\""
Sep 15 16:27:53.801994 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.801834    2577 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/da9bad7d-dfae-478c-ab1a-f387fb52f503-bound-sa-token\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\""
Sep 15 16:27:53.801994 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.801842    2577 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/da9bad7d-dfae-478c-ab1a-f387fb52f503-installation-pull-secrets\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\""
Sep 15 16:27:53.901544 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.901513    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b469d88dd-mt4bs"]
Sep 15 16:27:53.904803 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:27:53.904773    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5ad63276_f8e2_480b_a072_ad81559f2e93.slice/crio-3dae8553d663e8d41762448eef456df6800720d26053a43f103048e020184e84 WatchSource:0}: Error finding container 3dae8553d663e8d41762448eef456df6800720d26053a43f103048e020184e84: Status 404 returned error can't find the container with id 3dae8553d663e8d41762448eef456df6800720d26053a43f103048e020184e84
Sep 15 16:27:53.996466 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:53.996443    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5687879956-gt2bl"]
Sep 15 16:27:53.998834 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:27:53.998794    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0acbceae_7952_4c2b_90bd_b9fecd18e8e9.slice/crio-36d1a6bfb64365835c71c6f1696545da1c2deec61ae5bc6ded764d37e64b6e29 WatchSource:0}: Error finding container 36d1a6bfb64365835c71c6f1696545da1c2deec61ae5bc6ded764d37e64b6e29: Status 404 returned error can't find the container with id 36d1a6bfb64365835c71c6f1696545da1c2deec61ae5bc6ded764d37e64b6e29
Sep 15 16:27:54.104519 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:54.104489    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9683ce85-f982-4a05-83d0-a6ace6c05fd0-original-pull-secret\") pod \"global-pull-secret-syncer-n4g7x\" (UID: \"9683ce85-f982-4a05-83d0-a6ace6c05fd0\") " pod="kube-system/global-pull-secret-syncer-n4g7x"
Sep 15 16:27:54.104634 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:54.104531    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3da3c8f3-fcce-45f3-9756-43be57b887a1-metrics-certs\") pod \"network-metrics-daemon-md7hc\" (UID: \"3da3c8f3-fcce-45f3-9756-43be57b887a1\") " pod="openshift-multus/network-metrics-daemon-md7hc"
Sep 15 16:27:54.107113 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:54.107088    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 15 16:27:54.107216 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:54.107088    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 15 16:27:54.117735 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:54.117702    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3da3c8f3-fcce-45f3-9756-43be57b887a1-metrics-certs\") pod \"network-metrics-daemon-md7hc\" (UID: \"3da3c8f3-fcce-45f3-9756-43be57b887a1\") " pod="openshift-multus/network-metrics-daemon-md7hc"
Sep 15 16:27:54.117735 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:54.117732    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9683ce85-f982-4a05-83d0-a6ace6c05fd0-original-pull-secret\") pod \"global-pull-secret-syncer-n4g7x\" (UID: \"9683ce85-f982-4a05-83d0-a6ace6c05fd0\") " pod="kube-system/global-pull-secret-syncer-n4g7x"
Sep 15 16:27:54.202358 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:54.202274    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9w9qq\""
Sep 15 16:27:54.205552 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:54.205526    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pn9l\" (UniqueName: \"kubernetes.io/projected/9665201c-0ad3-4ba4-8bdb-beee79795c0e-kube-api-access-9pn9l\") pod \"network-check-target-4mbmd\" (UID: \"9665201c-0ad3-4ba4-8bdb-beee79795c0e\") " pod="openshift-network-diagnostics/network-check-target-4mbmd"
Sep 15 16:27:54.207900 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:54.207878    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 15 16:27:54.209994 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:54.209971    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-md7hc"
Sep 15 16:27:54.218897 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:54.218879    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 15 16:27:54.230041 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:54.230002    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pn9l\" (UniqueName: \"kubernetes.io/projected/9665201c-0ad3-4ba4-8bdb-beee79795c0e-kube-api-access-9pn9l\") pod \"network-check-target-4mbmd\" (UID: \"9665201c-0ad3-4ba4-8bdb-beee79795c0e\") " pod="openshift-network-diagnostics/network-check-target-4mbmd"
Sep 15 16:27:54.398296 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:54.398274    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4g7x"
Sep 15 16:27:54.494189 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:54.494157    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-md7hc"]
Sep 15 16:27:54.497280 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:27:54.497245    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3da3c8f3_fcce_45f3_9756_43be57b887a1.slice/crio-c774ffcc9f198d2ce61ddb7fdf519b612b80dea6ac7c8b560a82df2ee17a84b5 WatchSource:0}: Error finding container c774ffcc9f198d2ce61ddb7fdf519b612b80dea6ac7c8b560a82df2ee17a84b5: Status 404 returned error can't find the container with id c774ffcc9f198d2ce61ddb7fdf519b612b80dea6ac7c8b560a82df2ee17a84b5
Sep 15 16:27:54.510572 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:54.510544    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vcckz\""
Sep 15 16:27:54.518973 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:54.518950    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4mbmd"
Sep 15 16:27:54.633886 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:54.633851    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5687879956-gt2bl" event={"ID":"0acbceae-7952-4c2b-90bd-b9fecd18e8e9","Type":"ContainerStarted","Data":"49dbedcc98061de1384b0b4f88eddad7b75f094796f8178ead302812edfc695d"}
Sep 15 16:27:54.634046 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:54.633909    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5687879956-gt2bl" event={"ID":"0acbceae-7952-4c2b-90bd-b9fecd18e8e9","Type":"ContainerStarted","Data":"36d1a6bfb64365835c71c6f1696545da1c2deec61ae5bc6ded764d37e64b6e29"}
Sep 15 16:27:54.634403 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:54.634209    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5687879956-gt2bl"
Sep 15 16:27:54.635486 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:54.635416    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-md7hc" event={"ID":"3da3c8f3-fcce-45f3-9756-43be57b887a1","Type":"ContainerStarted","Data":"c774ffcc9f198d2ce61ddb7fdf519b612b80dea6ac7c8b560a82df2ee17a84b5"}
Sep 15 16:27:54.637632 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:54.636802    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-98f494d66-gnrc9"
Sep 15 16:27:54.637632 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:54.636825    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b469d88dd-mt4bs" event={"ID":"5ad63276-f8e2-480b-a072-ad81559f2e93","Type":"ContainerStarted","Data":"3dae8553d663e8d41762448eef456df6800720d26053a43f103048e020184e84"}
Sep 15 16:27:54.666551 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:54.666403    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5687879956-gt2bl" podStartSLOduration=1.666381168 podStartE2EDuration="1.666381168s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 16:27:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 16:27:54.664740741 +0000 UTC m=+66.710159091" watchObservedRunningTime="2026-09-15 16:27:54.666381168 +0000 UTC m=+66.711799522"
Sep 15 16:27:54.700380 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:54.700347    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-n4g7x"]
Sep 15 16:27:54.704469 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:27:54.704414    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9683ce85_f982_4a05_83d0_a6ace6c05fd0.slice/crio-4c57118d656fad2ef58ed21366a014e532938c6d7fda480b6f0404a2eabc761a WatchSource:0}: Error finding container 4c57118d656fad2ef58ed21366a014e532938c6d7fda480b6f0404a2eabc761a: Status 404 returned error can't find the container with id 4c57118d656fad2ef58ed21366a014e532938c6d7fda480b6f0404a2eabc761a
Sep 15 16:27:54.706979 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:54.706951    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-98f494d66-gnrc9"]
Sep 15 16:27:54.715652 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:54.715627    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-98f494d66-gnrc9"]
Sep 15 16:27:54.811246 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:54.811162    2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da9bad7d-dfae-478c-ab1a-f387fb52f503-registry-tls\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\""
Sep 15 16:27:54.844353 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:54.844289    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4mbmd"]
Sep 15 16:27:54.849594 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:27:54.849559    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9665201c_0ad3_4ba4_8bdb_beee79795c0e.slice/crio-f8efc3bf0a0faa5b64e6d3d3cb389395c857e183f5d85d3358ea49ec30f3c887 WatchSource:0}: Error finding container f8efc3bf0a0faa5b64e6d3d3cb389395c857e183f5d85d3358ea49ec30f3c887: Status 404 returned error can't find the container with id f8efc3bf0a0faa5b64e6d3d3cb389395c857e183f5d85d3358ea49ec30f3c887
Sep 15 16:27:55.253597 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:55.253557    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-95nzb"]
Sep 15 16:27:55.268191 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:55.268127    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-95nzb"
Sep 15 16:27:55.270488 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:55.270464    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-95nzb"]
Sep 15 16:27:55.270841 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:55.270824    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 15 16:27:55.270961 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:55.270892    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-sqgqj\""
Sep 15 16:27:55.317176 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:55.317136    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ca3e1132-415b-4f9a-bf70-f723b21210e3-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-95nzb\" (UID: \"ca3e1132-415b-4f9a-bf70-f723b21210e3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-95nzb"
Sep 15 16:27:55.418065 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:55.417990    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ca3e1132-415b-4f9a-bf70-f723b21210e3-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-95nzb\" (UID: \"ca3e1132-415b-4f9a-bf70-f723b21210e3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-95nzb"
Sep 15 16:27:55.418517 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:55.418204    2577 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Sep 15 16:27:55.418517 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:27:55.418256    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca3e1132-415b-4f9a-bf70-f723b21210e3-tls-certificates podName:ca3e1132-415b-4f9a-bf70-f723b21210e3 nodeName:}" failed. No retries permitted until 2026-09-15 16:27:55.91824296 +0000 UTC m=+67.963661287 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/ca3e1132-415b-4f9a-bf70-f723b21210e3-tls-certificates") pod "prometheus-operator-admission-webhook-5864cd99d7-95nzb" (UID: "ca3e1132-415b-4f9a-bf70-f723b21210e3") : secret "prometheus-operator-admission-webhook-tls" not found
Sep 15 16:27:55.643281 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:55.643239    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4mbmd" event={"ID":"9665201c-0ad3-4ba4-8bdb-beee79795c0e","Type":"ContainerStarted","Data":"f8efc3bf0a0faa5b64e6d3d3cb389395c857e183f5d85d3358ea49ec30f3c887"}
Sep 15 16:27:55.644838 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:55.644796    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-n4g7x" event={"ID":"9683ce85-f982-4a05-83d0-a6ace6c05fd0","Type":"ContainerStarted","Data":"4c57118d656fad2ef58ed21366a014e532938c6d7fda480b6f0404a2eabc761a"}
Sep 15 16:27:55.721089 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:55.721042    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d046ec2b-6b1e-4f34-aa14-fa14f51c225d-metrics-tls\") pod \"dns-default-bhdfv\" (UID: \"d046ec2b-6b1e-4f34-aa14-fa14f51c225d\") " pod="openshift-dns/dns-default-bhdfv"
Sep 15 16:27:55.724193 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:55.724164    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d046ec2b-6b1e-4f34-aa14-fa14f51c225d-metrics-tls\") pod \"dns-default-bhdfv\" (UID: \"d046ec2b-6b1e-4f34-aa14-fa14f51c225d\") " pod="openshift-dns/dns-default-bhdfv"
Sep 15 16:27:55.922960 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:55.922407    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ca3e1132-415b-4f9a-bf70-f723b21210e3-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-95nzb\" (UID: \"ca3e1132-415b-4f9a-bf70-f723b21210e3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-95nzb"
Sep 15 16:27:55.928148 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:55.928083    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ca3e1132-415b-4f9a-bf70-f723b21210e3-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-95nzb\" (UID: \"ca3e1132-415b-4f9a-bf70-f723b21210e3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-95nzb"
Sep 15 16:27:55.948661 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:55.948450    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xg4rz\""
Sep 15 16:27:55.955873 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:55.955841    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bhdfv"
Sep 15 16:27:56.180633 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:56.180552    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-95nzb"
Sep 15 16:27:56.392387 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:56.392352    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da9bad7d-dfae-478c-ab1a-f387fb52f503" path="/var/lib/kubelet/pods/da9bad7d-dfae-478c-ab1a-f387fb52f503/volumes"
Sep 15 16:27:57.397205 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:57.397175    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-95nzb"]
Sep 15 16:27:57.401171 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:57.400728    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bhdfv"]
Sep 15 16:27:57.655206 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:57.655121    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-md7hc" event={"ID":"3da3c8f3-fcce-45f3-9756-43be57b887a1","Type":"ContainerStarted","Data":"f685d53acef5797e09f62f02078a38846ce7faba7acca336b2a6d8e23f7a0d91"}
Sep 15 16:27:57.655206 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:57.655191    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-md7hc" event={"ID":"3da3c8f3-fcce-45f3-9756-43be57b887a1","Type":"ContainerStarted","Data":"d4a2fedc70a96b39db271153570ab587dbca57a3d6167ff14e77d868e66c00ef"}
Sep 15 16:27:57.657843 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:57.657808    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b469d88dd-mt4bs" event={"ID":"5ad63276-f8e2-480b-a072-ad81559f2e93","Type":"ContainerStarted","Data":"90e0bf737eefff78a086861c8f4ff704445110e7934760285cf5b742e7490ff7"}
Sep 15 16:27:57.676628 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:57.676562    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-md7hc" podStartSLOduration=67.071789026 podStartE2EDuration="1m9.676542993s" totalImagesPullingTime="2.604753967s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 16:26:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 16:27:57.675592244 +0000 UTC m=+69.721010594" watchObservedRunningTime="2026-09-15 16:27:57.676542993 +0000 UTC m=+69.721961346"
Sep 15 16:27:57.692224 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:57.692149    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b469d88dd-mt4bs" podStartSLOduration=1.41570351 podStartE2EDuration="4.692125154s" totalImagesPullingTime="3.276421644s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 16:27:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 16:27:57.691499589 +0000 UTC m=+69.736917951" watchObservedRunningTime="2026-09-15 16:27:57.692125154 +0000 UTC m=+69.737543505"
Sep 15 16:27:58.383174 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:27:58.383140    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca3e1132_415b_4f9a_bf70_f723b21210e3.slice/crio-a3466b283bbd3f141b0686aa7e36aa75a25f617a67e89e3b5428ed9b5bba72bd WatchSource:0}: Error finding container a3466b283bbd3f141b0686aa7e36aa75a25f617a67e89e3b5428ed9b5bba72bd: Status 404 returned error can't find the container with id a3466b283bbd3f141b0686aa7e36aa75a25f617a67e89e3b5428ed9b5bba72bd
Sep 15 16:27:58.663056 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:27:58.662933    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-95nzb" event={"ID":"ca3e1132-415b-4f9a-bf70-f723b21210e3","Type":"ContainerStarted","Data":"a3466b283bbd3f141b0686aa7e36aa75a25f617a67e89e3b5428ed9b5bba72bd"}
Sep 15 16:27:59.767907 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:27:59.767868    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd046ec2b_6b1e_4f34_aa14_fa14f51c225d.slice/crio-8410c50313ab6375f82982ace502986be1719803fac747a7d6046b42fdf830cb WatchSource:0}: Error finding container 8410c50313ab6375f82982ace502986be1719803fac747a7d6046b42fdf830cb: Status 404 returned error can't find the container with id 8410c50313ab6375f82982ace502986be1719803fac747a7d6046b42fdf830cb
Sep 15 16:28:00.673100 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:00.673027    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4mbmd" event={"ID":"9665201c-0ad3-4ba4-8bdb-beee79795c0e","Type":"ContainerStarted","Data":"d3f1f97145f6ab65cdb820ccb04ce598659a752081baf64496a2319ce4bc034f"}
Sep 15 16:28:00.673257 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:00.673156    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4mbmd"
Sep 15 16:28:00.674841 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:00.674766    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-n4g7x" event={"ID":"9683ce85-f982-4a05-83d0-a6ace6c05fd0","Type":"ContainerStarted","Data":"f4ecd9bcb697314e8469a68a24a8140d0a3b03864241652cc9e1cbdf4d817208"}
Sep 15 16:28:00.676667 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:00.676624    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-95nzb" event={"ID":"ca3e1132-415b-4f9a-bf70-f723b21210e3","Type":"ContainerStarted","Data":"63871a0cf64f9180654f7034425bdc67897419a4ddf43de466873672d3997e8d"}
Sep 15 16:28:00.676789 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:00.676747    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-95nzb"
Sep 15 16:28:00.683785 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:00.683742    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bhdfv" event={"ID":"d046ec2b-6b1e-4f34-aa14-fa14f51c225d","Type":"ContainerStarted","Data":"8410c50313ab6375f82982ace502986be1719803fac747a7d6046b42fdf830cb"}
Sep 15 16:28:00.684406 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:00.684381    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-95nzb"
Sep 15 16:28:00.692910 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:00.692865    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4mbmd" podStartSLOduration=67.719544626 podStartE2EDuration="1m12.692852527s" totalImagesPullingTime="4.973307901s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 16:26:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 16:28:00.692043619 +0000 UTC m=+72.737461971" watchObservedRunningTime="2026-09-15 16:28:00.692852527 +0000 UTC m=+72.738270877"
Sep 15 16:28:00.707329 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:00.707272    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-95nzb" podStartSLOduration=3.6662193800000002 podStartE2EDuration="5.70725463s" totalImagesPullingTime="2.04103525s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 16:27:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 16:28:00.707064866 +0000 UTC m=+72.752483217" watchObservedRunningTime="2026-09-15 16:28:00.70725463 +0000 UTC m=+72.752672981"
Sep 15 16:28:00.723273 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:00.723229    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-n4g7x" podStartSLOduration=67.603350239 podStartE2EDuration="1m12.723208856s" totalImagesPullingTime="5.119858617s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 16:26:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 16:28:00.722120779 +0000 UTC m=+72.767539130" watchObservedRunningTime="2026-09-15 16:28:00.723208856 +0000 UTC m=+72.768627208"
Sep 15 16:28:01.296169 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:01.296128    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-j8d6d"]
Sep 15 16:28:01.299453 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:01.299427    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-j8d6d"
Sep 15 16:28:01.302106 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:01.302080    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 15 16:28:01.302247 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:01.302127    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 15 16:28:01.303322 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:01.303193    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 15 16:28:01.303322 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:01.303203    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 15 16:28:01.303322 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:01.303233    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 15 16:28:01.303322 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:01.303233    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-sq59j\""
Sep 15 16:28:01.308673 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:01.308650    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-j8d6d"]
Sep 15 16:28:01.365118 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:01.365061    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a0e0b8b-3bf1-4503-ab85-2b52746556a4-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-j8d6d\" (UID: \"9a0e0b8b-3bf1-4503-ab85-2b52746556a4\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-j8d6d"
Sep 15 16:28:01.365295 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:01.365174    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5s4tf\" (UniqueName: \"kubernetes.io/projected/9a0e0b8b-3bf1-4503-ab85-2b52746556a4-kube-api-access-5s4tf\") pod \"prometheus-operator-68bcd7f987-j8d6d\" (UID: \"9a0e0b8b-3bf1-4503-ab85-2b52746556a4\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-j8d6d"
Sep 15 16:28:01.365295 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:01.365206    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9a0e0b8b-3bf1-4503-ab85-2b52746556a4-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-j8d6d\" (UID: \"9a0e0b8b-3bf1-4503-ab85-2b52746556a4\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-j8d6d"
Sep 15 16:28:01.365295 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:01.365266    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a0e0b8b-3bf1-4503-ab85-2b52746556a4-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-j8d6d\" (UID: \"9a0e0b8b-3bf1-4503-ab85-2b52746556a4\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-j8d6d"
Sep 15 16:28:01.465849 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:01.465804    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a0e0b8b-3bf1-4503-ab85-2b52746556a4-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-j8d6d\" (UID: \"9a0e0b8b-3bf1-4503-ab85-2b52746556a4\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-j8d6d"
Sep 15 16:28:01.465849 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:01.465871    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5s4tf\" (UniqueName: \"kubernetes.io/projected/9a0e0b8b-3bf1-4503-ab85-2b52746556a4-kube-api-access-5s4tf\") pod \"prometheus-operator-68bcd7f987-j8d6d\" (UID: \"9a0e0b8b-3bf1-4503-ab85-2b52746556a4\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-j8d6d"
Sep 15 16:28:01.466128 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:01.466049    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9a0e0b8b-3bf1-4503-ab85-2b52746556a4-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-j8d6d\" (UID: \"9a0e0b8b-3bf1-4503-ab85-2b52746556a4\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-j8d6d"
Sep 15 16:28:01.466128 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:01.466101    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a0e0b8b-3bf1-4503-ab85-2b52746556a4-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-j8d6d\" (UID: \"9a0e0b8b-3bf1-4503-ab85-2b52746556a4\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-j8d6d"
Sep 15 16:28:01.466223 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:28:01.466191    2577 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Sep 15 16:28:01.466286 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:28:01.466274    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a0e0b8b-3bf1-4503-ab85-2b52746556a4-prometheus-operator-tls podName:9a0e0b8b-3bf1-4503-ab85-2b52746556a4 nodeName:}" failed. No retries permitted until 2026-09-15 16:28:01.966251545 +0000 UTC m=+74.011669876 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/9a0e0b8b-3bf1-4503-ab85-2b52746556a4-prometheus-operator-tls") pod "prometheus-operator-68bcd7f987-j8d6d" (UID: "9a0e0b8b-3bf1-4503-ab85-2b52746556a4") : secret "prometheus-operator-tls" not found
Sep 15 16:28:01.466780 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:01.466757    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a0e0b8b-3bf1-4503-ab85-2b52746556a4-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-j8d6d\" (UID: \"9a0e0b8b-3bf1-4503-ab85-2b52746556a4\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-j8d6d"
Sep 15 16:28:01.468881 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:01.468858    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a0e0b8b-3bf1-4503-ab85-2b52746556a4-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-j8d6d\" (UID: \"9a0e0b8b-3bf1-4503-ab85-2b52746556a4\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-j8d6d"
Sep 15 16:28:01.476549 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:01.476518    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5s4tf\" (UniqueName: \"kubernetes.io/projected/9a0e0b8b-3bf1-4503-ab85-2b52746556a4-kube-api-access-5s4tf\") pod \"prometheus-operator-68bcd7f987-j8d6d\" (UID: \"9a0e0b8b-3bf1-4503-ab85-2b52746556a4\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-j8d6d"
Sep 15 16:28:01.689247 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:01.689211    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bhdfv" event={"ID":"d046ec2b-6b1e-4f34-aa14-fa14f51c225d","Type":"ContainerStarted","Data":"a8fffc5f8622909674c1f56b8f5846dbafba7041250c092fba0ae61b112b6e50"}
Sep 15 16:28:01.970304 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:01.970266    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9a0e0b8b-3bf1-4503-ab85-2b52746556a4-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-j8d6d\" (UID: \"9a0e0b8b-3bf1-4503-ab85-2b52746556a4\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-j8d6d"
Sep 15 16:28:01.972849 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:01.972829    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9a0e0b8b-3bf1-4503-ab85-2b52746556a4-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-j8d6d\" (UID: \"9a0e0b8b-3bf1-4503-ab85-2b52746556a4\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-j8d6d"
Sep 15 16:28:02.212031 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:02.211985    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-j8d6d"
Sep 15 16:28:02.484204 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:02.484128    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-j8d6d"]
Sep 15 16:28:02.486937 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:28:02.486904    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a0e0b8b_3bf1_4503_ab85_2b52746556a4.slice/crio-b3c5291106536b37f373fa2304d365a7f50b72e69ae4cfdf34bc31f1b541d9d5 WatchSource:0}: Error finding container b3c5291106536b37f373fa2304d365a7f50b72e69ae4cfdf34bc31f1b541d9d5: Status 404 returned error can't find the container with id b3c5291106536b37f373fa2304d365a7f50b72e69ae4cfdf34bc31f1b541d9d5
Sep 15 16:28:02.694108 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:02.694064    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bhdfv" event={"ID":"d046ec2b-6b1e-4f34-aa14-fa14f51c225d","Type":"ContainerStarted","Data":"e1442d03d62f1afe588ba529ee0fceff8d0bdac7a360ee02d3c494360d762021"}
Sep 15 16:28:02.694299 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:02.694183    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-bhdfv"
Sep 15 16:28:02.695401 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:02.695384    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-j8d6d" event={"ID":"9a0e0b8b-3bf1-4503-ab85-2b52746556a4","Type":"ContainerStarted","Data":"b3c5291106536b37f373fa2304d365a7f50b72e69ae4cfdf34bc31f1b541d9d5"}
Sep 15 16:28:02.712774 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:02.712722    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-bhdfv" podStartSLOduration=37.946169 podStartE2EDuration="39.712705142s" totalImagesPullingTime="1.766536142s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 16:27:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 16:28:02.711263788 +0000 UTC m=+74.756682132" watchObservedRunningTime="2026-09-15 16:28:02.712705142 +0000 UTC m=+74.758123491"
Sep 15 16:28:04.705733 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:04.705692    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-j8d6d" event={"ID":"9a0e0b8b-3bf1-4503-ab85-2b52746556a4","Type":"ContainerStarted","Data":"7a4fad0a238258609aa99461be3af178629e43e4ef9e3150a2d4fbc42539ac80"}
Sep 15 16:28:04.706226 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:04.705798    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-j8d6d" event={"ID":"9a0e0b8b-3bf1-4503-ab85-2b52746556a4","Type":"ContainerStarted","Data":"76918dfa787d98769ed72ffad790a0aefea7cd00d094361ec543549fe214ccee"}
Sep 15 16:28:04.725796 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:04.725746    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-68bcd7f987-j8d6d" podStartSLOduration=1.7209704179999998 podStartE2EDuration="3.725730886s" totalImagesPullingTime="2.004760468s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 16:28:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 16:28:04.724384513 +0000 UTC m=+76.769802874" watchObservedRunningTime="2026-09-15 16:28:04.725730886 +0000 UTC m=+76.771149256"
Sep 15 16:28:06.819910 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:06.819875    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-cdhvx"]
Sep 15 16:28:06.823370 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:06.823346    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-cdhvx"
Sep 15 16:28:06.830460 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:06.830436    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 15 16:28:06.830584 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:06.830496    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 15 16:28:06.830584 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:06.830498    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-5q6h5\""
Sep 15 16:28:06.833655 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:06.833636    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-vl6ht"]
Sep 15 16:28:06.836608 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:06.836593    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-vl6ht"
Sep 15 16:28:06.839457 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:06.839433    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 15 16:28:06.839749 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:06.839732    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-cdhvx"]
Sep 15 16:28:06.840680 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:06.840660    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-gkf2c\""
Sep 15 16:28:06.840762 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:06.840687    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 15 16:28:06.840762 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:06.840663    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 15 16:28:06.849769 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:06.849745    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-vl6ht"]
Sep 15 16:28:06.865490 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:06.865464    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fltfl"]
Sep 15 16:28:06.868548 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:06.868533    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fltfl"
Sep 15 16:28:06.872483 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:06.872463    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 15 16:28:06.872800 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:06.872782    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-cj2v6\""
Sep 15 16:28:06.873571 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:06.873553    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 15 16:28:06.873774 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:06.873760    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 15 16:28:06.907122 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:06.907091    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc77aeac-44b5-493d-9be6-61859790fdf2-sys\") pod \"node-exporter-fltfl\" (UID: \"cc77aeac-44b5-493d-9be6-61859790fdf2\") " pod="openshift-monitoring/node-exporter-fltfl"
Sep 15 16:28:06.907122 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:06.907119    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cc77aeac-44b5-493d-9be6-61859790fdf2-root\") pod \"node-exporter-fltfl\" (UID: \"cc77aeac-44b5-493d-9be6-61859790fdf2\") " pod="openshift-monitoring/node-exporter-fltfl"
Sep 15 16:28:06.907331 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:06.907142    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zctrl\" (UniqueName: \"kubernetes.io/projected/a9baa9aa-13cb-447e-ac1c-cb3032dde939-kube-api-access-zctrl\") pod \"openshift-state-metrics-67dcf8c979-cdhvx\" (UID: \"a9baa9aa-13cb-447e-ac1c-cb3032dde939\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-cdhvx"
Sep 15 16:28:06.907331 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:06.907166    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1434f43e-a6a9-42b3-9ee4-085c697f24e8-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-vl6ht\" (UID: \"1434f43e-a6a9-42b3-9ee4-085c697f24e8\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-vl6ht"
Sep 15 16:28:06.907331 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:06.907241    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cc77aeac-44b5-493d-9be6-61859790fdf2-node-exporter-wtmp\") pod \"node-exporter-fltfl\" (UID: \"cc77aeac-44b5-493d-9be6-61859790fdf2\") " pod="openshift-monitoring/node-exporter-fltfl"
Sep 15 16:28:06.907331 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:06.907279    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a9baa9aa-13cb-447e-ac1c-cb3032dde939-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-cdhvx\" (UID: \"a9baa9aa-13cb-447e-ac1c-cb3032dde939\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-cdhvx"
Sep 15 16:28:06.907331 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:06.907311    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cc77aeac-44b5-493d-9be6-61859790fdf2-node-exporter-accelerators-collector-config\") pod \"node-exporter-fltfl\" (UID: \"cc77aeac-44b5-493d-9be6-61859790fdf2\") " pod="openshift-monitoring/node-exporter-fltfl"
Sep 15 16:28:06.907542 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:06.907335    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a9baa9aa-13cb-447e-ac1c-cb3032dde939-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-cdhvx\" (UID: \"a9baa9aa-13cb-447e-ac1c-cb3032dde939\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-cdhvx"
Sep 15 16:28:06.907542 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:06.907364    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1434f43e-a6a9-42b3-9ee4-085c697f24e8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-vl6ht\" (UID: \"1434f43e-a6a9-42b3-9ee4-085c697f24e8\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-vl6ht"
Sep 15 16:28:06.907542 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:06.907380    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cc77aeac-44b5-493d-9be6-61859790fdf2-node-exporter-tls\") pod \"node-exporter-fltfl\" (UID: \"cc77aeac-44b5-493d-9be6-61859790fdf2\") " pod="openshift-monitoring/node-exporter-fltfl"
Sep 15 16:28:06.907542 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:06.907397    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cc77aeac-44b5-493d-9be6-61859790fdf2-metrics-client-ca\") pod \"node-exporter-fltfl\" (UID: \"cc77aeac-44b5-493d-9be6-61859790fdf2\") " pod="openshift-monitoring/node-exporter-fltfl"
Sep 15 16:28:06.907542 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:06.907412    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cc77aeac-44b5-493d-9be6-61859790fdf2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fltfl\" (UID: \"cc77aeac-44b5-493d-9be6-61859790fdf2\") " pod="openshift-monitoring/node-exporter-fltfl"
Sep 15 16:28:06.907542 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:06.907449    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1434f43e-a6a9-42b3-9ee4-085c697f24e8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-vl6ht\" (UID: \"1434f43e-a6a9-42b3-9ee4-085c697f24e8\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-vl6ht"
Sep 15 16:28:06.907542 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:06.907501    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mx75\" (UniqueName: \"kubernetes.io/projected/cc77aeac-44b5-493d-9be6-61859790fdf2-kube-api-access-6mx75\") pod \"node-exporter-fltfl\" (UID: \"cc77aeac-44b5-493d-9be6-61859790fdf2\") " pod="openshift-monitoring/node-exporter-fltfl"
Sep 15 16:28:06.907542 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:06.907529    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1434f43e-a6a9-42b3-9ee4-085c697f24e8-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-vl6ht\" (UID: \"1434f43e-a6a9-42b3-9ee4-085c697f24e8\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-vl6ht"
Sep 15 16:28:06.907848 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:06.907559    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1434f43e-a6a9-42b3-9ee4-085c697f24e8-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-vl6ht\" (UID: \"1434f43e-a6a9-42b3-9ee4-085c697f24e8\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-vl6ht"
Sep 15 16:28:06.907848 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:06.907596    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cc77aeac-44b5-493d-9be6-61859790fdf2-node-exporter-textfile\") pod \"node-exporter-fltfl\" (UID: \"cc77aeac-44b5-493d-9be6-61859790fdf2\") " pod="openshift-monitoring/node-exporter-fltfl"
Sep 15 16:28:06.907848 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:06.907627    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a9baa9aa-13cb-447e-ac1c-cb3032dde939-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-cdhvx\" (UID: \"a9baa9aa-13cb-447e-ac1c-cb3032dde939\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-cdhvx"
Sep 15 16:28:06.907848 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:06.907655    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drtn9\" (UniqueName: \"kubernetes.io/projected/1434f43e-a6a9-42b3-9ee4-085c697f24e8-kube-api-access-drtn9\") pod \"kube-state-metrics-59fbdd77d-vl6ht\" (UID: \"1434f43e-a6a9-42b3-9ee4-085c697f24e8\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-vl6ht"
Sep 15 16:28:07.008697 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:07.008654    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a9baa9aa-13cb-447e-ac1c-cb3032dde939-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-cdhvx\" (UID: \"a9baa9aa-13cb-447e-ac1c-cb3032dde939\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-cdhvx"
Sep 15 16:28:07.008697 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:07.008699    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cc77aeac-44b5-493d-9be6-61859790fdf2-node-exporter-accelerators-collector-config\") pod \"node-exporter-fltfl\" (UID: \"cc77aeac-44b5-493d-9be6-61859790fdf2\") " pod="openshift-monitoring/node-exporter-fltfl"
Sep 15 16:28:07.008953 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:07.008728    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a9baa9aa-13cb-447e-ac1c-cb3032dde939-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-cdhvx\" (UID: \"a9baa9aa-13cb-447e-ac1c-cb3032dde939\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-cdhvx"
Sep 15 16:28:07.008953 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:07.008760    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1434f43e-a6a9-42b3-9ee4-085c697f24e8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-vl6ht\" (UID: \"1434f43e-a6a9-42b3-9ee4-085c697f24e8\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-vl6ht"
Sep 15 16:28:07.008953 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:07.008875    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cc77aeac-44b5-493d-9be6-61859790fdf2-node-exporter-tls\") pod \"node-exporter-fltfl\" (UID: \"cc77aeac-44b5-493d-9be6-61859790fdf2\") " pod="openshift-monitoring/node-exporter-fltfl"
Sep 15 16:28:07.008953 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:07.008913    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cc77aeac-44b5-493d-9be6-61859790fdf2-metrics-client-ca\") pod \"node-exporter-fltfl\" (UID: \"cc77aeac-44b5-493d-9be6-61859790fdf2\") " pod="openshift-monitoring/node-exporter-fltfl"
Sep 15 16:28:07.008953 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:07.008943    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cc77aeac-44b5-493d-9be6-61859790fdf2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fltfl\" (UID: \"cc77aeac-44b5-493d-9be6-61859790fdf2\") " pod="openshift-monitoring/node-exporter-fltfl"
Sep 15 16:28:07.009245 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:07.008969    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1434f43e-a6a9-42b3-9ee4-085c697f24e8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-vl6ht\" (UID: \"1434f43e-a6a9-42b3-9ee4-085c697f24e8\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-vl6ht"
Sep 15 16:28:07.009245 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:07.009042    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mx75\" (UniqueName: \"kubernetes.io/projected/cc77aeac-44b5-493d-9be6-61859790fdf2-kube-api-access-6mx75\") pod \"node-exporter-fltfl\" (UID: \"cc77aeac-44b5-493d-9be6-61859790fdf2\") " pod="openshift-monitoring/node-exporter-fltfl"
Sep 15 16:28:07.009245 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:07.009068    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1434f43e-a6a9-42b3-9ee4-085c697f24e8-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-vl6ht\" (UID: \"1434f43e-a6a9-42b3-9ee4-085c697f24e8\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-vl6ht"
Sep 15 16:28:07.009245 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:07.009099    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1434f43e-a6a9-42b3-9ee4-085c697f24e8-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-vl6ht\" (UID: \"1434f43e-a6a9-42b3-9ee4-085c697f24e8\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-vl6ht"
Sep 15 16:28:07.009245 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:07.009126    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cc77aeac-44b5-493d-9be6-61859790fdf2-node-exporter-textfile\") pod \"node-exporter-fltfl\" (UID: \"cc77aeac-44b5-493d-9be6-61859790fdf2\") " pod="openshift-monitoring/node-exporter-fltfl"
Sep 15 16:28:07.009245 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:07.009161    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a9baa9aa-13cb-447e-ac1c-cb3032dde939-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-cdhvx\" (UID: \"a9baa9aa-13cb-447e-ac1c-cb3032dde939\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-cdhvx"
Sep 15 16:28:07.009245 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:07.009187    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drtn9\" (UniqueName: \"kubernetes.io/projected/1434f43e-a6a9-42b3-9ee4-085c697f24e8-kube-api-access-drtn9\") pod \"kube-state-metrics-59fbdd77d-vl6ht\" (UID: \"1434f43e-a6a9-42b3-9ee4-085c697f24e8\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-vl6ht"
Sep 15 16:28:07.009245 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:07.009226    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc77aeac-44b5-493d-9be6-61859790fdf2-sys\") pod \"node-exporter-fltfl\" (UID: \"cc77aeac-44b5-493d-9be6-61859790fdf2\") " pod="openshift-monitoring/node-exporter-fltfl"
Sep 15 16:28:07.009651 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:07.009249    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cc77aeac-44b5-493d-9be6-61859790fdf2-root\") pod \"node-exporter-fltfl\" (UID: \"cc77aeac-44b5-493d-9be6-61859790fdf2\") " pod="openshift-monitoring/node-exporter-fltfl"
Sep 15 16:28:07.009651 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:07.009282    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zctrl\" (UniqueName: \"kubernetes.io/projected/a9baa9aa-13cb-447e-ac1c-cb3032dde939-kube-api-access-zctrl\") pod \"openshift-state-metrics-67dcf8c979-cdhvx\" (UID: \"a9baa9aa-13cb-447e-ac1c-cb3032dde939\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-cdhvx"
Sep 15 16:28:07.009651 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:07.009323    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1434f43e-a6a9-42b3-9ee4-085c697f24e8-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-vl6ht\" (UID: \"1434f43e-a6a9-42b3-9ee4-085c697f24e8\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-vl6ht"
Sep 15 16:28:07.009651 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:07.009356    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cc77aeac-44b5-493d-9be6-61859790fdf2-node-exporter-wtmp\") pod \"node-exporter-fltfl\" (UID: \"cc77aeac-44b5-493d-9be6-61859790fdf2\") " pod="openshift-monitoring/node-exporter-fltfl"
Sep 15 16:28:07.009651 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:07.009432    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cc77aeac-44b5-493d-9be6-61859790fdf2-node-exporter-accelerators-collector-config\") pod \"node-exporter-fltfl\" (UID: \"cc77aeac-44b5-493d-9be6-61859790fdf2\") " pod="openshift-monitoring/node-exporter-fltfl"
Sep 15 16:28:07.009651 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:07.009520    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1434f43e-a6a9-42b3-9ee4-085c697f24e8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-vl6ht\" (UID: \"1434f43e-a6a9-42b3-9ee4-085c697f24e8\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-vl6ht"
Sep 15 16:28:07.009651 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:07.009524    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cc77aeac-44b5-493d-9be6-61859790fdf2-node-exporter-wtmp\") pod \"node-exporter-fltfl\" (UID: \"cc77aeac-44b5-493d-9be6-61859790fdf2\") " pod="openshift-monitoring/node-exporter-fltfl"
Sep 15 16:28:07.009651 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:07.009574    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cc77aeac-44b5-493d-9be6-61859790fdf2-metrics-client-ca\") pod \"node-exporter-fltfl\" (UID: \"cc77aeac-44b5-493d-9be6-61859790fdf2\") " pod="openshift-monitoring/node-exporter-fltfl"
Sep 15 16:28:07.009651 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:07.009645    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cc77aeac-44b5-493d-9be6-61859790fdf2-root\") pod \"node-exporter-fltfl\" (UID: \"cc77aeac-44b5-493d-9be6-61859790fdf2\") " pod="openshift-monitoring/node-exporter-fltfl"
Sep 15 16:28:07.010119 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:07.009667    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cc77aeac-44b5-493d-9be6-61859790fdf2-node-exporter-textfile\") pod \"node-exporter-fltfl\" (UID: \"cc77aeac-44b5-493d-9be6-61859790fdf2\") " pod="openshift-monitoring/node-exporter-fltfl"
Sep 15 16:28:07.010119 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:07.009790    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a9baa9aa-13cb-447e-ac1c-cb3032dde939-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-cdhvx\" (UID: \"a9baa9aa-13cb-447e-ac1c-cb3032dde939\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-cdhvx"
Sep 15 16:28:07.010119 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:07.009932    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1434f43e-a6a9-42b3-9ee4-085c697f24e8-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-vl6ht\" (UID: \"1434f43e-a6a9-42b3-9ee4-085c697f24e8\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-vl6ht"
Sep 15 16:28:07.010119 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:07.009989    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc77aeac-44b5-493d-9be6-61859790fdf2-sys\") pod \"node-exporter-fltfl\" (UID: \"cc77aeac-44b5-493d-9be6-61859790fdf2\") " pod="openshift-monitoring/node-exporter-fltfl"
Sep 15 16:28:07.010478 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:28:07.010178    2577 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Sep 15 16:28:07.010478 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:28:07.010242    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1434f43e-a6a9-42b3-9ee4-085c697f24e8-kube-state-metrics-tls podName:1434f43e-a6a9-42b3-9ee4-085c697f24e8 nodeName:}" failed. No retries permitted until 2026-09-15 16:28:07.510221254 +0000 UTC m=+79.555639585 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/1434f43e-a6a9-42b3-9ee4-085c697f24e8-kube-state-metrics-tls") pod "kube-state-metrics-59fbdd77d-vl6ht" (UID: "1434f43e-a6a9-42b3-9ee4-085c697f24e8") : secret "kube-state-metrics-tls" not found
Sep 15 16:28:07.010881 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:07.010854    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1434f43e-a6a9-42b3-9ee4-085c697f24e8-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-vl6ht\" (UID: \"1434f43e-a6a9-42b3-9ee4-085c697f24e8\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-vl6ht"
Sep 15 16:28:07.011749 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:07.011718    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cc77aeac-44b5-493d-9be6-61859790fdf2-node-exporter-tls\") pod \"node-exporter-fltfl\" (UID: \"cc77aeac-44b5-493d-9be6-61859790fdf2\") " pod="openshift-monitoring/node-exporter-fltfl"
Sep 15 16:28:07.012158 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:07.012139    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a9baa9aa-13cb-447e-ac1c-cb3032dde939-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-cdhvx\" (UID: \"a9baa9aa-13cb-447e-ac1c-cb3032dde939\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-cdhvx"
Sep 15 16:28:07.012239 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:07.012176    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a9baa9aa-13cb-447e-ac1c-cb3032dde939-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-cdhvx\" (UID: \"a9baa9aa-13cb-447e-ac1c-cb3032dde939\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-cdhvx"
Sep 15 16:28:07.012361 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:07.012344    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cc77aeac-44b5-493d-9be6-61859790fdf2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fltfl\" (UID: \"cc77aeac-44b5-493d-9be6-61859790fdf2\") " pod="openshift-monitoring/node-exporter-fltfl"
Sep 15 16:28:07.012493 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:07.012478    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1434f43e-a6a9-42b3-9ee4-085c697f24e8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-vl6ht\" (UID: \"1434f43e-a6a9-42b3-9ee4-085c697f24e8\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-vl6ht"
Sep 15 16:28:07.025423 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:07.025392    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mx75\" (UniqueName: \"kubernetes.io/projected/cc77aeac-44b5-493d-9be6-61859790fdf2-kube-api-access-6mx75\") pod \"node-exporter-fltfl\" (UID: \"cc77aeac-44b5-493d-9be6-61859790fdf2\") " pod="openshift-monitoring/node-exporter-fltfl"
Sep 15 16:28:07.025561 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:07.025539    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zctrl\" (UniqueName: \"kubernetes.io/projected/a9baa9aa-13cb-447e-ac1c-cb3032dde939-kube-api-access-zctrl\") pod \"openshift-state-metrics-67dcf8c979-cdhvx\" (UID: \"a9baa9aa-13cb-447e-ac1c-cb3032dde939\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-cdhvx"
Sep 15 16:28:07.026287 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:07.026267    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drtn9\" (UniqueName: \"kubernetes.io/projected/1434f43e-a6a9-42b3-9ee4-085c697f24e8-kube-api-access-drtn9\") pod \"kube-state-metrics-59fbdd77d-vl6ht\" (UID: \"1434f43e-a6a9-42b3-9ee4-085c697f24e8\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-vl6ht"
Sep 15 16:28:07.132408 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:07.132373    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-cdhvx"
Sep 15 16:28:07.177913 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:07.177880    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fltfl"
Sep 15 16:28:07.191669 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:28:07.191631    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc77aeac_44b5_493d_9be6_61859790fdf2.slice/crio-a3e5e39cb5e225a223e0c289c5812fa2e2abf61edab7468982a74e6dfda2d39b WatchSource:0}: Error finding container a3e5e39cb5e225a223e0c289c5812fa2e2abf61edab7468982a74e6dfda2d39b: Status 404 returned error can't find the container with id a3e5e39cb5e225a223e0c289c5812fa2e2abf61edab7468982a74e6dfda2d39b
Sep 15 16:28:07.408241 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:07.408158    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-cdhvx"]
Sep 15 16:28:07.411444 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:28:07.411414    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9baa9aa_13cb_447e_ac1c_cb3032dde939.slice/crio-85c7e685d3543258a0c18a8c04b6efdf8849478d53dca1f05564de5d1ff98de3 WatchSource:0}: Error finding container 85c7e685d3543258a0c18a8c04b6efdf8849478d53dca1f05564de5d1ff98de3: Status 404 returned error can't find the container with id 85c7e685d3543258a0c18a8c04b6efdf8849478d53dca1f05564de5d1ff98de3
Sep 15 16:28:07.513649 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:07.513619    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1434f43e-a6a9-42b3-9ee4-085c697f24e8-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-vl6ht\" (UID: \"1434f43e-a6a9-42b3-9ee4-085c697f24e8\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-vl6ht"
Sep 15 16:28:07.515869 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:07.515850    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1434f43e-a6a9-42b3-9ee4-085c697f24e8-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-vl6ht\" (UID: \"1434f43e-a6a9-42b3-9ee4-085c697f24e8\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-vl6ht"
Sep 15 16:28:07.717730 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:07.717638    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fltfl" event={"ID":"cc77aeac-44b5-493d-9be6-61859790fdf2","Type":"ContainerStarted","Data":"a3e5e39cb5e225a223e0c289c5812fa2e2abf61edab7468982a74e6dfda2d39b"}
Sep 15 16:28:07.719572 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:07.719543    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-cdhvx" event={"ID":"a9baa9aa-13cb-447e-ac1c-cb3032dde939","Type":"ContainerStarted","Data":"1539e5d881c031ed776bdb74607a422968a36c0e94ae5e74ed8f921e068a9f81"}
Sep 15 16:28:07.719705 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:07.719593    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-cdhvx" event={"ID":"a9baa9aa-13cb-447e-ac1c-cb3032dde939","Type":"ContainerStarted","Data":"8abd771565f899790ff6cb93d6577e510f6f0246b99e96d7596f44a61688e77e"}
Sep 15 16:28:07.719705 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:07.719612    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-cdhvx" event={"ID":"a9baa9aa-13cb-447e-ac1c-cb3032dde939","Type":"ContainerStarted","Data":"85c7e685d3543258a0c18a8c04b6efdf8849478d53dca1f05564de5d1ff98de3"}
Sep 15 16:28:07.747183 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:07.747151    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-vl6ht"
Sep 15 16:28:08.029370 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:08.029292    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-vl6ht"]
Sep 15 16:28:08.253134 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:28:08.253096    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1434f43e_a6a9_42b3_9ee4_085c697f24e8.slice/crio-81197cc4ffa2b441e40f56b969d834fbaa6d90522c268efbd0e5b92e74eebede WatchSource:0}: Error finding container 81197cc4ffa2b441e40f56b969d834fbaa6d90522c268efbd0e5b92e74eebede: Status 404 returned error can't find the container with id 81197cc4ffa2b441e40f56b969d834fbaa6d90522c268efbd0e5b92e74eebede
Sep 15 16:28:08.725537 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:08.725500    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-cdhvx" event={"ID":"a9baa9aa-13cb-447e-ac1c-cb3032dde939","Type":"ContainerStarted","Data":"b850564c0bfa1a58f78a53d8b90f17aaeb556828dffe402503ef9ff3c893d5da"}
Sep 15 16:28:08.726783 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:08.726751    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-vl6ht" event={"ID":"1434f43e-a6a9-42b3-9ee4-085c697f24e8","Type":"ContainerStarted","Data":"81197cc4ffa2b441e40f56b969d834fbaa6d90522c268efbd0e5b92e74eebede"}
Sep 15 16:28:08.728279 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:08.728253    2577 generic.go:356] "Generic (PLEG): container finished" podID="cc77aeac-44b5-493d-9be6-61859790fdf2" containerID="acf79c59d6abfe15feb0d6cc8707f644778006df49c02ed2d834f8587fa222a2" exitCode=0
Sep 15 16:28:08.728391 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:08.728315    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fltfl" event={"ID":"cc77aeac-44b5-493d-9be6-61859790fdf2","Type":"ContainerDied","Data":"acf79c59d6abfe15feb0d6cc8707f644778006df49c02ed2d834f8587fa222a2"}
Sep 15 16:28:08.746982 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:08.746908    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-cdhvx" podStartSLOduration=1.781209444 podStartE2EDuration="2.746886705s" totalImagesPullingTime="965.677261ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 16:28:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 16:28:08.743938912 +0000 UTC m=+80.789357261" watchObservedRunningTime="2026-09-15 16:28:08.746886705 +0000 UTC m=+80.792305058"
Sep 15 16:28:08.823387 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:08.823360    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-644596f744-ccsg9"]
Sep 15 16:28:08.830495 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:08.830471    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-644596f744-ccsg9"
Sep 15 16:28:08.833169 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:08.833143    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-mcpdk\""
Sep 15 16:28:08.833277 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:08.833235    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 15 16:28:08.833345 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:08.833284    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 15 16:28:08.833345 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:08.833284    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 15 16:28:08.833483 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:08.833467    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 15 16:28:08.833573 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:08.833559    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 15 16:28:08.833715 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:08.833700    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-3ev86hl6kvul1\""
Sep 15 16:28:08.837726 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:08.837704    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-644596f744-ccsg9"]
Sep 15 16:28:08.923867 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:08.923824    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/07715fc1-ea80-4e9f-a3c4-bcd99ff935d3-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-644596f744-ccsg9\" (UID: \"07715fc1-ea80-4e9f-a3c4-bcd99ff935d3\") " pod="openshift-monitoring/thanos-querier-644596f744-ccsg9"
Sep 15 16:28:08.923867 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:08.923867    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/07715fc1-ea80-4e9f-a3c4-bcd99ff935d3-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-644596f744-ccsg9\" (UID: \"07715fc1-ea80-4e9f-a3c4-bcd99ff935d3\") " pod="openshift-monitoring/thanos-querier-644596f744-ccsg9"
Sep 15 16:28:08.924133 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:08.923908    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgbff\" (UniqueName: \"kubernetes.io/projected/07715fc1-ea80-4e9f-a3c4-bcd99ff935d3-kube-api-access-tgbff\") pod \"thanos-querier-644596f744-ccsg9\" (UID: \"07715fc1-ea80-4e9f-a3c4-bcd99ff935d3\") " pod="openshift-monitoring/thanos-querier-644596f744-ccsg9"
Sep 15 16:28:08.924133 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:08.923930    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/07715fc1-ea80-4e9f-a3c4-bcd99ff935d3-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-644596f744-ccsg9\" (UID: \"07715fc1-ea80-4e9f-a3c4-bcd99ff935d3\") " pod="openshift-monitoring/thanos-querier-644596f744-ccsg9"
Sep 15 16:28:08.924133 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:08.923949    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/07715fc1-ea80-4e9f-a3c4-bcd99ff935d3-metrics-client-ca\") pod \"thanos-querier-644596f744-ccsg9\" (UID: \"07715fc1-ea80-4e9f-a3c4-bcd99ff935d3\") " pod="openshift-monitoring/thanos-querier-644596f744-ccsg9"
Sep 15 16:28:08.924133 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:08.923968    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/07715fc1-ea80-4e9f-a3c4-bcd99ff935d3-secret-thanos-querier-tls\") pod \"thanos-querier-644596f744-ccsg9\" (UID: \"07715fc1-ea80-4e9f-a3c4-bcd99ff935d3\") " pod="openshift-monitoring/thanos-querier-644596f744-ccsg9"
Sep 15 16:28:08.924133 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:08.924053    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/07715fc1-ea80-4e9f-a3c4-bcd99ff935d3-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-644596f744-ccsg9\" (UID: \"07715fc1-ea80-4e9f-a3c4-bcd99ff935d3\") " pod="openshift-monitoring/thanos-querier-644596f744-ccsg9"
Sep 15 16:28:08.924133 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:08.924090    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/07715fc1-ea80-4e9f-a3c4-bcd99ff935d3-secret-grpc-tls\") pod \"thanos-querier-644596f744-ccsg9\" (UID: \"07715fc1-ea80-4e9f-a3c4-bcd99ff935d3\") " pod="openshift-monitoring/thanos-querier-644596f744-ccsg9"
Sep 15 16:28:09.025276 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:09.025194    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/07715fc1-ea80-4e9f-a3c4-bcd99ff935d3-metrics-client-ca\") pod \"thanos-querier-644596f744-ccsg9\" (UID: \"07715fc1-ea80-4e9f-a3c4-bcd99ff935d3\") " pod="openshift-monitoring/thanos-querier-644596f744-ccsg9"
Sep 15 16:28:09.025276 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:09.025238    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/07715fc1-ea80-4e9f-a3c4-bcd99ff935d3-secret-thanos-querier-tls\") pod \"thanos-querier-644596f744-ccsg9\" (UID: \"07715fc1-ea80-4e9f-a3c4-bcd99ff935d3\") " pod="openshift-monitoring/thanos-querier-644596f744-ccsg9"
Sep 15 16:28:09.025276 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:09.025259    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/07715fc1-ea80-4e9f-a3c4-bcd99ff935d3-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-644596f744-ccsg9\" (UID: \"07715fc1-ea80-4e9f-a3c4-bcd99ff935d3\") " pod="openshift-monitoring/thanos-querier-644596f744-ccsg9"
Sep 15 16:28:09.025276 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:09.025276    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/07715fc1-ea80-4e9f-a3c4-bcd99ff935d3-secret-grpc-tls\") pod \"thanos-querier-644596f744-ccsg9\" (UID: \"07715fc1-ea80-4e9f-a3c4-bcd99ff935d3\") " pod="openshift-monitoring/thanos-querier-644596f744-ccsg9"
Sep 15 16:28:09.025544 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:09.025303    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/07715fc1-ea80-4e9f-a3c4-bcd99ff935d3-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-644596f744-ccsg9\" (UID: \"07715fc1-ea80-4e9f-a3c4-bcd99ff935d3\") " pod="openshift-monitoring/thanos-querier-644596f744-ccsg9"
Sep 15 16:28:09.025544 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:09.025325    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/07715fc1-ea80-4e9f-a3c4-bcd99ff935d3-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-644596f744-ccsg9\" (UID: \"07715fc1-ea80-4e9f-a3c4-bcd99ff935d3\") " pod="openshift-monitoring/thanos-querier-644596f744-ccsg9"
Sep 15 16:28:09.025544 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:09.025360    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgbff\" (UniqueName: \"kubernetes.io/projected/07715fc1-ea80-4e9f-a3c4-bcd99ff935d3-kube-api-access-tgbff\") pod \"thanos-querier-644596f744-ccsg9\" (UID: \"07715fc1-ea80-4e9f-a3c4-bcd99ff935d3\") " pod="openshift-monitoring/thanos-querier-644596f744-ccsg9"
Sep 15 16:28:09.025544 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:09.025384    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/07715fc1-ea80-4e9f-a3c4-bcd99ff935d3-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-644596f744-ccsg9\" (UID: \"07715fc1-ea80-4e9f-a3c4-bcd99ff935d3\") " pod="openshift-monitoring/thanos-querier-644596f744-ccsg9"
Sep 15 16:28:09.026281 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:09.026251    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/07715fc1-ea80-4e9f-a3c4-bcd99ff935d3-metrics-client-ca\") pod \"thanos-querier-644596f744-ccsg9\" (UID: \"07715fc1-ea80-4e9f-a3c4-bcd99ff935d3\") " pod="openshift-monitoring/thanos-querier-644596f744-ccsg9"
Sep 15 16:28:09.028198 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:09.028165    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/07715fc1-ea80-4e9f-a3c4-bcd99ff935d3-secret-thanos-querier-tls\") pod \"thanos-querier-644596f744-ccsg9\" (UID: \"07715fc1-ea80-4e9f-a3c4-bcd99ff935d3\") " pod="openshift-monitoring/thanos-querier-644596f744-ccsg9"
Sep 15 16:28:09.028361 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:09.028316    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/07715fc1-ea80-4e9f-a3c4-bcd99ff935d3-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-644596f744-ccsg9\" (UID: \"07715fc1-ea80-4e9f-a3c4-bcd99ff935d3\") " pod="openshift-monitoring/thanos-querier-644596f744-ccsg9"
Sep 15 16:28:09.028563 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:09.028541    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/07715fc1-ea80-4e9f-a3c4-bcd99ff935d3-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-644596f744-ccsg9\" (UID: \"07715fc1-ea80-4e9f-a3c4-bcd99ff935d3\") " pod="openshift-monitoring/thanos-querier-644596f744-ccsg9"
Sep 15 16:28:09.028645 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:09.028626    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/07715fc1-ea80-4e9f-a3c4-bcd99ff935d3-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-644596f744-ccsg9\" (UID: \"07715fc1-ea80-4e9f-a3c4-bcd99ff935d3\") " pod="openshift-monitoring/thanos-querier-644596f744-ccsg9"
Sep 15 16:28:09.028685 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:09.028665    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/07715fc1-ea80-4e9f-a3c4-bcd99ff935d3-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-644596f744-ccsg9\" (UID: \"07715fc1-ea80-4e9f-a3c4-bcd99ff935d3\") " pod="openshift-monitoring/thanos-querier-644596f744-ccsg9"
Sep 15 16:28:09.028808 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:09.028790    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/07715fc1-ea80-4e9f-a3c4-bcd99ff935d3-secret-grpc-tls\") pod \"thanos-querier-644596f744-ccsg9\" (UID: \"07715fc1-ea80-4e9f-a3c4-bcd99ff935d3\") " pod="openshift-monitoring/thanos-querier-644596f744-ccsg9"
Sep 15 16:28:09.035619 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:09.035600    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgbff\" (UniqueName: \"kubernetes.io/projected/07715fc1-ea80-4e9f-a3c4-bcd99ff935d3-kube-api-access-tgbff\") pod \"thanos-querier-644596f744-ccsg9\" (UID: \"07715fc1-ea80-4e9f-a3c4-bcd99ff935d3\") " pod="openshift-monitoring/thanos-querier-644596f744-ccsg9"
Sep 15 16:28:09.157810 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:09.157778    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-644596f744-ccsg9"
Sep 15 16:28:09.435431 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:09.435392    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-644596f744-ccsg9"]
Sep 15 16:28:09.439083 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:28:09.439054    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07715fc1_ea80_4e9f_a3c4_bcd99ff935d3.slice/crio-e2efe38231cd68f0c4416776171fb12c759c61213b2c1355c7d40b9c07b29c6b WatchSource:0}: Error finding container e2efe38231cd68f0c4416776171fb12c759c61213b2c1355c7d40b9c07b29c6b: Status 404 returned error can't find the container with id e2efe38231cd68f0c4416776171fb12c759c61213b2c1355c7d40b9c07b29c6b
Sep 15 16:28:09.735770 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:09.735677    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fltfl" event={"ID":"cc77aeac-44b5-493d-9be6-61859790fdf2","Type":"ContainerStarted","Data":"edb3cebec883f3bbe50da0b88cf7ad1751678b02196c9046402c925f199c58a3"}
Sep 15 16:28:09.735770 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:09.735732    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fltfl" event={"ID":"cc77aeac-44b5-493d-9be6-61859790fdf2","Type":"ContainerStarted","Data":"530a793fe2632b62f2a3e2b2bd9998bff5560f718742cbd54e6177f1d3daef7a"}
Sep 15 16:28:09.737189 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:09.737160    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-644596f744-ccsg9" event={"ID":"07715fc1-ea80-4e9f-a3c4-bcd99ff935d3","Type":"ContainerStarted","Data":"e2efe38231cd68f0c4416776171fb12c759c61213b2c1355c7d40b9c07b29c6b"}
Sep 15 16:28:10.744109 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:10.744051    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-vl6ht" event={"ID":"1434f43e-a6a9-42b3-9ee4-085c697f24e8","Type":"ContainerStarted","Data":"c0578f5a38a259d9caa5a2fa19f8ac006f6cd28362953ffe8c7a35970697cbe2"}
Sep 15 16:28:10.744611 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:10.744139    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-vl6ht" event={"ID":"1434f43e-a6a9-42b3-9ee4-085c697f24e8","Type":"ContainerStarted","Data":"a17676994e3c7d84361c478e933b749cb3ffb2bbc356d2277385930521fc1b47"}
Sep 15 16:28:10.744611 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:10.744169    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-vl6ht" event={"ID":"1434f43e-a6a9-42b3-9ee4-085c697f24e8","Type":"ContainerStarted","Data":"af0aebd22bb1d0aea45732277c1ac81092ebf1afd824f0bd61801e4a600eb923"}
Sep 15 16:28:10.764076 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:10.763658    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-vl6ht" podStartSLOduration=3.00006026 podStartE2EDuration="4.763637149s" totalImagesPullingTime="1.763576889s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 16:28:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 16:28:10.762856937 +0000 UTC m=+82.808275312" watchObservedRunningTime="2026-09-15 16:28:10.763637149 +0000 UTC m=+82.809055501"
Sep 15 16:28:10.764243 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:10.764189    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fltfl" podStartSLOduration=3.369046031 podStartE2EDuration="4.76417948s" totalImagesPullingTime="1.32070345s" totalInitContainerRuntime="74.429999ms" isStatefulPod=true podCreationTimestamp="2026-09-15 16:28:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 16:28:09.764699382 +0000 UTC m=+81.810117731" watchObservedRunningTime="2026-09-15 16:28:10.76417948 +0000 UTC m=+82.809597829"
Sep 15 16:28:11.169208 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:11.169178    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6bb77cf9f7-64wqt"]
Sep 15 16:28:11.172693 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:11.172669    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6bb77cf9f7-64wqt"
Sep 15 16:28:11.175654 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:11.175627    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 15 16:28:11.176639 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:11.176617    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-35k0ifb09r1sk\""
Sep 15 16:28:11.176859 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:11.176840    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 15 16:28:11.176951 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:11.176857    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 15 16:28:11.176951 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:11.176900    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-mlx9d\""
Sep 15 16:28:11.177072 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:11.176948    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 15 16:28:11.192192 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:11.192159    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6bb77cf9f7-64wqt"]
Sep 15 16:28:11.243625 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:11.243593    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c719aaa0-547d-4d5b-abd2-bbd68960e37c-secret-metrics-server-tls\") pod \"metrics-server-6bb77cf9f7-64wqt\" (UID: \"c719aaa0-547d-4d5b-abd2-bbd68960e37c\") " pod="openshift-monitoring/metrics-server-6bb77cf9f7-64wqt"
Sep 15 16:28:11.243811 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:11.243649    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c719aaa0-547d-4d5b-abd2-bbd68960e37c-secret-metrics-server-client-certs\") pod \"metrics-server-6bb77cf9f7-64wqt\" (UID: \"c719aaa0-547d-4d5b-abd2-bbd68960e37c\") " pod="openshift-monitoring/metrics-server-6bb77cf9f7-64wqt"
Sep 15 16:28:11.243811 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:11.243682    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r76s2\" (UniqueName: \"kubernetes.io/projected/c719aaa0-547d-4d5b-abd2-bbd68960e37c-kube-api-access-r76s2\") pod \"metrics-server-6bb77cf9f7-64wqt\" (UID: \"c719aaa0-547d-4d5b-abd2-bbd68960e37c\") " pod="openshift-monitoring/metrics-server-6bb77cf9f7-64wqt"
Sep 15 16:28:11.243811 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:11.243723    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c719aaa0-547d-4d5b-abd2-bbd68960e37c-metrics-server-audit-profiles\") pod \"metrics-server-6bb77cf9f7-64wqt\" (UID: \"c719aaa0-547d-4d5b-abd2-bbd68960e37c\") " pod="openshift-monitoring/metrics-server-6bb77cf9f7-64wqt"
Sep 15 16:28:11.243811 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:11.243745    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c719aaa0-547d-4d5b-abd2-bbd68960e37c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6bb77cf9f7-64wqt\" (UID: \"c719aaa0-547d-4d5b-abd2-bbd68960e37c\") " pod="openshift-monitoring/metrics-server-6bb77cf9f7-64wqt"
Sep 15 16:28:11.243811 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:11.243768    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c719aaa0-547d-4d5b-abd2-bbd68960e37c-client-ca-bundle\") pod \"metrics-server-6bb77cf9f7-64wqt\" (UID: \"c719aaa0-547d-4d5b-abd2-bbd68960e37c\") " pod="openshift-monitoring/metrics-server-6bb77cf9f7-64wqt"
Sep 15 16:28:11.243989 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:11.243825    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c719aaa0-547d-4d5b-abd2-bbd68960e37c-audit-log\") pod \"metrics-server-6bb77cf9f7-64wqt\" (UID: \"c719aaa0-547d-4d5b-abd2-bbd68960e37c\") " pod="openshift-monitoring/metrics-server-6bb77cf9f7-64wqt"
Sep 15 16:28:11.345080 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:11.345028    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c719aaa0-547d-4d5b-abd2-bbd68960e37c-secret-metrics-server-tls\") pod \"metrics-server-6bb77cf9f7-64wqt\" (UID: \"c719aaa0-547d-4d5b-abd2-bbd68960e37c\") " pod="openshift-monitoring/metrics-server-6bb77cf9f7-64wqt"
Sep 15 16:28:11.345264 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:11.345114    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c719aaa0-547d-4d5b-abd2-bbd68960e37c-secret-metrics-server-client-certs\") pod \"metrics-server-6bb77cf9f7-64wqt\" (UID: \"c719aaa0-547d-4d5b-abd2-bbd68960e37c\") " pod="openshift-monitoring/metrics-server-6bb77cf9f7-64wqt"
Sep 15 16:28:11.345264 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:11.345143    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r76s2\" (UniqueName: \"kubernetes.io/projected/c719aaa0-547d-4d5b-abd2-bbd68960e37c-kube-api-access-r76s2\") pod \"metrics-server-6bb77cf9f7-64wqt\" (UID: \"c719aaa0-547d-4d5b-abd2-bbd68960e37c\") " pod="openshift-monitoring/metrics-server-6bb77cf9f7-64wqt"
Sep 15 16:28:11.345264 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:11.345173    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c719aaa0-547d-4d5b-abd2-bbd68960e37c-metrics-server-audit-profiles\") pod \"metrics-server-6bb77cf9f7-64wqt\" (UID: \"c719aaa0-547d-4d5b-abd2-bbd68960e37c\") " pod="openshift-monitoring/metrics-server-6bb77cf9f7-64wqt"
Sep 15 16:28:11.345264 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:11.345226    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c719aaa0-547d-4d5b-abd2-bbd68960e37c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6bb77cf9f7-64wqt\" (UID: \"c719aaa0-547d-4d5b-abd2-bbd68960e37c\") " pod="openshift-monitoring/metrics-server-6bb77cf9f7-64wqt"
Sep 15 16:28:11.345264 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:11.345257    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c719aaa0-547d-4d5b-abd2-bbd68960e37c-client-ca-bundle\") pod \"metrics-server-6bb77cf9f7-64wqt\" (UID: \"c719aaa0-547d-4d5b-abd2-bbd68960e37c\") " pod="openshift-monitoring/metrics-server-6bb77cf9f7-64wqt"
Sep 15 16:28:11.345469 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:11.345308    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c719aaa0-547d-4d5b-abd2-bbd68960e37c-audit-log\") pod \"metrics-server-6bb77cf9f7-64wqt\" (UID: \"c719aaa0-547d-4d5b-abd2-bbd68960e37c\") " pod="openshift-monitoring/metrics-server-6bb77cf9f7-64wqt"
Sep 15 16:28:11.345687 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:11.345665    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c719aaa0-547d-4d5b-abd2-bbd68960e37c-audit-log\") pod \"metrics-server-6bb77cf9f7-64wqt\" (UID: \"c719aaa0-547d-4d5b-abd2-bbd68960e37c\") " pod="openshift-monitoring/metrics-server-6bb77cf9f7-64wqt"
Sep 15 16:28:11.346478 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:11.346450    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c719aaa0-547d-4d5b-abd2-bbd68960e37c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6bb77cf9f7-64wqt\" (UID: \"c719aaa0-547d-4d5b-abd2-bbd68960e37c\") " pod="openshift-monitoring/metrics-server-6bb77cf9f7-64wqt"
Sep 15 16:28:11.347031 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:11.346768    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c719aaa0-547d-4d5b-abd2-bbd68960e37c-metrics-server-audit-profiles\") pod \"metrics-server-6bb77cf9f7-64wqt\" (UID: \"c719aaa0-547d-4d5b-abd2-bbd68960e37c\") " pod="openshift-monitoring/metrics-server-6bb77cf9f7-64wqt"
Sep 15 16:28:11.348115 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:11.348087    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c719aaa0-547d-4d5b-abd2-bbd68960e37c-secret-metrics-server-client-certs\") pod \"metrics-server-6bb77cf9f7-64wqt\" (UID: \"c719aaa0-547d-4d5b-abd2-bbd68960e37c\") " pod="openshift-monitoring/metrics-server-6bb77cf9f7-64wqt"
Sep 15 16:28:11.348877 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:11.348857    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c719aaa0-547d-4d5b-abd2-bbd68960e37c-secret-metrics-server-tls\") pod \"metrics-server-6bb77cf9f7-64wqt\" (UID: \"c719aaa0-547d-4d5b-abd2-bbd68960e37c\") " pod="openshift-monitoring/metrics-server-6bb77cf9f7-64wqt"
Sep 15 16:28:11.349181 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:11.349157    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c719aaa0-547d-4d5b-abd2-bbd68960e37c-client-ca-bundle\") pod \"metrics-server-6bb77cf9f7-64wqt\" (UID: \"c719aaa0-547d-4d5b-abd2-bbd68960e37c\") " pod="openshift-monitoring/metrics-server-6bb77cf9f7-64wqt"
Sep 15 16:28:11.353444 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:11.353423    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r76s2\" (UniqueName: \"kubernetes.io/projected/c719aaa0-547d-4d5b-abd2-bbd68960e37c-kube-api-access-r76s2\") pod \"metrics-server-6bb77cf9f7-64wqt\" (UID: \"c719aaa0-547d-4d5b-abd2-bbd68960e37c\") " pod="openshift-monitoring/metrics-server-6bb77cf9f7-64wqt"
Sep 15 16:28:11.459389 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:11.459302    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-nkzzj"]
Sep 15 16:28:11.464237 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:11.464211    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-nkzzj"
Sep 15 16:28:11.467115 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:11.466983    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 15 16:28:11.467280 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:11.467150    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-qrgsx\""
Sep 15 16:28:11.475816 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:11.475709    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-nkzzj"]
Sep 15 16:28:11.483624 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:11.483591    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6bb77cf9f7-64wqt"
Sep 15 16:28:11.547057 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:11.547021    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b62ba472-5536-4449-ad46-334379635c28-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-nkzzj\" (UID: \"b62ba472-5536-4449-ad46-334379635c28\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-nkzzj"
Sep 15 16:28:11.547234 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:11.547111    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lr45c\" (UniqueName: \"kubernetes.io/projected/b62ba472-5536-4449-ad46-334379635c28-kube-api-access-lr45c\") pod \"monitoring-plugin-5d85778b9d-nkzzj\" (UID: \"b62ba472-5536-4449-ad46-334379635c28\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-nkzzj"
Sep 15 16:28:11.648523 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:11.648486    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lr45c\" (UniqueName: \"kubernetes.io/projected/b62ba472-5536-4449-ad46-334379635c28-kube-api-access-lr45c\") pod \"monitoring-plugin-5d85778b9d-nkzzj\" (UID: \"b62ba472-5536-4449-ad46-334379635c28\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-nkzzj"
Sep 15 16:28:11.648685 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:11.648578    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b62ba472-5536-4449-ad46-334379635c28-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-nkzzj\" (UID: \"b62ba472-5536-4449-ad46-334379635c28\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-nkzzj"
Sep 15 16:28:11.648685 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:28:11.648673    2577 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Sep 15 16:28:11.648751 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:28:11.648730    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b62ba472-5536-4449-ad46-334379635c28-monitoring-plugin-cert podName:b62ba472-5536-4449-ad46-334379635c28 nodeName:}" failed. No retries permitted until 2026-09-15 16:28:12.148714234 +0000 UTC m=+84.194132562 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/b62ba472-5536-4449-ad46-334379635c28-monitoring-plugin-cert") pod "monitoring-plugin-5d85778b9d-nkzzj" (UID: "b62ba472-5536-4449-ad46-334379635c28") : secret "monitoring-plugin-cert" not found
Sep 15 16:28:11.664378 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:11.664347    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lr45c\" (UniqueName: \"kubernetes.io/projected/b62ba472-5536-4449-ad46-334379635c28-kube-api-access-lr45c\") pod \"monitoring-plugin-5d85778b9d-nkzzj\" (UID: \"b62ba472-5536-4449-ad46-334379635c28\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-nkzzj"
Sep 15 16:28:11.949137 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:11.949110    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6bb77cf9f7-64wqt"]
Sep 15 16:28:11.951631 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:28:11.951600    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc719aaa0_547d_4d5b_abd2_bbd68960e37c.slice/crio-09e154189dadd3f7906574b07dbda592fadcb6d150ea5d7bea27c6f10382ba4f WatchSource:0}: Error finding container 09e154189dadd3f7906574b07dbda592fadcb6d150ea5d7bea27c6f10382ba4f: Status 404 returned error can't find the container with id 09e154189dadd3f7906574b07dbda592fadcb6d150ea5d7bea27c6f10382ba4f
Sep 15 16:28:12.153617 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:12.153580    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b62ba472-5536-4449-ad46-334379635c28-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-nkzzj\" (UID: \"b62ba472-5536-4449-ad46-334379635c28\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-nkzzj"
Sep 15 16:28:12.156004 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:12.155986    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b62ba472-5536-4449-ad46-334379635c28-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-nkzzj\" (UID: \"b62ba472-5536-4449-ad46-334379635c28\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-nkzzj"
Sep 15 16:28:12.379683 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:12.379644    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-nkzzj"
Sep 15 16:28:12.659366 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:12.659333    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-nkzzj"]
Sep 15 16:28:12.701408 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:12.701325    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-bhdfv"
Sep 15 16:28:12.739636 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:28:12.739602    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb62ba472_5536_4449_ad46_334379635c28.slice/crio-1e9daef004c3bce8b3019b03054de6c2ad6b47d0b298ca07ec0ac260e2d1c7ca WatchSource:0}: Error finding container 1e9daef004c3bce8b3019b03054de6c2ad6b47d0b298ca07ec0ac260e2d1c7ca: Status 404 returned error can't find the container with id 1e9daef004c3bce8b3019b03054de6c2ad6b47d0b298ca07ec0ac260e2d1c7ca
Sep 15 16:28:12.760898 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:12.760859    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-644596f744-ccsg9" event={"ID":"07715fc1-ea80-4e9f-a3c4-bcd99ff935d3","Type":"ContainerStarted","Data":"59ac5448cb902cc4302216971b785ae5b2fb3215ce17a7ea1257ac9830270a7f"}
Sep 15 16:28:12.761097 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:12.760949    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-644596f744-ccsg9" event={"ID":"07715fc1-ea80-4e9f-a3c4-bcd99ff935d3","Type":"ContainerStarted","Data":"9471675891dcbadbe9ef956e0e1870bbe4a301a116de5ca3b0dd7af4a043a3a4"}
Sep 15 16:28:12.761097 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:12.760993    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-644596f744-ccsg9" event={"ID":"07715fc1-ea80-4e9f-a3c4-bcd99ff935d3","Type":"ContainerStarted","Data":"380e649f48ef83312a766b723ac961ffc6cf655e1a1067d5163dd7974d314352"}
Sep 15 16:28:12.763060 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:12.762973    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6bb77cf9f7-64wqt" event={"ID":"c719aaa0-547d-4d5b-abd2-bbd68960e37c","Type":"ContainerStarted","Data":"09e154189dadd3f7906574b07dbda592fadcb6d150ea5d7bea27c6f10382ba4f"}
Sep 15 16:28:12.765376 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:12.765343    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-nkzzj" event={"ID":"b62ba472-5536-4449-ad46-334379635c28","Type":"ContainerStarted","Data":"1e9daef004c3bce8b3019b03054de6c2ad6b47d0b298ca07ec0ac260e2d1c7ca"}
Sep 15 16:28:13.028574 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.027483    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 15 16:28:13.033077 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.033044    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:28:13.040219 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.039976    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 15 16:28:13.040219 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.040059    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 15 16:28:13.040219 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.040087    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 15 16:28:13.040219 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.040087    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 15 16:28:13.040219 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.039979    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 15 16:28:13.041048 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.040149    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 15 16:28:13.041176 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.041054    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 15 16:28:13.042186 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.041487    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 15 16:28:13.048065 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.047995    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 15 16:28:13.048322 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.048301    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-759mk9c4na7r8\""
Sep 15 16:28:13.049668 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.049149    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-2j7tz\""
Sep 15 16:28:13.049668 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.048548    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 15 16:28:13.049668 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.048493    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 15 16:28:13.049668 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.049448    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 15 16:28:13.050875 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.050857    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 15 16:28:13.052973 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.052162    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 15 16:28:13.053868 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.053850    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 15 16:28:13.162249 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.162200    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5ac84877-33d6-44f5-928a-d5030c2dc07d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:28:13.162415 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.162255    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5ac84877-33d6-44f5-928a-d5030c2dc07d-web-config\") pod \"prometheus-k8s-0\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:28:13.162415 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.162288    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5ac84877-33d6-44f5-928a-d5030c2dc07d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:28:13.162415 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.162318    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5ac84877-33d6-44f5-928a-d5030c2dc07d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:28:13.162415 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.162364    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5ac84877-33d6-44f5-928a-d5030c2dc07d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:28:13.162630 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.162434    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5ac84877-33d6-44f5-928a-d5030c2dc07d-config\") pod \"prometheus-k8s-0\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:28:13.162630 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.162463    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dcz2\" (UniqueName: \"kubernetes.io/projected/5ac84877-33d6-44f5-928a-d5030c2dc07d-kube-api-access-4dcz2\") pod \"prometheus-k8s-0\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:28:13.162630 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.162512    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ac84877-33d6-44f5-928a-d5030c2dc07d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:28:13.162630 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.162541    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5ac84877-33d6-44f5-928a-d5030c2dc07d-config-out\") pod \"prometheus-k8s-0\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:28:13.162630 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.162575    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5ac84877-33d6-44f5-928a-d5030c2dc07d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:28:13.162630 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.162601    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5ac84877-33d6-44f5-928a-d5030c2dc07d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:28:13.162630 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.162625    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ac84877-33d6-44f5-928a-d5030c2dc07d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:28:13.162998 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.162650    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5ac84877-33d6-44f5-928a-d5030c2dc07d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:28:13.162998 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.162681    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5ac84877-33d6-44f5-928a-d5030c2dc07d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:28:13.162998 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.162709    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ac84877-33d6-44f5-928a-d5030c2dc07d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:28:13.162998 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.162738    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5ac84877-33d6-44f5-928a-d5030c2dc07d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:28:13.162998 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.162761    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5ac84877-33d6-44f5-928a-d5030c2dc07d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:28:13.162998 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.162794    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5ac84877-33d6-44f5-928a-d5030c2dc07d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:28:13.162998 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.162822    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5ac84877-33d6-44f5-928a-d5030c2dc07d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:28:13.162998 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.162846    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ac84877-33d6-44f5-928a-d5030c2dc07d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:28:13.264193 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.264108    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5ac84877-33d6-44f5-928a-d5030c2dc07d-config-out\") pod \"prometheus-k8s-0\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:28:13.264193 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.264165    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5ac84877-33d6-44f5-928a-d5030c2dc07d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:28:13.264379 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.264195    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5ac84877-33d6-44f5-928a-d5030c2dc07d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:28:13.264379 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.264224    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ac84877-33d6-44f5-928a-d5030c2dc07d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:28:13.264379 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.264253    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5ac84877-33d6-44f5-928a-d5030c2dc07d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:28:13.264379 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.264282    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5ac84877-33d6-44f5-928a-d5030c2dc07d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:28:13.264379 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.264311    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ac84877-33d6-44f5-928a-d5030c2dc07d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:28:13.264379 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.264340    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5ac84877-33d6-44f5-928a-d5030c2dc07d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:28:13.264379 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.264363    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5ac84877-33d6-44f5-928a-d5030c2dc07d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:28:13.264660 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.264394    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5ac84877-33d6-44f5-928a-d5030c2dc07d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:28:13.264660 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.264419    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5ac84877-33d6-44f5-928a-d5030c2dc07d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:28:13.264660 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.264445    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ac84877-33d6-44f5-928a-d5030c2dc07d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:28:13.264660 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.264473    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5ac84877-33d6-44f5-928a-d5030c2dc07d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:28:13.264660 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.264499    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5ac84877-33d6-44f5-928a-d5030c2dc07d-web-config\") pod \"prometheus-k8s-0\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:28:13.264660 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.264529    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5ac84877-33d6-44f5-928a-d5030c2dc07d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:28:13.264660 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.264558    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5ac84877-33d6-44f5-928a-d5030c2dc07d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:28:13.264660 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.264591    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5ac84877-33d6-44f5-928a-d5030c2dc07d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:28:13.264660 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.264626    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5ac84877-33d6-44f5-928a-d5030c2dc07d-config\") pod \"prometheus-k8s-0\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:28:13.264660 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.264648    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dcz2\" (UniqueName: \"kubernetes.io/projected/5ac84877-33d6-44f5-928a-d5030c2dc07d-kube-api-access-4dcz2\") pod \"prometheus-k8s-0\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:28:13.265278 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.264692    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ac84877-33d6-44f5-928a-d5030c2dc07d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:28:13.265619 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.265337    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ac84877-33d6-44f5-928a-d5030c2dc07d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:28:13.266636 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.265846    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5ac84877-33d6-44f5-928a-d5030c2dc07d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:28:13.266752 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.266695    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5ac84877-33d6-44f5-928a-d5030c2dc07d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:28:13.267455 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.267398    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5ac84877-33d6-44f5-928a-d5030c2dc07d-config-out\") pod \"prometheus-k8s-0\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:28:13.268775 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.268336    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ac84877-33d6-44f5-928a-d5030c2dc07d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:28:13.268775 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.268635    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5ac84877-33d6-44f5-928a-d5030c2dc07d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:28:13.268775 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.268698    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5ac84877-33d6-44f5-928a-d5030c2dc07d-web-config\") pod \"prometheus-k8s-0\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:28:13.269840 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.269792    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5ac84877-33d6-44f5-928a-d5030c2dc07d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:28:13.270356 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.270330    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5ac84877-33d6-44f5-928a-d5030c2dc07d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:28:13.270356 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.270347    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5ac84877-33d6-44f5-928a-d5030c2dc07d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:28:13.270890 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.270866    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5ac84877-33d6-44f5-928a-d5030c2dc07d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:28:13.271329 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.271284    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5ac84877-33d6-44f5-928a-d5030c2dc07d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:28:13.271447 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.271423    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ac84877-33d6-44f5-928a-d5030c2dc07d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:28:13.271869 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.271849    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5ac84877-33d6-44f5-928a-d5030c2dc07d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:28:13.272139 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.272078    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ac84877-33d6-44f5-928a-d5030c2dc07d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:28:13.273174 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.273150    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5ac84877-33d6-44f5-928a-d5030c2dc07d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:28:13.274314 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.274289    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/5ac84877-33d6-44f5-928a-d5030c2dc07d-config\") pod \"prometheus-k8s-0\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:28:13.274430 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.274408    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5ac84877-33d6-44f5-928a-d5030c2dc07d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:28:13.274638 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.274614    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5ac84877-33d6-44f5-928a-d5030c2dc07d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:28:13.276663 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.276644    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dcz2\" (UniqueName: \"kubernetes.io/projected/5ac84877-33d6-44f5-928a-d5030c2dc07d-kube-api-access-4dcz2\") pod \"prometheus-k8s-0\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:28:13.350385 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.350095    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:28:13.726659 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.726622    2577 patch_prober.go:28] interesting pod/image-registry-5687879956-gt2bl container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 15 16:28:13.726817 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.726683    2577 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5687879956-gt2bl" podUID="0acbceae-7952-4c2b-90bd-b9fecd18e8e9" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 16:28:13.774735 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.774467    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-644596f744-ccsg9" event={"ID":"07715fc1-ea80-4e9f-a3c4-bcd99ff935d3","Type":"ContainerStarted","Data":"7f4fab04a5609f51a9b730509d16a7aecefa0b1780e9781d881ec9a3901214da"}
Sep 15 16:28:13.774735 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.774557    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-644596f744-ccsg9" event={"ID":"07715fc1-ea80-4e9f-a3c4-bcd99ff935d3","Type":"ContainerStarted","Data":"fd05af9aedd4fbd8abf483662bab1b4e34d61d4aaf576396c290a9be502bbd8d"}
Sep 15 16:28:13.774735 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.774599    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-644596f744-ccsg9" event={"ID":"07715fc1-ea80-4e9f-a3c4-bcd99ff935d3","Type":"ContainerStarted","Data":"036710c73e92c3ed1176e07768c617f33cb839e357fe00cabf70133e320cd819"}
Sep 15 16:28:13.774735 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.774646    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-644596f744-ccsg9"
Sep 15 16:28:13.776700 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.776669    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6bb77cf9f7-64wqt" event={"ID":"c719aaa0-547d-4d5b-abd2-bbd68960e37c","Type":"ContainerStarted","Data":"573ae25ab787051ca147b84c193b254676adb76c4a0dea16a6ae33af96437fda"}
Sep 15 16:28:13.798434 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.798303    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-644596f744-ccsg9" podStartSLOduration=2.616142393 podStartE2EDuration="5.798252918s" totalImagesPullingTime="3.182110525s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 16:28:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 16:28:13.797770655 +0000 UTC m=+85.843188998" watchObservedRunningTime="2026-09-15 16:28:13.798252918 +0000 UTC m=+85.843671282"
Sep 15 16:28:13.816448 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.816398    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6bb77cf9f7-64wqt" podStartSLOduration=1.175515033 podStartE2EDuration="2.816381441s" totalImagesPullingTime="1.640866408s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 16:28:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 16:28:13.816180392 +0000 UTC m=+85.861598743" watchObservedRunningTime="2026-09-15 16:28:13.816381441 +0000 UTC m=+85.861799792"
Sep 15 16:28:13.829974 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:13.829942    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 15 16:28:13.838164 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:28:13.838127    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ac84877_33d6_44f5_928a_d5030c2dc07d.slice/crio-de8281d08b499b5bd235f0a5d0783056bbaae87784461f5e999f6eef693a12ee WatchSource:0}: Error finding container de8281d08b499b5bd235f0a5d0783056bbaae87784461f5e999f6eef693a12ee: Status 404 returned error can't find the container with id de8281d08b499b5bd235f0a5d0783056bbaae87784461f5e999f6eef693a12ee
Sep 15 16:28:14.781554 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:14.781522    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5ac84877-33d6-44f5-928a-d5030c2dc07d","Type":"ContainerStarted","Data":"de8281d08b499b5bd235f0a5d0783056bbaae87784461f5e999f6eef693a12ee"}
Sep 15 16:28:15.649971 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:15.649944    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5687879956-gt2bl"
Sep 15 16:28:15.788215 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:15.788168    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-nkzzj" event={"ID":"b62ba472-5536-4449-ad46-334379635c28","Type":"ContainerStarted","Data":"b3eee38ace023adedd6ce59b58f81e326fcde4181f0d7f16c070ea068bdc8c90"}
Sep 15 16:28:15.788549 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:15.788315    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-nkzzj"
Sep 15 16:28:15.790193 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:15.790114    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5ac84877-33d6-44f5-928a-d5030c2dc07d","Type":"ContainerStarted","Data":"8de0a13c22229e286692f45ec3263f13c64475d275a28c2d1535550ab688f694"}
Sep 15 16:28:15.794577 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:15.794552    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-nkzzj"
Sep 15 16:28:15.805153 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:15.805110    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-nkzzj" podStartSLOduration=2.816319696 podStartE2EDuration="4.805094808s" totalImagesPullingTime="1.988775112s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 16:28:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 16:28:15.804479929 +0000 UTC m=+87.849898280" watchObservedRunningTime="2026-09-15 16:28:15.805094808 +0000 UTC m=+87.850513159"
Sep 15 16:28:16.795171 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:16.795134    2577 generic.go:356] "Generic (PLEG): container finished" podID="5ac84877-33d6-44f5-928a-d5030c2dc07d" containerID="8de0a13c22229e286692f45ec3263f13c64475d275a28c2d1535550ab688f694" exitCode=0
Sep 15 16:28:16.795539 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:16.795277    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5ac84877-33d6-44f5-928a-d5030c2dc07d","Type":"ContainerDied","Data":"8de0a13c22229e286692f45ec3263f13c64475d275a28c2d1535550ab688f694"}
Sep 15 16:28:19.790594 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:19.790566    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-644596f744-ccsg9"
Sep 15 16:28:20.817891 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:20.817848    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5ac84877-33d6-44f5-928a-d5030c2dc07d","Type":"ContainerStarted","Data":"c545612628c57d87e13b5b8c92bbd501ed5eed4645f21738fd61953722e7bc17"}
Sep 15 16:28:20.818285 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:20.817932    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5ac84877-33d6-44f5-928a-d5030c2dc07d","Type":"ContainerStarted","Data":"ff435d429821092d7e6bcf961af149c52f6733926a3f397af54a6b17d07282ca"}
Sep 15 16:28:20.818285 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:20.817975    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5ac84877-33d6-44f5-928a-d5030c2dc07d","Type":"ContainerStarted","Data":"6b90e4751707a0ef69ce75bbe89d12f6eaa22a87f70d10dbae77dfab802d0bdb"}
Sep 15 16:28:20.818285 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:20.818036    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5ac84877-33d6-44f5-928a-d5030c2dc07d","Type":"ContainerStarted","Data":"6c4f292f9c43cd54e9210c3a0a3ef37d2483a48378d7ac2a79ab05f0f7256a35"}
Sep 15 16:28:20.818285 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:20.818072    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5ac84877-33d6-44f5-928a-d5030c2dc07d","Type":"ContainerStarted","Data":"e5a652b2c543a53081e44e3d53ffe0de90acfdc97ce95e991b5e3e3a641b0c3a"}
Sep 15 16:28:20.818285 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:20.818108    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5ac84877-33d6-44f5-928a-d5030c2dc07d","Type":"ContainerStarted","Data":"8245e54cd91bd2303b7deaf3417e5b80d9da7c6d39004dd73602770ead0d1ffe"}
Sep 15 16:28:20.848611 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:20.848553    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.007956145 podStartE2EDuration="7.848534834s" totalImagesPullingTime="4.821798105s" totalInitContainerRuntime="18.780584ms" isStatefulPod=false podCreationTimestamp="2026-09-15 16:28:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 16:28:20.847033018 +0000 UTC m=+92.892451366" watchObservedRunningTime="2026-09-15 16:28:20.848534834 +0000 UTC m=+92.893953184"
Sep 15 16:28:23.350235 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:23.350199    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:28:31.483760 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:31.483726    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6bb77cf9f7-64wqt"
Sep 15 16:28:31.484208 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:31.483812    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6bb77cf9f7-64wqt"
Sep 15 16:28:31.691905 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:31.691871    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4mbmd"
Sep 15 16:28:51.489453 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:51.489416    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6bb77cf9f7-64wqt"
Sep 15 16:28:51.493160 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:28:51.493140    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6bb77cf9f7-64wqt"
Sep 15 16:29:13.351120 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:13.351075    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:13.371065 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:13.371037    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:14.043322 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:14.043297    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:31.406924 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.406883    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 15 16:29:31.407408 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.407192    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5ac84877-33d6-44f5-928a-d5030c2dc07d" containerName="prometheus" containerID="cri-o://8245e54cd91bd2303b7deaf3417e5b80d9da7c6d39004dd73602770ead0d1ffe" gracePeriod=600
Sep 15 16:29:31.407408 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.407222    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5ac84877-33d6-44f5-928a-d5030c2dc07d" containerName="kube-rbac-proxy" containerID="cri-o://ff435d429821092d7e6bcf961af149c52f6733926a3f397af54a6b17d07282ca" gracePeriod=600
Sep 15 16:29:31.407408 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.407264    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5ac84877-33d6-44f5-928a-d5030c2dc07d" containerName="thanos-sidecar" containerID="cri-o://6c4f292f9c43cd54e9210c3a0a3ef37d2483a48378d7ac2a79ab05f0f7256a35" gracePeriod=600
Sep 15 16:29:31.407408 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.407303    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5ac84877-33d6-44f5-928a-d5030c2dc07d" containerName="kube-rbac-proxy-web" containerID="cri-o://6b90e4751707a0ef69ce75bbe89d12f6eaa22a87f70d10dbae77dfab802d0bdb" gracePeriod=600
Sep 15 16:29:31.407608 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.407333    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5ac84877-33d6-44f5-928a-d5030c2dc07d" containerName="kube-rbac-proxy-thanos" containerID="cri-o://c545612628c57d87e13b5b8c92bbd501ed5eed4645f21738fd61953722e7bc17" gracePeriod=600
Sep 15 16:29:31.407608 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.407311    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5ac84877-33d6-44f5-928a-d5030c2dc07d" containerName="config-reloader" containerID="cri-o://e5a652b2c543a53081e44e3d53ffe0de90acfdc97ce95e991b5e3e3a641b0c3a" gracePeriod=600
Sep 15 16:29:31.662192 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.661888    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:31.766093 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.766064    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5ac84877-33d6-44f5-928a-d5030c2dc07d-prometheus-k8s-rulefiles-1\") pod \"5ac84877-33d6-44f5-928a-d5030c2dc07d\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") "
Sep 15 16:29:31.766271 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.766105    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5ac84877-33d6-44f5-928a-d5030c2dc07d-secret-grpc-tls\") pod \"5ac84877-33d6-44f5-928a-d5030c2dc07d\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") "
Sep 15 16:29:31.766271 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.766146    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ac84877-33d6-44f5-928a-d5030c2dc07d-configmap-kubelet-serving-ca-bundle\") pod \"5ac84877-33d6-44f5-928a-d5030c2dc07d\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") "
Sep 15 16:29:31.766271 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.766170    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4dcz2\" (UniqueName: \"kubernetes.io/projected/5ac84877-33d6-44f5-928a-d5030c2dc07d-kube-api-access-4dcz2\") pod \"5ac84877-33d6-44f5-928a-d5030c2dc07d\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") "
Sep 15 16:29:31.766271 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.766197    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ac84877-33d6-44f5-928a-d5030c2dc07d-configmap-serving-certs-ca-bundle\") pod \"5ac84877-33d6-44f5-928a-d5030c2dc07d\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") "
Sep 15 16:29:31.766271 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.766237    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5ac84877-33d6-44f5-928a-d5030c2dc07d-secret-prometheus-k8s-tls\") pod \"5ac84877-33d6-44f5-928a-d5030c2dc07d\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") "
Sep 15 16:29:31.766271 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.766264    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5ac84877-33d6-44f5-928a-d5030c2dc07d-secret-kube-rbac-proxy\") pod \"5ac84877-33d6-44f5-928a-d5030c2dc07d\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") "
Sep 15 16:29:31.766576 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.766291    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5ac84877-33d6-44f5-928a-d5030c2dc07d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"5ac84877-33d6-44f5-928a-d5030c2dc07d\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") "
Sep 15 16:29:31.766576 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.766321    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5ac84877-33d6-44f5-928a-d5030c2dc07d-prometheus-k8s-db\") pod \"5ac84877-33d6-44f5-928a-d5030c2dc07d\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") "
Sep 15 16:29:31.766576 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.766345    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5ac84877-33d6-44f5-928a-d5030c2dc07d-prometheus-k8s-rulefiles-2\") pod \"5ac84877-33d6-44f5-928a-d5030c2dc07d\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") "
Sep 15 16:29:31.766576 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.766373    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5ac84877-33d6-44f5-928a-d5030c2dc07d-secret-metrics-client-certs\") pod \"5ac84877-33d6-44f5-928a-d5030c2dc07d\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") "
Sep 15 16:29:31.766576 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.766406    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5ac84877-33d6-44f5-928a-d5030c2dc07d-config\") pod \"5ac84877-33d6-44f5-928a-d5030c2dc07d\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") "
Sep 15 16:29:31.766576 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.766428    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5ac84877-33d6-44f5-928a-d5030c2dc07d-prometheus-k8s-rulefiles-0\") pod \"5ac84877-33d6-44f5-928a-d5030c2dc07d\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") "
Sep 15 16:29:31.766576 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.766432    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ac84877-33d6-44f5-928a-d5030c2dc07d-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "5ac84877-33d6-44f5-928a-d5030c2dc07d" (UID: "5ac84877-33d6-44f5-928a-d5030c2dc07d"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 16:29:31.766576 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.766456    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ac84877-33d6-44f5-928a-d5030c2dc07d-prometheus-trusted-ca-bundle\") pod \"5ac84877-33d6-44f5-928a-d5030c2dc07d\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") "
Sep 15 16:29:31.766576 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.766495    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5ac84877-33d6-44f5-928a-d5030c2dc07d-thanos-prometheus-http-client-file\") pod \"5ac84877-33d6-44f5-928a-d5030c2dc07d\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") "
Sep 15 16:29:31.766576 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.766545    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5ac84877-33d6-44f5-928a-d5030c2dc07d-web-config\") pod \"5ac84877-33d6-44f5-928a-d5030c2dc07d\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") "
Sep 15 16:29:31.766576 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.766572    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5ac84877-33d6-44f5-928a-d5030c2dc07d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"5ac84877-33d6-44f5-928a-d5030c2dc07d\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") "
Sep 15 16:29:31.767294 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.766610    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5ac84877-33d6-44f5-928a-d5030c2dc07d-config-out\") pod \"5ac84877-33d6-44f5-928a-d5030c2dc07d\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") "
Sep 15 16:29:31.767294 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.766653    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5ac84877-33d6-44f5-928a-d5030c2dc07d-tls-assets\") pod \"5ac84877-33d6-44f5-928a-d5030c2dc07d\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") "
Sep 15 16:29:31.767294 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.766688    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ac84877-33d6-44f5-928a-d5030c2dc07d-configmap-metrics-client-ca\") pod \"5ac84877-33d6-44f5-928a-d5030c2dc07d\" (UID: \"5ac84877-33d6-44f5-928a-d5030c2dc07d\") "
Sep 15 16:29:31.767294 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.766954    2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5ac84877-33d6-44f5-928a-d5030c2dc07d-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\""
Sep 15 16:29:31.767294 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.766563    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ac84877-33d6-44f5-928a-d5030c2dc07d-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "5ac84877-33d6-44f5-928a-d5030c2dc07d" (UID: "5ac84877-33d6-44f5-928a-d5030c2dc07d"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 16:29:31.767535 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.766660    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ac84877-33d6-44f5-928a-d5030c2dc07d-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "5ac84877-33d6-44f5-928a-d5030c2dc07d" (UID: "5ac84877-33d6-44f5-928a-d5030c2dc07d"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 16:29:31.767535 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.767047    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ac84877-33d6-44f5-928a-d5030c2dc07d-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "5ac84877-33d6-44f5-928a-d5030c2dc07d" (UID: "5ac84877-33d6-44f5-928a-d5030c2dc07d"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 16:29:31.767535 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.767285    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ac84877-33d6-44f5-928a-d5030c2dc07d-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "5ac84877-33d6-44f5-928a-d5030c2dc07d" (UID: "5ac84877-33d6-44f5-928a-d5030c2dc07d"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 16:29:31.768284 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.767695    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ac84877-33d6-44f5-928a-d5030c2dc07d-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "5ac84877-33d6-44f5-928a-d5030c2dc07d" (UID: "5ac84877-33d6-44f5-928a-d5030c2dc07d"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 16:29:31.768284 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.768110    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ac84877-33d6-44f5-928a-d5030c2dc07d-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "5ac84877-33d6-44f5-928a-d5030c2dc07d" (UID: "5ac84877-33d6-44f5-928a-d5030c2dc07d"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 16:29:31.769109 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.769079    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ac84877-33d6-44f5-928a-d5030c2dc07d-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "5ac84877-33d6-44f5-928a-d5030c2dc07d" (UID: "5ac84877-33d6-44f5-928a-d5030c2dc07d"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 16:29:31.769415 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.769384    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ac84877-33d6-44f5-928a-d5030c2dc07d-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "5ac84877-33d6-44f5-928a-d5030c2dc07d" (UID: "5ac84877-33d6-44f5-928a-d5030c2dc07d"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 16:29:31.769601 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.769583    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ac84877-33d6-44f5-928a-d5030c2dc07d-config-out" (OuterVolumeSpecName: "config-out") pod "5ac84877-33d6-44f5-928a-d5030c2dc07d" (UID: "5ac84877-33d6-44f5-928a-d5030c2dc07d"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 16:29:31.770188 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.770121    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ac84877-33d6-44f5-928a-d5030c2dc07d-kube-api-access-4dcz2" (OuterVolumeSpecName: "kube-api-access-4dcz2") pod "5ac84877-33d6-44f5-928a-d5030c2dc07d" (UID: "5ac84877-33d6-44f5-928a-d5030c2dc07d"). InnerVolumeSpecName "kube-api-access-4dcz2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 16:29:31.770535 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.770276    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ac84877-33d6-44f5-928a-d5030c2dc07d-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "5ac84877-33d6-44f5-928a-d5030c2dc07d" (UID: "5ac84877-33d6-44f5-928a-d5030c2dc07d"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 16:29:31.770535 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.770374    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ac84877-33d6-44f5-928a-d5030c2dc07d-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "5ac84877-33d6-44f5-928a-d5030c2dc07d" (UID: "5ac84877-33d6-44f5-928a-d5030c2dc07d"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 16:29:31.770689 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.770632    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ac84877-33d6-44f5-928a-d5030c2dc07d-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "5ac84877-33d6-44f5-928a-d5030c2dc07d" (UID: "5ac84877-33d6-44f5-928a-d5030c2dc07d"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 16:29:31.771135 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.771099    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ac84877-33d6-44f5-928a-d5030c2dc07d-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "5ac84877-33d6-44f5-928a-d5030c2dc07d" (UID: "5ac84877-33d6-44f5-928a-d5030c2dc07d"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 16:29:31.771135 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.771113    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ac84877-33d6-44f5-928a-d5030c2dc07d-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "5ac84877-33d6-44f5-928a-d5030c2dc07d" (UID: "5ac84877-33d6-44f5-928a-d5030c2dc07d"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 16:29:31.771313 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.771295    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ac84877-33d6-44f5-928a-d5030c2dc07d-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "5ac84877-33d6-44f5-928a-d5030c2dc07d" (UID: "5ac84877-33d6-44f5-928a-d5030c2dc07d"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 16:29:31.771632 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.771607    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ac84877-33d6-44f5-928a-d5030c2dc07d-config" (OuterVolumeSpecName: "config") pod "5ac84877-33d6-44f5-928a-d5030c2dc07d" (UID: "5ac84877-33d6-44f5-928a-d5030c2dc07d"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 16:29:31.772663 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.772642    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ac84877-33d6-44f5-928a-d5030c2dc07d-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "5ac84877-33d6-44f5-928a-d5030c2dc07d" (UID: "5ac84877-33d6-44f5-928a-d5030c2dc07d"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 16:29:31.783515 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.783483    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ac84877-33d6-44f5-928a-d5030c2dc07d-web-config" (OuterVolumeSpecName: "web-config") pod "5ac84877-33d6-44f5-928a-d5030c2dc07d" (UID: "5ac84877-33d6-44f5-928a-d5030c2dc07d"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 16:29:31.867658 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.867605    2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5ac84877-33d6-44f5-928a-d5030c2dc07d-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\""
Sep 15 16:29:31.867658 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.867653    2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5ac84877-33d6-44f5-928a-d5030c2dc07d-prometheus-k8s-db\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\""
Sep 15 16:29:31.867658 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.867663    2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5ac84877-33d6-44f5-928a-d5030c2dc07d-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\""
Sep 15 16:29:31.867658 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.867673    2577 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5ac84877-33d6-44f5-928a-d5030c2dc07d-secret-metrics-client-certs\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\""
Sep 15 16:29:31.867920 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.867682    2577 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/5ac84877-33d6-44f5-928a-d5030c2dc07d-config\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\""
Sep 15 16:29:31.867920 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.867690    2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5ac84877-33d6-44f5-928a-d5030c2dc07d-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\""
Sep 15 16:29:31.867920 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.867699    2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ac84877-33d6-44f5-928a-d5030c2dc07d-prometheus-trusted-ca-bundle\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\""
Sep 15 16:29:31.867920 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.867708    2577 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5ac84877-33d6-44f5-928a-d5030c2dc07d-thanos-prometheus-http-client-file\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\""
Sep 15 16:29:31.867920 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.867716    2577 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5ac84877-33d6-44f5-928a-d5030c2dc07d-web-config\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\""
Sep 15 16:29:31.867920 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.867724    2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5ac84877-33d6-44f5-928a-d5030c2dc07d-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\""
Sep 15 16:29:31.867920 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.867732    2577 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5ac84877-33d6-44f5-928a-d5030c2dc07d-config-out\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\""
Sep 15 16:29:31.867920 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.867740    2577 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5ac84877-33d6-44f5-928a-d5030c2dc07d-tls-assets\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\""
Sep 15 16:29:31.867920 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.867748    2577 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ac84877-33d6-44f5-928a-d5030c2dc07d-configmap-metrics-client-ca\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\""
Sep 15 16:29:31.867920 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.867756    2577 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5ac84877-33d6-44f5-928a-d5030c2dc07d-secret-grpc-tls\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\""
Sep 15 16:29:31.867920 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.867764    2577 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ac84877-33d6-44f5-928a-d5030c2dc07d-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\""
Sep 15 16:29:31.867920 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.867771    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4dcz2\" (UniqueName: \"kubernetes.io/projected/5ac84877-33d6-44f5-928a-d5030c2dc07d-kube-api-access-4dcz2\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\""
Sep 15 16:29:31.867920 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.867781    2577 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ac84877-33d6-44f5-928a-d5030c2dc07d-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\""
Sep 15 16:29:31.867920 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.867788    2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5ac84877-33d6-44f5-928a-d5030c2dc07d-secret-prometheus-k8s-tls\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\""
Sep 15 16:29:31.867920 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:31.867796    2577 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5ac84877-33d6-44f5-928a-d5030c2dc07d-secret-kube-rbac-proxy\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\""
Sep 15 16:29:32.103675 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.103643    2577 generic.go:356] "Generic (PLEG): container finished" podID="5ac84877-33d6-44f5-928a-d5030c2dc07d" containerID="c545612628c57d87e13b5b8c92bbd501ed5eed4645f21738fd61953722e7bc17" exitCode=0
Sep 15 16:29:32.103675 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.103670    2577 generic.go:356] "Generic (PLEG): container finished" podID="5ac84877-33d6-44f5-928a-d5030c2dc07d" containerID="ff435d429821092d7e6bcf961af149c52f6733926a3f397af54a6b17d07282ca" exitCode=0
Sep 15 16:29:32.103675 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.103678    2577 generic.go:356] "Generic (PLEG): container finished" podID="5ac84877-33d6-44f5-928a-d5030c2dc07d" containerID="6b90e4751707a0ef69ce75bbe89d12f6eaa22a87f70d10dbae77dfab802d0bdb" exitCode=0
Sep 15 16:29:32.103890 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.103686    2577 generic.go:356] "Generic (PLEG): container finished" podID="5ac84877-33d6-44f5-928a-d5030c2dc07d" containerID="6c4f292f9c43cd54e9210c3a0a3ef37d2483a48378d7ac2a79ab05f0f7256a35" exitCode=0
Sep 15 16:29:32.103890 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.103692    2577 generic.go:356] "Generic (PLEG): container finished" podID="5ac84877-33d6-44f5-928a-d5030c2dc07d" containerID="e5a652b2c543a53081e44e3d53ffe0de90acfdc97ce95e991b5e3e3a641b0c3a" exitCode=0
Sep 15 16:29:32.103890 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.103697    2577 generic.go:356] "Generic (PLEG): container finished" podID="5ac84877-33d6-44f5-928a-d5030c2dc07d" containerID="8245e54cd91bd2303b7deaf3417e5b80d9da7c6d39004dd73602770ead0d1ffe" exitCode=0
Sep 15 16:29:32.103890 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.103733    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:32.103890 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.103731    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5ac84877-33d6-44f5-928a-d5030c2dc07d","Type":"ContainerDied","Data":"c545612628c57d87e13b5b8c92bbd501ed5eed4645f21738fd61953722e7bc17"}
Sep 15 16:29:32.103890 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.103815    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5ac84877-33d6-44f5-928a-d5030c2dc07d","Type":"ContainerDied","Data":"ff435d429821092d7e6bcf961af149c52f6733926a3f397af54a6b17d07282ca"}
Sep 15 16:29:32.103890 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.103859    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5ac84877-33d6-44f5-928a-d5030c2dc07d","Type":"ContainerDied","Data":"6b90e4751707a0ef69ce75bbe89d12f6eaa22a87f70d10dbae77dfab802d0bdb"}
Sep 15 16:29:32.103890 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.103879    2577 scope.go:117] "RemoveContainer" containerID="c545612628c57d87e13b5b8c92bbd501ed5eed4645f21738fd61953722e7bc17"
Sep 15 16:29:32.104158 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.103902    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5ac84877-33d6-44f5-928a-d5030c2dc07d","Type":"ContainerDied","Data":"6c4f292f9c43cd54e9210c3a0a3ef37d2483a48378d7ac2a79ab05f0f7256a35"}
Sep 15 16:29:32.104158 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.103943    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5ac84877-33d6-44f5-928a-d5030c2dc07d","Type":"ContainerDied","Data":"e5a652b2c543a53081e44e3d53ffe0de90acfdc97ce95e991b5e3e3a641b0c3a"}
Sep 15 16:29:32.104158 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.103984    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5ac84877-33d6-44f5-928a-d5030c2dc07d","Type":"ContainerDied","Data":"8245e54cd91bd2303b7deaf3417e5b80d9da7c6d39004dd73602770ead0d1ffe"}
Sep 15 16:29:32.104158 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.104042    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5ac84877-33d6-44f5-928a-d5030c2dc07d","Type":"ContainerDied","Data":"de8281d08b499b5bd235f0a5d0783056bbaae87784461f5e999f6eef693a12ee"}
Sep 15 16:29:32.112972 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.112951    2577 scope.go:117] "RemoveContainer" containerID="ff435d429821092d7e6bcf961af149c52f6733926a3f397af54a6b17d07282ca"
Sep 15 16:29:32.120313 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.120290    2577 scope.go:117] "RemoveContainer" containerID="6b90e4751707a0ef69ce75bbe89d12f6eaa22a87f70d10dbae77dfab802d0bdb"
Sep 15 16:29:32.126957 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.126930    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 15 16:29:32.128263 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.128239    2577 scope.go:117] "RemoveContainer" containerID="6c4f292f9c43cd54e9210c3a0a3ef37d2483a48378d7ac2a79ab05f0f7256a35"
Sep 15 16:29:32.133643 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.133619    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 15 16:29:32.138056 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.138039    2577 scope.go:117] "RemoveContainer" containerID="e5a652b2c543a53081e44e3d53ffe0de90acfdc97ce95e991b5e3e3a641b0c3a"
Sep 15 16:29:32.145288 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.145269    2577 scope.go:117] "RemoveContainer" containerID="8245e54cd91bd2303b7deaf3417e5b80d9da7c6d39004dd73602770ead0d1ffe"
Sep 15 16:29:32.153044 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.153024    2577 scope.go:117] "RemoveContainer" containerID="8de0a13c22229e286692f45ec3263f13c64475d275a28c2d1535550ab688f694"
Sep 15 16:29:32.158331 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.158310    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 15 16:29:32.158603 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.158591    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ac84877-33d6-44f5-928a-d5030c2dc07d" containerName="init-config-reloader"
Sep 15 16:29:32.158644 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.158606    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ac84877-33d6-44f5-928a-d5030c2dc07d" containerName="init-config-reloader"
Sep 15 16:29:32.158644 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.158616    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ac84877-33d6-44f5-928a-d5030c2dc07d" containerName="kube-rbac-proxy"
Sep 15 16:29:32.158644 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.158622    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ac84877-33d6-44f5-928a-d5030c2dc07d" containerName="kube-rbac-proxy"
Sep 15 16:29:32.158644 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.158631    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ac84877-33d6-44f5-928a-d5030c2dc07d" containerName="prometheus"
Sep 15 16:29:32.158644 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.158638    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ac84877-33d6-44f5-928a-d5030c2dc07d" containerName="prometheus"
Sep 15 16:29:32.158644 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.158643    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ac84877-33d6-44f5-928a-d5030c2dc07d" containerName="kube-rbac-proxy-thanos"
Sep 15 16:29:32.158843 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.158649    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ac84877-33d6-44f5-928a-d5030c2dc07d" containerName="kube-rbac-proxy-thanos"
Sep 15 16:29:32.158843 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.158657    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ac84877-33d6-44f5-928a-d5030c2dc07d" containerName="config-reloader"
Sep 15 16:29:32.158843 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.158662    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ac84877-33d6-44f5-928a-d5030c2dc07d" containerName="config-reloader"
Sep 15 16:29:32.158843 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.158669    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ac84877-33d6-44f5-928a-d5030c2dc07d" containerName="thanos-sidecar"
Sep 15 16:29:32.158843 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.158674    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ac84877-33d6-44f5-928a-d5030c2dc07d" containerName="thanos-sidecar"
Sep 15 16:29:32.158843 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.158684    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ac84877-33d6-44f5-928a-d5030c2dc07d" containerName="kube-rbac-proxy-web"
Sep 15 16:29:32.158843 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.158689    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ac84877-33d6-44f5-928a-d5030c2dc07d" containerName="kube-rbac-proxy-web"
Sep 15 16:29:32.158843 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.158730    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ac84877-33d6-44f5-928a-d5030c2dc07d" containerName="kube-rbac-proxy"
Sep 15 16:29:32.158843 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.158737    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ac84877-33d6-44f5-928a-d5030c2dc07d" containerName="thanos-sidecar"
Sep 15 16:29:32.158843 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.158743    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ac84877-33d6-44f5-928a-d5030c2dc07d" containerName="kube-rbac-proxy-web"
Sep 15 16:29:32.158843 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.158748    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ac84877-33d6-44f5-928a-d5030c2dc07d" containerName="config-reloader"
Sep 15 16:29:32.158843 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.158753    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ac84877-33d6-44f5-928a-d5030c2dc07d" containerName="kube-rbac-proxy-thanos"
Sep 15 16:29:32.158843 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.158758    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ac84877-33d6-44f5-928a-d5030c2dc07d" containerName="prometheus"
Sep 15 16:29:32.160809 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.160793    2577 scope.go:117] "RemoveContainer" containerID="c545612628c57d87e13b5b8c92bbd501ed5eed4645f21738fd61953722e7bc17"
Sep 15 16:29:32.161248 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:29:32.161212    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c545612628c57d87e13b5b8c92bbd501ed5eed4645f21738fd61953722e7bc17\": container with ID starting with c545612628c57d87e13b5b8c92bbd501ed5eed4645f21738fd61953722e7bc17 not found: ID does not exist" containerID="c545612628c57d87e13b5b8c92bbd501ed5eed4645f21738fd61953722e7bc17"
Sep 15 16:29:32.161362 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.161250    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c545612628c57d87e13b5b8c92bbd501ed5eed4645f21738fd61953722e7bc17"} err="failed to get container status \"c545612628c57d87e13b5b8c92bbd501ed5eed4645f21738fd61953722e7bc17\": rpc error: code = NotFound desc = could not find container \"c545612628c57d87e13b5b8c92bbd501ed5eed4645f21738fd61953722e7bc17\": container with ID starting with c545612628c57d87e13b5b8c92bbd501ed5eed4645f21738fd61953722e7bc17 not found: ID does not exist"
Sep 15 16:29:32.161362 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.161283    2577 scope.go:117] "RemoveContainer" containerID="ff435d429821092d7e6bcf961af149c52f6733926a3f397af54a6b17d07282ca"
Sep 15 16:29:32.161768 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:29:32.161741    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff435d429821092d7e6bcf961af149c52f6733926a3f397af54a6b17d07282ca\": container with ID starting with ff435d429821092d7e6bcf961af149c52f6733926a3f397af54a6b17d07282ca not found: ID does not exist" containerID="ff435d429821092d7e6bcf961af149c52f6733926a3f397af54a6b17d07282ca"
Sep 15 16:29:32.161871 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.161775    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff435d429821092d7e6bcf961af149c52f6733926a3f397af54a6b17d07282ca"} err="failed to get container status \"ff435d429821092d7e6bcf961af149c52f6733926a3f397af54a6b17d07282ca\": rpc error: code = NotFound desc = could not find container \"ff435d429821092d7e6bcf961af149c52f6733926a3f397af54a6b17d07282ca\": container with ID starting with ff435d429821092d7e6bcf961af149c52f6733926a3f397af54a6b17d07282ca not found: ID does not exist"
Sep 15 16:29:32.161871 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.161799    2577 scope.go:117] "RemoveContainer" containerID="6b90e4751707a0ef69ce75bbe89d12f6eaa22a87f70d10dbae77dfab802d0bdb"
Sep 15 16:29:32.162200 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:29:32.162177    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b90e4751707a0ef69ce75bbe89d12f6eaa22a87f70d10dbae77dfab802d0bdb\": container with ID starting with 6b90e4751707a0ef69ce75bbe89d12f6eaa22a87f70d10dbae77dfab802d0bdb not found: ID does not exist" containerID="6b90e4751707a0ef69ce75bbe89d12f6eaa22a87f70d10dbae77dfab802d0bdb"
Sep 15 16:29:32.162291 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.162204    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b90e4751707a0ef69ce75bbe89d12f6eaa22a87f70d10dbae77dfab802d0bdb"} err="failed to get container status \"6b90e4751707a0ef69ce75bbe89d12f6eaa22a87f70d10dbae77dfab802d0bdb\": rpc error: code = NotFound desc = could not find container \"6b90e4751707a0ef69ce75bbe89d12f6eaa22a87f70d10dbae77dfab802d0bdb\": container with ID starting with 6b90e4751707a0ef69ce75bbe89d12f6eaa22a87f70d10dbae77dfab802d0bdb not found: ID does not exist"
Sep 15 16:29:32.162291 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.162221    2577 scope.go:117] "RemoveContainer" containerID="6c4f292f9c43cd54e9210c3a0a3ef37d2483a48378d7ac2a79ab05f0f7256a35"
Sep 15 16:29:32.162494 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:29:32.162478    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c4f292f9c43cd54e9210c3a0a3ef37d2483a48378d7ac2a79ab05f0f7256a35\": container with ID starting with 6c4f292f9c43cd54e9210c3a0a3ef37d2483a48378d7ac2a79ab05f0f7256a35 not found: ID does not exist" containerID="6c4f292f9c43cd54e9210c3a0a3ef37d2483a48378d7ac2a79ab05f0f7256a35"
Sep 15 16:29:32.162539 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.162500    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c4f292f9c43cd54e9210c3a0a3ef37d2483a48378d7ac2a79ab05f0f7256a35"} err="failed to get container status \"6c4f292f9c43cd54e9210c3a0a3ef37d2483a48378d7ac2a79ab05f0f7256a35\": rpc error: code = NotFound desc = could not find container \"6c4f292f9c43cd54e9210c3a0a3ef37d2483a48378d7ac2a79ab05f0f7256a35\": container with ID starting with 6c4f292f9c43cd54e9210c3a0a3ef37d2483a48378d7ac2a79ab05f0f7256a35 not found: ID does not exist"
Sep 15 16:29:32.162539 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.162513    2577 scope.go:117] "RemoveContainer" containerID="e5a652b2c543a53081e44e3d53ffe0de90acfdc97ce95e991b5e3e3a641b0c3a"
Sep 15 16:29:32.162796 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:29:32.162779    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5a652b2c543a53081e44e3d53ffe0de90acfdc97ce95e991b5e3e3a641b0c3a\": container with ID starting with e5a652b2c543a53081e44e3d53ffe0de90acfdc97ce95e991b5e3e3a641b0c3a not found: ID does not exist" containerID="e5a652b2c543a53081e44e3d53ffe0de90acfdc97ce95e991b5e3e3a641b0c3a"
Sep 15 16:29:32.162837 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.162802    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5a652b2c543a53081e44e3d53ffe0de90acfdc97ce95e991b5e3e3a641b0c3a"} err="failed to get container status \"e5a652b2c543a53081e44e3d53ffe0de90acfdc97ce95e991b5e3e3a641b0c3a\": rpc error: code = NotFound desc = could not find container \"e5a652b2c543a53081e44e3d53ffe0de90acfdc97ce95e991b5e3e3a641b0c3a\": container with ID starting with e5a652b2c543a53081e44e3d53ffe0de90acfdc97ce95e991b5e3e3a641b0c3a not found: ID does not exist"
Sep 15 16:29:32.162837 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.162818    2577 scope.go:117] "RemoveContainer" containerID="8245e54cd91bd2303b7deaf3417e5b80d9da7c6d39004dd73602770ead0d1ffe"
Sep 15 16:29:32.163079 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:29:32.163063    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8245e54cd91bd2303b7deaf3417e5b80d9da7c6d39004dd73602770ead0d1ffe\": container with ID starting with 8245e54cd91bd2303b7deaf3417e5b80d9da7c6d39004dd73602770ead0d1ffe not found: ID does not exist" containerID="8245e54cd91bd2303b7deaf3417e5b80d9da7c6d39004dd73602770ead0d1ffe"
Sep 15 16:29:32.163134 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.163082    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8245e54cd91bd2303b7deaf3417e5b80d9da7c6d39004dd73602770ead0d1ffe"} err="failed to get container status \"8245e54cd91bd2303b7deaf3417e5b80d9da7c6d39004dd73602770ead0d1ffe\": rpc error: code = NotFound desc = could not find container \"8245e54cd91bd2303b7deaf3417e5b80d9da7c6d39004dd73602770ead0d1ffe\": container with ID starting with 8245e54cd91bd2303b7deaf3417e5b80d9da7c6d39004dd73602770ead0d1ffe not found: ID does not exist"
Sep 15 16:29:32.163134 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.163095    2577 scope.go:117] "RemoveContainer" containerID="8de0a13c22229e286692f45ec3263f13c64475d275a28c2d1535550ab688f694"
Sep 15 16:29:32.163340 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:29:32.163325    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8de0a13c22229e286692f45ec3263f13c64475d275a28c2d1535550ab688f694\": container with ID starting with 8de0a13c22229e286692f45ec3263f13c64475d275a28c2d1535550ab688f694 not found: ID does not exist" containerID="8de0a13c22229e286692f45ec3263f13c64475d275a28c2d1535550ab688f694"
Sep 15 16:29:32.163390 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.163346    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8de0a13c22229e286692f45ec3263f13c64475d275a28c2d1535550ab688f694"} err="failed to get container status \"8de0a13c22229e286692f45ec3263f13c64475d275a28c2d1535550ab688f694\": rpc error: code = NotFound desc = could not find container \"8de0a13c22229e286692f45ec3263f13c64475d275a28c2d1535550ab688f694\": container with ID starting with 8de0a13c22229e286692f45ec3263f13c64475d275a28c2d1535550ab688f694 not found: ID does not exist"
Sep 15 16:29:32.163390 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.163358    2577 scope.go:117] "RemoveContainer" containerID="c545612628c57d87e13b5b8c92bbd501ed5eed4645f21738fd61953722e7bc17"
Sep 15 16:29:32.163704 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.163685    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c545612628c57d87e13b5b8c92bbd501ed5eed4645f21738fd61953722e7bc17"} err="failed to get container status \"c545612628c57d87e13b5b8c92bbd501ed5eed4645f21738fd61953722e7bc17\": rpc error: code = NotFound desc = could not find container \"c545612628c57d87e13b5b8c92bbd501ed5eed4645f21738fd61953722e7bc17\": container with ID starting with c545612628c57d87e13b5b8c92bbd501ed5eed4645f21738fd61953722e7bc17 not found: ID does not exist"
Sep 15 16:29:32.163704 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.163702    2577 scope.go:117] "RemoveContainer" containerID="ff435d429821092d7e6bcf961af149c52f6733926a3f397af54a6b17d07282ca"
Sep 15 16:29:32.163920 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.163904    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff435d429821092d7e6bcf961af149c52f6733926a3f397af54a6b17d07282ca"} err="failed to get container status \"ff435d429821092d7e6bcf961af149c52f6733926a3f397af54a6b17d07282ca\": rpc error: code = NotFound desc = could not find container \"ff435d429821092d7e6bcf961af149c52f6733926a3f397af54a6b17d07282ca\": container with ID starting with ff435d429821092d7e6bcf961af149c52f6733926a3f397af54a6b17d07282ca not found: ID does not exist"
Sep 15 16:29:32.163959 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.163923    2577 scope.go:117] "RemoveContainer" containerID="6b90e4751707a0ef69ce75bbe89d12f6eaa22a87f70d10dbae77dfab802d0bdb"
Sep 15 16:29:32.163993 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.163978    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:32.164361 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.164199    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b90e4751707a0ef69ce75bbe89d12f6eaa22a87f70d10dbae77dfab802d0bdb"} err="failed to get container status \"6b90e4751707a0ef69ce75bbe89d12f6eaa22a87f70d10dbae77dfab802d0bdb\": rpc error: code = NotFound desc = could not find container \"6b90e4751707a0ef69ce75bbe89d12f6eaa22a87f70d10dbae77dfab802d0bdb\": container with ID starting with 6b90e4751707a0ef69ce75bbe89d12f6eaa22a87f70d10dbae77dfab802d0bdb not found: ID does not exist"
Sep 15 16:29:32.164361 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.164225    2577 scope.go:117] "RemoveContainer" containerID="6c4f292f9c43cd54e9210c3a0a3ef37d2483a48378d7ac2a79ab05f0f7256a35"
Sep 15 16:29:32.164616 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.164592    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c4f292f9c43cd54e9210c3a0a3ef37d2483a48378d7ac2a79ab05f0f7256a35"} err="failed to get container status \"6c4f292f9c43cd54e9210c3a0a3ef37d2483a48378d7ac2a79ab05f0f7256a35\": rpc error: code = NotFound desc = could not find container \"6c4f292f9c43cd54e9210c3a0a3ef37d2483a48378d7ac2a79ab05f0f7256a35\": container with ID starting with 6c4f292f9c43cd54e9210c3a0a3ef37d2483a48378d7ac2a79ab05f0f7256a35 not found: ID does not exist"
Sep 15 16:29:32.164668 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.164619    2577 scope.go:117] "RemoveContainer" containerID="e5a652b2c543a53081e44e3d53ffe0de90acfdc97ce95e991b5e3e3a641b0c3a"
Sep 15 16:29:32.164890 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.164872    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5a652b2c543a53081e44e3d53ffe0de90acfdc97ce95e991b5e3e3a641b0c3a"} err="failed to get container status \"e5a652b2c543a53081e44e3d53ffe0de90acfdc97ce95e991b5e3e3a641b0c3a\": rpc error: code = NotFound desc = could not find container \"e5a652b2c543a53081e44e3d53ffe0de90acfdc97ce95e991b5e3e3a641b0c3a\": container with ID starting with e5a652b2c543a53081e44e3d53ffe0de90acfdc97ce95e991b5e3e3a641b0c3a not found: ID does not exist"
Sep 15 16:29:32.164890 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.164889    2577 scope.go:117] "RemoveContainer" containerID="8245e54cd91bd2303b7deaf3417e5b80d9da7c6d39004dd73602770ead0d1ffe"
Sep 15 16:29:32.165243 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.165225    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8245e54cd91bd2303b7deaf3417e5b80d9da7c6d39004dd73602770ead0d1ffe"} err="failed to get container status \"8245e54cd91bd2303b7deaf3417e5b80d9da7c6d39004dd73602770ead0d1ffe\": rpc error: code = NotFound desc = could not find container \"8245e54cd91bd2303b7deaf3417e5b80d9da7c6d39004dd73602770ead0d1ffe\": container with ID starting with 8245e54cd91bd2303b7deaf3417e5b80d9da7c6d39004dd73602770ead0d1ffe not found: ID does not exist"
Sep 15 16:29:32.165315 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.165243    2577 scope.go:117] "RemoveContainer" containerID="8de0a13c22229e286692f45ec3263f13c64475d275a28c2d1535550ab688f694"
Sep 15 16:29:32.165533 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.165511    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8de0a13c22229e286692f45ec3263f13c64475d275a28c2d1535550ab688f694"} err="failed to get container status \"8de0a13c22229e286692f45ec3263f13c64475d275a28c2d1535550ab688f694\": rpc error: code = NotFound desc = could not find container \"8de0a13c22229e286692f45ec3263f13c64475d275a28c2d1535550ab688f694\": container with ID starting with 8de0a13c22229e286692f45ec3263f13c64475d275a28c2d1535550ab688f694 not found: ID does not exist"
Sep 15 16:29:32.165533 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.165533    2577 scope.go:117] "RemoveContainer" containerID="c545612628c57d87e13b5b8c92bbd501ed5eed4645f21738fd61953722e7bc17"
Sep 15 16:29:32.165823 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.165801    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c545612628c57d87e13b5b8c92bbd501ed5eed4645f21738fd61953722e7bc17"} err="failed to get container status \"c545612628c57d87e13b5b8c92bbd501ed5eed4645f21738fd61953722e7bc17\": rpc error: code = NotFound desc = could not find container \"c545612628c57d87e13b5b8c92bbd501ed5eed4645f21738fd61953722e7bc17\": container with ID starting with c545612628c57d87e13b5b8c92bbd501ed5eed4645f21738fd61953722e7bc17 not found: ID does not exist"
Sep 15 16:29:32.165823 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.165821    2577 scope.go:117] "RemoveContainer" containerID="ff435d429821092d7e6bcf961af149c52f6733926a3f397af54a6b17d07282ca"
Sep 15 16:29:32.166186 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.166165    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff435d429821092d7e6bcf961af149c52f6733926a3f397af54a6b17d07282ca"} err="failed to get container status \"ff435d429821092d7e6bcf961af149c52f6733926a3f397af54a6b17d07282ca\": rpc error: code = NotFound desc = could not find container \"ff435d429821092d7e6bcf961af149c52f6733926a3f397af54a6b17d07282ca\": container with ID starting with ff435d429821092d7e6bcf961af149c52f6733926a3f397af54a6b17d07282ca not found: ID does not exist"
Sep 15 16:29:32.166269 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.166187    2577 scope.go:117] "RemoveContainer" containerID="6b90e4751707a0ef69ce75bbe89d12f6eaa22a87f70d10dbae77dfab802d0bdb"
Sep 15 16:29:32.166471 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.166450    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b90e4751707a0ef69ce75bbe89d12f6eaa22a87f70d10dbae77dfab802d0bdb"} err="failed to get container status \"6b90e4751707a0ef69ce75bbe89d12f6eaa22a87f70d10dbae77dfab802d0bdb\": rpc error: code = NotFound desc = could not find container \"6b90e4751707a0ef69ce75bbe89d12f6eaa22a87f70d10dbae77dfab802d0bdb\": container with ID starting with 6b90e4751707a0ef69ce75bbe89d12f6eaa22a87f70d10dbae77dfab802d0bdb not found: ID does not exist"
Sep 15 16:29:32.166471 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.166470    2577 scope.go:117] "RemoveContainer" containerID="6c4f292f9c43cd54e9210c3a0a3ef37d2483a48378d7ac2a79ab05f0f7256a35"
Sep 15 16:29:32.166617 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.166606    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 15 16:29:32.166663 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.166623    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 15 16:29:32.166764 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.166744    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c4f292f9c43cd54e9210c3a0a3ef37d2483a48378d7ac2a79ab05f0f7256a35"} err="failed to get container status \"6c4f292f9c43cd54e9210c3a0a3ef37d2483a48378d7ac2a79ab05f0f7256a35\": rpc error: code = NotFound desc = could not find container \"6c4f292f9c43cd54e9210c3a0a3ef37d2483a48378d7ac2a79ab05f0f7256a35\": container with ID starting with 6c4f292f9c43cd54e9210c3a0a3ef37d2483a48378d7ac2a79ab05f0f7256a35 not found: ID does not exist"
Sep 15 16:29:32.166822 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.166766    2577 scope.go:117] "RemoveContainer" containerID="e5a652b2c543a53081e44e3d53ffe0de90acfdc97ce95e991b5e3e3a641b0c3a"
Sep 15 16:29:32.167158 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.166985    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 15 16:29:32.167158 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.167051    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 15 16:29:32.167304 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.167153    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5a652b2c543a53081e44e3d53ffe0de90acfdc97ce95e991b5e3e3a641b0c3a"} err="failed to get container status \"e5a652b2c543a53081e44e3d53ffe0de90acfdc97ce95e991b5e3e3a641b0c3a\": rpc error: code = NotFound desc = could not find container \"e5a652b2c543a53081e44e3d53ffe0de90acfdc97ce95e991b5e3e3a641b0c3a\": container with ID starting with e5a652b2c543a53081e44e3d53ffe0de90acfdc97ce95e991b5e3e3a641b0c3a not found: ID does not exist"
Sep 15 16:29:32.167304 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.167175    2577 scope.go:117] "RemoveContainer" containerID="8245e54cd91bd2303b7deaf3417e5b80d9da7c6d39004dd73602770ead0d1ffe"
Sep 15 16:29:32.167304 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.167186    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 15 16:29:32.167462 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.167389    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 15 16:29:32.167515 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.167477    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 15 16:29:32.167574 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.167478    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-759mk9c4na7r8\""
Sep 15 16:29:32.167574 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.167517    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8245e54cd91bd2303b7deaf3417e5b80d9da7c6d39004dd73602770ead0d1ffe"} err="failed to get container status \"8245e54cd91bd2303b7deaf3417e5b80d9da7c6d39004dd73602770ead0d1ffe\": rpc error: code = NotFound desc = could not find container \"8245e54cd91bd2303b7deaf3417e5b80d9da7c6d39004dd73602770ead0d1ffe\": container with ID starting with 8245e54cd91bd2303b7deaf3417e5b80d9da7c6d39004dd73602770ead0d1ffe not found: ID does not exist"
Sep 15 16:29:32.167574 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.167554    2577 scope.go:117] "RemoveContainer" containerID="8de0a13c22229e286692f45ec3263f13c64475d275a28c2d1535550ab688f694"
Sep 15 16:29:32.167715 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.167575    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 15 16:29:32.167715 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.167575    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-2j7tz\""
Sep 15 16:29:32.167863 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.167842    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8de0a13c22229e286692f45ec3263f13c64475d275a28c2d1535550ab688f694"} err="failed to get container status \"8de0a13c22229e286692f45ec3263f13c64475d275a28c2d1535550ab688f694\": rpc error: code = NotFound desc = could not find container \"8de0a13c22229e286692f45ec3263f13c64475d275a28c2d1535550ab688f694\": container with ID starting with 8de0a13c22229e286692f45ec3263f13c64475d275a28c2d1535550ab688f694 not found: ID does not exist"
Sep 15 16:29:32.167932 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.167865    2577 scope.go:117] "RemoveContainer" containerID="c545612628c57d87e13b5b8c92bbd501ed5eed4645f21738fd61953722e7bc17"
Sep 15 16:29:32.168025 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.167994    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 15 16:29:32.168077 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.168004    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 15 16:29:32.168237 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.168215    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c545612628c57d87e13b5b8c92bbd501ed5eed4645f21738fd61953722e7bc17"} err="failed to get container status \"c545612628c57d87e13b5b8c92bbd501ed5eed4645f21738fd61953722e7bc17\": rpc error: code = NotFound desc = could not find container \"c545612628c57d87e13b5b8c92bbd501ed5eed4645f21738fd61953722e7bc17\": container with ID starting with c545612628c57d87e13b5b8c92bbd501ed5eed4645f21738fd61953722e7bc17 not found: ID does not exist"
Sep 15 16:29:32.168285 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.168242    2577 scope.go:117] "RemoveContainer" containerID="ff435d429821092d7e6bcf961af149c52f6733926a3f397af54a6b17d07282ca"
Sep 15 16:29:32.168400 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.168382    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 15 16:29:32.168456 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.168426    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 15 16:29:32.168565 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.168546    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff435d429821092d7e6bcf961af149c52f6733926a3f397af54a6b17d07282ca"} err="failed to get container status \"ff435d429821092d7e6bcf961af149c52f6733926a3f397af54a6b17d07282ca\": rpc error: code = NotFound desc = could not find container \"ff435d429821092d7e6bcf961af149c52f6733926a3f397af54a6b17d07282ca\": container with ID starting with ff435d429821092d7e6bcf961af149c52f6733926a3f397af54a6b17d07282ca not found: ID does not exist"
Sep 15 16:29:32.168565 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.168564    2577 scope.go:117] "RemoveContainer" containerID="6b90e4751707a0ef69ce75bbe89d12f6eaa22a87f70d10dbae77dfab802d0bdb"
Sep 15 16:29:32.168860 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.168831    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b90e4751707a0ef69ce75bbe89d12f6eaa22a87f70d10dbae77dfab802d0bdb"} err="failed to get container status \"6b90e4751707a0ef69ce75bbe89d12f6eaa22a87f70d10dbae77dfab802d0bdb\": rpc error: code = NotFound desc = could not find container \"6b90e4751707a0ef69ce75bbe89d12f6eaa22a87f70d10dbae77dfab802d0bdb\": container with ID starting with 6b90e4751707a0ef69ce75bbe89d12f6eaa22a87f70d10dbae77dfab802d0bdb not found: ID does not exist"
Sep 15 16:29:32.168928 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.168862    2577 scope.go:117] "RemoveContainer" containerID="6c4f292f9c43cd54e9210c3a0a3ef37d2483a48378d7ac2a79ab05f0f7256a35"
Sep 15 16:29:32.169215 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.169196    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c4f292f9c43cd54e9210c3a0a3ef37d2483a48378d7ac2a79ab05f0f7256a35"} err="failed to get container status \"6c4f292f9c43cd54e9210c3a0a3ef37d2483a48378d7ac2a79ab05f0f7256a35\": rpc error: code = NotFound desc = could not find container \"6c4f292f9c43cd54e9210c3a0a3ef37d2483a48378d7ac2a79ab05f0f7256a35\": container with ID starting with 6c4f292f9c43cd54e9210c3a0a3ef37d2483a48378d7ac2a79ab05f0f7256a35 not found: ID does not exist"
Sep 15 16:29:32.169215 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.169216    2577 scope.go:117] "RemoveContainer" containerID="e5a652b2c543a53081e44e3d53ffe0de90acfdc97ce95e991b5e3e3a641b0c3a"
Sep 15 16:29:32.169488 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.169466    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5a652b2c543a53081e44e3d53ffe0de90acfdc97ce95e991b5e3e3a641b0c3a"} err="failed to get container status \"e5a652b2c543a53081e44e3d53ffe0de90acfdc97ce95e991b5e3e3a641b0c3a\": rpc error: code = NotFound desc = could not find container \"e5a652b2c543a53081e44e3d53ffe0de90acfdc97ce95e991b5e3e3a641b0c3a\": container with ID starting with e5a652b2c543a53081e44e3d53ffe0de90acfdc97ce95e991b5e3e3a641b0c3a not found: ID does not exist"
Sep 15 16:29:32.169578 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.169491    2577 scope.go:117] "RemoveContainer" containerID="8245e54cd91bd2303b7deaf3417e5b80d9da7c6d39004dd73602770ead0d1ffe"
Sep 15 16:29:32.170134 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.170107    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8245e54cd91bd2303b7deaf3417e5b80d9da7c6d39004dd73602770ead0d1ffe"} err="failed to get container status \"8245e54cd91bd2303b7deaf3417e5b80d9da7c6d39004dd73602770ead0d1ffe\": rpc error: code = NotFound desc = could not find container \"8245e54cd91bd2303b7deaf3417e5b80d9da7c6d39004dd73602770ead0d1ffe\": container with ID starting with 8245e54cd91bd2303b7deaf3417e5b80d9da7c6d39004dd73602770ead0d1ffe not found: ID does not exist"
Sep 15 16:29:32.170213 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.170135    2577 scope.go:117] "RemoveContainer" containerID="8de0a13c22229e286692f45ec3263f13c64475d275a28c2d1535550ab688f694"
Sep 15 16:29:32.170213 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.170167    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 15 16:29:32.170423 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.170405    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8de0a13c22229e286692f45ec3263f13c64475d275a28c2d1535550ab688f694"} err="failed to get container status \"8de0a13c22229e286692f45ec3263f13c64475d275a28c2d1535550ab688f694\": rpc error: code = NotFound desc = could not find container \"8de0a13c22229e286692f45ec3263f13c64475d275a28c2d1535550ab688f694\": container with ID starting with 8de0a13c22229e286692f45ec3263f13c64475d275a28c2d1535550ab688f694 not found: ID does not exist"
Sep 15 16:29:32.170500 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.170425    2577 scope.go:117] "RemoveContainer" containerID="c545612628c57d87e13b5b8c92bbd501ed5eed4645f21738fd61953722e7bc17"
Sep 15 16:29:32.170771 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.170747    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c545612628c57d87e13b5b8c92bbd501ed5eed4645f21738fd61953722e7bc17"} err="failed to get container status \"c545612628c57d87e13b5b8c92bbd501ed5eed4645f21738fd61953722e7bc17\": rpc error: code = NotFound desc = could not find container \"c545612628c57d87e13b5b8c92bbd501ed5eed4645f21738fd61953722e7bc17\": container with ID starting with c545612628c57d87e13b5b8c92bbd501ed5eed4645f21738fd61953722e7bc17 not found: ID does not exist"
Sep 15 16:29:32.170846 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.170773    2577 scope.go:117] "RemoveContainer" containerID="ff435d429821092d7e6bcf961af149c52f6733926a3f397af54a6b17d07282ca"
Sep 15 16:29:32.171169 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.171142    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff435d429821092d7e6bcf961af149c52f6733926a3f397af54a6b17d07282ca"} err="failed to get container status \"ff435d429821092d7e6bcf961af149c52f6733926a3f397af54a6b17d07282ca\": rpc error: code = NotFound desc = could not find container \"ff435d429821092d7e6bcf961af149c52f6733926a3f397af54a6b17d07282ca\": container with ID starting with ff435d429821092d7e6bcf961af149c52f6733926a3f397af54a6b17d07282ca not found: ID does not exist"
Sep 15 16:29:32.171169 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.171167    2577 scope.go:117] "RemoveContainer" containerID="6b90e4751707a0ef69ce75bbe89d12f6eaa22a87f70d10dbae77dfab802d0bdb"
Sep 15 16:29:32.171439 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.171418    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b90e4751707a0ef69ce75bbe89d12f6eaa22a87f70d10dbae77dfab802d0bdb"} err="failed to get container status \"6b90e4751707a0ef69ce75bbe89d12f6eaa22a87f70d10dbae77dfab802d0bdb\": rpc error: code = NotFound desc = could not find container \"6b90e4751707a0ef69ce75bbe89d12f6eaa22a87f70d10dbae77dfab802d0bdb\": container with ID starting with 6b90e4751707a0ef69ce75bbe89d12f6eaa22a87f70d10dbae77dfab802d0bdb not found: ID does not exist"
Sep 15 16:29:32.171439 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.171438    2577 scope.go:117] "RemoveContainer" containerID="6c4f292f9c43cd54e9210c3a0a3ef37d2483a48378d7ac2a79ab05f0f7256a35"
Sep 15 16:29:32.171704 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.171686    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c4f292f9c43cd54e9210c3a0a3ef37d2483a48378d7ac2a79ab05f0f7256a35"} err="failed to get container status \"6c4f292f9c43cd54e9210c3a0a3ef37d2483a48378d7ac2a79ab05f0f7256a35\": rpc error: code = NotFound desc = could not find container \"6c4f292f9c43cd54e9210c3a0a3ef37d2483a48378d7ac2a79ab05f0f7256a35\": container with ID starting with 6c4f292f9c43cd54e9210c3a0a3ef37d2483a48378d7ac2a79ab05f0f7256a35 not found: ID does not exist"
Sep 15 16:29:32.171766 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.171705    2577 scope.go:117] "RemoveContainer" containerID="e5a652b2c543a53081e44e3d53ffe0de90acfdc97ce95e991b5e3e3a641b0c3a"
Sep 15 16:29:32.172039 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.171995    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5a652b2c543a53081e44e3d53ffe0de90acfdc97ce95e991b5e3e3a641b0c3a"} err="failed to get container status \"e5a652b2c543a53081e44e3d53ffe0de90acfdc97ce95e991b5e3e3a641b0c3a\": rpc error: code = NotFound desc = could not find container \"e5a652b2c543a53081e44e3d53ffe0de90acfdc97ce95e991b5e3e3a641b0c3a\": container with ID starting with e5a652b2c543a53081e44e3d53ffe0de90acfdc97ce95e991b5e3e3a641b0c3a not found: ID does not exist"
Sep 15 16:29:32.172039 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.172038    2577 scope.go:117] "RemoveContainer" containerID="8245e54cd91bd2303b7deaf3417e5b80d9da7c6d39004dd73602770ead0d1ffe"
Sep 15 16:29:32.172406 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.172373    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8245e54cd91bd2303b7deaf3417e5b80d9da7c6d39004dd73602770ead0d1ffe"} err="failed to get container status \"8245e54cd91bd2303b7deaf3417e5b80d9da7c6d39004dd73602770ead0d1ffe\": rpc error: code = NotFound desc = could not find container \"8245e54cd91bd2303b7deaf3417e5b80d9da7c6d39004dd73602770ead0d1ffe\": container with ID starting with 8245e54cd91bd2303b7deaf3417e5b80d9da7c6d39004dd73602770ead0d1ffe not found: ID does not exist"
Sep 15 16:29:32.172406 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.172401    2577 scope.go:117] "RemoveContainer" containerID="8de0a13c22229e286692f45ec3263f13c64475d275a28c2d1535550ab688f694"
Sep 15 16:29:32.172700 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.172668    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8de0a13c22229e286692f45ec3263f13c64475d275a28c2d1535550ab688f694"} err="failed to get container status \"8de0a13c22229e286692f45ec3263f13c64475d275a28c2d1535550ab688f694\": rpc error: code = NotFound desc = could not find container \"8de0a13c22229e286692f45ec3263f13c64475d275a28c2d1535550ab688f694\": container with ID starting with 8de0a13c22229e286692f45ec3263f13c64475d275a28c2d1535550ab688f694 not found: ID does not exist"
Sep 15 16:29:32.172700 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.172691    2577 scope.go:117] "RemoveContainer" containerID="c545612628c57d87e13b5b8c92bbd501ed5eed4645f21738fd61953722e7bc17"
Sep 15 16:29:32.172949 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.172931    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c545612628c57d87e13b5b8c92bbd501ed5eed4645f21738fd61953722e7bc17"} err="failed to get container status \"c545612628c57d87e13b5b8c92bbd501ed5eed4645f21738fd61953722e7bc17\": rpc error: code = NotFound desc = could not find container \"c545612628c57d87e13b5b8c92bbd501ed5eed4645f21738fd61953722e7bc17\": container with ID starting with c545612628c57d87e13b5b8c92bbd501ed5eed4645f21738fd61953722e7bc17 not found: ID does not exist"
Sep 15 16:29:32.173028 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.172950    2577 scope.go:117] "RemoveContainer" containerID="ff435d429821092d7e6bcf961af149c52f6733926a3f397af54a6b17d07282ca"
Sep 15 16:29:32.173090 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.173046    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 15 16:29:32.173237 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.173219    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff435d429821092d7e6bcf961af149c52f6733926a3f397af54a6b17d07282ca"} err="failed to get container status \"ff435d429821092d7e6bcf961af149c52f6733926a3f397af54a6b17d07282ca\": rpc error: code = NotFound desc = could not find container \"ff435d429821092d7e6bcf961af149c52f6733926a3f397af54a6b17d07282ca\": container with ID starting with ff435d429821092d7e6bcf961af149c52f6733926a3f397af54a6b17d07282ca not found: ID does not exist"
Sep 15 16:29:32.173285 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.173239    2577 scope.go:117] "RemoveContainer" containerID="6b90e4751707a0ef69ce75bbe89d12f6eaa22a87f70d10dbae77dfab802d0bdb"
Sep 15 16:29:32.173522 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.173504    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b90e4751707a0ef69ce75bbe89d12f6eaa22a87f70d10dbae77dfab802d0bdb"} err="failed to get container status \"6b90e4751707a0ef69ce75bbe89d12f6eaa22a87f70d10dbae77dfab802d0bdb\": rpc error: code = NotFound desc = could not find container \"6b90e4751707a0ef69ce75bbe89d12f6eaa22a87f70d10dbae77dfab802d0bdb\": container with ID starting with 6b90e4751707a0ef69ce75bbe89d12f6eaa22a87f70d10dbae77dfab802d0bdb not found: ID does not exist"
Sep 15 16:29:32.173566 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.173523    2577 scope.go:117] "RemoveContainer" containerID="6c4f292f9c43cd54e9210c3a0a3ef37d2483a48378d7ac2a79ab05f0f7256a35"
Sep 15 16:29:32.173748 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.173733    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c4f292f9c43cd54e9210c3a0a3ef37d2483a48378d7ac2a79ab05f0f7256a35"} err="failed to get container status \"6c4f292f9c43cd54e9210c3a0a3ef37d2483a48378d7ac2a79ab05f0f7256a35\": rpc error: code = NotFound desc = could not find container \"6c4f292f9c43cd54e9210c3a0a3ef37d2483a48378d7ac2a79ab05f0f7256a35\": container with ID starting with 6c4f292f9c43cd54e9210c3a0a3ef37d2483a48378d7ac2a79ab05f0f7256a35 not found: ID does not exist"
Sep 15 16:29:32.173799 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.173749    2577 scope.go:117] "RemoveContainer" containerID="e5a652b2c543a53081e44e3d53ffe0de90acfdc97ce95e991b5e3e3a641b0c3a"
Sep 15 16:29:32.173976 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.173954    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5a652b2c543a53081e44e3d53ffe0de90acfdc97ce95e991b5e3e3a641b0c3a"} err="failed to get container status \"e5a652b2c543a53081e44e3d53ffe0de90acfdc97ce95e991b5e3e3a641b0c3a\": rpc error: code = NotFound desc = could not find container \"e5a652b2c543a53081e44e3d53ffe0de90acfdc97ce95e991b5e3e3a641b0c3a\": container with ID starting with e5a652b2c543a53081e44e3d53ffe0de90acfdc97ce95e991b5e3e3a641b0c3a not found: ID does not exist"
Sep 15 16:29:32.174047 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.173977    2577 scope.go:117] "RemoveContainer" containerID="8245e54cd91bd2303b7deaf3417e5b80d9da7c6d39004dd73602770ead0d1ffe"
Sep 15 16:29:32.174230 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.174215    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8245e54cd91bd2303b7deaf3417e5b80d9da7c6d39004dd73602770ead0d1ffe"} err="failed to get container status \"8245e54cd91bd2303b7deaf3417e5b80d9da7c6d39004dd73602770ead0d1ffe\": rpc error: code = NotFound desc = could not find container \"8245e54cd91bd2303b7deaf3417e5b80d9da7c6d39004dd73602770ead0d1ffe\": container with ID starting with 8245e54cd91bd2303b7deaf3417e5b80d9da7c6d39004dd73602770ead0d1ffe not found: ID does not exist"
Sep 15 16:29:32.174230 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.174229    2577 scope.go:117] "RemoveContainer" containerID="8de0a13c22229e286692f45ec3263f13c64475d275a28c2d1535550ab688f694"
Sep 15 16:29:32.174502 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.174488    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8de0a13c22229e286692f45ec3263f13c64475d275a28c2d1535550ab688f694"} err="failed to get container status \"8de0a13c22229e286692f45ec3263f13c64475d275a28c2d1535550ab688f694\": rpc error: code = NotFound desc = could not find container \"8de0a13c22229e286692f45ec3263f13c64475d275a28c2d1535550ab688f694\": container with ID starting with 8de0a13c22229e286692f45ec3263f13c64475d275a28c2d1535550ab688f694 not found: ID does not exist"
Sep 15 16:29:32.183089 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.183064    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 15 16:29:32.270073 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.270033    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1bf4f2e5-d29b-48ea-af97-db822c2981e9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1bf4f2e5-d29b-48ea-af97-db822c2981e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:32.270073 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.270073    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1bf4f2e5-d29b-48ea-af97-db822c2981e9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1bf4f2e5-d29b-48ea-af97-db822c2981e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:32.270289 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.270097    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1bf4f2e5-d29b-48ea-af97-db822c2981e9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1bf4f2e5-d29b-48ea-af97-db822c2981e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:32.270289 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.270171    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1bf4f2e5-d29b-48ea-af97-db822c2981e9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1bf4f2e5-d29b-48ea-af97-db822c2981e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:32.270289 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.270210    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjwtb\" (UniqueName: \"kubernetes.io/projected/1bf4f2e5-d29b-48ea-af97-db822c2981e9-kube-api-access-sjwtb\") pod \"prometheus-k8s-0\" (UID: \"1bf4f2e5-d29b-48ea-af97-db822c2981e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:32.270289 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.270237    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1bf4f2e5-d29b-48ea-af97-db822c2981e9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1bf4f2e5-d29b-48ea-af97-db822c2981e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:32.270289 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.270257    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1bf4f2e5-d29b-48ea-af97-db822c2981e9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1bf4f2e5-d29b-48ea-af97-db822c2981e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:32.270457 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.270297    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1bf4f2e5-d29b-48ea-af97-db822c2981e9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1bf4f2e5-d29b-48ea-af97-db822c2981e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:32.270457 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.270347    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bf4f2e5-d29b-48ea-af97-db822c2981e9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1bf4f2e5-d29b-48ea-af97-db822c2981e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:32.270457 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.270363    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1bf4f2e5-d29b-48ea-af97-db822c2981e9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1bf4f2e5-d29b-48ea-af97-db822c2981e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:32.270457 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.270395    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1bf4f2e5-d29b-48ea-af97-db822c2981e9-web-config\") pod \"prometheus-k8s-0\" (UID: \"1bf4f2e5-d29b-48ea-af97-db822c2981e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:32.270457 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.270418    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1bf4f2e5-d29b-48ea-af97-db822c2981e9-config\") pod \"prometheus-k8s-0\" (UID: \"1bf4f2e5-d29b-48ea-af97-db822c2981e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:32.270457 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.270441    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1bf4f2e5-d29b-48ea-af97-db822c2981e9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1bf4f2e5-d29b-48ea-af97-db822c2981e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:32.270622 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.270473    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bf4f2e5-d29b-48ea-af97-db822c2981e9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1bf4f2e5-d29b-48ea-af97-db822c2981e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:32.270622 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.270496    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1bf4f2e5-d29b-48ea-af97-db822c2981e9-config-out\") pod \"prometheus-k8s-0\" (UID: \"1bf4f2e5-d29b-48ea-af97-db822c2981e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:32.270622 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.270516    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1bf4f2e5-d29b-48ea-af97-db822c2981e9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1bf4f2e5-d29b-48ea-af97-db822c2981e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:32.270622 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.270546    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1bf4f2e5-d29b-48ea-af97-db822c2981e9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1bf4f2e5-d29b-48ea-af97-db822c2981e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:32.270622 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.270588    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bf4f2e5-d29b-48ea-af97-db822c2981e9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1bf4f2e5-d29b-48ea-af97-db822c2981e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:32.270762 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.270626    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1bf4f2e5-d29b-48ea-af97-db822c2981e9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1bf4f2e5-d29b-48ea-af97-db822c2981e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:32.270762 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.270644    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1bf4f2e5-d29b-48ea-af97-db822c2981e9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1bf4f2e5-d29b-48ea-af97-db822c2981e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:32.371408 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.371325    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1bf4f2e5-d29b-48ea-af97-db822c2981e9-web-config\") pod \"prometheus-k8s-0\" (UID: \"1bf4f2e5-d29b-48ea-af97-db822c2981e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:32.371408 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.371369    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1bf4f2e5-d29b-48ea-af97-db822c2981e9-config\") pod \"prometheus-k8s-0\" (UID: \"1bf4f2e5-d29b-48ea-af97-db822c2981e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:32.371408 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.371391    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1bf4f2e5-d29b-48ea-af97-db822c2981e9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1bf4f2e5-d29b-48ea-af97-db822c2981e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:32.371660 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.371422    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bf4f2e5-d29b-48ea-af97-db822c2981e9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1bf4f2e5-d29b-48ea-af97-db822c2981e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:32.371660 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.371452    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1bf4f2e5-d29b-48ea-af97-db822c2981e9-config-out\") pod \"prometheus-k8s-0\" (UID: \"1bf4f2e5-d29b-48ea-af97-db822c2981e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:32.371660 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.371481    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1bf4f2e5-d29b-48ea-af97-db822c2981e9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1bf4f2e5-d29b-48ea-af97-db822c2981e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:32.371660 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.371504    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1bf4f2e5-d29b-48ea-af97-db822c2981e9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1bf4f2e5-d29b-48ea-af97-db822c2981e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:32.371660 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.371532    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bf4f2e5-d29b-48ea-af97-db822c2981e9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1bf4f2e5-d29b-48ea-af97-db822c2981e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:32.371660 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.371582    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1bf4f2e5-d29b-48ea-af97-db822c2981e9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1bf4f2e5-d29b-48ea-af97-db822c2981e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:32.371660 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.371623    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1bf4f2e5-d29b-48ea-af97-db822c2981e9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1bf4f2e5-d29b-48ea-af97-db822c2981e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:32.371660 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.371656    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1bf4f2e5-d29b-48ea-af97-db822c2981e9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1bf4f2e5-d29b-48ea-af97-db822c2981e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:32.372088 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.371685    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1bf4f2e5-d29b-48ea-af97-db822c2981e9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1bf4f2e5-d29b-48ea-af97-db822c2981e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:32.372088 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.371718    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1bf4f2e5-d29b-48ea-af97-db822c2981e9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1bf4f2e5-d29b-48ea-af97-db822c2981e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:32.372088 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.371747    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1bf4f2e5-d29b-48ea-af97-db822c2981e9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1bf4f2e5-d29b-48ea-af97-db822c2981e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:32.372088 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.371788    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjwtb\" (UniqueName: \"kubernetes.io/projected/1bf4f2e5-d29b-48ea-af97-db822c2981e9-kube-api-access-sjwtb\") pod \"prometheus-k8s-0\" (UID: \"1bf4f2e5-d29b-48ea-af97-db822c2981e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:32.372088 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.371829    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1bf4f2e5-d29b-48ea-af97-db822c2981e9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1bf4f2e5-d29b-48ea-af97-db822c2981e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:32.372088 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.371853    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1bf4f2e5-d29b-48ea-af97-db822c2981e9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1bf4f2e5-d29b-48ea-af97-db822c2981e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:32.372088 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.371893    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1bf4f2e5-d29b-48ea-af97-db822c2981e9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1bf4f2e5-d29b-48ea-af97-db822c2981e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:32.372088 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.371935    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bf4f2e5-d29b-48ea-af97-db822c2981e9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1bf4f2e5-d29b-48ea-af97-db822c2981e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:32.372088 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.371963    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1bf4f2e5-d29b-48ea-af97-db822c2981e9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1bf4f2e5-d29b-48ea-af97-db822c2981e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:32.372530 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.372481    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bf4f2e5-d29b-48ea-af97-db822c2981e9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1bf4f2e5-d29b-48ea-af97-db822c2981e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:32.372530 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.372522    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1bf4f2e5-d29b-48ea-af97-db822c2981e9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1bf4f2e5-d29b-48ea-af97-db822c2981e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:32.374916 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.374608    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1bf4f2e5-d29b-48ea-af97-db822c2981e9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1bf4f2e5-d29b-48ea-af97-db822c2981e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:32.374916 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.374699    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1bf4f2e5-d29b-48ea-af97-db822c2981e9-config-out\") pod \"prometheus-k8s-0\" (UID: \"1bf4f2e5-d29b-48ea-af97-db822c2981e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:32.374916 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.374783    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1bf4f2e5-d29b-48ea-af97-db822c2981e9-web-config\") pod \"prometheus-k8s-0\" (UID: \"1bf4f2e5-d29b-48ea-af97-db822c2981e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:32.374916 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.374855    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1bf4f2e5-d29b-48ea-af97-db822c2981e9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1bf4f2e5-d29b-48ea-af97-db822c2981e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:32.374916 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.374855    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/1bf4f2e5-d29b-48ea-af97-db822c2981e9-config\") pod \"prometheus-k8s-0\" (UID: \"1bf4f2e5-d29b-48ea-af97-db822c2981e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:32.375284 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.375144    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1bf4f2e5-d29b-48ea-af97-db822c2981e9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1bf4f2e5-d29b-48ea-af97-db822c2981e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:32.375284 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.375222    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1bf4f2e5-d29b-48ea-af97-db822c2981e9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1bf4f2e5-d29b-48ea-af97-db822c2981e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:32.375423 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.375328    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1bf4f2e5-d29b-48ea-af97-db822c2981e9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1bf4f2e5-d29b-48ea-af97-db822c2981e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:32.375423 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.375357    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bf4f2e5-d29b-48ea-af97-db822c2981e9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1bf4f2e5-d29b-48ea-af97-db822c2981e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:32.375706 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.375681    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1bf4f2e5-d29b-48ea-af97-db822c2981e9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1bf4f2e5-d29b-48ea-af97-db822c2981e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:32.375946 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.375922    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1bf4f2e5-d29b-48ea-af97-db822c2981e9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1bf4f2e5-d29b-48ea-af97-db822c2981e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:32.376474 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.376449    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bf4f2e5-d29b-48ea-af97-db822c2981e9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1bf4f2e5-d29b-48ea-af97-db822c2981e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:32.377117 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.377086    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1bf4f2e5-d29b-48ea-af97-db822c2981e9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1bf4f2e5-d29b-48ea-af97-db822c2981e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:32.377337 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.377318    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1bf4f2e5-d29b-48ea-af97-db822c2981e9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1bf4f2e5-d29b-48ea-af97-db822c2981e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:32.377394 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.377348    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1bf4f2e5-d29b-48ea-af97-db822c2981e9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1bf4f2e5-d29b-48ea-af97-db822c2981e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:32.377658 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.377636    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1bf4f2e5-d29b-48ea-af97-db822c2981e9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1bf4f2e5-d29b-48ea-af97-db822c2981e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:32.378136 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.378119    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1bf4f2e5-d29b-48ea-af97-db822c2981e9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1bf4f2e5-d29b-48ea-af97-db822c2981e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:32.381083 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.381061    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjwtb\" (UniqueName: \"kubernetes.io/projected/1bf4f2e5-d29b-48ea-af97-db822c2981e9-kube-api-access-sjwtb\") pod \"prometheus-k8s-0\" (UID: \"1bf4f2e5-d29b-48ea-af97-db822c2981e9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:32.390785 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.390763    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ac84877-33d6-44f5-928a-d5030c2dc07d" path="/var/lib/kubelet/pods/5ac84877-33d6-44f5-928a-d5030c2dc07d/volumes"
Sep 15 16:29:32.475440 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.475399    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:29:32.761864 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:32.759651    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 15 16:29:32.764988 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:29:32.764948    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bf4f2e5_d29b_48ea_af97_db822c2981e9.slice/crio-4c06d3a57f3125260c87653dfa1bb213ae83ed01226717caef91b2bc164ddded WatchSource:0}: Error finding container 4c06d3a57f3125260c87653dfa1bb213ae83ed01226717caef91b2bc164ddded: Status 404 returned error can't find the container with id 4c06d3a57f3125260c87653dfa1bb213ae83ed01226717caef91b2bc164ddded
Sep 15 16:29:33.109061 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:33.109000    2577 generic.go:356] "Generic (PLEG): container finished" podID="1bf4f2e5-d29b-48ea-af97-db822c2981e9" containerID="c941d0fa4e2f0c03de7b190152c5f39807670fb12d073ac05ced84df29a64a5b" exitCode=0
Sep 15 16:29:33.109061 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:33.109051    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1bf4f2e5-d29b-48ea-af97-db822c2981e9","Type":"ContainerDied","Data":"c941d0fa4e2f0c03de7b190152c5f39807670fb12d073ac05ced84df29a64a5b"}
Sep 15 16:29:33.109308 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:33.109119    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1bf4f2e5-d29b-48ea-af97-db822c2981e9","Type":"ContainerStarted","Data":"4c06d3a57f3125260c87653dfa1bb213ae83ed01226717caef91b2bc164ddded"}
Sep 15 16:29:34.118764 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:34.118724    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1bf4f2e5-d29b-48ea-af97-db822c2981e9","Type":"ContainerStarted","Data":"ad09ad309f184259804e5c60d70c3e698f60cca809a8fb5ecc0958736f7a956a"}
Sep 15 16:29:34.119256 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:34.118792    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1bf4f2e5-d29b-48ea-af97-db822c2981e9","Type":"ContainerStarted","Data":"777c1c3ea3a23e51999787bb256c856ed1297c3a140f2bb70b59bfe20a7e7f81"}
Sep 15 16:29:34.119256 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:34.118820    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1bf4f2e5-d29b-48ea-af97-db822c2981e9","Type":"ContainerStarted","Data":"d7ec4773bcb2bcaaffa0d1e9557f00d59fdc017348ef98a0dd3da6812c7c3c7b"}
Sep 15 16:29:34.119256 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:34.118843    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1bf4f2e5-d29b-48ea-af97-db822c2981e9","Type":"ContainerStarted","Data":"9828bc3e351d53d78d81a3baafb9a4dbff9cdca6f1e541937b363173aac2e405"}
Sep 15 16:29:34.119256 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:34.118866    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1bf4f2e5-d29b-48ea-af97-db822c2981e9","Type":"ContainerStarted","Data":"4c6d6e00270e1c690ea74253950f39dfdad063296fdb47d1da5f5e5ffe678134"}
Sep 15 16:29:34.119256 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:34.118894    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1bf4f2e5-d29b-48ea-af97-db822c2981e9","Type":"ContainerStarted","Data":"5e84ff8ba2a57860f4bd94782289c7a0d3fcf4d4bb0c2a5c7b0041bcc218609e"}
Sep 15 16:29:34.148848 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:34.148339    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.129647913 podStartE2EDuration="2.148316809s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.668896ms" isStatefulPod=false podCreationTimestamp="2026-09-15 16:29:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 16:29:34.147790393 +0000 UTC m=+166.193208745" watchObservedRunningTime="2026-09-15 16:29:34.148316809 +0000 UTC m=+166.193735159"
Sep 15 16:29:37.475871 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:29:37.475833    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:30:32.476419 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:30:32.476381    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:30:32.492807 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:30:32.492778    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:30:33.380682 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:30:33.380653    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 15 16:31:48.312553 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:31:48.312524    2577 kubelet.go:1648] "Image garbage collection succeeded"
Sep 15 16:37:07.380714 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:37:07.380663    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-init-qplpz"]
Sep 15 16:37:07.384290 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:37:07.384266    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-qplpz"
Sep 15 16:37:07.386867 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:37:07.386847    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Sep 15 16:37:07.387981 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:37:07.387957    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"hf-token\""
Sep 15 16:37:07.387981 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:37:07.387967    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Sep 15 16:37:07.388179 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:37:07.387959    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-dtbhk\""
Sep 15 16:37:07.388179 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:37:07.387996    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\""
Sep 15 16:37:07.390916 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:37:07.390890    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-qplpz"]
Sep 15 16:37:07.429602 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:37:07.429557    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vglpb\" (UniqueName: \"kubernetes.io/projected/34faddb9-2ee6-41e0-a3fd-89c33d38bb40-kube-api-access-vglpb\") pod \"s3-init-qplpz\" (UID: \"34faddb9-2ee6-41e0-a3fd-89c33d38bb40\") " pod="kserve/s3-init-qplpz"
Sep 15 16:37:07.429765 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:37:07.429619    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34faddb9-2ee6-41e0-a3fd-89c33d38bb40-model-cache\") pod \"s3-init-qplpz\" (UID: \"34faddb9-2ee6-41e0-a3fd-89c33d38bb40\") " pod="kserve/s3-init-qplpz"
Sep 15 16:37:07.530260 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:37:07.530222    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vglpb\" (UniqueName: \"kubernetes.io/projected/34faddb9-2ee6-41e0-a3fd-89c33d38bb40-kube-api-access-vglpb\") pod \"s3-init-qplpz\" (UID: \"34faddb9-2ee6-41e0-a3fd-89c33d38bb40\") " pod="kserve/s3-init-qplpz"
Sep 15 16:37:07.530428 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:37:07.530285    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34faddb9-2ee6-41e0-a3fd-89c33d38bb40-model-cache\") pod \"s3-init-qplpz\" (UID: \"34faddb9-2ee6-41e0-a3fd-89c33d38bb40\") " pod="kserve/s3-init-qplpz"
Sep 15 16:37:07.530718 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:37:07.530701    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34faddb9-2ee6-41e0-a3fd-89c33d38bb40-model-cache\") pod \"s3-init-qplpz\" (UID: \"34faddb9-2ee6-41e0-a3fd-89c33d38bb40\") " pod="kserve/s3-init-qplpz"
Sep 15 16:37:07.539606 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:37:07.539575    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vglpb\" (UniqueName: \"kubernetes.io/projected/34faddb9-2ee6-41e0-a3fd-89c33d38bb40-kube-api-access-vglpb\") pod \"s3-init-qplpz\" (UID: \"34faddb9-2ee6-41e0-a3fd-89c33d38bb40\") " pod="kserve/s3-init-qplpz"
Sep 15 16:37:07.694855 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:37:07.694773    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-qplpz"
Sep 15 16:37:07.965316 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:37:07.965294    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-qplpz"]
Sep 15 16:37:07.967879 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:37:07.967850    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod34faddb9_2ee6_41e0_a3fd_89c33d38bb40.slice/crio-a7320f680beaa2223996a764691d111737935093cd79db179c52d01c1df36cb1 WatchSource:0}: Error finding container a7320f680beaa2223996a764691d111737935093cd79db179c52d01c1df36cb1: Status 404 returned error can't find the container with id a7320f680beaa2223996a764691d111737935093cd79db179c52d01c1df36cb1
Sep 15 16:37:07.970136 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:37:07.970119    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 16:37:08.874961 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:37:08.874919    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-qplpz" event={"ID":"34faddb9-2ee6-41e0-a3fd-89c33d38bb40","Type":"ContainerStarted","Data":"a7320f680beaa2223996a764691d111737935093cd79db179c52d01c1df36cb1"}
Sep 15 16:37:11.890483 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:37:11.890442    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-qplpz" event={"ID":"34faddb9-2ee6-41e0-a3fd-89c33d38bb40","Type":"ContainerStarted","Data":"0f3100933284e694d5e94a068d47edc33bcbff18c7299541b3a3379595ac7390"}
Sep 15 16:37:13.900314 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:37:13.900279    2577 generic.go:356] "Generic (PLEG): container finished" podID="34faddb9-2ee6-41e0-a3fd-89c33d38bb40" containerID="0f3100933284e694d5e94a068d47edc33bcbff18c7299541b3a3379595ac7390" exitCode=0
Sep 15 16:37:13.900314 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:37:13.900322    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-qplpz" event={"ID":"34faddb9-2ee6-41e0-a3fd-89c33d38bb40","Type":"ContainerDied","Data":"0f3100933284e694d5e94a068d47edc33bcbff18c7299541b3a3379595ac7390"}
Sep 15 16:37:18.926427 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:37:18.926384    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-qplpz" event={"ID":"34faddb9-2ee6-41e0-a3fd-89c33d38bb40","Type":"ContainerStarted","Data":"f79d81bf1cf00e401a27106d5faba2227d8030d0a24c2ba558b468414d482665"}
Sep 15 16:37:18.944209 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:37:18.944151    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-init-qplpz" podStartSLOduration=1.7839646729999998 podStartE2EDuration="11.944133467s" totalImagesPullingTime="8.095131607s" totalInitContainerRuntime="2.065037187s" isStatefulPod=false podCreationTimestamp="2026-09-15 16:37:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 16:37:18.942368588 +0000 UTC m=+630.987786941" watchObservedRunningTime="2026-09-15 16:37:18.944133467 +0000 UTC m=+630.989551816"
Sep 15 16:38:24.181752 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:24.181719    2577 generic.go:356] "Generic (PLEG): container finished" podID="34faddb9-2ee6-41e0-a3fd-89c33d38bb40" containerID="f79d81bf1cf00e401a27106d5faba2227d8030d0a24c2ba558b468414d482665" exitCode=0
Sep 15 16:38:24.182192 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:24.181759    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-qplpz" event={"ID":"34faddb9-2ee6-41e0-a3fd-89c33d38bb40","Type":"ContainerDied","Data":"f79d81bf1cf00e401a27106d5faba2227d8030d0a24c2ba558b468414d482665"}
Sep 15 16:38:25.314702 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:25.314676    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-qplpz"
Sep 15 16:38:25.415674 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:25.415637    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vglpb\" (UniqueName: \"kubernetes.io/projected/34faddb9-2ee6-41e0-a3fd-89c33d38bb40-kube-api-access-vglpb\") pod \"34faddb9-2ee6-41e0-a3fd-89c33d38bb40\" (UID: \"34faddb9-2ee6-41e0-a3fd-89c33d38bb40\") "
Sep 15 16:38:25.415869 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:25.415687    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34faddb9-2ee6-41e0-a3fd-89c33d38bb40-model-cache\") pod \"34faddb9-2ee6-41e0-a3fd-89c33d38bb40\" (UID: \"34faddb9-2ee6-41e0-a3fd-89c33d38bb40\") "
Sep 15 16:38:25.418113 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:25.418081    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34faddb9-2ee6-41e0-a3fd-89c33d38bb40-kube-api-access-vglpb" (OuterVolumeSpecName: "kube-api-access-vglpb") pod "34faddb9-2ee6-41e0-a3fd-89c33d38bb40" (UID: "34faddb9-2ee6-41e0-a3fd-89c33d38bb40"). InnerVolumeSpecName "kube-api-access-vglpb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 16:38:25.434353 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:25.434321    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34faddb9-2ee6-41e0-a3fd-89c33d38bb40-model-cache" (OuterVolumeSpecName: "model-cache") pod "34faddb9-2ee6-41e0-a3fd-89c33d38bb40" (UID: "34faddb9-2ee6-41e0-a3fd-89c33d38bb40"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 16:38:25.516914 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:25.516825    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vglpb\" (UniqueName: \"kubernetes.io/projected/34faddb9-2ee6-41e0-a3fd-89c33d38bb40-kube-api-access-vglpb\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\""
Sep 15 16:38:25.516914 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:25.516855    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34faddb9-2ee6-41e0-a3fd-89c33d38bb40-model-cache\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\""
Sep 15 16:38:26.192300 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:26.192270    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-qplpz"
Sep 15 16:38:26.192493 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:26.192269    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-qplpz" event={"ID":"34faddb9-2ee6-41e0-a3fd-89c33d38bb40","Type":"ContainerDied","Data":"a7320f680beaa2223996a764691d111737935093cd79db179c52d01c1df36cb1"}
Sep 15 16:38:26.192493 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:26.192385    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a7320f680beaa2223996a764691d111737935093cd79db179c52d01c1df36cb1"
Sep 15 16:38:38.308540 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:38.308504    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6457847f78-pbmzs"]
Sep 15 16:38:38.308932 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:38.308856    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34faddb9-2ee6-41e0-a3fd-89c33d38bb40" containerName="download-hf-model"
Sep 15 16:38:38.308932 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:38.308869    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="34faddb9-2ee6-41e0-a3fd-89c33d38bb40" containerName="download-hf-model"
Sep 15 16:38:38.308932 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:38.308884    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34faddb9-2ee6-41e0-a3fd-89c33d38bb40" containerName="s3-init"
Sep 15 16:38:38.308932 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:38.308890    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="34faddb9-2ee6-41e0-a3fd-89c33d38bb40" containerName="s3-init"
Sep 15 16:38:38.309134 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:38.308938    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="34faddb9-2ee6-41e0-a3fd-89c33d38bb40" containerName="s3-init"
Sep 15 16:38:38.312323 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:38.312297    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6457847f78-pbmzs"
Sep 15 16:38:38.315292 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:38.315267    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Sep 15 16:38:38.315437 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:38.315307    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Sep 15 16:38:38.315437 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:38.315349    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-1-predictor-serving-cert\""
Sep 15 16:38:38.316577 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:38.316555    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Sep 15 16:38:38.316696 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:38.316580    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-1-kube-rbac-proxy-sar-config\""
Sep 15 16:38:38.316696 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:38.316556    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-dpw6w\""
Sep 15 16:38:38.316696 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:38.316556    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Sep 15 16:38:38.323563 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:38.323541    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6457847f78-pbmzs"]
Sep 15 16:38:38.411428 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:38.411378    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/240e56b4-214c-4ae2-9cc8-f91589389980-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-6457847f78-pbmzs\" (UID: \"240e56b4-214c-4ae2-9cc8-f91589389980\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6457847f78-pbmzs"
Sep 15 16:38:38.411609 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:38.411494    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/240e56b4-214c-4ae2-9cc8-f91589389980-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-6457847f78-pbmzs\" (UID: \"240e56b4-214c-4ae2-9cc8-f91589389980\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6457847f78-pbmzs"
Sep 15 16:38:38.411609 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:38.411537    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/240e56b4-214c-4ae2-9cc8-f91589389980-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-6457847f78-pbmzs\" (UID: \"240e56b4-214c-4ae2-9cc8-f91589389980\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6457847f78-pbmzs"
Sep 15 16:38:38.411609 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:38.411570    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/240e56b4-214c-4ae2-9cc8-f91589389980-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-6457847f78-pbmzs\" (UID: \"240e56b4-214c-4ae2-9cc8-f91589389980\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6457847f78-pbmzs"
Sep 15 16:38:38.411772 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:38.411686    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zk2g\" (UniqueName: \"kubernetes.io/projected/240e56b4-214c-4ae2-9cc8-f91589389980-kube-api-access-7zk2g\") pod \"isvc-sklearn-graph-1-predictor-6457847f78-pbmzs\" (UID: \"240e56b4-214c-4ae2-9cc8-f91589389980\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6457847f78-pbmzs"
Sep 15 16:38:38.512987 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:38.512950    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/240e56b4-214c-4ae2-9cc8-f91589389980-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-6457847f78-pbmzs\" (UID: \"240e56b4-214c-4ae2-9cc8-f91589389980\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6457847f78-pbmzs"
Sep 15 16:38:38.513187 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:38.513030    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/240e56b4-214c-4ae2-9cc8-f91589389980-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-6457847f78-pbmzs\" (UID: \"240e56b4-214c-4ae2-9cc8-f91589389980\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6457847f78-pbmzs"
Sep 15 16:38:38.513187 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:38.513053    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/240e56b4-214c-4ae2-9cc8-f91589389980-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-6457847f78-pbmzs\" (UID: \"240e56b4-214c-4ae2-9cc8-f91589389980\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6457847f78-pbmzs"
Sep 15 16:38:38.513187 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:38.513074    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/240e56b4-214c-4ae2-9cc8-f91589389980-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-6457847f78-pbmzs\" (UID: \"240e56b4-214c-4ae2-9cc8-f91589389980\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6457847f78-pbmzs"
Sep 15 16:38:38.513187 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:38.513109    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zk2g\" (UniqueName: \"kubernetes.io/projected/240e56b4-214c-4ae2-9cc8-f91589389980-kube-api-access-7zk2g\") pod \"isvc-sklearn-graph-1-predictor-6457847f78-pbmzs\" (UID: \"240e56b4-214c-4ae2-9cc8-f91589389980\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6457847f78-pbmzs"
Sep 15 16:38:38.513574 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:38.513549    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/240e56b4-214c-4ae2-9cc8-f91589389980-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-6457847f78-pbmzs\" (UID: \"240e56b4-214c-4ae2-9cc8-f91589389980\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6457847f78-pbmzs"
Sep 15 16:38:38.513779 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:38.513758    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/240e56b4-214c-4ae2-9cc8-f91589389980-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-6457847f78-pbmzs\" (UID: \"240e56b4-214c-4ae2-9cc8-f91589389980\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6457847f78-pbmzs"
Sep 15 16:38:38.513821 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:38.513758    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/240e56b4-214c-4ae2-9cc8-f91589389980-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-6457847f78-pbmzs\" (UID: \"240e56b4-214c-4ae2-9cc8-f91589389980\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6457847f78-pbmzs"
Sep 15 16:38:38.515792 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:38.515767    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/240e56b4-214c-4ae2-9cc8-f91589389980-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-6457847f78-pbmzs\" (UID: \"240e56b4-214c-4ae2-9cc8-f91589389980\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6457847f78-pbmzs"
Sep 15 16:38:38.526177 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:38.526136    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zk2g\" (UniqueName: \"kubernetes.io/projected/240e56b4-214c-4ae2-9cc8-f91589389980-kube-api-access-7zk2g\") pod \"isvc-sklearn-graph-1-predictor-6457847f78-pbmzs\" (UID: \"240e56b4-214c-4ae2-9cc8-f91589389980\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6457847f78-pbmzs"
Sep 15 16:38:38.624270 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:38.624233    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6457847f78-pbmzs"
Sep 15 16:38:38.786333 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:38.786293    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk"]
Sep 15 16:38:38.789942 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:38.789927    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk"
Sep 15 16:38:38.792578 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:38.792547    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-2-predictor-serving-cert\""
Sep 15 16:38:38.792696 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:38.792588    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-2-kube-rbac-proxy-sar-config\""
Sep 15 16:38:38.801917 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:38.801892    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk"]
Sep 15 16:38:38.815830 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:38.815798    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c9d78113-8585-4329-9b83-2eded2d34456-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk\" (UID: \"c9d78113-8585-4329-9b83-2eded2d34456\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk"
Sep 15 16:38:38.815977 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:38.815841    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c9d78113-8585-4329-9b83-2eded2d34456-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk\" (UID: \"c9d78113-8585-4329-9b83-2eded2d34456\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk"
Sep 15 16:38:38.815977 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:38.815878    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fbgh\" (UniqueName: \"kubernetes.io/projected/c9d78113-8585-4329-9b83-2eded2d34456-kube-api-access-5fbgh\") pod \"isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk\" (UID: \"c9d78113-8585-4329-9b83-2eded2d34456\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk"
Sep 15 16:38:38.815977 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:38.815895    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c9d78113-8585-4329-9b83-2eded2d34456-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk\" (UID: \"c9d78113-8585-4329-9b83-2eded2d34456\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk"
Sep 15 16:38:38.815977 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:38.815931    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c9d78113-8585-4329-9b83-2eded2d34456-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk\" (UID: \"c9d78113-8585-4329-9b83-2eded2d34456\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk"
Sep 15 16:38:38.899763 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:38.899681    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6457847f78-pbmzs"]
Sep 15 16:38:38.903172 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:38:38.903146    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod240e56b4_214c_4ae2_9cc8_f91589389980.slice/crio-4969dbdfc32f74a7800a0c42af3b97500324b2428b7c0d9ab581c211ae1fea90 WatchSource:0}: Error finding container 4969dbdfc32f74a7800a0c42af3b97500324b2428b7c0d9ab581c211ae1fea90: Status 404 returned error can't find the container with id 4969dbdfc32f74a7800a0c42af3b97500324b2428b7c0d9ab581c211ae1fea90
Sep 15 16:38:38.916557 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:38.916529    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c9d78113-8585-4329-9b83-2eded2d34456-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk\" (UID: \"c9d78113-8585-4329-9b83-2eded2d34456\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk"
Sep 15 16:38:38.916655 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:38.916593    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c9d78113-8585-4329-9b83-2eded2d34456-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk\" (UID: \"c9d78113-8585-4329-9b83-2eded2d34456\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk"
Sep 15 16:38:38.916655 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:38.916642    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fbgh\" (UniqueName: \"kubernetes.io/projected/c9d78113-8585-4329-9b83-2eded2d34456-kube-api-access-5fbgh\") pod \"isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk\" (UID: \"c9d78113-8585-4329-9b83-2eded2d34456\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk"
Sep 15 16:38:38.916754 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:38.916666    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c9d78113-8585-4329-9b83-2eded2d34456-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk\" (UID: \"c9d78113-8585-4329-9b83-2eded2d34456\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk"
Sep 15 16:38:38.916754 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:38:38.916681    2577 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-serving-cert: secret "isvc-sklearn-graph-2-predictor-serving-cert" not found
Sep 15 16:38:38.916754 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:38.916720    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c9d78113-8585-4329-9b83-2eded2d34456-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk\" (UID: \"c9d78113-8585-4329-9b83-2eded2d34456\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk"
Sep 15 16:38:38.916754 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:38:38.916749    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9d78113-8585-4329-9b83-2eded2d34456-proxy-tls podName:c9d78113-8585-4329-9b83-2eded2d34456 nodeName:}" failed. No retries permitted until 2026-09-15 16:38:39.416727996 +0000 UTC m=+711.462146341 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/c9d78113-8585-4329-9b83-2eded2d34456-proxy-tls") pod "isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk" (UID: "c9d78113-8585-4329-9b83-2eded2d34456") : secret "isvc-sklearn-graph-2-predictor-serving-cert" not found
Sep 15 16:38:38.917039 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:38.916997    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c9d78113-8585-4329-9b83-2eded2d34456-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk\" (UID: \"c9d78113-8585-4329-9b83-2eded2d34456\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk"
Sep 15 16:38:38.917308 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:38.917292    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c9d78113-8585-4329-9b83-2eded2d34456-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk\" (UID: \"c9d78113-8585-4329-9b83-2eded2d34456\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk"
Sep 15 16:38:38.917439 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:38.917417    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c9d78113-8585-4329-9b83-2eded2d34456-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk\" (UID: \"c9d78113-8585-4329-9b83-2eded2d34456\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk"
Sep 15 16:38:38.925500 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:38.925471    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fbgh\" (UniqueName: \"kubernetes.io/projected/c9d78113-8585-4329-9b83-2eded2d34456-kube-api-access-5fbgh\") pod \"isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk\" (UID: \"c9d78113-8585-4329-9b83-2eded2d34456\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk"
Sep 15 16:38:39.248395 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:39.248314    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6457847f78-pbmzs" event={"ID":"240e56b4-214c-4ae2-9cc8-f91589389980","Type":"ContainerStarted","Data":"3f10ffa0c0365f744a62b832555be792e78caf4ee39cdf85ab79c7ba4ae17a90"}
Sep 15 16:38:39.248395 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:39.248378    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6457847f78-pbmzs" event={"ID":"240e56b4-214c-4ae2-9cc8-f91589389980","Type":"ContainerStarted","Data":"4969dbdfc32f74a7800a0c42af3b97500324b2428b7c0d9ab581c211ae1fea90"}
Sep 15 16:38:39.422400 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:39.422368    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c9d78113-8585-4329-9b83-2eded2d34456-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk\" (UID: \"c9d78113-8585-4329-9b83-2eded2d34456\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk"
Sep 15 16:38:39.425208 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:39.425181    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c9d78113-8585-4329-9b83-2eded2d34456-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk\" (UID: \"c9d78113-8585-4329-9b83-2eded2d34456\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk"
Sep 15 16:38:39.699988 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:39.699955    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk"
Sep 15 16:38:39.973297 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:39.973270    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk"]
Sep 15 16:38:39.974942 ip-10-0-128-222 kubenswrapper[2577]: W0915 16:38:39.974908    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9d78113_8585_4329_9b83_2eded2d34456.slice/crio-09ae2e9285d873ed5e2b19d36d6f4eef0da14955cadc688abb57c3f8c6f2038f WatchSource:0}: Error finding container 09ae2e9285d873ed5e2b19d36d6f4eef0da14955cadc688abb57c3f8c6f2038f: Status 404 returned error can't find the container with id 09ae2e9285d873ed5e2b19d36d6f4eef0da14955cadc688abb57c3f8c6f2038f
Sep 15 16:38:40.257822 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:40.257734    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk" event={"ID":"c9d78113-8585-4329-9b83-2eded2d34456","Type":"ContainerStarted","Data":"dbdfca737fe3558855045778d6f5183416dce117e10a1d0a55eca420f59f9d91"}
Sep 15 16:38:40.257822 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:40.257794    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk" event={"ID":"c9d78113-8585-4329-9b83-2eded2d34456","Type":"ContainerStarted","Data":"09ae2e9285d873ed5e2b19d36d6f4eef0da14955cadc688abb57c3f8c6f2038f"}
Sep 15 16:38:43.271509 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:43.271427    2577 generic.go:356] "Generic (PLEG): container finished" podID="240e56b4-214c-4ae2-9cc8-f91589389980" containerID="3f10ffa0c0365f744a62b832555be792e78caf4ee39cdf85ab79c7ba4ae17a90" exitCode=0
Sep 15 16:38:43.271509 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:43.271500    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6457847f78-pbmzs" event={"ID":"240e56b4-214c-4ae2-9cc8-f91589389980","Type":"ContainerDied","Data":"3f10ffa0c0365f744a62b832555be792e78caf4ee39cdf85ab79c7ba4ae17a90"}
Sep 15 16:38:44.284663 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:44.284625    2577 generic.go:356] "Generic (PLEG): container finished" podID="c9d78113-8585-4329-9b83-2eded2d34456" containerID="dbdfca737fe3558855045778d6f5183416dce117e10a1d0a55eca420f59f9d91" exitCode=0
Sep 15 16:38:44.285138 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:38:44.284718    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk" event={"ID":"c9d78113-8585-4329-9b83-2eded2d34456","Type":"ContainerDied","Data":"dbdfca737fe3558855045778d6f5183416dce117e10a1d0a55eca420f59f9d91"}
Sep 15 16:39:00.390655 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:39:00.390626    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6457847f78-pbmzs" event={"ID":"240e56b4-214c-4ae2-9cc8-f91589389980","Type":"ContainerStarted","Data":"22c75ca7789372337500700f1fa15de7c0f064480f277fc5e47af8ff74a0adea"}
Sep 15 16:39:00.390975 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:39:00.390680    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk" event={"ID":"c9d78113-8585-4329-9b83-2eded2d34456","Type":"ContainerStarted","Data":"0aeaedcc709ff0032696cbb56c9409fc5b0ba8a9daac9c4416884855e026900f"}
Sep 15 16:39:03.407443 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:39:03.407392    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk" event={"ID":"c9d78113-8585-4329-9b83-2eded2d34456","Type":"ContainerStarted","Data":"d6763358e877c8c81ce61bd2e855ddc0d24563e3fa163a1ca857ac113d8be6dd"}
Sep 15 16:39:03.410707 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:39:03.410676    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6457847f78-pbmzs" event={"ID":"240e56b4-214c-4ae2-9cc8-f91589389980","Type":"ContainerStarted","Data":"f5d2cd34c1fdd097f21bc1147bb12eed394652008d5ad6b695e1e80a0cad0838"}
Sep 15 16:39:03.410879 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:39:03.410752    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6457847f78-pbmzs"
Sep 15 16:39:03.428430 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:39:03.428370    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk" podStartSLOduration=3.194042628 podStartE2EDuration="25.428353438s" totalImagesPullingTime="18.461265389s" totalInitContainerRuntime="3.773045421s" isStatefulPod=false podCreationTimestamp="2026-09-15 16:38:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 16:39:03.426123302 +0000 UTC m=+735.471541664" watchObservedRunningTime="2026-09-15 16:39:03.428353438 +0000 UTC m=+735.473771788"
Sep 15 16:39:03.443852 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:39:03.443792    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6457847f78-pbmzs" podStartSLOduration=2.034997617 podStartE2EDuration="25.443774443s" totalImagesPullingTime="19.419228493s" totalInitContainerRuntime="3.989548333s" isStatefulPod=false podCreationTimestamp="2026-09-15 16:38:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 16:39:03.4430918 +0000 UTC m=+735.488510161" watchObservedRunningTime="2026-09-15 16:39:03.443774443 +0000 UTC m=+735.489192793"
Sep 15 16:39:04.416060 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:39:04.416001    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk"
Sep 15 16:39:04.416474 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:39:04.416096    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6457847f78-pbmzs"
Sep 15 16:39:04.416474 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:39:04.416128    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk"
Sep 15 16:39:04.417093 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:39:04.417066    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk" podUID="c9d78113-8585-4329-9b83-2eded2d34456" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused"
Sep 15 16:39:04.417188 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:39:04.417074    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6457847f78-pbmzs" podUID="240e56b4-214c-4ae2-9cc8-f91589389980" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.22:8080: connect: connection refused"
Sep 15 16:39:05.419964 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:39:05.419914    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk" podUID="c9d78113-8585-4329-9b83-2eded2d34456" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused"
Sep 15 16:39:05.420374 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:39:05.419914    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6457847f78-pbmzs" podUID="240e56b4-214c-4ae2-9cc8-f91589389980" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.22:8080: connect: connection refused"
Sep 15 16:39:10.424557 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:39:10.424525    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6457847f78-pbmzs"
Sep 15 16:39:10.424931 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:39:10.424715    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk"
Sep 15 16:39:10.424972 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:39:10.424952    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6457847f78-pbmzs" podUID="240e56b4-214c-4ae2-9cc8-f91589389980" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.22:8080: connect: connection refused"
Sep 15 16:39:10.425490 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:39:10.425466    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk" podUID="c9d78113-8585-4329-9b83-2eded2d34456" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused"
Sep 15 16:39:20.425739 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:39:20.425702    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6457847f78-pbmzs" podUID="240e56b4-214c-4ae2-9cc8-f91589389980" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.22:8080: connect: connection refused"
Sep 15 16:39:20.426167 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:39:20.425702    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk" podUID="c9d78113-8585-4329-9b83-2eded2d34456" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused"
Sep 15 16:39:30.425672 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:39:30.425633    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk" podUID="c9d78113-8585-4329-9b83-2eded2d34456" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused"
Sep 15 16:39:30.426237 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:39:30.425633    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6457847f78-pbmzs" podUID="240e56b4-214c-4ae2-9cc8-f91589389980" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.22:8080: connect: connection refused"
Sep 15 16:39:40.425248 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:39:40.425209    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6457847f78-pbmzs" podUID="240e56b4-214c-4ae2-9cc8-f91589389980" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.22:8080: connect: connection refused"
Sep 15 16:39:40.425672 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:39:40.425360    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk" podUID="c9d78113-8585-4329-9b83-2eded2d34456" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused"
Sep 15 16:39:50.425768 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:39:50.425729    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk" podUID="c9d78113-8585-4329-9b83-2eded2d34456" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused"
Sep 15 16:39:50.426193 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:39:50.425730    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6457847f78-pbmzs" podUID="240e56b4-214c-4ae2-9cc8-f91589389980" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.22:8080: connect: connection refused"
Sep 15 16:40:00.425361 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:40:00.425320    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk" podUID="c9d78113-8585-4329-9b83-2eded2d34456" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused"
Sep 15 16:40:00.425726 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:40:00.425320    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6457847f78-pbmzs" podUID="240e56b4-214c-4ae2-9cc8-f91589389980" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.22:8080: connect: connection refused"
Sep 15 16:40:10.425327 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:40:10.425241    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6457847f78-pbmzs" podUID="240e56b4-214c-4ae2-9cc8-f91589389980" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.22:8080: connect: connection refused"
Sep 15 16:40:10.425764 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:40:10.425404    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk" podUID="c9d78113-8585-4329-9b83-2eded2d34456" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused"
Sep 15 16:40:13.386588 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:40:13.386548    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk" podUID="c9d78113-8585-4329-9b83-2eded2d34456" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused"
Sep 15 16:40:20.426170 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:40:20.426135    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6457847f78-pbmzs"
Sep 15 16:40:23.388112 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:40:23.388085    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk"
Sep 15 16:40:58.433603 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:40:58.433571    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk"]
Sep 15 16:40:58.434140 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:40:58.433829    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk" podUID="c9d78113-8585-4329-9b83-2eded2d34456" containerName="kserve-container" containerID="cri-o://0aeaedcc709ff0032696cbb56c9409fc5b0ba8a9daac9c4416884855e026900f" gracePeriod=30
Sep 15 16:40:58.434140 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:40:58.433879    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk" podUID="c9d78113-8585-4329-9b83-2eded2d34456" containerName="kube-rbac-proxy" containerID="cri-o://d6763358e877c8c81ce61bd2e855ddc0d24563e3fa163a1ca857ac113d8be6dd" gracePeriod=30
Sep 15 16:40:58.466390 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:40:58.466355    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6457847f78-pbmzs"]
Sep 15 16:40:58.466631 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:40:58.466605    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6457847f78-pbmzs" podUID="240e56b4-214c-4ae2-9cc8-f91589389980" containerName="kserve-container" containerID="cri-o://22c75ca7789372337500700f1fa15de7c0f064480f277fc5e47af8ff74a0adea" gracePeriod=30
Sep 15 16:40:58.466729 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:40:58.466656    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6457847f78-pbmzs" podUID="240e56b4-214c-4ae2-9cc8-f91589389980" containerName="kube-rbac-proxy" containerID="cri-o://f5d2cd34c1fdd097f21bc1147bb12eed394652008d5ad6b695e1e80a0cad0838" gracePeriod=30
Sep 15 16:40:58.883768 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:40:58.883735    2577 generic.go:356] "Generic (PLEG): container finished" podID="c9d78113-8585-4329-9b83-2eded2d34456" containerID="d6763358e877c8c81ce61bd2e855ddc0d24563e3fa163a1ca857ac113d8be6dd" exitCode=2
Sep 15 16:40:58.883963 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:40:58.883812    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk" event={"ID":"c9d78113-8585-4329-9b83-2eded2d34456","Type":"ContainerDied","Data":"d6763358e877c8c81ce61bd2e855ddc0d24563e3fa163a1ca857ac113d8be6dd"}
Sep 15 16:40:58.885948 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:40:58.885928    2577 generic.go:356] "Generic (PLEG): container finished" podID="240e56b4-214c-4ae2-9cc8-f91589389980" containerID="f5d2cd34c1fdd097f21bc1147bb12eed394652008d5ad6b695e1e80a0cad0838" exitCode=2
Sep 15 16:40:58.886032 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:40:58.885986    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6457847f78-pbmzs" event={"ID":"240e56b4-214c-4ae2-9cc8-f91589389980","Type":"ContainerDied","Data":"f5d2cd34c1fdd097f21bc1147bb12eed394652008d5ad6b695e1e80a0cad0838"}
Sep 15 16:41:00.420282 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:00.420230    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk" podUID="c9d78113-8585-4329-9b83-2eded2d34456" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.23:8643/healthz\": dial tcp 10.133.0.23:8643: connect: connection refused"
Sep 15 16:41:00.420714 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:00.420230    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6457847f78-pbmzs" podUID="240e56b4-214c-4ae2-9cc8-f91589389980" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.22:8643/healthz\": dial tcp 10.133.0.22:8643: connect: connection refused"
Sep 15 16:41:00.425581 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:00.425556    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6457847f78-pbmzs" podUID="240e56b4-214c-4ae2-9cc8-f91589389980" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.22:8080: connect: connection refused"
Sep 15 16:41:03.386604 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:03.386560    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk" podUID="c9d78113-8585-4329-9b83-2eded2d34456" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.23:8080: connect: connection refused"
Sep 15 16:41:03.720525 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:03.720499    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6457847f78-pbmzs"
Sep 15 16:41:03.725549 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:03.725521    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk"
Sep 15 16:41:03.889050 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:03.888974    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/240e56b4-214c-4ae2-9cc8-f91589389980-proxy-tls\") pod \"240e56b4-214c-4ae2-9cc8-f91589389980\" (UID: \"240e56b4-214c-4ae2-9cc8-f91589389980\") "
Sep 15 16:41:03.889050 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:03.889058    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/240e56b4-214c-4ae2-9cc8-f91589389980-kube-rbac-proxy-sar-config\") pod \"240e56b4-214c-4ae2-9cc8-f91589389980\" (UID: \"240e56b4-214c-4ae2-9cc8-f91589389980\") "
Sep 15 16:41:03.889297 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:03.889079    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7zk2g\" (UniqueName: \"kubernetes.io/projected/240e56b4-214c-4ae2-9cc8-f91589389980-kube-api-access-7zk2g\") pod \"240e56b4-214c-4ae2-9cc8-f91589389980\" (UID: \"240e56b4-214c-4ae2-9cc8-f91589389980\") "
Sep 15 16:41:03.889297 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:03.889113    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c9d78113-8585-4329-9b83-2eded2d34456-proxy-tls\") pod \"c9d78113-8585-4329-9b83-2eded2d34456\" (UID: \"c9d78113-8585-4329-9b83-2eded2d34456\") "
Sep 15 16:41:03.889297 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:03.889140    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c9d78113-8585-4329-9b83-2eded2d34456-kserve-provision-location\") pod \"c9d78113-8585-4329-9b83-2eded2d34456\" (UID: \"c9d78113-8585-4329-9b83-2eded2d34456\") "
Sep 15 16:41:03.889297 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:03.889211    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5fbgh\" (UniqueName: \"kubernetes.io/projected/c9d78113-8585-4329-9b83-2eded2d34456-kube-api-access-5fbgh\") pod \"c9d78113-8585-4329-9b83-2eded2d34456\" (UID: \"c9d78113-8585-4329-9b83-2eded2d34456\") "
Sep 15 16:41:03.889297 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:03.889264    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/240e56b4-214c-4ae2-9cc8-f91589389980-kserve-provision-location\") pod \"240e56b4-214c-4ae2-9cc8-f91589389980\" (UID: \"240e56b4-214c-4ae2-9cc8-f91589389980\") "
Sep 15 16:41:03.889550 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:03.889324    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c9d78113-8585-4329-9b83-2eded2d34456-cabundle-cert\") pod \"c9d78113-8585-4329-9b83-2eded2d34456\" (UID: \"c9d78113-8585-4329-9b83-2eded2d34456\") "
Sep 15 16:41:03.889550 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:03.889368    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c9d78113-8585-4329-9b83-2eded2d34456-kube-rbac-proxy-sar-config\") pod \"c9d78113-8585-4329-9b83-2eded2d34456\" (UID: \"c9d78113-8585-4329-9b83-2eded2d34456\") "
Sep 15 16:41:03.889550 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:03.889439    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/240e56b4-214c-4ae2-9cc8-f91589389980-cabundle-cert\") pod \"240e56b4-214c-4ae2-9cc8-f91589389980\" (UID: \"240e56b4-214c-4ae2-9cc8-f91589389980\") "
Sep 15 16:41:03.889550 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:03.889447    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9d78113-8585-4329-9b83-2eded2d34456-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "c9d78113-8585-4329-9b83-2eded2d34456" (UID: "c9d78113-8585-4329-9b83-2eded2d34456"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 16:41:03.889754 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:03.889555    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/240e56b4-214c-4ae2-9cc8-f91589389980-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "240e56b4-214c-4ae2-9cc8-f91589389980" (UID: "240e56b4-214c-4ae2-9cc8-f91589389980"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 16:41:03.889816 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:03.889774    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9d78113-8585-4329-9b83-2eded2d34456-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "c9d78113-8585-4329-9b83-2eded2d34456" (UID: "c9d78113-8585-4329-9b83-2eded2d34456"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 16:41:03.889869 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:03.889833    2577 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c9d78113-8585-4329-9b83-2eded2d34456-kserve-provision-location\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\""
Sep 15 16:41:03.889869 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:03.889853    2577 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/240e56b4-214c-4ae2-9cc8-f91589389980-kserve-provision-location\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\""
Sep 15 16:41:03.890187 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:03.890066    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/240e56b4-214c-4ae2-9cc8-f91589389980-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "240e56b4-214c-4ae2-9cc8-f91589389980" (UID: "240e56b4-214c-4ae2-9cc8-f91589389980"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 16:41:03.890187 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:03.890077    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/240e56b4-214c-4ae2-9cc8-f91589389980-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "240e56b4-214c-4ae2-9cc8-f91589389980" (UID: "240e56b4-214c-4ae2-9cc8-f91589389980"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 16:41:03.890187 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:03.890133    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9d78113-8585-4329-9b83-2eded2d34456-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "c9d78113-8585-4329-9b83-2eded2d34456" (UID: "c9d78113-8585-4329-9b83-2eded2d34456"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 16:41:03.891554 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:03.891529    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9d78113-8585-4329-9b83-2eded2d34456-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "c9d78113-8585-4329-9b83-2eded2d34456" (UID: "c9d78113-8585-4329-9b83-2eded2d34456"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 16:41:03.891665 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:03.891556    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9d78113-8585-4329-9b83-2eded2d34456-kube-api-access-5fbgh" (OuterVolumeSpecName: "kube-api-access-5fbgh") pod "c9d78113-8585-4329-9b83-2eded2d34456" (UID: "c9d78113-8585-4329-9b83-2eded2d34456"). InnerVolumeSpecName "kube-api-access-5fbgh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 16:41:03.891767 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:03.891751    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/240e56b4-214c-4ae2-9cc8-f91589389980-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "240e56b4-214c-4ae2-9cc8-f91589389980" (UID: "240e56b4-214c-4ae2-9cc8-f91589389980"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 16:41:03.891767 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:03.891756    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/240e56b4-214c-4ae2-9cc8-f91589389980-kube-api-access-7zk2g" (OuterVolumeSpecName: "kube-api-access-7zk2g") pod "240e56b4-214c-4ae2-9cc8-f91589389980" (UID: "240e56b4-214c-4ae2-9cc8-f91589389980"). InnerVolumeSpecName "kube-api-access-7zk2g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 16:41:03.911797 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:03.911762    2577 generic.go:356] "Generic (PLEG): container finished" podID="c9d78113-8585-4329-9b83-2eded2d34456" containerID="0aeaedcc709ff0032696cbb56c9409fc5b0ba8a9daac9c4416884855e026900f" exitCode=0
Sep 15 16:41:03.911917 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:03.911820    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk"
Sep 15 16:41:03.911917 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:03.911838    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk" event={"ID":"c9d78113-8585-4329-9b83-2eded2d34456","Type":"ContainerDied","Data":"0aeaedcc709ff0032696cbb56c9409fc5b0ba8a9daac9c4416884855e026900f"}
Sep 15 16:41:03.911917 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:03.911895    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk" event={"ID":"c9d78113-8585-4329-9b83-2eded2d34456","Type":"ContainerDied","Data":"09ae2e9285d873ed5e2b19d36d6f4eef0da14955cadc688abb57c3f8c6f2038f"}
Sep 15 16:41:03.912098 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:03.911925    2577 scope.go:117] "RemoveContainer" containerID="d6763358e877c8c81ce61bd2e855ddc0d24563e3fa163a1ca857ac113d8be6dd"
Sep 15 16:41:03.914226 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:03.914173    2577 generic.go:356] "Generic (PLEG): container finished" podID="240e56b4-214c-4ae2-9cc8-f91589389980" containerID="22c75ca7789372337500700f1fa15de7c0f064480f277fc5e47af8ff74a0adea" exitCode=0
Sep 15 16:41:03.914302 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:03.914227    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6457847f78-pbmzs"
Sep 15 16:41:03.914302 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:03.914254    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6457847f78-pbmzs" event={"ID":"240e56b4-214c-4ae2-9cc8-f91589389980","Type":"ContainerDied","Data":"22c75ca7789372337500700f1fa15de7c0f064480f277fc5e47af8ff74a0adea"}
Sep 15 16:41:03.914371 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:03.914309    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6457847f78-pbmzs" event={"ID":"240e56b4-214c-4ae2-9cc8-f91589389980","Type":"ContainerDied","Data":"4969dbdfc32f74a7800a0c42af3b97500324b2428b7c0d9ab581c211ae1fea90"}
Sep 15 16:41:03.920977 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:03.920954    2577 scope.go:117] "RemoveContainer" containerID="0aeaedcc709ff0032696cbb56c9409fc5b0ba8a9daac9c4416884855e026900f"
Sep 15 16:41:03.928911 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:03.928893    2577 scope.go:117] "RemoveContainer" containerID="dbdfca737fe3558855045778d6f5183416dce117e10a1d0a55eca420f59f9d91"
Sep 15 16:41:03.935246 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:03.935224    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk"]
Sep 15 16:41:03.937300 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:03.937284    2577 scope.go:117] "RemoveContainer" containerID="d6763358e877c8c81ce61bd2e855ddc0d24563e3fa163a1ca857ac113d8be6dd"
Sep 15 16:41:03.937613 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:41:03.937593    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6763358e877c8c81ce61bd2e855ddc0d24563e3fa163a1ca857ac113d8be6dd\": container with ID starting with d6763358e877c8c81ce61bd2e855ddc0d24563e3fa163a1ca857ac113d8be6dd not found: ID does not exist" containerID="d6763358e877c8c81ce61bd2e855ddc0d24563e3fa163a1ca857ac113d8be6dd"
Sep 15 16:41:03.937677 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:03.937623    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6763358e877c8c81ce61bd2e855ddc0d24563e3fa163a1ca857ac113d8be6dd"} err="failed to get container status \"d6763358e877c8c81ce61bd2e855ddc0d24563e3fa163a1ca857ac113d8be6dd\": rpc error: code = NotFound desc = could not find container \"d6763358e877c8c81ce61bd2e855ddc0d24563e3fa163a1ca857ac113d8be6dd\": container with ID starting with d6763358e877c8c81ce61bd2e855ddc0d24563e3fa163a1ca857ac113d8be6dd not found: ID does not exist"
Sep 15 16:41:03.937677 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:03.937644    2577 scope.go:117] "RemoveContainer" containerID="0aeaedcc709ff0032696cbb56c9409fc5b0ba8a9daac9c4416884855e026900f"
Sep 15 16:41:03.937861 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:41:03.937846    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0aeaedcc709ff0032696cbb56c9409fc5b0ba8a9daac9c4416884855e026900f\": container with ID starting with 0aeaedcc709ff0032696cbb56c9409fc5b0ba8a9daac9c4416884855e026900f not found: ID does not exist" containerID="0aeaedcc709ff0032696cbb56c9409fc5b0ba8a9daac9c4416884855e026900f"
Sep 15 16:41:03.937901 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:03.937864    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0aeaedcc709ff0032696cbb56c9409fc5b0ba8a9daac9c4416884855e026900f"} err="failed to get container status \"0aeaedcc709ff0032696cbb56c9409fc5b0ba8a9daac9c4416884855e026900f\": rpc error: code = NotFound desc = could not find container \"0aeaedcc709ff0032696cbb56c9409fc5b0ba8a9daac9c4416884855e026900f\": container with ID starting with 0aeaedcc709ff0032696cbb56c9409fc5b0ba8a9daac9c4416884855e026900f not found: ID does not exist"
Sep 15 16:41:03.937901 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:03.937877    2577 scope.go:117] "RemoveContainer" containerID="dbdfca737fe3558855045778d6f5183416dce117e10a1d0a55eca420f59f9d91"
Sep 15 16:41:03.938171 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:41:03.938154    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbdfca737fe3558855045778d6f5183416dce117e10a1d0a55eca420f59f9d91\": container with ID starting with dbdfca737fe3558855045778d6f5183416dce117e10a1d0a55eca420f59f9d91 not found: ID does not exist" containerID="dbdfca737fe3558855045778d6f5183416dce117e10a1d0a55eca420f59f9d91"
Sep 15 16:41:03.938226 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:03.938177    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbdfca737fe3558855045778d6f5183416dce117e10a1d0a55eca420f59f9d91"} err="failed to get container status \"dbdfca737fe3558855045778d6f5183416dce117e10a1d0a55eca420f59f9d91\": rpc error: code = NotFound desc = could not find container \"dbdfca737fe3558855045778d6f5183416dce117e10a1d0a55eca420f59f9d91\": container with ID starting with dbdfca737fe3558855045778d6f5183416dce117e10a1d0a55eca420f59f9d91 not found: ID does not exist"
Sep 15 16:41:03.938226 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:03.938193    2577 scope.go:117] "RemoveContainer" containerID="f5d2cd34c1fdd097f21bc1147bb12eed394652008d5ad6b695e1e80a0cad0838"
Sep 15 16:41:03.941104 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:03.941084    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk"]
Sep 15 16:41:03.946107 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:03.946088    2577 scope.go:117] "RemoveContainer" containerID="22c75ca7789372337500700f1fa15de7c0f064480f277fc5e47af8ff74a0adea"
Sep 15 16:41:03.956195 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:03.956169    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6457847f78-pbmzs"]
Sep 15 16:41:03.956908 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:03.956882    2577 scope.go:117] "RemoveContainer" containerID="3f10ffa0c0365f744a62b832555be792e78caf4ee39cdf85ab79c7ba4ae17a90"
Sep 15 16:41:03.957396 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:03.957376    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6457847f78-pbmzs"]
Sep 15 16:41:03.964888 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:03.964869    2577 scope.go:117] "RemoveContainer" containerID="f5d2cd34c1fdd097f21bc1147bb12eed394652008d5ad6b695e1e80a0cad0838"
Sep 15 16:41:03.965241 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:41:03.965217    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5d2cd34c1fdd097f21bc1147bb12eed394652008d5ad6b695e1e80a0cad0838\": container with ID starting with f5d2cd34c1fdd097f21bc1147bb12eed394652008d5ad6b695e1e80a0cad0838 not found: ID does not exist" containerID="f5d2cd34c1fdd097f21bc1147bb12eed394652008d5ad6b695e1e80a0cad0838"
Sep 15 16:41:03.965321 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:03.965249    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5d2cd34c1fdd097f21bc1147bb12eed394652008d5ad6b695e1e80a0cad0838"} err="failed to get container status \"f5d2cd34c1fdd097f21bc1147bb12eed394652008d5ad6b695e1e80a0cad0838\": rpc error: code = NotFound desc = could not find container \"f5d2cd34c1fdd097f21bc1147bb12eed394652008d5ad6b695e1e80a0cad0838\": container with ID starting with f5d2cd34c1fdd097f21bc1147bb12eed394652008d5ad6b695e1e80a0cad0838 not found: ID does not exist"
Sep 15 16:41:03.965321 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:03.965270    2577 scope.go:117] "RemoveContainer" containerID="22c75ca7789372337500700f1fa15de7c0f064480f277fc5e47af8ff74a0adea"
Sep 15 16:41:03.965544 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:41:03.965530    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22c75ca7789372337500700f1fa15de7c0f064480f277fc5e47af8ff74a0adea\": container with ID starting with 22c75ca7789372337500700f1fa15de7c0f064480f277fc5e47af8ff74a0adea not found: ID does not exist" containerID="22c75ca7789372337500700f1fa15de7c0f064480f277fc5e47af8ff74a0adea"
Sep 15 16:41:03.965586 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:03.965547    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22c75ca7789372337500700f1fa15de7c0f064480f277fc5e47af8ff74a0adea"} err="failed to get container status \"22c75ca7789372337500700f1fa15de7c0f064480f277fc5e47af8ff74a0adea\": rpc error: code = NotFound desc = could not find container \"22c75ca7789372337500700f1fa15de7c0f064480f277fc5e47af8ff74a0adea\": container with ID starting with 22c75ca7789372337500700f1fa15de7c0f064480f277fc5e47af8ff74a0adea not found: ID does not exist"
Sep 15 16:41:03.965586 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:03.965559    2577 scope.go:117] "RemoveContainer" containerID="3f10ffa0c0365f744a62b832555be792e78caf4ee39cdf85ab79c7ba4ae17a90"
Sep 15 16:41:03.965818 ip-10-0-128-222 kubenswrapper[2577]: E0915 16:41:03.965798    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f10ffa0c0365f744a62b832555be792e78caf4ee39cdf85ab79c7ba4ae17a90\": container with ID starting with 3f10ffa0c0365f744a62b832555be792e78caf4ee39cdf85ab79c7ba4ae17a90 not found: ID does not exist" containerID="3f10ffa0c0365f744a62b832555be792e78caf4ee39cdf85ab79c7ba4ae17a90"
Sep 15 16:41:03.965865 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:03.965825    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f10ffa0c0365f744a62b832555be792e78caf4ee39cdf85ab79c7ba4ae17a90"} err="failed to get container status \"3f10ffa0c0365f744a62b832555be792e78caf4ee39cdf85ab79c7ba4ae17a90\": rpc error: code = NotFound desc = could not find container \"3f10ffa0c0365f744a62b832555be792e78caf4ee39cdf85ab79c7ba4ae17a90\": container with ID starting with 3f10ffa0c0365f744a62b832555be792e78caf4ee39cdf85ab79c7ba4ae17a90 not found: ID does not exist"
Sep 15 16:41:03.990935 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:03.990900    2577 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c9d78113-8585-4329-9b83-2eded2d34456-proxy-tls\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\""
Sep 15 16:41:03.990935 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:03.990929    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5fbgh\" (UniqueName: \"kubernetes.io/projected/c9d78113-8585-4329-9b83-2eded2d34456-kube-api-access-5fbgh\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\""
Sep 15 16:41:03.990935 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:03.990939    2577 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c9d78113-8585-4329-9b83-2eded2d34456-cabundle-cert\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\""
Sep 15 16:41:03.991146 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:03.990948    2577 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c9d78113-8585-4329-9b83-2eded2d34456-kube-rbac-proxy-sar-config\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\""
Sep 15 16:41:03.991146 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:03.990957    2577 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/240e56b4-214c-4ae2-9cc8-f91589389980-cabundle-cert\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\""
Sep 15 16:41:03.991146 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:03.990966    2577 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/240e56b4-214c-4ae2-9cc8-f91589389980-proxy-tls\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\""
Sep 15 16:41:03.991146 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:03.990973    2577 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/240e56b4-214c-4ae2-9cc8-f91589389980-kube-rbac-proxy-sar-config\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\""
Sep 15 16:41:03.991146 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:03.990981    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7zk2g\" (UniqueName: \"kubernetes.io/projected/240e56b4-214c-4ae2-9cc8-f91589389980-kube-api-access-7zk2g\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\""
Sep 15 16:41:04.391586 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:04.391556    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="240e56b4-214c-4ae2-9cc8-f91589389980" path="/var/lib/kubelet/pods/240e56b4-214c-4ae2-9cc8-f91589389980/volumes"
Sep 15 16:41:04.392063 ip-10-0-128-222 kubenswrapper[2577]: I0915 16:41:04.392049    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9d78113-8585-4329-9b83-2eded2d34456" path="/var/lib/kubelet/pods/c9d78113-8585-4329-9b83-2eded2d34456/volumes"
Sep 15 17:17:59.086744 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:17:59.086706    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5cbjh/must-gather-tphcj"]
Sep 15 17:17:59.089427 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:17:59.087179    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9d78113-8585-4329-9b83-2eded2d34456" containerName="storage-initializer"
Sep 15 17:17:59.089427 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:17:59.087197    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9d78113-8585-4329-9b83-2eded2d34456" containerName="storage-initializer"
Sep 15 17:17:59.089427 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:17:59.087223    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9d78113-8585-4329-9b83-2eded2d34456" containerName="kserve-container"
Sep 15 17:17:59.089427 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:17:59.087231    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9d78113-8585-4329-9b83-2eded2d34456" containerName="kserve-container"
Sep 15 17:17:59.089427 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:17:59.087241    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="240e56b4-214c-4ae2-9cc8-f91589389980" containerName="storage-initializer"
Sep 15 17:17:59.089427 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:17:59.087247    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="240e56b4-214c-4ae2-9cc8-f91589389980" containerName="storage-initializer"
Sep 15 17:17:59.089427 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:17:59.087253    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="240e56b4-214c-4ae2-9cc8-f91589389980" containerName="kube-rbac-proxy"
Sep 15 17:17:59.089427 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:17:59.087259    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="240e56b4-214c-4ae2-9cc8-f91589389980" containerName="kube-rbac-proxy"
Sep 15 17:17:59.089427 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:17:59.087268    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9d78113-8585-4329-9b83-2eded2d34456" containerName="kube-rbac-proxy"
Sep 15 17:17:59.089427 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:17:59.087273    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9d78113-8585-4329-9b83-2eded2d34456" containerName="kube-rbac-proxy"
Sep 15 17:17:59.089427 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:17:59.087284    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="240e56b4-214c-4ae2-9cc8-f91589389980" containerName="kserve-container"
Sep 15 17:17:59.089427 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:17:59.087289    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="240e56b4-214c-4ae2-9cc8-f91589389980" containerName="kserve-container"
Sep 15 17:17:59.089427 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:17:59.087345    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9d78113-8585-4329-9b83-2eded2d34456" containerName="kube-rbac-proxy"
Sep 15 17:17:59.089427 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:17:59.087353    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="240e56b4-214c-4ae2-9cc8-f91589389980" containerName="kserve-container"
Sep 15 17:17:59.089427 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:17:59.087359    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="240e56b4-214c-4ae2-9cc8-f91589389980" containerName="kube-rbac-proxy"
Sep 15 17:17:59.089427 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:17:59.087366    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9d78113-8585-4329-9b83-2eded2d34456" containerName="kserve-container"
Sep 15 17:17:59.090421 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:17:59.090406    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5cbjh/must-gather-tphcj"
Sep 15 17:17:59.093170 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:17:59.093146    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5cbjh\"/\"kube-root-ca.crt\""
Sep 15 17:17:59.094368 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:17:59.094349    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-5cbjh\"/\"default-dockercfg-nv4zr\""
Sep 15 17:17:59.094473 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:17:59.094354    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5cbjh\"/\"openshift-service-ca.crt\""
Sep 15 17:17:59.100233 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:17:59.100205    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5cbjh/must-gather-tphcj"]
Sep 15 17:17:59.263336 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:17:59.263293    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwg4g\" (UniqueName: \"kubernetes.io/projected/663cbbb3-0f43-4fe7-b2d0-53bbce296891-kube-api-access-dwg4g\") pod \"must-gather-tphcj\" (UID: \"663cbbb3-0f43-4fe7-b2d0-53bbce296891\") " pod="openshift-must-gather-5cbjh/must-gather-tphcj"
Sep 15 17:17:59.263336 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:17:59.263340    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/663cbbb3-0f43-4fe7-b2d0-53bbce296891-must-gather-output\") pod \"must-gather-tphcj\" (UID: \"663cbbb3-0f43-4fe7-b2d0-53bbce296891\") " pod="openshift-must-gather-5cbjh/must-gather-tphcj"
Sep 15 17:17:59.364080 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:17:59.364041    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwg4g\" (UniqueName: \"kubernetes.io/projected/663cbbb3-0f43-4fe7-b2d0-53bbce296891-kube-api-access-dwg4g\") pod \"must-gather-tphcj\" (UID: \"663cbbb3-0f43-4fe7-b2d0-53bbce296891\") " pod="openshift-must-gather-5cbjh/must-gather-tphcj"
Sep 15 17:17:59.364223 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:17:59.364095    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/663cbbb3-0f43-4fe7-b2d0-53bbce296891-must-gather-output\") pod \"must-gather-tphcj\" (UID: \"663cbbb3-0f43-4fe7-b2d0-53bbce296891\") " pod="openshift-must-gather-5cbjh/must-gather-tphcj"
Sep 15 17:17:59.364463 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:17:59.364443    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/663cbbb3-0f43-4fe7-b2d0-53bbce296891-must-gather-output\") pod \"must-gather-tphcj\" (UID: \"663cbbb3-0f43-4fe7-b2d0-53bbce296891\") " pod="openshift-must-gather-5cbjh/must-gather-tphcj"
Sep 15 17:17:59.372054 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:17:59.372001    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwg4g\" (UniqueName: \"kubernetes.io/projected/663cbbb3-0f43-4fe7-b2d0-53bbce296891-kube-api-access-dwg4g\") pod \"must-gather-tphcj\" (UID: \"663cbbb3-0f43-4fe7-b2d0-53bbce296891\") " pod="openshift-must-gather-5cbjh/must-gather-tphcj"
Sep 15 17:17:59.400141 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:17:59.400103    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5cbjh/must-gather-tphcj"
Sep 15 17:17:59.670479 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:17:59.670452    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5cbjh/must-gather-tphcj"]
Sep 15 17:17:59.672667 ip-10-0-128-222 kubenswrapper[2577]: W0915 17:17:59.672634    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod663cbbb3_0f43_4fe7_b2d0_53bbce296891.slice/crio-a0b0bc7a539d85a71320ab33f6dca03d30aad225670fabeab92e009a4a0d1e0d WatchSource:0}: Error finding container a0b0bc7a539d85a71320ab33f6dca03d30aad225670fabeab92e009a4a0d1e0d: Status 404 returned error can't find the container with id a0b0bc7a539d85a71320ab33f6dca03d30aad225670fabeab92e009a4a0d1e0d
Sep 15 17:17:59.674596 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:17:59.674580    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 17:18:00.514634 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:00.514560    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5cbjh/must-gather-tphcj" event={"ID":"663cbbb3-0f43-4fe7-b2d0-53bbce296891","Type":"ContainerStarted","Data":"a0b0bc7a539d85a71320ab33f6dca03d30aad225670fabeab92e009a4a0d1e0d"}
Sep 15 17:18:06.545184 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:06.545104    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5cbjh/must-gather-tphcj" event={"ID":"663cbbb3-0f43-4fe7-b2d0-53bbce296891","Type":"ContainerStarted","Data":"495568ca05b6a2101fbca3391aaba3eb164a8ff01a1a8d199c99ce96536b9e79"}
Sep 15 17:18:06.545184 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:06.545157    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5cbjh/must-gather-tphcj" event={"ID":"663cbbb3-0f43-4fe7-b2d0-53bbce296891","Type":"ContainerStarted","Data":"0b9fa77595618fc215b2df93386f76b247691d269f2a6c7d544fbd3f4c87cf3e"}
Sep 15 17:18:06.561820 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:06.561764    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5cbjh/must-gather-tphcj" podStartSLOduration=1.351830363 podStartE2EDuration="7.561748692s" totalImagesPullingTime="6.209918329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 17:17:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:18:06.560323954 +0000 UTC m=+3078.605742302" watchObservedRunningTime="2026-09-15 17:18:06.561748692 +0000 UTC m=+3078.607167041"
Sep 15 17:18:29.645222 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:29.645186    2577 generic.go:356] "Generic (PLEG): container finished" podID="663cbbb3-0f43-4fe7-b2d0-53bbce296891" containerID="0b9fa77595618fc215b2df93386f76b247691d269f2a6c7d544fbd3f4c87cf3e" exitCode=0
Sep 15 17:18:29.645661 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:29.645256    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5cbjh/must-gather-tphcj" event={"ID":"663cbbb3-0f43-4fe7-b2d0-53bbce296891","Type":"ContainerDied","Data":"0b9fa77595618fc215b2df93386f76b247691d269f2a6c7d544fbd3f4c87cf3e"}
Sep 15 17:18:29.645661 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:29.645568    2577 scope.go:117] "RemoveContainer" containerID="0b9fa77595618fc215b2df93386f76b247691d269f2a6c7d544fbd3f4c87cf3e"
Sep 15 17:18:29.854918 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:29.854874    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-5cbjh_must-gather-tphcj_663cbbb3-0f43-4fe7-b2d0-53bbce296891/gather/0.log"
Sep 15 17:18:33.328913 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:33.328882    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-n4g7x_9683ce85-f982-4a05-83d0-a6ace6c05fd0/global-pull-secret-syncer/0.log"
Sep 15 17:18:33.442313 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:33.442279    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-txx8b_a5da2ef5-4cda-424d-8618-79d3d4b6fe1c/konnectivity-agent/0.log"
Sep 15 17:18:33.463759 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:33.463728    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-222.ec2.internal_254bd750f9fd800e2c1818cb4a5d50a1/haproxy/0.log"
Sep 15 17:18:35.299708 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:35.299670    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-5cbjh/must-gather-tphcj"]
Sep 15 17:18:35.300243 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:35.299866    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-5cbjh/must-gather-tphcj" podUID="663cbbb3-0f43-4fe7-b2d0-53bbce296891" containerName="copy" containerID="cri-o://495568ca05b6a2101fbca3391aaba3eb164a8ff01a1a8d199c99ce96536b9e79" gracePeriod=2
Sep 15 17:18:35.302358 ip-10-0-128-222 kubenswrapper[2577]: E0915 17:18:35.302322    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-tphcj\" is forbidden: User \"system:node:ip-10-0-128-222.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-5cbjh\": no relationship found between node 'ip-10-0-128-222.ec2.internal' and this object" podUID="663cbbb3-0f43-4fe7-b2d0-53bbce296891" pod="openshift-must-gather-5cbjh/must-gather-tphcj"
Sep 15 17:18:35.303626 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:35.303589    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-5cbjh/must-gather-tphcj"]
Sep 15 17:18:35.533101 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:35.533073    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-5cbjh_must-gather-tphcj_663cbbb3-0f43-4fe7-b2d0-53bbce296891/copy/0.log"
Sep 15 17:18:35.535632 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:35.535611    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5cbjh/must-gather-tphcj"
Sep 15 17:18:35.537791 ip-10-0-128-222 kubenswrapper[2577]: E0915 17:18:35.537765    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-tphcj\" is forbidden: User \"system:node:ip-10-0-128-222.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-5cbjh\": no relationship found between node 'ip-10-0-128-222.ec2.internal' and this object" podUID="663cbbb3-0f43-4fe7-b2d0-53bbce296891" pod="openshift-must-gather-5cbjh/must-gather-tphcj"
Sep 15 17:18:35.669217 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:35.669190    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-5cbjh_must-gather-tphcj_663cbbb3-0f43-4fe7-b2d0-53bbce296891/copy/0.log"
Sep 15 17:18:35.669528 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:35.669505    2577 generic.go:356] "Generic (PLEG): container finished" podID="663cbbb3-0f43-4fe7-b2d0-53bbce296891" containerID="495568ca05b6a2101fbca3391aaba3eb164a8ff01a1a8d199c99ce96536b9e79" exitCode=143
Sep 15 17:18:35.669606 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:35.669553    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5cbjh/must-gather-tphcj"
Sep 15 17:18:35.669653 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:35.669610    2577 scope.go:117] "RemoveContainer" containerID="495568ca05b6a2101fbca3391aaba3eb164a8ff01a1a8d199c99ce96536b9e79"
Sep 15 17:18:35.671875 ip-10-0-128-222 kubenswrapper[2577]: E0915 17:18:35.671851    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-tphcj\" is forbidden: User \"system:node:ip-10-0-128-222.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-5cbjh\": no relationship found between node 'ip-10-0-128-222.ec2.internal' and this object" podUID="663cbbb3-0f43-4fe7-b2d0-53bbce296891" pod="openshift-must-gather-5cbjh/must-gather-tphcj"
Sep 15 17:18:35.677230 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:35.677183    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/663cbbb3-0f43-4fe7-b2d0-53bbce296891-must-gather-output\") pod \"663cbbb3-0f43-4fe7-b2d0-53bbce296891\" (UID: \"663cbbb3-0f43-4fe7-b2d0-53bbce296891\") "
Sep 15 17:18:35.677291 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:35.677234    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dwg4g\" (UniqueName: \"kubernetes.io/projected/663cbbb3-0f43-4fe7-b2d0-53bbce296891-kube-api-access-dwg4g\") pod \"663cbbb3-0f43-4fe7-b2d0-53bbce296891\" (UID: \"663cbbb3-0f43-4fe7-b2d0-53bbce296891\") "
Sep 15 17:18:35.677291 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:35.677267    2577 scope.go:117] "RemoveContainer" containerID="0b9fa77595618fc215b2df93386f76b247691d269f2a6c7d544fbd3f4c87cf3e"
Sep 15 17:18:35.678873 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:35.678849    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/663cbbb3-0f43-4fe7-b2d0-53bbce296891-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "663cbbb3-0f43-4fe7-b2d0-53bbce296891" (UID: "663cbbb3-0f43-4fe7-b2d0-53bbce296891"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 17:18:35.679695 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:35.679678    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/663cbbb3-0f43-4fe7-b2d0-53bbce296891-kube-api-access-dwg4g" (OuterVolumeSpecName: "kube-api-access-dwg4g") pod "663cbbb3-0f43-4fe7-b2d0-53bbce296891" (UID: "663cbbb3-0f43-4fe7-b2d0-53bbce296891"). InnerVolumeSpecName "kube-api-access-dwg4g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 17:18:35.694443 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:35.694419    2577 scope.go:117] "RemoveContainer" containerID="495568ca05b6a2101fbca3391aaba3eb164a8ff01a1a8d199c99ce96536b9e79"
Sep 15 17:18:35.694777 ip-10-0-128-222 kubenswrapper[2577]: E0915 17:18:35.694754    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"495568ca05b6a2101fbca3391aaba3eb164a8ff01a1a8d199c99ce96536b9e79\": container with ID starting with 495568ca05b6a2101fbca3391aaba3eb164a8ff01a1a8d199c99ce96536b9e79 not found: ID does not exist" containerID="495568ca05b6a2101fbca3391aaba3eb164a8ff01a1a8d199c99ce96536b9e79"
Sep 15 17:18:35.694857 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:35.694792    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"495568ca05b6a2101fbca3391aaba3eb164a8ff01a1a8d199c99ce96536b9e79"} err="failed to get container status \"495568ca05b6a2101fbca3391aaba3eb164a8ff01a1a8d199c99ce96536b9e79\": rpc error: code = NotFound desc = could not find container \"495568ca05b6a2101fbca3391aaba3eb164a8ff01a1a8d199c99ce96536b9e79\": container with ID starting with 495568ca05b6a2101fbca3391aaba3eb164a8ff01a1a8d199c99ce96536b9e79 not found: ID does not exist"
Sep 15 17:18:35.694857 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:35.694818    2577 scope.go:117] "RemoveContainer" containerID="0b9fa77595618fc215b2df93386f76b247691d269f2a6c7d544fbd3f4c87cf3e"
Sep 15 17:18:35.695154 ip-10-0-128-222 kubenswrapper[2577]: E0915 17:18:35.695132    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b9fa77595618fc215b2df93386f76b247691d269f2a6c7d544fbd3f4c87cf3e\": container with ID starting with 0b9fa77595618fc215b2df93386f76b247691d269f2a6c7d544fbd3f4c87cf3e not found: ID does not exist" containerID="0b9fa77595618fc215b2df93386f76b247691d269f2a6c7d544fbd3f4c87cf3e"
Sep 15 17:18:35.695207 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:35.695160    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b9fa77595618fc215b2df93386f76b247691d269f2a6c7d544fbd3f4c87cf3e"} err="failed to get container status \"0b9fa77595618fc215b2df93386f76b247691d269f2a6c7d544fbd3f4c87cf3e\": rpc error: code = NotFound desc = could not find container \"0b9fa77595618fc215b2df93386f76b247691d269f2a6c7d544fbd3f4c87cf3e\": container with ID starting with 0b9fa77595618fc215b2df93386f76b247691d269f2a6c7d544fbd3f4c87cf3e not found: ID does not exist"
Sep 15 17:18:35.778161 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:35.778119    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dwg4g\" (UniqueName: \"kubernetes.io/projected/663cbbb3-0f43-4fe7-b2d0-53bbce296891-kube-api-access-dwg4g\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\""
Sep 15 17:18:35.778161 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:35.778152    2577 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/663cbbb3-0f43-4fe7-b2d0-53bbce296891-must-gather-output\") on node \"ip-10-0-128-222.ec2.internal\" DevicePath \"\""
Sep 15 17:18:35.979940 ip-10-0-128-222 kubenswrapper[2577]: E0915 17:18:35.979903    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-tphcj\" is forbidden: User \"system:node:ip-10-0-128-222.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-5cbjh\": no relationship found between node 'ip-10-0-128-222.ec2.internal' and this object" podUID="663cbbb3-0f43-4fe7-b2d0-53bbce296891" pod="openshift-must-gather-5cbjh/must-gather-tphcj"
Sep 15 17:18:36.391263 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:36.391229    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="663cbbb3-0f43-4fe7-b2d0-53bbce296891" path="/var/lib/kubelet/pods/663cbbb3-0f43-4fe7-b2d0-53bbce296891/volumes"
Sep 15 17:18:37.353647 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:37.353620    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-vl6ht_1434f43e-a6a9-42b3-9ee4-085c697f24e8/kube-state-metrics/0.log"
Sep 15 17:18:37.376969 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:37.376925    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-vl6ht_1434f43e-a6a9-42b3-9ee4-085c697f24e8/kube-rbac-proxy-main/0.log"
Sep 15 17:18:37.404173 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:37.404140    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-vl6ht_1434f43e-a6a9-42b3-9ee4-085c697f24e8/kube-rbac-proxy-self/0.log"
Sep 15 17:18:37.440243 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:37.440209    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6bb77cf9f7-64wqt_c719aaa0-547d-4d5b-abd2-bbd68960e37c/metrics-server/0.log"
Sep 15 17:18:37.469659 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:37.469625    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-nkzzj_b62ba472-5536-4449-ad46-334379635c28/monitoring-plugin/0.log"
Sep 15 17:18:37.502353 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:37.502327    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fltfl_cc77aeac-44b5-493d-9be6-61859790fdf2/node-exporter/0.log"
Sep 15 17:18:37.523335 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:37.523310    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fltfl_cc77aeac-44b5-493d-9be6-61859790fdf2/kube-rbac-proxy/0.log"
Sep 15 17:18:37.547883 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:37.547855    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fltfl_cc77aeac-44b5-493d-9be6-61859790fdf2/init-textfile/0.log"
Sep 15 17:18:37.747083 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:37.747058    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-cdhvx_a9baa9aa-13cb-447e-ac1c-cb3032dde939/kube-rbac-proxy-main/0.log"
Sep 15 17:18:37.776345 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:37.776317    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-cdhvx_a9baa9aa-13cb-447e-ac1c-cb3032dde939/kube-rbac-proxy-self/0.log"
Sep 15 17:18:37.801300 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:37.801269    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-cdhvx_a9baa9aa-13cb-447e-ac1c-cb3032dde939/openshift-state-metrics/0.log"
Sep 15 17:18:37.845143 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:37.845112    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1bf4f2e5-d29b-48ea-af97-db822c2981e9/prometheus/0.log"
Sep 15 17:18:37.868931 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:37.868860    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1bf4f2e5-d29b-48ea-af97-db822c2981e9/config-reloader/0.log"
Sep 15 17:18:37.894489 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:37.894458    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1bf4f2e5-d29b-48ea-af97-db822c2981e9/thanos-sidecar/0.log"
Sep 15 17:18:37.918962 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:37.918931    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1bf4f2e5-d29b-48ea-af97-db822c2981e9/kube-rbac-proxy-web/0.log"
Sep 15 17:18:37.946075 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:37.946045    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1bf4f2e5-d29b-48ea-af97-db822c2981e9/kube-rbac-proxy/0.log"
Sep 15 17:18:37.970186 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:37.970158    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1bf4f2e5-d29b-48ea-af97-db822c2981e9/kube-rbac-proxy-thanos/0.log"
Sep 15 17:18:37.993738 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:37.993712    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1bf4f2e5-d29b-48ea-af97-db822c2981e9/init-config-reloader/0.log"
Sep 15 17:18:38.022995 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:38.022968    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-j8d6d_9a0e0b8b-3bf1-4503-ab85-2b52746556a4/prometheus-operator/0.log"
Sep 15 17:18:38.047617 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:38.047587    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-j8d6d_9a0e0b8b-3bf1-4503-ab85-2b52746556a4/kube-rbac-proxy/0.log"
Sep 15 17:18:38.074363 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:38.074332    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5864cd99d7-95nzb_ca3e1132-415b-4f9a-bf70-f723b21210e3/prometheus-operator-admission-webhook/0.log"
Sep 15 17:18:38.189065 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:38.188963    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-644596f744-ccsg9_07715fc1-ea80-4e9f-a3c4-bcd99ff935d3/thanos-query/0.log"
Sep 15 17:18:38.212587 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:38.212560    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-644596f744-ccsg9_07715fc1-ea80-4e9f-a3c4-bcd99ff935d3/kube-rbac-proxy-web/0.log"
Sep 15 17:18:38.239631 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:38.239605    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-644596f744-ccsg9_07715fc1-ea80-4e9f-a3c4-bcd99ff935d3/kube-rbac-proxy/0.log"
Sep 15 17:18:38.265796 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:38.265761    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-644596f744-ccsg9_07715fc1-ea80-4e9f-a3c4-bcd99ff935d3/prom-label-proxy/0.log"
Sep 15 17:18:38.288124 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:38.288091    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-644596f744-ccsg9_07715fc1-ea80-4e9f-a3c4-bcd99ff935d3/kube-rbac-proxy-rules/0.log"
Sep 15 17:18:38.318020 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:38.317974    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-644596f744-ccsg9_07715fc1-ea80-4e9f-a3c4-bcd99ff935d3/kube-rbac-proxy-metrics/0.log"
Sep 15 17:18:41.854960 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:41.854926    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-t4w98/perf-node-gather-daemonset-gtn2w"]
Sep 15 17:18:41.855574 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:41.855394    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="663cbbb3-0f43-4fe7-b2d0-53bbce296891" containerName="copy"
Sep 15 17:18:41.855574 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:41.855413    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="663cbbb3-0f43-4fe7-b2d0-53bbce296891" containerName="copy"
Sep 15 17:18:41.855574 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:41.855428    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="663cbbb3-0f43-4fe7-b2d0-53bbce296891" containerName="gather"
Sep 15 17:18:41.855574 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:41.855437    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="663cbbb3-0f43-4fe7-b2d0-53bbce296891" containerName="gather"
Sep 15 17:18:41.855574 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:41.855529    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="663cbbb3-0f43-4fe7-b2d0-53bbce296891" containerName="gather"
Sep 15 17:18:41.855574 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:41.855541    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="663cbbb3-0f43-4fe7-b2d0-53bbce296891" containerName="copy"
Sep 15 17:18:41.860810 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:41.860786    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t4w98/perf-node-gather-daemonset-gtn2w"
Sep 15 17:18:41.863633 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:41.863606    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-t4w98\"/\"default-dockercfg-98xd7\""
Sep 15 17:18:41.863774 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:41.863650    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-t4w98\"/\"openshift-service-ca.crt\""
Sep 15 17:18:41.864517 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:41.864502    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-t4w98\"/\"kube-root-ca.crt\""
Sep 15 17:18:41.869135 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:41.869113    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t4w98/perf-node-gather-daemonset-gtn2w"]
Sep 15 17:18:42.036265 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:42.036229    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9f2ea613-dc09-4334-ad10-796ba0079324-sys\") pod \"perf-node-gather-daemonset-gtn2w\" (UID: \"9f2ea613-dc09-4334-ad10-796ba0079324\") " pod="openshift-must-gather-t4w98/perf-node-gather-daemonset-gtn2w"
Sep 15 17:18:42.036441 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:42.036272    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9f2ea613-dc09-4334-ad10-796ba0079324-proc\") pod \"perf-node-gather-daemonset-gtn2w\" (UID: \"9f2ea613-dc09-4334-ad10-796ba0079324\") " pod="openshift-must-gather-t4w98/perf-node-gather-daemonset-gtn2w"
Sep 15 17:18:42.036441 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:42.036313    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9f2ea613-dc09-4334-ad10-796ba0079324-podres\") pod \"perf-node-gather-daemonset-gtn2w\" (UID: \"9f2ea613-dc09-4334-ad10-796ba0079324\") " pod="openshift-must-gather-t4w98/perf-node-gather-daemonset-gtn2w"
Sep 15 17:18:42.036441 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:42.036366    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9f2ea613-dc09-4334-ad10-796ba0079324-lib-modules\") pod \"perf-node-gather-daemonset-gtn2w\" (UID: \"9f2ea613-dc09-4334-ad10-796ba0079324\") " pod="openshift-must-gather-t4w98/perf-node-gather-daemonset-gtn2w"
Sep 15 17:18:42.036441 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:42.036406    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9x47v\" (UniqueName: \"kubernetes.io/projected/9f2ea613-dc09-4334-ad10-796ba0079324-kube-api-access-9x47v\") pod \"perf-node-gather-daemonset-gtn2w\" (UID: \"9f2ea613-dc09-4334-ad10-796ba0079324\") " pod="openshift-must-gather-t4w98/perf-node-gather-daemonset-gtn2w"
Sep 15 17:18:42.080957 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:42.080930    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bhdfv_d046ec2b-6b1e-4f34-aa14-fa14f51c225d/dns/0.log"
Sep 15 17:18:42.103091 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:42.103059    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bhdfv_d046ec2b-6b1e-4f34-aa14-fa14f51c225d/kube-rbac-proxy/0.log"
Sep 15 17:18:42.137807 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:42.137719    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9f2ea613-dc09-4334-ad10-796ba0079324-sys\") pod \"perf-node-gather-daemonset-gtn2w\" (UID: \"9f2ea613-dc09-4334-ad10-796ba0079324\") " pod="openshift-must-gather-t4w98/perf-node-gather-daemonset-gtn2w"
Sep 15 17:18:42.137807 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:42.137760    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9f2ea613-dc09-4334-ad10-796ba0079324-proc\") pod \"perf-node-gather-daemonset-gtn2w\" (UID: \"9f2ea613-dc09-4334-ad10-796ba0079324\") " pod="openshift-must-gather-t4w98/perf-node-gather-daemonset-gtn2w"
Sep 15 17:18:42.137807 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:42.137783    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9f2ea613-dc09-4334-ad10-796ba0079324-podres\") pod \"perf-node-gather-daemonset-gtn2w\" (UID: \"9f2ea613-dc09-4334-ad10-796ba0079324\") " pod="openshift-must-gather-t4w98/perf-node-gather-daemonset-gtn2w"
Sep 15 17:18:42.137807 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:42.137803    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9f2ea613-dc09-4334-ad10-796ba0079324-lib-modules\") pod \"perf-node-gather-daemonset-gtn2w\" (UID: \"9f2ea613-dc09-4334-ad10-796ba0079324\") " pod="openshift-must-gather-t4w98/perf-node-gather-daemonset-gtn2w"
Sep 15 17:18:42.138157 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:42.137838    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9x47v\" (UniqueName: \"kubernetes.io/projected/9f2ea613-dc09-4334-ad10-796ba0079324-kube-api-access-9x47v\") pod \"perf-node-gather-daemonset-gtn2w\" (UID: \"9f2ea613-dc09-4334-ad10-796ba0079324\") " pod="openshift-must-gather-t4w98/perf-node-gather-daemonset-gtn2w"
Sep 15 17:18:42.138157 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:42.137865    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9f2ea613-dc09-4334-ad10-796ba0079324-proc\") pod \"perf-node-gather-daemonset-gtn2w\" (UID: \"9f2ea613-dc09-4334-ad10-796ba0079324\") " pod="openshift-must-gather-t4w98/perf-node-gather-daemonset-gtn2w"
Sep 15 17:18:42.138157 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:42.137865    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9f2ea613-dc09-4334-ad10-796ba0079324-sys\") pod \"perf-node-gather-daemonset-gtn2w\" (UID: \"9f2ea613-dc09-4334-ad10-796ba0079324\") " pod="openshift-must-gather-t4w98/perf-node-gather-daemonset-gtn2w"
Sep 15 17:18:42.138157 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:42.137927    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9f2ea613-dc09-4334-ad10-796ba0079324-podres\") pod \"perf-node-gather-daemonset-gtn2w\" (UID: \"9f2ea613-dc09-4334-ad10-796ba0079324\") " pod="openshift-must-gather-t4w98/perf-node-gather-daemonset-gtn2w"
Sep 15 17:18:42.138157 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:42.137963    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9f2ea613-dc09-4334-ad10-796ba0079324-lib-modules\") pod \"perf-node-gather-daemonset-gtn2w\" (UID: \"9f2ea613-dc09-4334-ad10-796ba0079324\") " pod="openshift-must-gather-t4w98/perf-node-gather-daemonset-gtn2w"
Sep 15 17:18:42.146512 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:42.146480    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9x47v\" (UniqueName: \"kubernetes.io/projected/9f2ea613-dc09-4334-ad10-796ba0079324-kube-api-access-9x47v\") pod \"perf-node-gather-daemonset-gtn2w\" (UID: \"9f2ea613-dc09-4334-ad10-796ba0079324\") " pod="openshift-must-gather-t4w98/perf-node-gather-daemonset-gtn2w"
Sep 15 17:18:42.172153 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:42.172117    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t4w98/perf-node-gather-daemonset-gtn2w"
Sep 15 17:18:42.283987 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:42.283956    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v4dlm_22a84780-b244-4fa8-8b6b-60337f595112/dns-node-resolver/0.log"
Sep 15 17:18:42.443231 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:42.443207    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t4w98/perf-node-gather-daemonset-gtn2w"]
Sep 15 17:18:42.445434 ip-10-0-128-222 kubenswrapper[2577]: W0915 17:18:42.445406    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9f2ea613_dc09_4334_ad10_796ba0079324.slice/crio-69596f280775542b3530da1ad4bc50bb0d820832fa1d654812e2690b30f49586 WatchSource:0}: Error finding container 69596f280775542b3530da1ad4bc50bb0d820832fa1d654812e2690b30f49586: Status 404 returned error can't find the container with id 69596f280775542b3530da1ad4bc50bb0d820832fa1d654812e2690b30f49586
Sep 15 17:18:42.700897 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:42.700816    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t4w98/perf-node-gather-daemonset-gtn2w" event={"ID":"9f2ea613-dc09-4334-ad10-796ba0079324","Type":"ContainerStarted","Data":"39eba844ba50b5368ed1b4e62d3fba6e4ccb53d6a05fa888f99f736123176316"}
Sep 15 17:18:42.700897 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:42.700871    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t4w98/perf-node-gather-daemonset-gtn2w" event={"ID":"9f2ea613-dc09-4334-ad10-796ba0079324","Type":"ContainerStarted","Data":"69596f280775542b3530da1ad4bc50bb0d820832fa1d654812e2690b30f49586"}
Sep 15 17:18:42.701253 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:42.700945    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-t4w98/perf-node-gather-daemonset-gtn2w"
Sep 15 17:18:42.715989 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:42.715941    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-t4w98/perf-node-gather-daemonset-gtn2w" podStartSLOduration=1.715921078 podStartE2EDuration="1.715921078s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 17:18:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 17:18:42.715021849 +0000 UTC m=+3114.760440191" watchObservedRunningTime="2026-09-15 17:18:42.715921078 +0000 UTC m=+3114.761339428"
Sep 15 17:18:42.746277 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:42.746245    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5687879956-gt2bl_0acbceae-7952-4c2b-90bd-b9fecd18e8e9/registry/0.log"
Sep 15 17:18:42.768990 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:42.768959    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-59vps_4a10ffb9-f241-40dc-8db4-c4813201e65d/node-ca/0.log"
Sep 15 17:18:43.913538 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:43.913508    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-f2blw_9a7fe522-bb6a-43e1-b526-4b73776efaee/serve-healthcheck-canary/0.log"
Sep 15 17:18:44.336658 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:44.336587    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7wnbg_e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0/kube-rbac-proxy/0.log"
Sep 15 17:18:44.359246 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:44.359220    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7wnbg_e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0/exporter/0.log"
Sep 15 17:18:44.380154 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:44.380127    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7wnbg_e8ee17ce-78ec-4c17-9aa4-eccfbf50f8e0/extractor/0.log"
Sep 15 17:18:46.890602 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:46.890565    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-qplpz_34faddb9-2ee6-41e0-a3fd-89c33d38bb40/s3-init/0.log"
Sep 15 17:18:46.907270 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:46.907238    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-qplpz_34faddb9-2ee6-41e0-a3fd-89c33d38bb40/download-hf-model/0.log"
Sep 15 17:18:48.715216 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:48.715184    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-t4w98/perf-node-gather-daemonset-gtn2w"
Sep 15 17:18:52.672074 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:52.672041    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rtmw2_97eb67a3-7048-4d86-9521-f76c77cf9166/kube-multus-additional-cni-plugins/0.log"
Sep 15 17:18:52.695832 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:52.695805    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rtmw2_97eb67a3-7048-4d86-9521-f76c77cf9166/egress-router-binary-copy/0.log"
Sep 15 17:18:52.716836 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:52.716810    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rtmw2_97eb67a3-7048-4d86-9521-f76c77cf9166/cni-plugins/0.log"
Sep 15 17:18:52.739400 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:52.739362    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rtmw2_97eb67a3-7048-4d86-9521-f76c77cf9166/bond-cni-plugin/0.log"
Sep 15 17:18:52.760423 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:52.760397    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rtmw2_97eb67a3-7048-4d86-9521-f76c77cf9166/routeoverride-cni/0.log"
Sep 15 17:18:52.789073 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:52.789047    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rtmw2_97eb67a3-7048-4d86-9521-f76c77cf9166/whereabouts-cni-bincopy/0.log"
Sep 15 17:18:52.815169 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:52.815143    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rtmw2_97eb67a3-7048-4d86-9521-f76c77cf9166/whereabouts-cni/0.log"
Sep 15 17:18:52.847361 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:52.847328    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-s8z2k_3aea9285-dc6b-4584-a146-3cebd64a5d83/kube-multus/0.log"
Sep 15 17:18:52.933351 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:52.933271    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-md7hc_3da3c8f3-fcce-45f3-9756-43be57b887a1/network-metrics-daemon/0.log"
Sep 15 17:18:52.954746 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:52.954726    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-md7hc_3da3c8f3-fcce-45f3-9756-43be57b887a1/kube-rbac-proxy/0.log"
Sep 15 17:18:53.974106 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:53.974075    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q4krz_314c32cc-a844-4d14-9ac8-c33379de1cdd/ovn-controller/0.log"
Sep 15 17:18:53.992154 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:53.992123    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q4krz_314c32cc-a844-4d14-9ac8-c33379de1cdd/ovn-acl-logging/0.log"
Sep 15 17:18:54.014255 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:54.014225    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q4krz_314c32cc-a844-4d14-9ac8-c33379de1cdd/kube-rbac-proxy-node/0.log"
Sep 15 17:18:54.036547 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:54.036507    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q4krz_314c32cc-a844-4d14-9ac8-c33379de1cdd/kube-rbac-proxy-ovn-metrics/0.log"
Sep 15 17:18:54.057422 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:54.057390    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q4krz_314c32cc-a844-4d14-9ac8-c33379de1cdd/northd/0.log"
Sep 15 17:18:54.077996 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:54.077963    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q4krz_314c32cc-a844-4d14-9ac8-c33379de1cdd/nbdb/0.log"
Sep 15 17:18:54.098348 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:54.098317    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q4krz_314c32cc-a844-4d14-9ac8-c33379de1cdd/sbdb/0.log"
Sep 15 17:18:54.137480 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:54.137450    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q4krz_314c32cc-a844-4d14-9ac8-c33379de1cdd/ovnkube-controller/0.log"
Sep 15 17:18:55.332764 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:55.332740    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-4mbmd_9665201c-0ad3-4ba4-8bdb-beee79795c0e/network-check-target-container/0.log"
Sep 15 17:18:56.292635 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:56.292610    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-9s6p7_0024ce65-5059-4c76-b912-fee018cb987c/iptables-alerter/0.log"
Sep 15 17:18:56.913985 ip-10-0-128-222 kubenswrapper[2577]: I0915 17:18:56.913957    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-l4f6l_c576ac52-148e-4877-8b32-3ca845e01acf/tuned/0.log"