Sep 07 12:32:40.714518 ip-10-0-129-7 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 07 12:32:40.714533 ip-10-0-129-7 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 07 12:32:40.714542 ip-10-0-129-7 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 07 12:32:40.714942 ip-10-0-129-7 systemd[1]: Failed to start Kubernetes Kubelet. Sep 07 12:32:50.747137 ip-10-0-129-7 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 07 12:32:50.747159 ip-10-0-129-7 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 9db9c1ccd19b4e658532ac41a45790d2 -- Sep 07 12:34:31.733924 ip-10-0-129-7 systemd[1]: Starting Kubernetes Kubelet... Sep 07 12:34:32.113796 ip-10-0-129-7 kubenswrapper[2584]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 07 12:34:32.113796 ip-10-0-129-7 kubenswrapper[2584]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 07 12:34:32.113796 ip-10-0-129-7 kubenswrapper[2584]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 07 12:34:32.113796 ip-10-0-129-7 kubenswrapper[2584]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 07 12:34:32.113796 ip-10-0-129-7 kubenswrapper[2584]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 07 12:34:32.115658 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.115543 2584 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 07 12:34:32.120326 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120305 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 12:34:32.120326 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120325 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 12:34:32.120326 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120328 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 12:34:32.120423 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120331 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 12:34:32.120423 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120334 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 12:34:32.120423 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120338 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 12:34:32.120423 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120341 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 12:34:32.120423 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120344 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 12:34:32.120423 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120347 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 12:34:32.120423 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120350 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 12:34:32.120423 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120352 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 12:34:32.120423 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120355 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 12:34:32.120423 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120357 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 12:34:32.120423 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120360 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 12:34:32.120423 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120364 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 12:34:32.120423 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120368 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 12:34:32.120423 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120371 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 12:34:32.120423 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120374 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 12:34:32.120423 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120377 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 12:34:32.120423 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120380 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 12:34:32.120423 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120382 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 12:34:32.120423 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120391 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 12:34:32.120423 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120394 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 12:34:32.121006 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120397 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 12:34:32.121006 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120400 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 12:34:32.121006 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120403 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 12:34:32.121006 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120405 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 12:34:32.121006 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120408 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 12:34:32.121006 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120411 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 12:34:32.121006 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120413 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 12:34:32.121006 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120416 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 12:34:32.121006 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120418 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 12:34:32.121006 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120421 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 12:34:32.121006 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120423 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 12:34:32.121006 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120425 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 12:34:32.121006 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120428 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 12:34:32.121006 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120431 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 12:34:32.121006 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120434 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 12:34:32.121006 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120437 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 12:34:32.121006 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120439 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 12:34:32.121006 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120442 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 12:34:32.121006 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120445 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 12:34:32.121006 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120448 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 12:34:32.121502 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120451 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 12:34:32.121502 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120453 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 12:34:32.121502 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120455 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 12:34:32.121502 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120458 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 12:34:32.121502 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120461 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 12:34:32.121502 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120463 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 12:34:32.121502 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120466 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 12:34:32.121502 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120468 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 12:34:32.121502 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120472 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 12:34:32.121502 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120475 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 12:34:32.121502 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120479 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 12:34:32.121502 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120483 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 12:34:32.121502 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120495 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 12:34:32.121502 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120499 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 12:34:32.121502 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120503 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 12:34:32.121502 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120506 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 12:34:32.121502 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120509 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 12:34:32.121502 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120511 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 12:34:32.121502 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120514 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 12:34:32.122016 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120517 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 12:34:32.122016 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120519 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 12:34:32.122016 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120522 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 12:34:32.122016 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120524 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 12:34:32.122016 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120527 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 12:34:32.122016 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120530 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 12:34:32.122016 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120532 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 12:34:32.122016 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120535 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 12:34:32.122016 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120537 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 12:34:32.122016 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120540 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 12:34:32.122016 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120542 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 12:34:32.122016 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120545 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 12:34:32.122016 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120547 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 12:34:32.122016 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120550 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 12:34:32.122016 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120552 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 12:34:32.122016 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120555 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 12:34:32.122016 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120557 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 12:34:32.122016 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120559 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 12:34:32.122016 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120562 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 12:34:32.122016 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120564 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 12:34:32.122507 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120567 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 12:34:32.122507 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120569 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 12:34:32.122507 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120572 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 12:34:32.122507 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120574 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 12:34:32.122507 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120577 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 12:34:32.122507 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120581 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 12:34:32.122507 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120584 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 12:34:32.122507 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120586 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 12:34:32.122507 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120589 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 12:34:32.122507 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120592 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 12:34:32.122507 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120594 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 12:34:32.122507 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120597 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 12:34:32.122507 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120599 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 12:34:32.122507 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120601 2584 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 12:34:32.122507 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120604 2584 feature_gate.go:328] unrecognized feature gate: Example Sep 07 12:34:32.122507 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120606 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 12:34:32.122507 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.120609 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 12:34:32.122507 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121359 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 12:34:32.122507 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121366 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 12:34:32.122507 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121369 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 12:34:32.123012 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121373 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 12:34:32.123012 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121376 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 12:34:32.123012 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121379 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 12:34:32.123012 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121382 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 12:34:32.123012 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121384 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 12:34:32.123012 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121387 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 12:34:32.123012 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121390 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 12:34:32.123012 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121393 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 12:34:32.123012 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121396 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 12:34:32.123012 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121398 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 12:34:32.123012 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121401 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 12:34:32.123012 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121404 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 12:34:32.123012 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121406 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 12:34:32.123012 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121409 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 12:34:32.123012 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121411 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 12:34:32.123012 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121414 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 12:34:32.123012 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121416 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 12:34:32.123012 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121419 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 12:34:32.123012 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121423 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 12:34:32.123747 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121426 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 12:34:32.123747 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121428 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 12:34:32.123747 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121431 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 12:34:32.123747 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121433 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 12:34:32.123747 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121435 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 12:34:32.123747 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121439 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 12:34:32.123747 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121443 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 12:34:32.123747 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121446 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 12:34:32.123747 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121449 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 12:34:32.123747 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121453 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 12:34:32.123747 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121456 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 12:34:32.123747 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121458 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 12:34:32.123747 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121461 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 12:34:32.123747 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121463 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 12:34:32.123747 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121466 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 12:34:32.123747 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121469 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 12:34:32.123747 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121472 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 12:34:32.123747 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121475 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 12:34:32.123747 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121477 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 12:34:32.124460 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121480 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 12:34:32.124460 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121483 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 12:34:32.124460 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121486 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 12:34:32.124460 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121488 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 12:34:32.124460 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121491 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 12:34:32.124460 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121493 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 12:34:32.124460 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121496 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 12:34:32.124460 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121499 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 12:34:32.124460 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121501 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 12:34:32.124460 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121504 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 12:34:32.124460 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121506 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 12:34:32.124460 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121510 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 12:34:32.124460 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121514 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 12:34:32.124460 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121517 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 12:34:32.124460 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121520 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 12:34:32.124460 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121523 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 12:34:32.124460 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121525 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 12:34:32.124460 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121528 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 12:34:32.124460 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121530 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 12:34:32.124460 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121532 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 12:34:32.124992 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121535 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 12:34:32.124992 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121538 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 12:34:32.124992 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121540 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 12:34:32.124992 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121543 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 12:34:32.124992 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121545 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 12:34:32.124992 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121548 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 12:34:32.124992 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121551 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 12:34:32.124992 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121554 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 12:34:32.124992 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121556 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 12:34:32.124992 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121559 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 12:34:32.124992 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121561 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 12:34:32.124992 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121564 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 12:34:32.124992 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121567 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 12:34:32.124992 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121569 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 12:34:32.124992 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121572 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 12:34:32.124992 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121574 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 12:34:32.124992 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121576 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 12:34:32.124992 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121579 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 12:34:32.124992 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121581 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 12:34:32.124992 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121585 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 12:34:32.125481 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121587 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 12:34:32.125481 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121590 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 12:34:32.125481 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121592 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 12:34:32.125481 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121595 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 12:34:32.125481 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121598 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 12:34:32.125481 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121601 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 12:34:32.125481 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121604 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 12:34:32.125481 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121606 2584 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 12:34:32.125481 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121611 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 12:34:32.125481 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121630 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 12:34:32.125481 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121633 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 12:34:32.125481 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121636 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 12:34:32.125481 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121639 2584 feature_gate.go:328] unrecognized feature gate: Example Sep 07 12:34:32.125481 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121641 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 12:34:32.125481 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121644 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 12:34:32.125481 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121647 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 12:34:32.125481 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121649 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 12:34:32.125481 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.121652 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 12:34:32.125481 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122043 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 12:34:32.125961 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122048 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 12:34:32.125961 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122051 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 12:34:32.125961 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122054 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 12:34:32.125961 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122057 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 12:34:32.125961 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122060 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 12:34:32.125961 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122063 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 12:34:32.125961 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122065 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 12:34:32.125961 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122068 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 12:34:32.125961 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122070 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 12:34:32.125961 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122073 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 12:34:32.125961 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122076 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 12:34:32.125961 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122078 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 12:34:32.125961 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122081 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 12:34:32.125961 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122083 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 12:34:32.125961 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122086 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 12:34:32.125961 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122088 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 12:34:32.125961 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122091 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 12:34:32.125961 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122094 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 12:34:32.125961 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122097 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 12:34:32.125961 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122100 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 12:34:32.126437 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122103 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 12:34:32.126437 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122106 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 12:34:32.126437 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122109 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 12:34:32.126437 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122113 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 12:34:32.126437 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122116 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 12:34:32.126437 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122119 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 12:34:32.126437 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122122 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 12:34:32.126437 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122125 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 12:34:32.126437 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122127 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 12:34:32.126437 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122130 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 12:34:32.126437 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122132 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 12:34:32.126437 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122135 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 12:34:32.126437 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122137 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 12:34:32.126437 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122140 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 12:34:32.126437 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122143 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 12:34:32.126437 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122145 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 12:34:32.126437 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122148 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 12:34:32.126437 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122151 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 12:34:32.126437 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122154 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 12:34:32.126953 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122156 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 12:34:32.126953 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122159 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 12:34:32.126953 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122161 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 12:34:32.126953 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122163 2584 feature_gate.go:328] unrecognized feature gate: Example Sep 07 12:34:32.126953 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122166 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 12:34:32.126953 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122168 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 12:34:32.126953 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122171 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 12:34:32.126953 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122173 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 12:34:32.126953 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122176 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 12:34:32.126953 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122179 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 12:34:32.126953 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122181 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 12:34:32.126953 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122184 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 12:34:32.126953 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122188 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 12:34:32.126953 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122192 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 12:34:32.126953 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122195 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 12:34:32.126953 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122199 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 12:34:32.126953 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122201 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 12:34:32.126953 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122204 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 12:34:32.126953 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122207 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 12:34:32.127399 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122209 2584 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 12:34:32.127399 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122212 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 12:34:32.127399 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122215 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 12:34:32.127399 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122217 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 12:34:32.127399 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122220 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 12:34:32.127399 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122222 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 12:34:32.127399 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122229 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 12:34:32.127399 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122232 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 12:34:32.127399 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122234 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 12:34:32.127399 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122237 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 12:34:32.127399 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122239 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 12:34:32.127399 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122242 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 12:34:32.127399 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122245 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 12:34:32.127399 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122248 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 12:34:32.127399 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122251 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 12:34:32.127399 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122253 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 12:34:32.127399 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122256 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 12:34:32.127399 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122258 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 12:34:32.127399 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122260 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 12:34:32.127399 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122263 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 12:34:32.127898 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122265 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 12:34:32.127898 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122268 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 12:34:32.127898 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122272 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 12:34:32.127898 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122275 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 12:34:32.127898 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122277 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 12:34:32.127898 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122280 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 12:34:32.127898 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122282 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 12:34:32.127898 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122285 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 12:34:32.127898 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122288 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 12:34:32.127898 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122291 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 12:34:32.127898 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122293 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 12:34:32.127898 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122296 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 12:34:32.127898 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122299 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 12:34:32.127898 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122301 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 12:34:32.127898 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122304 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 12:34:32.127898 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122306 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 12:34:32.127898 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122309 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 12:34:32.127898 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122311 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 12:34:32.127898 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122315 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 12:34:32.127898 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.122317 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 12:34:32.128406 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122412 2584 flags.go:64] FLAG: --address="0.0.0.0" Sep 07 12:34:32.128406 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122450 2584 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 07 12:34:32.128406 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122464 2584 flags.go:64] FLAG: --anonymous-auth="true" Sep 07 12:34:32.128406 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122485 2584 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 07 12:34:32.128406 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122491 2584 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 07 12:34:32.128406 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122495 2584 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 07 12:34:32.128406 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122500 2584 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 07 12:34:32.128406 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122504 2584 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 07 12:34:32.128406 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122507 2584 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 07 12:34:32.128406 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122511 2584 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 07 12:34:32.128406 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122514 2584 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 07 12:34:32.128406 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122519 2584 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 07 12:34:32.128406 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122522 2584 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 07 12:34:32.128406 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122525 2584 flags.go:64] FLAG: --cgroup-root="" Sep 07 12:34:32.128406 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122529 2584 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 07 12:34:32.128406 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122532 2584 flags.go:64] FLAG: --client-ca-file="" Sep 07 12:34:32.128406 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122534 2584 flags.go:64] FLAG: --cloud-provider="external" Sep 07 12:34:32.128406 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122537 2584 flags.go:64] FLAG: --cluster-dns="[]" Sep 07 12:34:32.128406 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122542 2584 flags.go:64] FLAG: --cluster-domain="" Sep 07 12:34:32.128406 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122544 2584 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 07 12:34:32.128406 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122548 2584 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 07 12:34:32.128406 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122551 2584 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 07 12:34:32.128406 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122555 2584 flags.go:64] FLAG: --container-log-max-files="5" Sep 07 12:34:32.128406 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122558 2584 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 07 12:34:32.129003 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122561 2584 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 07 12:34:32.129003 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122564 2584 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 07 12:34:32.129003 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122567 2584 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 07 12:34:32.129003 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122571 2584 flags.go:64] FLAG: --contention-profiling="false" Sep 07 12:34:32.129003 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122574 2584 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 07 12:34:32.129003 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122576 2584 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 07 12:34:32.129003 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122580 2584 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 07 12:34:32.129003 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122583 2584 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 07 12:34:32.129003 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122589 2584 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 07 12:34:32.129003 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122592 2584 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 07 12:34:32.129003 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122595 2584 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 07 12:34:32.129003 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122598 2584 flags.go:64] FLAG: --enable-load-reader="false" Sep 07 12:34:32.129003 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122601 2584 flags.go:64] FLAG: --enable-server="true" Sep 07 12:34:32.129003 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122604 2584 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 07 12:34:32.129003 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122609 2584 flags.go:64] FLAG: --event-burst="100" Sep 07 12:34:32.129003 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122612 2584 flags.go:64] FLAG: --event-qps="50" Sep 07 12:34:32.129003 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122630 2584 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 07 12:34:32.129003 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122636 2584 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 07 12:34:32.129003 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122640 2584 flags.go:64] FLAG: --eviction-hard="" Sep 07 12:34:32.129003 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122646 2584 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 07 12:34:32.129003 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122650 2584 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 07 12:34:32.129003 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122655 2584 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 07 12:34:32.129003 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122659 2584 flags.go:64] FLAG: --eviction-soft="" Sep 07 12:34:32.129003 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122662 2584 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 07 12:34:32.129003 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122665 2584 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 07 12:34:32.129638 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122669 2584 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 07 12:34:32.129638 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122672 2584 flags.go:64] FLAG: --experimental-mounter-path="" Sep 07 12:34:32.129638 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122675 2584 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 07 12:34:32.129638 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122678 2584 flags.go:64] FLAG: --fail-swap-on="true" Sep 07 12:34:32.129638 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122681 2584 flags.go:64] FLAG: --feature-gates="" Sep 07 12:34:32.129638 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122685 2584 flags.go:64] FLAG: --file-check-frequency="20s" Sep 07 12:34:32.129638 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122689 2584 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 07 12:34:32.129638 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122692 2584 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 07 12:34:32.129638 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122695 2584 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 07 12:34:32.129638 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122698 2584 flags.go:64] FLAG: --healthz-port="10248" Sep 07 12:34:32.129638 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122702 2584 flags.go:64] FLAG: --help="false" Sep 07 12:34:32.129638 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122705 2584 flags.go:64] FLAG: --hostname-override="ip-10-0-129-7.ec2.internal" Sep 07 12:34:32.129638 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122708 2584 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 07 12:34:32.129638 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122711 2584 flags.go:64] FLAG: --http-check-frequency="20s" Sep 07 12:34:32.129638 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122714 2584 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 07 12:34:32.129638 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122717 2584 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 07 12:34:32.129638 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122721 2584 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 07 12:34:32.129638 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122724 2584 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 07 12:34:32.129638 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122726 2584 flags.go:64] FLAG: --image-service-endpoint="" Sep 07 12:34:32.129638 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122730 2584 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 07 12:34:32.129638 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122739 2584 flags.go:64] FLAG: --kube-api-burst="100" Sep 07 12:34:32.129638 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122743 2584 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 07 12:34:32.129638 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122747 2584 flags.go:64] FLAG: --kube-api-qps="50" Sep 07 12:34:32.129638 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122750 2584 flags.go:64] FLAG: --kube-reserved="" Sep 07 12:34:32.130238 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122753 2584 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 07 12:34:32.130238 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122756 2584 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 07 12:34:32.130238 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122759 2584 flags.go:64] FLAG: --kubelet-cgroups="" Sep 07 12:34:32.130238 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122762 2584 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 07 12:34:32.130238 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122765 2584 flags.go:64] FLAG: --lock-file="" Sep 07 12:34:32.130238 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122768 2584 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 07 12:34:32.130238 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122770 2584 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 07 12:34:32.130238 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122774 2584 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 07 12:34:32.130238 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122779 2584 flags.go:64] FLAG: --log-json-split-stream="false" Sep 07 12:34:32.130238 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122782 2584 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 07 12:34:32.130238 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122785 2584 flags.go:64] FLAG: --log-text-split-stream="false" Sep 07 12:34:32.130238 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122788 2584 flags.go:64] FLAG: --logging-format="text" Sep 07 12:34:32.130238 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122792 2584 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 07 12:34:32.130238 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122795 2584 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 07 12:34:32.130238 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122798 2584 flags.go:64] FLAG: --manifest-url="" Sep 07 12:34:32.130238 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122801 2584 flags.go:64] FLAG: --manifest-url-header="" Sep 07 12:34:32.130238 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122806 2584 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 07 12:34:32.130238 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122809 2584 flags.go:64] FLAG: --max-open-files="1000000" Sep 07 12:34:32.130238 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122813 2584 flags.go:64] FLAG: --max-pods="110" Sep 07 12:34:32.130238 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122816 2584 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 07 12:34:32.130238 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122819 2584 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 07 12:34:32.130238 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122822 2584 flags.go:64] FLAG: --memory-manager-policy="None" Sep 07 12:34:32.130238 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122826 2584 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 07 12:34:32.130238 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122829 2584 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 07 12:34:32.130238 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122832 2584 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 07 12:34:32.130904 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122835 2584 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 07 12:34:32.130904 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122842 2584 flags.go:64] FLAG: --node-status-max-images="50" Sep 07 12:34:32.130904 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122845 2584 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 07 12:34:32.130904 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122848 2584 flags.go:64] FLAG: --oom-score-adj="-999" Sep 07 12:34:32.130904 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122852 2584 flags.go:64] FLAG: --pod-cidr="" Sep 07 12:34:32.130904 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122854 2584 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 07 12:34:32.130904 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122861 2584 flags.go:64] FLAG: --pod-manifest-path="" Sep 07 12:34:32.130904 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122864 2584 flags.go:64] FLAG: --pod-max-pids="-1" Sep 07 12:34:32.130904 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122867 2584 flags.go:64] FLAG: --pods-per-core="0" Sep 07 12:34:32.130904 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122870 2584 flags.go:64] FLAG: --port="10250" Sep 07 12:34:32.130904 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122873 2584 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 07 12:34:32.130904 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122876 2584 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0fb84982a615838bd" Sep 07 12:34:32.130904 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122879 2584 flags.go:64] FLAG: --qos-reserved="" Sep 07 12:34:32.130904 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122882 2584 flags.go:64] FLAG: --read-only-port="10255" Sep 07 12:34:32.130904 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122885 2584 flags.go:64] FLAG: --register-node="true" Sep 07 12:34:32.130904 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122888 2584 flags.go:64] FLAG: --register-with-taints="" Sep 07 12:34:32.130904 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122892 2584 flags.go:64] FLAG: --registry-burst="10" Sep 07 12:34:32.130904 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122895 2584 flags.go:64] FLAG: --registry-qps="5" Sep 07 12:34:32.130904 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122898 2584 flags.go:64] FLAG: --reserved-cpus="" Sep 07 12:34:32.130904 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122901 2584 flags.go:64] FLAG: --reserved-memory="" Sep 07 12:34:32.130904 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122904 2584 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 07 12:34:32.130904 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122908 2584 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 07 12:34:32.130904 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122911 2584 flags.go:64] FLAG: --rotate-certificates="false" Sep 07 12:34:32.130904 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122914 2584 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 07 12:34:32.130904 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122916 2584 flags.go:64] FLAG: --runonce="false" Sep 07 12:34:32.131522 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122919 2584 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 07 12:34:32.131522 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122922 2584 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 07 12:34:32.131522 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122925 2584 flags.go:64] FLAG: --seccomp-default="false" Sep 07 12:34:32.131522 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122928 2584 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 07 12:34:32.131522 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122931 2584 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 07 12:34:32.131522 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122934 2584 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 07 12:34:32.131522 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122937 2584 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 07 12:34:32.131522 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122940 2584 flags.go:64] FLAG: --storage-driver-password="root" Sep 07 12:34:32.131522 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122943 2584 flags.go:64] FLAG: --storage-driver-secure="false" Sep 07 12:34:32.131522 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122945 2584 flags.go:64] FLAG: --storage-driver-table="stats" Sep 07 12:34:32.131522 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122948 2584 flags.go:64] FLAG: --storage-driver-user="root" Sep 07 12:34:32.131522 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122951 2584 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 07 12:34:32.131522 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122954 2584 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 07 12:34:32.131522 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122957 2584 flags.go:64] FLAG: --system-cgroups="" Sep 07 12:34:32.131522 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122959 2584 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 07 12:34:32.131522 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122964 2584 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 07 12:34:32.131522 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122967 2584 flags.go:64] FLAG: --tls-cert-file="" Sep 07 12:34:32.131522 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122970 2584 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 07 12:34:32.131522 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122974 2584 flags.go:64] FLAG: --tls-min-version="" Sep 07 12:34:32.131522 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122979 2584 flags.go:64] FLAG: --tls-private-key-file="" Sep 07 12:34:32.131522 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122982 2584 flags.go:64] FLAG: --topology-manager-policy="none" Sep 07 12:34:32.131522 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122984 2584 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 07 12:34:32.131522 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122987 2584 flags.go:64] FLAG: --topology-manager-scope="container" Sep 07 12:34:32.131522 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122990 2584 flags.go:64] FLAG: --v="2" Sep 07 12:34:32.131522 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122994 2584 flags.go:64] FLAG: --version="false" Sep 07 12:34:32.132137 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.122998 2584 flags.go:64] FLAG: --vmodule="" Sep 07 12:34:32.132137 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.123002 2584 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 07 12:34:32.132137 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.123005 2584 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 07 12:34:32.132137 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124297 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 12:34:32.132137 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124312 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 12:34:32.132137 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124316 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 12:34:32.132137 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124319 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 12:34:32.132137 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124322 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 12:34:32.132137 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124325 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 12:34:32.132137 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124328 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 12:34:32.132137 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124330 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 12:34:32.132137 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124333 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 12:34:32.132137 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124336 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 12:34:32.132137 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124338 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 12:34:32.132137 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124341 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 12:34:32.132137 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124344 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 12:34:32.132137 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124347 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 12:34:32.132137 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124350 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 12:34:32.132137 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124353 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 12:34:32.132137 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124356 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 12:34:32.132675 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124359 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 12:34:32.132675 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124361 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 12:34:32.132675 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124364 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 12:34:32.132675 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124366 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 12:34:32.132675 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124369 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 12:34:32.132675 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124371 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 12:34:32.132675 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124373 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 12:34:32.132675 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124376 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 12:34:32.132675 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124378 2584 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 12:34:32.132675 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124381 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 12:34:32.132675 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124383 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 12:34:32.132675 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124386 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 12:34:32.132675 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124388 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 12:34:32.132675 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124391 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 12:34:32.132675 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124397 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 12:34:32.132675 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124400 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 12:34:32.132675 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124403 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 12:34:32.132675 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124405 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 12:34:32.132675 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124408 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 12:34:32.132675 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124411 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 12:34:32.133162 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124413 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 12:34:32.133162 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124416 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 12:34:32.133162 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124418 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 12:34:32.133162 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124421 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 12:34:32.133162 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124424 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 12:34:32.133162 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124426 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 12:34:32.133162 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124429 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 12:34:32.133162 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124432 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 12:34:32.133162 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124434 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 12:34:32.133162 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124436 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 12:34:32.133162 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124439 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 12:34:32.133162 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124442 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 12:34:32.133162 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124444 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 12:34:32.133162 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124448 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 12:34:32.133162 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124450 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 12:34:32.133162 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124453 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 12:34:32.133162 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124455 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 12:34:32.133162 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124459 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 12:34:32.133162 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124463 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 12:34:32.133162 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124466 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 12:34:32.133674 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124469 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 12:34:32.133674 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124472 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 12:34:32.133674 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124475 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 12:34:32.133674 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124478 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 12:34:32.133674 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124481 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 12:34:32.133674 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124483 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 12:34:32.133674 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124493 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 12:34:32.133674 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124496 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 12:34:32.133674 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124499 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 12:34:32.133674 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124502 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 12:34:32.133674 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124504 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 12:34:32.133674 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124508 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 12:34:32.133674 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124512 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 12:34:32.133674 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124515 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 12:34:32.133674 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124517 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 12:34:32.133674 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124520 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 12:34:32.133674 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124522 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 12:34:32.133674 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124525 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 12:34:32.133674 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124527 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 12:34:32.133674 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124530 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 12:34:32.134190 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124533 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 12:34:32.134190 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124535 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 12:34:32.134190 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124539 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 12:34:32.134190 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124543 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 12:34:32.134190 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124546 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 12:34:32.134190 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124549 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 12:34:32.134190 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124552 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 12:34:32.134190 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124555 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 12:34:32.134190 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124558 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 12:34:32.134190 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124561 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 12:34:32.134190 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124564 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 12:34:32.134190 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124566 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 12:34:32.134190 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124569 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 12:34:32.134190 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124572 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 12:34:32.134190 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124574 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 12:34:32.134190 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124577 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 12:34:32.134190 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124579 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 12:34:32.134190 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124582 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 12:34:32.134190 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124584 2584 feature_gate.go:328] unrecognized feature gate: Example Sep 07 12:34:32.134683 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124587 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 12:34:32.134683 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124592 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 12:34:32.134683 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.124595 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 12:34:32.134683 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.124601 2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 07 12:34:32.134683 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.132088 2584 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 07 12:34:32.134683 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.132105 2584 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 07 12:34:32.134683 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.132881 2584 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 07 12:34:32.134683 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.132889 2584 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 07 12:34:32.134683 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.132949 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 12:34:32.134683 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.132954 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 12:34:32.134683 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.132958 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 12:34:32.134683 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.132963 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 12:34:32.134683 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.132968 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 12:34:32.134683 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.132971 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 12:34:32.135040 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.132974 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 12:34:32.135040 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.132977 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 12:34:32.135040 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.132979 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 12:34:32.135040 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.132982 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 12:34:32.135040 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.132985 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 12:34:32.135040 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.132988 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 12:34:32.135040 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.132993 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 12:34:32.135040 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.132996 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 12:34:32.135040 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.132999 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 12:34:32.135040 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133001 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 12:34:32.135040 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133004 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 12:34:32.135040 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133006 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 12:34:32.135040 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133009 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 12:34:32.135040 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133011 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 12:34:32.135040 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133014 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 12:34:32.135040 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133016 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 12:34:32.135040 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133019 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 12:34:32.135040 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133021 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 12:34:32.135040 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133023 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 12:34:32.135496 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133026 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 12:34:32.135496 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133028 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 12:34:32.135496 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133031 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 12:34:32.135496 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133033 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 12:34:32.135496 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133037 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 12:34:32.135496 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133041 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 12:34:32.135496 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133043 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 12:34:32.135496 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133046 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 12:34:32.135496 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133048 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 12:34:32.135496 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133050 2584 feature_gate.go:328] unrecognized feature gate: Example Sep 07 12:34:32.135496 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133053 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 12:34:32.135496 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133055 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 12:34:32.135496 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133058 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 12:34:32.135496 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133061 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 12:34:32.135496 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133063 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 12:34:32.135496 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133066 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 12:34:32.135496 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133068 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 12:34:32.135496 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133071 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 12:34:32.135496 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133073 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 12:34:32.135496 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133076 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 12:34:32.136079 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133079 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 12:34:32.136079 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133082 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 12:34:32.136079 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133084 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 12:34:32.136079 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133086 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 12:34:32.136079 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133089 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 12:34:32.136079 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133092 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 12:34:32.136079 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133094 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 12:34:32.136079 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133097 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 12:34:32.136079 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133099 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 12:34:32.136079 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133102 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 12:34:32.136079 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133104 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 12:34:32.136079 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133107 2584 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 12:34:32.136079 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133110 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 12:34:32.136079 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133112 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 12:34:32.136079 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133115 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 12:34:32.136079 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133117 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 12:34:32.136079 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133121 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 12:34:32.136079 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133123 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 12:34:32.136079 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133126 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 12:34:32.136079 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133128 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 12:34:32.136568 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133131 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 12:34:32.136568 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133134 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 12:34:32.136568 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133136 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 12:34:32.136568 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133138 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 12:34:32.136568 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133158 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 12:34:32.136568 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133161 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 12:34:32.136568 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133165 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 12:34:32.136568 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133169 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 12:34:32.136568 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133172 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 12:34:32.136568 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133175 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 12:34:32.136568 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133178 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 12:34:32.136568 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133182 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 12:34:32.136568 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133185 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 12:34:32.136568 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133188 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 12:34:32.136568 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133190 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 12:34:32.136568 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133193 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 12:34:32.136568 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133197 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 12:34:32.136568 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133200 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 12:34:32.136568 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133203 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 12:34:32.137047 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133206 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 12:34:32.137047 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133208 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 12:34:32.137047 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133211 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 12:34:32.137047 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133213 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 12:34:32.137047 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133215 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 12:34:32.137047 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133218 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 12:34:32.137047 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133220 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 12:34:32.137047 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133223 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 12:34:32.137047 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133226 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 12:34:32.137047 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133228 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 12:34:32.137047 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133231 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 12:34:32.137047 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133234 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 12:34:32.137047 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133236 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 12:34:32.137047 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133239 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 12:34:32.137047 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133241 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 12:34:32.137406 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.133246 2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 07 12:34:32.137406 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133363 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 12:34:32.137406 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133367 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 12:34:32.137406 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133371 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 12:34:32.137406 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133374 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 12:34:32.137406 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133377 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 12:34:32.137406 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133381 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 12:34:32.137406 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133383 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 12:34:32.137406 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133386 2584 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 12:34:32.137406 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133388 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 12:34:32.137406 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133391 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 12:34:32.137406 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133394 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 12:34:32.137406 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133397 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 12:34:32.137406 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133399 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 12:34:32.137406 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133402 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 12:34:32.137798 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133404 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 12:34:32.137798 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133407 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 12:34:32.137798 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133409 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 12:34:32.137798 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133411 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 12:34:32.137798 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133414 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 12:34:32.137798 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133416 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 12:34:32.137798 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133420 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 12:34:32.137798 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133424 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 12:34:32.137798 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133428 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 12:34:32.137798 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133431 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 12:34:32.137798 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133434 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 12:34:32.137798 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133437 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 12:34:32.137798 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133441 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 12:34:32.137798 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133444 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 12:34:32.137798 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133448 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 12:34:32.137798 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133450 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 12:34:32.137798 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133453 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 12:34:32.137798 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133456 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 12:34:32.137798 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133459 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 12:34:32.138268 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133462 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 12:34:32.138268 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133464 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 12:34:32.138268 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133467 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 12:34:32.138268 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133470 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 12:34:32.138268 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133473 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 12:34:32.138268 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133475 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 12:34:32.138268 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133478 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 12:34:32.138268 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133480 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 12:34:32.138268 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133483 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 12:34:32.138268 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133485 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 12:34:32.138268 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133488 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 12:34:32.138268 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133491 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 12:34:32.138268 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133494 2584 feature_gate.go:328] unrecognized feature gate: Example Sep 07 12:34:32.138268 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133496 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 12:34:32.138268 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133499 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 12:34:32.138268 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133501 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 12:34:32.138268 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133504 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 12:34:32.138268 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133506 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 12:34:32.138268 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133509 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 12:34:32.138268 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133511 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 12:34:32.138805 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133514 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 12:34:32.138805 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133516 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 12:34:32.138805 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133519 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 12:34:32.138805 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133521 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 12:34:32.138805 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133524 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 12:34:32.138805 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133527 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 12:34:32.138805 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133530 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 12:34:32.138805 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133532 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 12:34:32.138805 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133535 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 12:34:32.138805 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133538 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 12:34:32.138805 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133540 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 12:34:32.138805 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133543 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 12:34:32.138805 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133546 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 12:34:32.138805 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133548 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 12:34:32.138805 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133551 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 12:34:32.138805 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133553 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 12:34:32.138805 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133556 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 12:34:32.138805 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133558 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 12:34:32.138805 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133561 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 12:34:32.138805 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133563 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 12:34:32.139287 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133566 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 12:34:32.139287 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133568 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 12:34:32.139287 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133571 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 12:34:32.139287 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133574 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 12:34:32.139287 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133576 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 12:34:32.139287 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133579 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 12:34:32.139287 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133581 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 12:34:32.139287 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133584 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 12:34:32.139287 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133586 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 12:34:32.139287 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133588 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 12:34:32.139287 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133591 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 12:34:32.139287 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133594 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 12:34:32.139287 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133596 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 12:34:32.139287 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133599 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 12:34:32.139287 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133601 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 12:34:32.139287 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133604 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 12:34:32.139287 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133607 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 12:34:32.139287 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133610 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 12:34:32.139287 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133612 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 12:34:32.139287 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133630 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 12:34:32.139927 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133634 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 12:34:32.139927 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133636 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 12:34:32.139927 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133639 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 12:34:32.139927 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133642 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 12:34:32.139927 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133644 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 12:34:32.139927 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:32.133647 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 12:34:32.139927 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.133652 2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 07 12:34:32.139927 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.133773 2584 server.go:962] "Client rotation is on, will bootstrap in background" Sep 07 12:34:32.139927 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.135947 2584 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 07 12:34:32.139927 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.136786 2584 server.go:1019] "Starting client certificate rotation" Sep 07 12:34:32.139927 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.136884 2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 07 12:34:32.139927 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.137586 2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 07 12:34:32.139927 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.139099 2584 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 07 12:34:32.143760 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.143745 2584 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 07 12:34:32.152781 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.152747 2584 log.go:25] "Validated CRI v1 runtime API" Sep 07 12:34:32.155652 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.155633 2584 log.go:25] "Validated CRI v1 image API" Sep 07 12:34:32.156558 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.156540 2584 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 07 12:34:32.160420 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.160401 2584 fs.go:135] Filesystem UUIDs: map[69b4cda9-5be5-4fde-ba1e-ed280ce38ff2:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 fb02ea67-4819-4340-b2b1-8db61ff6207b:/dev/nvme0n1p3] Sep 07 12:34:32.160482 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.160421 2584 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 07 12:34:32.166467 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.166348 2584 manager.go:216] Machine: {Timestamp:2026-09-07 12:34:32.165074404 +0000 UTC m=+0.315504125 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3107856 MemoryCapacity:32812167168 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2339af903842dafe4cd4bc9711b80c SystemUUID:ec2339af-9038-42da-fe4c-d4bc9711b80c BootID:9db9c1cc-d19b-4e65-8532-ac41a45790d2 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ba:0a:70:15:09 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ba:0a:70:15:09 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6e:ff:c3:dc:fd:c8 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812167168 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 07 12:34:32.166467 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.166455 2584 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 07 12:34:32.166634 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.166540 2584 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 07 12:34:32.169264 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.169237 2584 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 07 12:34:32.169403 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.169267 2584 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-7.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 07 12:34:32.169843 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.169827 2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 07 12:34:32.170002 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.169991 2584 topology_manager.go:138] "Creating topology manager with none policy" Sep 07 12:34:32.170042 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.170006 2584 container_manager_linux.go:309] "Creating device plugin manager" Sep 07 12:34:32.170042 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.170014 2584 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 07 12:34:32.170629 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.170608 2584 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 07 12:34:32.171825 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.171814 2584 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 07 12:34:32.175509 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.175497 2584 state_mem.go:36] "Initialized new in-memory state store" Sep 07 12:34:32.175692 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.175682 2584 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 07 12:34:32.175740 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.175714 2584 kubelet.go:486] "Attempting to sync node with API server" Sep 07 12:34:32.175740 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.175724 2584 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 07 12:34:32.175740 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.175735 2584 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 07 12:34:32.175856 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.175745 2584 kubelet.go:398] "Adding apiserver pod source" Sep 07 12:34:32.175856 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.175755 2584 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 07 12:34:32.176119 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.176108 2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 07 12:34:32.176154 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.176126 2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 07 12:34:32.178267 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.178246 2584 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 07 12:34:32.180401 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.180388 2584 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 07 12:34:32.180446 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.180419 2584 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 07 12:34:32.180588 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.180578 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 07 12:34:32.180651 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.180593 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 07 12:34:32.180651 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.180599 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 07 12:34:32.180651 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.180605 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 07 12:34:32.180651 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.180612 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 07 12:34:32.180651 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.180635 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 07 12:34:32.181031 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.181023 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 07 12:34:32.181031 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.181032 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 07 12:34:32.181091 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.181039 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 07 12:34:32.181091 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.181044 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 07 12:34:32.181091 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.181053 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 07 12:34:32.181091 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.181062 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 07 12:34:32.181833 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.181824 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 07 12:34:32.181833 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.181833 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 07 12:34:32.185744 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.185729 2584 server.go:1268] "Started kubelet" Sep 07 12:34:32.185855 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.185799 2584 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 07 12:34:32.185931 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.185887 2584 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 07 12:34:32.185979 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.185955 2584 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 07 12:34:32.186312 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.186287 2584 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-7.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 07 12:34:32.186411 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:32.186381 2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-7.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 07 12:34:32.186411 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:32.186383 2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 07 12:34:32.186785 ip-10-0-129-7 systemd[1]: Started Kubernetes Kubelet. Sep 07 12:34:32.187180 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.187163 2584 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 07 12:34:32.187910 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.187895 2584 server.go:310] "Adding debug handlers to kubelet server" Sep 07 12:34:32.190182 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:32.190160 2584 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 07 12:34:32.190547 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:32.189765 2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-7.ec2.internal.18d30a00045cef86 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-7.ec2.internal,UID:ip-10-0-129-7.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-7.ec2.internal,},FirstTimestamp:2026-09-07 12:34:32.185696134 +0000 UTC m=+0.336125845,LastTimestamp:2026-09-07 12:34:32.185696134 +0000 UTC m=+0.336125845,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-7.ec2.internal,}" Sep 07 12:34:32.191429 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.191410 2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 07 12:34:32.191969 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.191952 2584 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 07 12:34:32.192089 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:32.192072 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-7.ec2.internal\" not found" Sep 07 12:34:32.192684 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.192666 2584 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 07 12:34:32.192684 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.192669 2584 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 07 12:34:32.192817 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.192692 2584 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 07 12:34:32.192817 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.192769 2584 reconstruct.go:97] "Volume reconstruction finished" Sep 07 12:34:32.192817 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.192778 2584 reconciler.go:29] "Reconciler: start to sync state" Sep 07 12:34:32.193020 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.193006 2584 factory.go:153] Registering CRI-O factory Sep 07 12:34:32.193074 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.193022 2584 factory.go:223] Registration of the crio container factory successfully Sep 07 12:34:32.193074 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.193066 2584 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 07 12:34:32.193074 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.193072 2584 factory.go:55] Registering systemd factory Sep 07 12:34:32.193074 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.193078 2584 factory.go:223] Registration of the systemd container factory successfully Sep 07 12:34:32.193261 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.193102 2584 factory.go:103] Registering Raw factory Sep 07 12:34:32.193261 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.193112 2584 manager.go:1196] Started watching for new ooms in manager Sep 07 12:34:32.193610 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.193591 2584 manager.go:349] Starting recovery of all containers Sep 07 12:34:32.195153 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.195133 2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dpdcv" Sep 07 12:34:32.204895 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.204707 2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dpdcv" Sep 07 12:34:32.204895 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:32.204869 2584 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-7.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 07 12:34:32.205087 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:32.204950 2584 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 07 12:34:32.205900 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.205879 2584 manager.go:354] Recovery completed Sep 07 12:34:32.211473 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.211460 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 12:34:32.213423 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.213406 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-7.ec2.internal" event="NodeHasSufficientMemory" Sep 07 12:34:32.213503 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.213443 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-7.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 12:34:32.213503 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.213457 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-7.ec2.internal" event="NodeHasSufficientPID" Sep 07 12:34:32.214047 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.214033 2584 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 07 12:34:32.214095 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.214045 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 12:34:32.214095 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.214048 2584 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 07 12:34:32.214095 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.214078 2584 state_mem.go:36] "Initialized new in-memory state store" Sep 07 12:34:32.214690 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.214674 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-7.ec2.internal" event="NodeHasSufficientMemory" Sep 07 12:34:32.214803 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.214707 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-7.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 12:34:32.214803 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.214720 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-7.ec2.internal" event="NodeHasSufficientPID" Sep 07 12:34:32.216237 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.216224 2584 policy_none.go:49] "None policy: Start" Sep 07 12:34:32.216332 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.216241 2584 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 07 12:34:32.216332 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.216251 2584 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 07 12:34:32.218398 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.218384 2584 policy_none.go:47] "Start" Sep 07 12:34:32.276309 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.262845 2584 manager.go:337] "Starting Device Plugin manager" Sep 07 12:34:32.276309 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:32.262882 2584 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 07 12:34:32.276309 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.262893 2584 server.go:87] "Starting device plugin registration server" Sep 07 12:34:32.276309 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.263273 2584 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 07 12:34:32.276309 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.263283 2584 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 07 12:34:32.276309 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.263389 2584 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 07 12:34:32.276309 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.263477 2584 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 07 12:34:32.276309 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.263487 2584 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 07 12:34:32.276309 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:32.264150 2584 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 07 12:34:32.276309 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:32.264193 2584 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-7.ec2.internal\" not found" Sep 07 12:34:32.330258 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.330215 2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 07 12:34:32.331630 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.331595 2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 07 12:34:32.331707 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.331673 2584 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 07 12:34:32.331707 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.331705 2584 kubelet.go:2448] "Starting kubelet main sync loop" Sep 07 12:34:32.331777 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:32.331757 2584 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 07 12:34:32.334157 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.334131 2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 12:34:32.364099 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.363972 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 12:34:32.365129 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.365112 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-7.ec2.internal" event="NodeHasSufficientMemory" Sep 07 12:34:32.365211 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.365141 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-7.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 12:34:32.365211 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.365151 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-7.ec2.internal" event="NodeHasSufficientPID" Sep 07 12:34:32.365211 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.365178 2584 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-7.ec2.internal" Sep 07 12:34:32.376629 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.376589 2584 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-7.ec2.internal" Sep 07 12:34:32.376750 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:32.376638 2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-7.ec2.internal\": node \"ip-10-0-129-7.ec2.internal\" not found" Sep 07 12:34:32.389742 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:32.389714 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-7.ec2.internal\" not found" Sep 07 12:34:32.432426 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.432390 2584 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-7.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-7.ec2.internal"] Sep 07 12:34:32.432590 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.432470 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 12:34:32.434042 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.434026 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-7.ec2.internal" event="NodeHasSufficientMemory" Sep 07 12:34:32.434099 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.434057 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-7.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 12:34:32.434099 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.434069 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-7.ec2.internal" event="NodeHasSufficientPID" Sep 07 12:34:32.436230 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.436217 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 12:34:32.436356 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.436340 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-7.ec2.internal" Sep 07 12:34:32.436406 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.436373 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 12:34:32.436977 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.436960 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-7.ec2.internal" event="NodeHasSufficientMemory" Sep 07 12:34:32.437073 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.436990 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-7.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 12:34:32.437073 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.436965 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-7.ec2.internal" event="NodeHasSufficientMemory" Sep 07 12:34:32.437073 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.437005 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-7.ec2.internal" event="NodeHasSufficientPID" Sep 07 12:34:32.437073 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.437025 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-7.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 12:34:32.437073 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.437045 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-7.ec2.internal" event="NodeHasSufficientPID" Sep 07 12:34:32.438888 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.438871 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-7.ec2.internal" Sep 07 12:34:32.438960 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.438903 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 12:34:32.439571 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.439557 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-7.ec2.internal" event="NodeHasSufficientMemory" Sep 07 12:34:32.439666 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.439587 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-7.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 12:34:32.439666 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.439614 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-7.ec2.internal" event="NodeHasSufficientPID" Sep 07 12:34:32.467541 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:32.467516 2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-7.ec2.internal\" not found" node="ip-10-0-129-7.ec2.internal" Sep 07 12:34:32.472416 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:32.472396 2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-7.ec2.internal\" not found" node="ip-10-0-129-7.ec2.internal" Sep 07 12:34:32.490480 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:32.490450 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-7.ec2.internal\" not found" Sep 07 12:34:32.494279 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.494261 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6271a59ad6d0df0c8b736d4338d59778-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-7.ec2.internal\" (UID: \"6271a59ad6d0df0c8b736d4338d59778\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-7.ec2.internal" Sep 07 12:34:32.494372 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.494287 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6271a59ad6d0df0c8b736d4338d59778-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-7.ec2.internal\" (UID: \"6271a59ad6d0df0c8b736d4338d59778\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-7.ec2.internal" Sep 07 12:34:32.494372 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.494302 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/abdd9ed4ef1ebcac8d95bd841ee6df0e-config\") pod \"kube-apiserver-proxy-ip-10-0-129-7.ec2.internal\" (UID: \"abdd9ed4ef1ebcac8d95bd841ee6df0e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-7.ec2.internal" Sep 07 12:34:32.591182 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:32.591152 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-7.ec2.internal\" not found" Sep 07 12:34:32.594435 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.594406 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6271a59ad6d0df0c8b736d4338d59778-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-7.ec2.internal\" (UID: \"6271a59ad6d0df0c8b736d4338d59778\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-7.ec2.internal" Sep 07 12:34:32.594500 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.594444 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6271a59ad6d0df0c8b736d4338d59778-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-7.ec2.internal\" (UID: \"6271a59ad6d0df0c8b736d4338d59778\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-7.ec2.internal" Sep 07 12:34:32.594500 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.594462 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/abdd9ed4ef1ebcac8d95bd841ee6df0e-config\") pod \"kube-apiserver-proxy-ip-10-0-129-7.ec2.internal\" (UID: \"abdd9ed4ef1ebcac8d95bd841ee6df0e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-7.ec2.internal" Sep 07 12:34:32.594500 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.594492 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/abdd9ed4ef1ebcac8d95bd841ee6df0e-config\") pod \"kube-apiserver-proxy-ip-10-0-129-7.ec2.internal\" (UID: \"abdd9ed4ef1ebcac8d95bd841ee6df0e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-7.ec2.internal" Sep 07 12:34:32.594636 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.594525 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6271a59ad6d0df0c8b736d4338d59778-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-7.ec2.internal\" (UID: \"6271a59ad6d0df0c8b736d4338d59778\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-7.ec2.internal" Sep 07 12:34:32.594636 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.594525 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6271a59ad6d0df0c8b736d4338d59778-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-7.ec2.internal\" (UID: \"6271a59ad6d0df0c8b736d4338d59778\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-7.ec2.internal" Sep 07 12:34:32.692152 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:32.692062 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-7.ec2.internal\" not found" Sep 07 12:34:32.770513 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.770475 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-7.ec2.internal" Sep 07 12:34:32.775862 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:32.775734 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-7.ec2.internal" Sep 07 12:34:32.792329 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:32.792294 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-7.ec2.internal\" not found" Sep 07 12:34:32.892792 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:32.892750 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-7.ec2.internal\" not found" Sep 07 12:34:32.993174 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:32.993110 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-7.ec2.internal\" not found" Sep 07 12:34:33.093716 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:33.093678 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-7.ec2.internal\" not found" Sep 07 12:34:33.137024 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:33.136984 2584 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 07 12:34:33.137477 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:33.137176 2584 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 07 12:34:33.194812 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:33.194776 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-7.ec2.internal\" not found" Sep 07 12:34:33.208247 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:33.208213 2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-06 12:29:32 +0000 UTC" deadline="2028-05-23 08:40:55.077570776 +0000 UTC" Sep 07 12:34:33.208247 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:33.208240 2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14972h6m21.869334257s" Sep 07 12:34:33.295206 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:33.295122 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-7.ec2.internal\" not found" Sep 07 12:34:33.395601 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:33.395559 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-7.ec2.internal\" not found" Sep 07 12:34:33.402553 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:33.402511 2584 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 12:34:33.408220 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:33.408194 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabdd9ed4ef1ebcac8d95bd841ee6df0e.slice/crio-e776bdb54bd322f786f13e54a3e9aad92f96e395fc7744595045c560f99ebc07 WatchSource:0}: Error finding container e776bdb54bd322f786f13e54a3e9aad92f96e395fc7744595045c560f99ebc07: Status 404 returned error can't find the container with id e776bdb54bd322f786f13e54a3e9aad92f96e395fc7744595045c560f99ebc07 Sep 07 12:34:33.414561 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:33.414546 2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 07 12:34:33.468115 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:33.468078 2584 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 12:34:33.482492 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:33.482462 2584 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 12:34:33.492578 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:33.492547 2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-7.ec2.internal" Sep 07 12:34:33.523602 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:33.523572 2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 07 12:34:33.524613 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:33.524598 2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-7.ec2.internal" Sep 07 12:34:33.547865 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:33.547793 2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 07 12:34:34.147419 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:34.147380 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6271a59ad6d0df0c8b736d4338d59778.slice/crio-1dbb6a1263763a6ccad2cde7f1a2f31bd585a85a77656cf10e104967d3bf4599 WatchSource:0}: Error finding container 1dbb6a1263763a6ccad2cde7f1a2f31bd585a85a77656cf10e104967d3bf4599: Status 404 returned error can't find the container with id 1dbb6a1263763a6ccad2cde7f1a2f31bd585a85a77656cf10e104967d3bf4599 Sep 07 12:34:34.176974 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.176938 2584 apiserver.go:52] "Watching apiserver" Sep 07 12:34:34.187008 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.186977 2584 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 07 12:34:34.188934 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.188893 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-lkvmb","openshift-ovn-kubernetes/ovnkube-node-bk5j9","kube-system/konnectivity-agent-cl7zg","kube-system/kube-apiserver-proxy-ip-10-0-129-7.ec2.internal","openshift-cluster-node-tuning-operator/tuned-7hpvd","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-7.ec2.internal","openshift-multus/multus-xpkzx","openshift-network-diagnostics/network-check-target-lclwd","openshift-network-operator/iptables-alerter-lj4gt","kube-system/global-pull-secret-syncer-b7nh4","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrv9f","openshift-dns/node-resolver-ctd66","openshift-image-registry/node-ca-xsqsc","openshift-multus/multus-additional-cni-plugins-lgzj8"] Sep 07 12:34:34.192103 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.192077 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrv9f" Sep 07 12:34:34.193145 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.192558 2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 07 12:34:34.194684 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.194661 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:34:34.195049 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.195030 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-xc9v7\"" Sep 07 12:34:34.195386 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.195351 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 07 12:34:34.195493 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.195389 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 07 12:34:34.195629 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.195613 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 07 12:34:34.197753 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.197222 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-92gr2\"" Sep 07 12:34:34.197753 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.197251 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lgzj8" Sep 07 12:34:34.197753 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.197469 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 07 12:34:34.200640 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.199659 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 07 12:34:34.200640 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.199735 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xsqsc" Sep 07 12:34:34.200640 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.200138 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 07 12:34:34.201052 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.200668 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 07 12:34:34.201052 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.200890 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-grs8g\"" Sep 07 12:34:34.201417 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.201397 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 07 12:34:34.201527 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.201447 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 07 12:34:34.201527 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.201462 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 07 12:34:34.201651 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.201563 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 07 12:34:34.201787 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.201769 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 07 12:34:34.202763 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.202745 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7hpvd" Sep 07 12:34:34.203118 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.203092 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b93cc419-fdec-4e46-b3f4-61776f098e4d-socket-dir\") pod \"aws-ebs-csi-driver-node-nrv9f\" (UID: \"b93cc419-fdec-4e46-b3f4-61776f098e4d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrv9f" Sep 07 12:34:34.203211 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.203129 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3-systemd-units\") pod \"ovnkube-node-bk5j9\" (UID: \"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:34:34.203211 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.203160 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3-host-slash\") pod \"ovnkube-node-bk5j9\" (UID: \"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:34:34.203211 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.203183 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3-node-log\") pod \"ovnkube-node-bk5j9\" (UID: \"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:34:34.203211 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.203208 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3-env-overrides\") pod \"ovnkube-node-bk5j9\" (UID: \"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:34:34.203418 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.203231 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3-run-openvswitch\") pod \"ovnkube-node-bk5j9\" (UID: \"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:34:34.203418 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.203256 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3-ovnkube-config\") pod \"ovnkube-node-bk5j9\" (UID: \"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:34:34.203418 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.203279 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b93cc419-fdec-4e46-b3f4-61776f098e4d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nrv9f\" (UID: \"b93cc419-fdec-4e46-b3f4-61776f098e4d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrv9f" Sep 07 12:34:34.203418 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.203310 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b93cc419-fdec-4e46-b3f4-61776f098e4d-registration-dir\") pod \"aws-ebs-csi-driver-node-nrv9f\" (UID: \"b93cc419-fdec-4e46-b3f4-61776f098e4d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrv9f" Sep 07 12:34:34.203418 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.203344 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j72t9\" (UniqueName: \"kubernetes.io/projected/b93cc419-fdec-4e46-b3f4-61776f098e4d-kube-api-access-j72t9\") pod \"aws-ebs-csi-driver-node-nrv9f\" (UID: \"b93cc419-fdec-4e46-b3f4-61776f098e4d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrv9f" Sep 07 12:34:34.203418 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.203369 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3-host-cni-bin\") pod \"ovnkube-node-bk5j9\" (UID: \"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:34:34.203418 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.203398 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b93cc419-fdec-4e46-b3f4-61776f098e4d-sys-fs\") pod \"aws-ebs-csi-driver-node-nrv9f\" (UID: \"b93cc419-fdec-4e46-b3f4-61776f098e4d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrv9f" Sep 07 12:34:34.203716 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.203416 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3-host-kubelet\") pod \"ovnkube-node-bk5j9\" (UID: \"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:34:34.203716 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.203447 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3-etc-openvswitch\") pod \"ovnkube-node-bk5j9\" (UID: \"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:34:34.203716 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.203463 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3-run-ovn\") pod \"ovnkube-node-bk5j9\" (UID: \"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:34:34.203716 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.203477 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktb9z\" (UniqueName: \"kubernetes.io/projected/a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3-kube-api-access-ktb9z\") pod \"ovnkube-node-bk5j9\" (UID: \"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:34:34.203716 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.203493 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b93cc419-fdec-4e46-b3f4-61776f098e4d-device-dir\") pod \"aws-ebs-csi-driver-node-nrv9f\" (UID: \"b93cc419-fdec-4e46-b3f4-61776f098e4d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrv9f" Sep 07 12:34:34.203716 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.203509 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3-var-lib-openvswitch\") pod \"ovnkube-node-bk5j9\" (UID: \"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:34:34.203716 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.203523 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3-run-systemd\") pod \"ovnkube-node-bk5j9\" (UID: \"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:34:34.203716 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.203538 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3-log-socket\") pod \"ovnkube-node-bk5j9\" (UID: \"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:34:34.203716 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.203553 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3-host-run-ovn-kubernetes\") pod \"ovnkube-node-bk5j9\" (UID: \"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:34:34.203716 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.203567 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3-host-run-netns\") pod \"ovnkube-node-bk5j9\" (UID: \"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:34:34.203716 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.203588 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bk5j9\" (UID: \"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:34:34.203716 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.203638 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b93cc419-fdec-4e46-b3f4-61776f098e4d-etc-selinux\") pod \"aws-ebs-csi-driver-node-nrv9f\" (UID: \"b93cc419-fdec-4e46-b3f4-61776f098e4d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrv9f" Sep 07 12:34:34.204317 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.203752 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3-host-cni-netd\") pod \"ovnkube-node-bk5j9\" (UID: \"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:34:34.204317 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.203784 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3-ovn-node-metrics-cert\") pod \"ovnkube-node-bk5j9\" (UID: \"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:34:34.204317 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.203830 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3-ovnkube-script-lib\") pod \"ovnkube-node-bk5j9\" (UID: \"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:34:34.205350 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.205327 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ctd66" Sep 07 12:34:34.206137 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.206116 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 07 12:34:34.207167 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.206398 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 07 12:34:34.207167 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.206472 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-bkjlt\"" Sep 07 12:34:34.207167 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.206849 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 07 12:34:34.207167 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.206850 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 07 12:34:34.207167 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.206916 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gcg9c\"" Sep 07 12:34:34.207167 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.206919 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 07 12:34:34.207167 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.207067 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 07 12:34:34.207557 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.207291 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 07 12:34:34.207806 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.207780 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xpkzx" Sep 07 12:34:34.208855 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.208829 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 07 12:34:34.211529 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.211181 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-j6hmw\"" Sep 07 12:34:34.212577 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.212179 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 07 12:34:34.212577 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.212281 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 07 12:34:34.212577 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.212302 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lj4gt" Sep 07 12:34:34.212577 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.212362 2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 07 12:34:34.212577 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.212379 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-dwkps\"" Sep 07 12:34:34.215760 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.215502 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7nh4" Sep 07 12:34:34.215760 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:34.215587 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7nh4" podUID="4620ef7e-ba96-427e-ab48-a8aa3d7bc243" Sep 07 12:34:34.216194 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.216173 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7zvq4\"" Sep 07 12:34:34.216289 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.216219 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 07 12:34:34.216289 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.216225 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 07 12:34:34.216402 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.216371 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 07 12:34:34.218665 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.218341 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lclwd" Sep 07 12:34:34.218665 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:34.218425 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lclwd" podUID="7008051b-bbec-4967-b4ff-dc60f109a092" Sep 07 12:34:34.220862 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.220842 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lkvmb" Sep 07 12:34:34.220954 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:34.220937 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lkvmb" podUID="2350fd1e-ae4b-48d4-9ef6-e45cb3f83129" Sep 07 12:34:34.223551 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.223532 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cl7zg" Sep 07 12:34:34.228934 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.228912 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 07 12:34:34.229159 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.229136 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-mg9jk\"" Sep 07 12:34:34.229381 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.229363 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 07 12:34:34.267052 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.267020 2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-jjmf7" Sep 07 12:34:34.277420 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.277396 2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-jjmf7" Sep 07 12:34:34.293569 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.293538 2584 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 07 12:34:34.304459 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.304425 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3-ovn-node-metrics-cert\") pod \"ovnkube-node-bk5j9\" (UID: \"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:34:34.304619 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.304475 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/07c66148-19e3-41c1-91fe-c3591bb347e8-run\") pod \"tuned-7hpvd\" (UID: \"07c66148-19e3-41c1-91fe-c3591bb347e8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hpvd" Sep 07 12:34:34.304619 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.304494 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/07c66148-19e3-41c1-91fe-c3591bb347e8-sys\") pod \"tuned-7hpvd\" (UID: \"07c66148-19e3-41c1-91fe-c3591bb347e8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hpvd" Sep 07 12:34:34.304619 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.304517 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/07c66148-19e3-41c1-91fe-c3591bb347e8-lib-modules\") pod \"tuned-7hpvd\" (UID: \"07c66148-19e3-41c1-91fe-c3591bb347e8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hpvd" Sep 07 12:34:34.304619 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.304554 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/07c66148-19e3-41c1-91fe-c3591bb347e8-etc-tuned\") pod \"tuned-7hpvd\" (UID: \"07c66148-19e3-41c1-91fe-c3591bb347e8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hpvd" Sep 07 12:34:34.304619 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.304582 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/54e55813-9848-4014-bbc1-41700bba7900-cnibin\") pod \"multus-xpkzx\" (UID: \"54e55813-9848-4014-bbc1-41700bba7900\") " pod="openshift-multus/multus-xpkzx" Sep 07 12:34:34.304930 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.304714 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/54e55813-9848-4014-bbc1-41700bba7900-host-var-lib-cni-bin\") pod \"multus-xpkzx\" (UID: \"54e55813-9848-4014-bbc1-41700bba7900\") " pod="openshift-multus/multus-xpkzx" Sep 07 12:34:34.304930 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.304757 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b93cc419-fdec-4e46-b3f4-61776f098e4d-socket-dir\") pod \"aws-ebs-csi-driver-node-nrv9f\" (UID: \"b93cc419-fdec-4e46-b3f4-61776f098e4d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrv9f" Sep 07 12:34:34.304930 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.304783 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3-node-log\") pod \"ovnkube-node-bk5j9\" (UID: \"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:34:34.304930 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.304809 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/54e55813-9848-4014-bbc1-41700bba7900-system-cni-dir\") pod \"multus-xpkzx\" (UID: \"54e55813-9848-4014-bbc1-41700bba7900\") " pod="openshift-multus/multus-xpkzx" Sep 07 12:34:34.304930 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.304834 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/54e55813-9848-4014-bbc1-41700bba7900-host-var-lib-kubelet\") pod \"multus-xpkzx\" (UID: \"54e55813-9848-4014-bbc1-41700bba7900\") " pod="openshift-multus/multus-xpkzx" Sep 07 12:34:34.304930 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.304861 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/54e55813-9848-4014-bbc1-41700bba7900-multus-daemon-config\") pod \"multus-xpkzx\" (UID: \"54e55813-9848-4014-bbc1-41700bba7900\") " pod="openshift-multus/multus-xpkzx" Sep 07 12:34:34.304930 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.304889 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gt5r\" (UniqueName: \"kubernetes.io/projected/54e55813-9848-4014-bbc1-41700bba7900-kube-api-access-8gt5r\") pod \"multus-xpkzx\" (UID: \"54e55813-9848-4014-bbc1-41700bba7900\") " pod="openshift-multus/multus-xpkzx" Sep 07 12:34:34.304930 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.304918 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5cf1801e-b694-49ad-9c7c-803229efc5f3-iptables-alerter-script\") pod \"iptables-alerter-lj4gt\" (UID: \"5cf1801e-b694-49ad-9c7c-803229efc5f3\") " pod="openshift-network-operator/iptables-alerter-lj4gt" Sep 07 12:34:34.305323 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.304945 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3-run-openvswitch\") pod \"ovnkube-node-bk5j9\" (UID: \"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:34:34.305323 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.304971 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3-ovnkube-config\") pod \"ovnkube-node-bk5j9\" (UID: \"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:34:34.305323 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.304998 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/07c66148-19e3-41c1-91fe-c3591bb347e8-etc-systemd\") pod \"tuned-7hpvd\" (UID: \"07c66148-19e3-41c1-91fe-c3591bb347e8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hpvd" Sep 07 12:34:34.305323 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.305024 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/54e55813-9848-4014-bbc1-41700bba7900-cni-binary-copy\") pod \"multus-xpkzx\" (UID: \"54e55813-9848-4014-bbc1-41700bba7900\") " pod="openshift-multus/multus-xpkzx" Sep 07 12:34:34.305323 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.305050 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4620ef7e-ba96-427e-ab48-a8aa3d7bc243-dbus\") pod \"global-pull-secret-syncer-b7nh4\" (UID: \"4620ef7e-ba96-427e-ab48-a8aa3d7bc243\") " pod="kube-system/global-pull-secret-syncer-b7nh4" Sep 07 12:34:34.305323 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.305077 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlk72\" (UniqueName: \"kubernetes.io/projected/7008051b-bbec-4967-b4ff-dc60f109a092-kube-api-access-dlk72\") pod \"network-check-target-lclwd\" (UID: \"7008051b-bbec-4967-b4ff-dc60f109a092\") " pod="openshift-network-diagnostics/network-check-target-lclwd" Sep 07 12:34:34.305323 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.305100 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2350fd1e-ae4b-48d4-9ef6-e45cb3f83129-metrics-certs\") pod \"network-metrics-daemon-lkvmb\" (UID: \"2350fd1e-ae4b-48d4-9ef6-e45cb3f83129\") " pod="openshift-multus/network-metrics-daemon-lkvmb" Sep 07 12:34:34.305323 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.305165 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9r2sz\" (UniqueName: \"kubernetes.io/projected/2350fd1e-ae4b-48d4-9ef6-e45cb3f83129-kube-api-access-9r2sz\") pod \"network-metrics-daemon-lkvmb\" (UID: \"2350fd1e-ae4b-48d4-9ef6-e45cb3f83129\") " pod="openshift-multus/network-metrics-daemon-lkvmb" Sep 07 12:34:34.305323 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.305212 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b93cc419-fdec-4e46-b3f4-61776f098e4d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nrv9f\" (UID: \"b93cc419-fdec-4e46-b3f4-61776f098e4d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrv9f" Sep 07 12:34:34.305323 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.305240 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b93cc419-fdec-4e46-b3f4-61776f098e4d-registration-dir\") pod \"aws-ebs-csi-driver-node-nrv9f\" (UID: \"b93cc419-fdec-4e46-b3f4-61776f098e4d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrv9f" Sep 07 12:34:34.305323 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.305270 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j72t9\" (UniqueName: \"kubernetes.io/projected/b93cc419-fdec-4e46-b3f4-61776f098e4d-kube-api-access-j72t9\") pod \"aws-ebs-csi-driver-node-nrv9f\" (UID: \"b93cc419-fdec-4e46-b3f4-61776f098e4d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrv9f" Sep 07 12:34:34.305323 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.305297 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3-host-cni-bin\") pod \"ovnkube-node-bk5j9\" (UID: \"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:34:34.305949 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.305329 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/07c66148-19e3-41c1-91fe-c3591bb347e8-host\") pod \"tuned-7hpvd\" (UID: \"07c66148-19e3-41c1-91fe-c3591bb347e8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hpvd" Sep 07 12:34:34.305949 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.305353 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/07c66148-19e3-41c1-91fe-c3591bb347e8-tmp\") pod \"tuned-7hpvd\" (UID: \"07c66148-19e3-41c1-91fe-c3591bb347e8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hpvd" Sep 07 12:34:34.305949 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.305380 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/54e55813-9848-4014-bbc1-41700bba7900-host-var-lib-cni-multus\") pod \"multus-xpkzx\" (UID: \"54e55813-9848-4014-bbc1-41700bba7900\") " pod="openshift-multus/multus-xpkzx" Sep 07 12:34:34.305949 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.305422 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/34989fc7-d971-4b4a-9b00-aef1cb59f2bf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lgzj8\" (UID: \"34989fc7-d971-4b4a-9b00-aef1cb59f2bf\") " pod="openshift-multus/multus-additional-cni-plugins-lgzj8" Sep 07 12:34:34.305949 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.305453 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3-etc-openvswitch\") pod \"ovnkube-node-bk5j9\" (UID: \"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:34:34.305949 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.305480 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1abf056-5424-47f2-b0cc-9e4791a442e4-tmp-dir\") pod \"node-resolver-ctd66\" (UID: \"a1abf056-5424-47f2-b0cc-9e4791a442e4\") " pod="openshift-dns/node-resolver-ctd66" Sep 07 12:34:34.305949 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.305508 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/54e55813-9848-4014-bbc1-41700bba7900-host-run-multus-certs\") pod \"multus-xpkzx\" (UID: \"54e55813-9848-4014-bbc1-41700bba7900\") " pod="openshift-multus/multus-xpkzx" Sep 07 12:34:34.305949 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.305533 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eb990ca0-9dd8-4a6a-9aea-385184d47b70-serviceca\") pod \"node-ca-xsqsc\" (UID: \"eb990ca0-9dd8-4a6a-9aea-385184d47b70\") " pod="openshift-image-registry/node-ca-xsqsc" Sep 07 12:34:34.305949 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.305566 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3-var-lib-openvswitch\") pod \"ovnkube-node-bk5j9\" (UID: \"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:34:34.305949 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.305592 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/07c66148-19e3-41c1-91fe-c3591bb347e8-etc-modprobe-d\") pod \"tuned-7hpvd\" (UID: \"07c66148-19e3-41c1-91fe-c3591bb347e8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hpvd" Sep 07 12:34:34.305949 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.305630 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5cf1801e-b694-49ad-9c7c-803229efc5f3-host-slash\") pod \"iptables-alerter-lj4gt\" (UID: \"5cf1801e-b694-49ad-9c7c-803229efc5f3\") " pod="openshift-network-operator/iptables-alerter-lj4gt" Sep 07 12:34:34.305949 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.305657 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7q56x\" (UniqueName: \"kubernetes.io/projected/eb990ca0-9dd8-4a6a-9aea-385184d47b70-kube-api-access-7q56x\") pod \"node-ca-xsqsc\" (UID: \"eb990ca0-9dd8-4a6a-9aea-385184d47b70\") " pod="openshift-image-registry/node-ca-xsqsc" Sep 07 12:34:34.305949 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.305684 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3-run-systemd\") pod \"ovnkube-node-bk5j9\" (UID: \"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:34:34.305949 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.305746 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3-log-socket\") pod \"ovnkube-node-bk5j9\" (UID: \"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:34:34.305949 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.305767 2584 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 07 12:34:34.305949 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.305780 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttbbf\" (UniqueName: \"kubernetes.io/projected/07c66148-19e3-41c1-91fe-c3591bb347e8-kube-api-access-ttbbf\") pod \"tuned-7hpvd\" (UID: \"07c66148-19e3-41c1-91fe-c3591bb347e8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hpvd" Sep 07 12:34:34.305949 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.305807 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54e55813-9848-4014-bbc1-41700bba7900-etc-kubernetes\") pod \"multus-xpkzx\" (UID: \"54e55813-9848-4014-bbc1-41700bba7900\") " pod="openshift-multus/multus-xpkzx" Sep 07 12:34:34.306845 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.305877 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqcwv\" (UniqueName: \"kubernetes.io/projected/5cf1801e-b694-49ad-9c7c-803229efc5f3-kube-api-access-wqcwv\") pod \"iptables-alerter-lj4gt\" (UID: \"5cf1801e-b694-49ad-9c7c-803229efc5f3\") " pod="openshift-network-operator/iptables-alerter-lj4gt" Sep 07 12:34:34.306845 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.305903 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b93cc419-fdec-4e46-b3f4-61776f098e4d-socket-dir\") pod \"aws-ebs-csi-driver-node-nrv9f\" (UID: \"b93cc419-fdec-4e46-b3f4-61776f098e4d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrv9f" Sep 07 12:34:34.306845 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.305906 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/34989fc7-d971-4b4a-9b00-aef1cb59f2bf-cnibin\") pod \"multus-additional-cni-plugins-lgzj8\" (UID: \"34989fc7-d971-4b4a-9b00-aef1cb59f2bf\") " pod="openshift-multus/multus-additional-cni-plugins-lgzj8" Sep 07 12:34:34.306845 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.305960 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjskg\" (UniqueName: \"kubernetes.io/projected/a1abf056-5424-47f2-b0cc-9e4791a442e4-kube-api-access-xjskg\") pod \"node-resolver-ctd66\" (UID: \"a1abf056-5424-47f2-b0cc-9e4791a442e4\") " pod="openshift-dns/node-resolver-ctd66" Sep 07 12:34:34.306845 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.305966 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3-node-log\") pod \"ovnkube-node-bk5j9\" (UID: \"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:34:34.306845 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.305989 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4620ef7e-ba96-427e-ab48-a8aa3d7bc243-original-pull-secret\") pod \"global-pull-secret-syncer-b7nh4\" (UID: \"4620ef7e-ba96-427e-ab48-a8aa3d7bc243\") " pod="kube-system/global-pull-secret-syncer-b7nh4" Sep 07 12:34:34.306845 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.306018 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4c11358c-536b-46d1-a3ad-1472e7f9ddd9-konnectivity-ca\") pod \"konnectivity-agent-cl7zg\" (UID: \"4c11358c-536b-46d1-a3ad-1472e7f9ddd9\") " pod="kube-system/konnectivity-agent-cl7zg" Sep 07 12:34:34.306845 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.306055 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b93cc419-fdec-4e46-b3f4-61776f098e4d-etc-selinux\") pod \"aws-ebs-csi-driver-node-nrv9f\" (UID: \"b93cc419-fdec-4e46-b3f4-61776f098e4d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrv9f" Sep 07 12:34:34.306845 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.306062 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3-run-openvswitch\") pod \"ovnkube-node-bk5j9\" (UID: \"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:34:34.306845 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.306084 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3-ovnkube-script-lib\") pod \"ovnkube-node-bk5j9\" (UID: \"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:34:34.306845 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.306113 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/54e55813-9848-4014-bbc1-41700bba7900-host-run-k8s-cni-cncf-io\") pod \"multus-xpkzx\" (UID: \"54e55813-9848-4014-bbc1-41700bba7900\") " pod="openshift-multus/multus-xpkzx" Sep 07 12:34:34.306845 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.306141 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34989fc7-d971-4b4a-9b00-aef1cb59f2bf-system-cni-dir\") pod \"multus-additional-cni-plugins-lgzj8\" (UID: \"34989fc7-d971-4b4a-9b00-aef1cb59f2bf\") " pod="openshift-multus/multus-additional-cni-plugins-lgzj8" Sep 07 12:34:34.306845 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.306168 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/34989fc7-d971-4b4a-9b00-aef1cb59f2bf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lgzj8\" (UID: \"34989fc7-d971-4b4a-9b00-aef1cb59f2bf\") " pod="openshift-multus/multus-additional-cni-plugins-lgzj8" Sep 07 12:34:34.306845 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.306196 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/34989fc7-d971-4b4a-9b00-aef1cb59f2bf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lgzj8\" (UID: \"34989fc7-d971-4b4a-9b00-aef1cb59f2bf\") " pod="openshift-multus/multus-additional-cni-plugins-lgzj8" Sep 07 12:34:34.306845 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.306225 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3-systemd-units\") pod \"ovnkube-node-bk5j9\" (UID: \"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:34:34.306845 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.306252 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3-host-slash\") pod \"ovnkube-node-bk5j9\" (UID: \"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:34:34.307630 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.306306 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3-env-overrides\") pod \"ovnkube-node-bk5j9\" (UID: \"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:34:34.307630 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.306333 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4c11358c-536b-46d1-a3ad-1472e7f9ddd9-agent-certs\") pod \"konnectivity-agent-cl7zg\" (UID: \"4c11358c-536b-46d1-a3ad-1472e7f9ddd9\") " pod="kube-system/konnectivity-agent-cl7zg" Sep 07 12:34:34.307630 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.306359 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/07c66148-19e3-41c1-91fe-c3591bb347e8-etc-kubernetes\") pod \"tuned-7hpvd\" (UID: \"07c66148-19e3-41c1-91fe-c3591bb347e8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hpvd" Sep 07 12:34:34.307630 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.306388 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/34989fc7-d971-4b4a-9b00-aef1cb59f2bf-cni-binary-copy\") pod \"multus-additional-cni-plugins-lgzj8\" (UID: \"34989fc7-d971-4b4a-9b00-aef1cb59f2bf\") " pod="openshift-multus/multus-additional-cni-plugins-lgzj8" Sep 07 12:34:34.307630 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.306417 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkc95\" (UniqueName: \"kubernetes.io/projected/34989fc7-d971-4b4a-9b00-aef1cb59f2bf-kube-api-access-dkc95\") pod \"multus-additional-cni-plugins-lgzj8\" (UID: \"34989fc7-d971-4b4a-9b00-aef1cb59f2bf\") " pod="openshift-multus/multus-additional-cni-plugins-lgzj8" Sep 07 12:34:34.307630 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.306444 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/07c66148-19e3-41c1-91fe-c3591bb347e8-etc-sysctl-conf\") pod \"tuned-7hpvd\" (UID: \"07c66148-19e3-41c1-91fe-c3591bb347e8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hpvd" Sep 07 12:34:34.307630 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.306471 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/54e55813-9848-4014-bbc1-41700bba7900-host-run-netns\") pod \"multus-xpkzx\" (UID: \"54e55813-9848-4014-bbc1-41700bba7900\") " pod="openshift-multus/multus-xpkzx" Sep 07 12:34:34.307630 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.306502 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b93cc419-fdec-4e46-b3f4-61776f098e4d-sys-fs\") pod \"aws-ebs-csi-driver-node-nrv9f\" (UID: \"b93cc419-fdec-4e46-b3f4-61776f098e4d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrv9f" Sep 07 12:34:34.307630 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.306531 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3-host-kubelet\") pod \"ovnkube-node-bk5j9\" (UID: \"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:34:34.307630 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.306558 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3-run-ovn\") pod \"ovnkube-node-bk5j9\" (UID: \"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:34:34.307630 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.306586 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktb9z\" (UniqueName: \"kubernetes.io/projected/a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3-kube-api-access-ktb9z\") pod \"ovnkube-node-bk5j9\" (UID: \"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:34:34.307630 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.306613 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/54e55813-9848-4014-bbc1-41700bba7900-hostroot\") pod \"multus-xpkzx\" (UID: \"54e55813-9848-4014-bbc1-41700bba7900\") " pod="openshift-multus/multus-xpkzx" Sep 07 12:34:34.307630 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.306642 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb990ca0-9dd8-4a6a-9aea-385184d47b70-host\") pod \"node-ca-xsqsc\" (UID: \"eb990ca0-9dd8-4a6a-9aea-385184d47b70\") " pod="openshift-image-registry/node-ca-xsqsc" Sep 07 12:34:34.307630 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.306671 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b93cc419-fdec-4e46-b3f4-61776f098e4d-device-dir\") pod \"aws-ebs-csi-driver-node-nrv9f\" (UID: \"b93cc419-fdec-4e46-b3f4-61776f098e4d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrv9f" Sep 07 12:34:34.307630 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.306718 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/07c66148-19e3-41c1-91fe-c3591bb347e8-var-lib-kubelet\") pod \"tuned-7hpvd\" (UID: \"07c66148-19e3-41c1-91fe-c3591bb347e8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hpvd" Sep 07 12:34:34.307630 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.306769 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a1abf056-5424-47f2-b0cc-9e4791a442e4-hosts-file\") pod \"node-resolver-ctd66\" (UID: \"a1abf056-5424-47f2-b0cc-9e4791a442e4\") " pod="openshift-dns/node-resolver-ctd66" Sep 07 12:34:34.307630 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.306803 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/54e55813-9848-4014-bbc1-41700bba7900-multus-cni-dir\") pod \"multus-xpkzx\" (UID: \"54e55813-9848-4014-bbc1-41700bba7900\") " pod="openshift-multus/multus-xpkzx" Sep 07 12:34:34.308447 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.306806 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b93cc419-fdec-4e46-b3f4-61776f098e4d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nrv9f\" (UID: \"b93cc419-fdec-4e46-b3f4-61776f098e4d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrv9f" Sep 07 12:34:34.308447 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.306831 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3-host-run-ovn-kubernetes\") pod \"ovnkube-node-bk5j9\" (UID: \"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:34:34.308447 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.306855 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/07c66148-19e3-41c1-91fe-c3591bb347e8-etc-sysconfig\") pod \"tuned-7hpvd\" (UID: \"07c66148-19e3-41c1-91fe-c3591bb347e8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hpvd" Sep 07 12:34:34.308447 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.306866 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b93cc419-fdec-4e46-b3f4-61776f098e4d-registration-dir\") pod \"aws-ebs-csi-driver-node-nrv9f\" (UID: \"b93cc419-fdec-4e46-b3f4-61776f098e4d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrv9f" Sep 07 12:34:34.308447 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.306878 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/54e55813-9848-4014-bbc1-41700bba7900-multus-socket-dir-parent\") pod \"multus-xpkzx\" (UID: \"54e55813-9848-4014-bbc1-41700bba7900\") " pod="openshift-multus/multus-xpkzx" Sep 07 12:34:34.308447 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.306902 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/54e55813-9848-4014-bbc1-41700bba7900-multus-conf-dir\") pod \"multus-xpkzx\" (UID: \"54e55813-9848-4014-bbc1-41700bba7900\") " pod="openshift-multus/multus-xpkzx" Sep 07 12:34:34.308447 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.306924 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4620ef7e-ba96-427e-ab48-a8aa3d7bc243-kubelet-config\") pod \"global-pull-secret-syncer-b7nh4\" (UID: \"4620ef7e-ba96-427e-ab48-a8aa3d7bc243\") " pod="kube-system/global-pull-secret-syncer-b7nh4" Sep 07 12:34:34.308447 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.306947 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3-host-run-netns\") pod \"ovnkube-node-bk5j9\" (UID: \"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:34:34.308447 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.306974 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bk5j9\" (UID: \"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:34:34.308447 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.307003 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/07c66148-19e3-41c1-91fe-c3591bb347e8-etc-sysctl-d\") pod \"tuned-7hpvd\" (UID: \"07c66148-19e3-41c1-91fe-c3591bb347e8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hpvd" Sep 07 12:34:34.308447 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.307029 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3-host-cni-netd\") pod \"ovnkube-node-bk5j9\" (UID: \"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:34:34.308447 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.307106 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3-host-cni-netd\") pod \"ovnkube-node-bk5j9\" (UID: \"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:34:34.308447 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.307202 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3-host-cni-bin\") pod \"ovnkube-node-bk5j9\" (UID: \"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:34:34.308447 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.307249 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3-var-lib-openvswitch\") pod \"ovnkube-node-bk5j9\" (UID: \"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:34:34.308447 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.307283 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3-host-run-ovn-kubernetes\") pod \"ovnkube-node-bk5j9\" (UID: \"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:34:34.308447 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.307340 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3-run-systemd\") pod \"ovnkube-node-bk5j9\" (UID: \"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:34:34.308447 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.307354 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3-ovnkube-config\") pod \"ovnkube-node-bk5j9\" (UID: \"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:34:34.309063 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.307380 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3-log-socket\") pod \"ovnkube-node-bk5j9\" (UID: \"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:34:34.309063 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.307469 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bk5j9\" (UID: \"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:34:34.309063 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.307522 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3-systemd-units\") pod \"ovnkube-node-bk5j9\" (UID: \"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:34:34.309063 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.307555 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3-host-slash\") pod \"ovnkube-node-bk5j9\" (UID: \"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:34:34.309063 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.307653 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b93cc419-fdec-4e46-b3f4-61776f098e4d-sys-fs\") pod \"aws-ebs-csi-driver-node-nrv9f\" (UID: \"b93cc419-fdec-4e46-b3f4-61776f098e4d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrv9f" Sep 07 12:34:34.309063 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.307663 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b93cc419-fdec-4e46-b3f4-61776f098e4d-device-dir\") pod \"aws-ebs-csi-driver-node-nrv9f\" (UID: \"b93cc419-fdec-4e46-b3f4-61776f098e4d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrv9f" Sep 07 12:34:34.309063 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.307725 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3-host-run-netns\") pod \"ovnkube-node-bk5j9\" (UID: \"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:34:34.309063 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.307785 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3-run-ovn\") pod \"ovnkube-node-bk5j9\" (UID: \"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:34:34.309063 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.307787 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3-etc-openvswitch\") pod \"ovnkube-node-bk5j9\" (UID: \"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:34:34.309063 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.307813 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3-host-kubelet\") pod \"ovnkube-node-bk5j9\" (UID: \"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:34:34.309063 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.307911 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b93cc419-fdec-4e46-b3f4-61776f098e4d-etc-selinux\") pod \"aws-ebs-csi-driver-node-nrv9f\" (UID: \"b93cc419-fdec-4e46-b3f4-61776f098e4d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrv9f" Sep 07 12:34:34.309063 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.307981 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3-env-overrides\") pod \"ovnkube-node-bk5j9\" (UID: \"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:34:34.309063 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.308250 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3-ovnkube-script-lib\") pod \"ovnkube-node-bk5j9\" (UID: \"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:34:34.310213 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.310189 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3-ovn-node-metrics-cert\") pod \"ovnkube-node-bk5j9\" (UID: \"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:34:34.318886 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.318854 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktb9z\" (UniqueName: \"kubernetes.io/projected/a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3-kube-api-access-ktb9z\") pod \"ovnkube-node-bk5j9\" (UID: \"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:34:34.320335 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.320309 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j72t9\" (UniqueName: \"kubernetes.io/projected/b93cc419-fdec-4e46-b3f4-61776f098e4d-kube-api-access-j72t9\") pod \"aws-ebs-csi-driver-node-nrv9f\" (UID: \"b93cc419-fdec-4e46-b3f4-61776f098e4d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrv9f" Sep 07 12:34:34.337585 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.337518 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-7.ec2.internal" event={"ID":"6271a59ad6d0df0c8b736d4338d59778","Type":"ContainerStarted","Data":"1dbb6a1263763a6ccad2cde7f1a2f31bd585a85a77656cf10e104967d3bf4599"} Sep 07 12:34:34.339025 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.338999 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-7.ec2.internal" event={"ID":"abdd9ed4ef1ebcac8d95bd841ee6df0e","Type":"ContainerStarted","Data":"e776bdb54bd322f786f13e54a3e9aad92f96e395fc7744595045c560f99ebc07"} Sep 07 12:34:34.407840 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.407741 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a1abf056-5424-47f2-b0cc-9e4791a442e4-hosts-file\") pod \"node-resolver-ctd66\" (UID: \"a1abf056-5424-47f2-b0cc-9e4791a442e4\") " pod="openshift-dns/node-resolver-ctd66" Sep 07 12:34:34.407840 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.407793 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/54e55813-9848-4014-bbc1-41700bba7900-multus-cni-dir\") pod \"multus-xpkzx\" (UID: \"54e55813-9848-4014-bbc1-41700bba7900\") " pod="openshift-multus/multus-xpkzx" Sep 07 12:34:34.407840 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.407822 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/07c66148-19e3-41c1-91fe-c3591bb347e8-etc-sysconfig\") pod \"tuned-7hpvd\" (UID: \"07c66148-19e3-41c1-91fe-c3591bb347e8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hpvd" Sep 07 12:34:34.408095 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.407848 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/54e55813-9848-4014-bbc1-41700bba7900-multus-socket-dir-parent\") pod \"multus-xpkzx\" (UID: \"54e55813-9848-4014-bbc1-41700bba7900\") " pod="openshift-multus/multus-xpkzx" Sep 07 12:34:34.408095 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.407868 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/54e55813-9848-4014-bbc1-41700bba7900-multus-conf-dir\") pod \"multus-xpkzx\" (UID: \"54e55813-9848-4014-bbc1-41700bba7900\") " pod="openshift-multus/multus-xpkzx" Sep 07 12:34:34.408095 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.407891 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4620ef7e-ba96-427e-ab48-a8aa3d7bc243-kubelet-config\") pod \"global-pull-secret-syncer-b7nh4\" (UID: \"4620ef7e-ba96-427e-ab48-a8aa3d7bc243\") " pod="kube-system/global-pull-secret-syncer-b7nh4" Sep 07 12:34:34.408095 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.407905 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/07c66148-19e3-41c1-91fe-c3591bb347e8-etc-sysconfig\") pod \"tuned-7hpvd\" (UID: \"07c66148-19e3-41c1-91fe-c3591bb347e8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hpvd" Sep 07 12:34:34.408095 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.407901 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a1abf056-5424-47f2-b0cc-9e4791a442e4-hosts-file\") pod \"node-resolver-ctd66\" (UID: \"a1abf056-5424-47f2-b0cc-9e4791a442e4\") " pod="openshift-dns/node-resolver-ctd66" Sep 07 12:34:34.408095 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.407913 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/07c66148-19e3-41c1-91fe-c3591bb347e8-etc-sysctl-d\") pod \"tuned-7hpvd\" (UID: \"07c66148-19e3-41c1-91fe-c3591bb347e8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hpvd" Sep 07 12:34:34.408095 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.407974 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4620ef7e-ba96-427e-ab48-a8aa3d7bc243-kubelet-config\") pod \"global-pull-secret-syncer-b7nh4\" (UID: \"4620ef7e-ba96-427e-ab48-a8aa3d7bc243\") " pod="kube-system/global-pull-secret-syncer-b7nh4" Sep 07 12:34:34.408095 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.407972 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/54e55813-9848-4014-bbc1-41700bba7900-multus-socket-dir-parent\") pod \"multus-xpkzx\" (UID: \"54e55813-9848-4014-bbc1-41700bba7900\") " pod="openshift-multus/multus-xpkzx" Sep 07 12:34:34.408095 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.407916 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/54e55813-9848-4014-bbc1-41700bba7900-multus-cni-dir\") pod \"multus-xpkzx\" (UID: \"54e55813-9848-4014-bbc1-41700bba7900\") " pod="openshift-multus/multus-xpkzx" Sep 07 12:34:34.408095 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.407943 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/54e55813-9848-4014-bbc1-41700bba7900-multus-conf-dir\") pod \"multus-xpkzx\" (UID: \"54e55813-9848-4014-bbc1-41700bba7900\") " pod="openshift-multus/multus-xpkzx" Sep 07 12:34:34.408095 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.408018 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/07c66148-19e3-41c1-91fe-c3591bb347e8-run\") pod \"tuned-7hpvd\" (UID: \"07c66148-19e3-41c1-91fe-c3591bb347e8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hpvd" Sep 07 12:34:34.408095 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.408045 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/07c66148-19e3-41c1-91fe-c3591bb347e8-sys\") pod \"tuned-7hpvd\" (UID: \"07c66148-19e3-41c1-91fe-c3591bb347e8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hpvd" Sep 07 12:34:34.408095 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.408051 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/07c66148-19e3-41c1-91fe-c3591bb347e8-etc-sysctl-d\") pod \"tuned-7hpvd\" (UID: \"07c66148-19e3-41c1-91fe-c3591bb347e8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hpvd" Sep 07 12:34:34.408095 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.408069 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/07c66148-19e3-41c1-91fe-c3591bb347e8-lib-modules\") pod \"tuned-7hpvd\" (UID: \"07c66148-19e3-41c1-91fe-c3591bb347e8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hpvd" Sep 07 12:34:34.408853 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.408117 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/07c66148-19e3-41c1-91fe-c3591bb347e8-sys\") pod \"tuned-7hpvd\" (UID: \"07c66148-19e3-41c1-91fe-c3591bb347e8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hpvd" Sep 07 12:34:34.408853 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.408130 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/07c66148-19e3-41c1-91fe-c3591bb347e8-etc-tuned\") pod \"tuned-7hpvd\" (UID: \"07c66148-19e3-41c1-91fe-c3591bb347e8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hpvd" Sep 07 12:34:34.408853 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.408112 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/07c66148-19e3-41c1-91fe-c3591bb347e8-run\") pod \"tuned-7hpvd\" (UID: \"07c66148-19e3-41c1-91fe-c3591bb347e8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hpvd" Sep 07 12:34:34.408853 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.408168 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/07c66148-19e3-41c1-91fe-c3591bb347e8-lib-modules\") pod \"tuned-7hpvd\" (UID: \"07c66148-19e3-41c1-91fe-c3591bb347e8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hpvd" Sep 07 12:34:34.408853 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.408184 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/54e55813-9848-4014-bbc1-41700bba7900-cnibin\") pod \"multus-xpkzx\" (UID: \"54e55813-9848-4014-bbc1-41700bba7900\") " pod="openshift-multus/multus-xpkzx" Sep 07 12:34:34.408853 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.408267 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/54e55813-9848-4014-bbc1-41700bba7900-cnibin\") pod \"multus-xpkzx\" (UID: \"54e55813-9848-4014-bbc1-41700bba7900\") " pod="openshift-multus/multus-xpkzx" Sep 07 12:34:34.408853 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.408312 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/54e55813-9848-4014-bbc1-41700bba7900-host-var-lib-cni-bin\") pod \"multus-xpkzx\" (UID: \"54e55813-9848-4014-bbc1-41700bba7900\") " pod="openshift-multus/multus-xpkzx" Sep 07 12:34:34.408853 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.408209 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/54e55813-9848-4014-bbc1-41700bba7900-host-var-lib-cni-bin\") pod \"multus-xpkzx\" (UID: \"54e55813-9848-4014-bbc1-41700bba7900\") " pod="openshift-multus/multus-xpkzx" Sep 07 12:34:34.408853 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.408356 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/54e55813-9848-4014-bbc1-41700bba7900-system-cni-dir\") pod \"multus-xpkzx\" (UID: \"54e55813-9848-4014-bbc1-41700bba7900\") " pod="openshift-multus/multus-xpkzx" Sep 07 12:34:34.408853 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.408381 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/54e55813-9848-4014-bbc1-41700bba7900-host-var-lib-kubelet\") pod \"multus-xpkzx\" (UID: \"54e55813-9848-4014-bbc1-41700bba7900\") " pod="openshift-multus/multus-xpkzx" Sep 07 12:34:34.408853 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.408406 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/54e55813-9848-4014-bbc1-41700bba7900-multus-daemon-config\") pod \"multus-xpkzx\" (UID: \"54e55813-9848-4014-bbc1-41700bba7900\") " pod="openshift-multus/multus-xpkzx" Sep 07 12:34:34.408853 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.408431 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gt5r\" (UniqueName: \"kubernetes.io/projected/54e55813-9848-4014-bbc1-41700bba7900-kube-api-access-8gt5r\") pod \"multus-xpkzx\" (UID: \"54e55813-9848-4014-bbc1-41700bba7900\") " pod="openshift-multus/multus-xpkzx" Sep 07 12:34:34.408853 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.408441 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/54e55813-9848-4014-bbc1-41700bba7900-host-var-lib-kubelet\") pod \"multus-xpkzx\" (UID: \"54e55813-9848-4014-bbc1-41700bba7900\") " pod="openshift-multus/multus-xpkzx" Sep 07 12:34:34.408853 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.408456 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5cf1801e-b694-49ad-9c7c-803229efc5f3-iptables-alerter-script\") pod \"iptables-alerter-lj4gt\" (UID: \"5cf1801e-b694-49ad-9c7c-803229efc5f3\") " pod="openshift-network-operator/iptables-alerter-lj4gt" Sep 07 12:34:34.408853 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.408482 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/07c66148-19e3-41c1-91fe-c3591bb347e8-etc-systemd\") pod \"tuned-7hpvd\" (UID: \"07c66148-19e3-41c1-91fe-c3591bb347e8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hpvd" Sep 07 12:34:34.408853 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.408494 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/54e55813-9848-4014-bbc1-41700bba7900-system-cni-dir\") pod \"multus-xpkzx\" (UID: \"54e55813-9848-4014-bbc1-41700bba7900\") " pod="openshift-multus/multus-xpkzx" Sep 07 12:34:34.408853 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.408499 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/54e55813-9848-4014-bbc1-41700bba7900-cni-binary-copy\") pod \"multus-xpkzx\" (UID: \"54e55813-9848-4014-bbc1-41700bba7900\") " pod="openshift-multus/multus-xpkzx" Sep 07 12:34:34.408853 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.408532 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4620ef7e-ba96-427e-ab48-a8aa3d7bc243-dbus\") pod \"global-pull-secret-syncer-b7nh4\" (UID: \"4620ef7e-ba96-427e-ab48-a8aa3d7bc243\") " pod="kube-system/global-pull-secret-syncer-b7nh4" Sep 07 12:34:34.409726 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.408551 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlk72\" (UniqueName: \"kubernetes.io/projected/7008051b-bbec-4967-b4ff-dc60f109a092-kube-api-access-dlk72\") pod \"network-check-target-lclwd\" (UID: \"7008051b-bbec-4967-b4ff-dc60f109a092\") " pod="openshift-network-diagnostics/network-check-target-lclwd" Sep 07 12:34:34.409726 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.408567 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2350fd1e-ae4b-48d4-9ef6-e45cb3f83129-metrics-certs\") pod \"network-metrics-daemon-lkvmb\" (UID: \"2350fd1e-ae4b-48d4-9ef6-e45cb3f83129\") " pod="openshift-multus/network-metrics-daemon-lkvmb" Sep 07 12:34:34.409726 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.408589 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9r2sz\" (UniqueName: \"kubernetes.io/projected/2350fd1e-ae4b-48d4-9ef6-e45cb3f83129-kube-api-access-9r2sz\") pod \"network-metrics-daemon-lkvmb\" (UID: \"2350fd1e-ae4b-48d4-9ef6-e45cb3f83129\") " pod="openshift-multus/network-metrics-daemon-lkvmb" Sep 07 12:34:34.409726 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.408614 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/07c66148-19e3-41c1-91fe-c3591bb347e8-host\") pod \"tuned-7hpvd\" (UID: \"07c66148-19e3-41c1-91fe-c3591bb347e8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hpvd" Sep 07 12:34:34.409726 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.408628 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/07c66148-19e3-41c1-91fe-c3591bb347e8-tmp\") pod \"tuned-7hpvd\" (UID: \"07c66148-19e3-41c1-91fe-c3591bb347e8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hpvd" Sep 07 12:34:34.409726 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.408679 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/54e55813-9848-4014-bbc1-41700bba7900-host-var-lib-cni-multus\") pod \"multus-xpkzx\" (UID: \"54e55813-9848-4014-bbc1-41700bba7900\") " pod="openshift-multus/multus-xpkzx" Sep 07 12:34:34.409726 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.408704 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/34989fc7-d971-4b4a-9b00-aef1cb59f2bf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lgzj8\" (UID: \"34989fc7-d971-4b4a-9b00-aef1cb59f2bf\") " pod="openshift-multus/multus-additional-cni-plugins-lgzj8" Sep 07 12:34:34.409726 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.408730 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1abf056-5424-47f2-b0cc-9e4791a442e4-tmp-dir\") pod \"node-resolver-ctd66\" (UID: \"a1abf056-5424-47f2-b0cc-9e4791a442e4\") " pod="openshift-dns/node-resolver-ctd66" Sep 07 12:34:34.409726 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.408754 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/54e55813-9848-4014-bbc1-41700bba7900-host-run-multus-certs\") pod \"multus-xpkzx\" (UID: \"54e55813-9848-4014-bbc1-41700bba7900\") " pod="openshift-multus/multus-xpkzx" Sep 07 12:34:34.409726 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.408777 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eb990ca0-9dd8-4a6a-9aea-385184d47b70-serviceca\") pod \"node-ca-xsqsc\" (UID: \"eb990ca0-9dd8-4a6a-9aea-385184d47b70\") " pod="openshift-image-registry/node-ca-xsqsc" Sep 07 12:34:34.409726 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.408801 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/07c66148-19e3-41c1-91fe-c3591bb347e8-etc-modprobe-d\") pod \"tuned-7hpvd\" (UID: \"07c66148-19e3-41c1-91fe-c3591bb347e8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hpvd" Sep 07 12:34:34.409726 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.408824 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5cf1801e-b694-49ad-9c7c-803229efc5f3-host-slash\") pod \"iptables-alerter-lj4gt\" (UID: \"5cf1801e-b694-49ad-9c7c-803229efc5f3\") " pod="openshift-network-operator/iptables-alerter-lj4gt" Sep 07 12:34:34.409726 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.408846 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7q56x\" (UniqueName: \"kubernetes.io/projected/eb990ca0-9dd8-4a6a-9aea-385184d47b70-kube-api-access-7q56x\") pod \"node-ca-xsqsc\" (UID: \"eb990ca0-9dd8-4a6a-9aea-385184d47b70\") " pod="openshift-image-registry/node-ca-xsqsc" Sep 07 12:34:34.409726 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.408871 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttbbf\" (UniqueName: \"kubernetes.io/projected/07c66148-19e3-41c1-91fe-c3591bb347e8-kube-api-access-ttbbf\") pod \"tuned-7hpvd\" (UID: \"07c66148-19e3-41c1-91fe-c3591bb347e8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hpvd" Sep 07 12:34:34.409726 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.408895 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54e55813-9848-4014-bbc1-41700bba7900-etc-kubernetes\") pod \"multus-xpkzx\" (UID: \"54e55813-9848-4014-bbc1-41700bba7900\") " pod="openshift-multus/multus-xpkzx" Sep 07 12:34:34.409726 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.408921 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqcwv\" (UniqueName: \"kubernetes.io/projected/5cf1801e-b694-49ad-9c7c-803229efc5f3-kube-api-access-wqcwv\") pod \"iptables-alerter-lj4gt\" (UID: \"5cf1801e-b694-49ad-9c7c-803229efc5f3\") " pod="openshift-network-operator/iptables-alerter-lj4gt" Sep 07 12:34:34.409726 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.408957 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/34989fc7-d971-4b4a-9b00-aef1cb59f2bf-cnibin\") pod \"multus-additional-cni-plugins-lgzj8\" (UID: \"34989fc7-d971-4b4a-9b00-aef1cb59f2bf\") " pod="openshift-multus/multus-additional-cni-plugins-lgzj8" Sep 07 12:34:34.410622 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.408986 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjskg\" (UniqueName: \"kubernetes.io/projected/a1abf056-5424-47f2-b0cc-9e4791a442e4-kube-api-access-xjskg\") pod \"node-resolver-ctd66\" (UID: \"a1abf056-5424-47f2-b0cc-9e4791a442e4\") " pod="openshift-dns/node-resolver-ctd66" Sep 07 12:34:34.410622 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.409012 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4620ef7e-ba96-427e-ab48-a8aa3d7bc243-original-pull-secret\") pod \"global-pull-secret-syncer-b7nh4\" (UID: \"4620ef7e-ba96-427e-ab48-a8aa3d7bc243\") " pod="kube-system/global-pull-secret-syncer-b7nh4" Sep 07 12:34:34.410622 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.409037 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4c11358c-536b-46d1-a3ad-1472e7f9ddd9-konnectivity-ca\") pod \"konnectivity-agent-cl7zg\" (UID: \"4c11358c-536b-46d1-a3ad-1472e7f9ddd9\") " pod="kube-system/konnectivity-agent-cl7zg" Sep 07 12:34:34.410622 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.409066 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/54e55813-9848-4014-bbc1-41700bba7900-host-run-k8s-cni-cncf-io\") pod \"multus-xpkzx\" (UID: \"54e55813-9848-4014-bbc1-41700bba7900\") " pod="openshift-multus/multus-xpkzx" Sep 07 12:34:34.410622 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.409091 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34989fc7-d971-4b4a-9b00-aef1cb59f2bf-system-cni-dir\") pod \"multus-additional-cni-plugins-lgzj8\" (UID: \"34989fc7-d971-4b4a-9b00-aef1cb59f2bf\") " pod="openshift-multus/multus-additional-cni-plugins-lgzj8" Sep 07 12:34:34.410622 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.409118 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/34989fc7-d971-4b4a-9b00-aef1cb59f2bf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lgzj8\" (UID: \"34989fc7-d971-4b4a-9b00-aef1cb59f2bf\") " pod="openshift-multus/multus-additional-cni-plugins-lgzj8" Sep 07 12:34:34.410622 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.409130 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/07c66148-19e3-41c1-91fe-c3591bb347e8-etc-systemd\") pod \"tuned-7hpvd\" (UID: \"07c66148-19e3-41c1-91fe-c3591bb347e8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hpvd" Sep 07 12:34:34.410622 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.409148 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/34989fc7-d971-4b4a-9b00-aef1cb59f2bf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lgzj8\" (UID: \"34989fc7-d971-4b4a-9b00-aef1cb59f2bf\") " pod="openshift-multus/multus-additional-cni-plugins-lgzj8" Sep 07 12:34:34.410622 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.409171 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5cf1801e-b694-49ad-9c7c-803229efc5f3-iptables-alerter-script\") pod \"iptables-alerter-lj4gt\" (UID: \"5cf1801e-b694-49ad-9c7c-803229efc5f3\") " pod="openshift-network-operator/iptables-alerter-lj4gt" Sep 07 12:34:34.410622 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.409179 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4c11358c-536b-46d1-a3ad-1472e7f9ddd9-agent-certs\") pod \"konnectivity-agent-cl7zg\" (UID: \"4c11358c-536b-46d1-a3ad-1472e7f9ddd9\") " pod="kube-system/konnectivity-agent-cl7zg" Sep 07 12:34:34.410622 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.409178 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/54e55813-9848-4014-bbc1-41700bba7900-multus-daemon-config\") pod \"multus-xpkzx\" (UID: \"54e55813-9848-4014-bbc1-41700bba7900\") " pod="openshift-multus/multus-xpkzx" Sep 07 12:34:34.410622 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.409211 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4620ef7e-ba96-427e-ab48-a8aa3d7bc243-dbus\") pod \"global-pull-secret-syncer-b7nh4\" (UID: \"4620ef7e-ba96-427e-ab48-a8aa3d7bc243\") " pod="kube-system/global-pull-secret-syncer-b7nh4" Sep 07 12:34:34.410622 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.409258 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54e55813-9848-4014-bbc1-41700bba7900-etc-kubernetes\") pod \"multus-xpkzx\" (UID: \"54e55813-9848-4014-bbc1-41700bba7900\") " pod="openshift-multus/multus-xpkzx" Sep 07 12:34:34.410622 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:34.409297 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 12:34:34.410622 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.409339 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/34989fc7-d971-4b4a-9b00-aef1cb59f2bf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lgzj8\" (UID: \"34989fc7-d971-4b4a-9b00-aef1cb59f2bf\") " pod="openshift-multus/multus-additional-cni-plugins-lgzj8" Sep 07 12:34:34.410622 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:34.409389 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 12:34:34.410622 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.409393 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/54e55813-9848-4014-bbc1-41700bba7900-host-var-lib-cni-multus\") pod \"multus-xpkzx\" (UID: \"54e55813-9848-4014-bbc1-41700bba7900\") " pod="openshift-multus/multus-xpkzx" Sep 07 12:34:34.410622 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.409394 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/07c66148-19e3-41c1-91fe-c3591bb347e8-etc-modprobe-d\") pod \"tuned-7hpvd\" (UID: \"07c66148-19e3-41c1-91fe-c3591bb347e8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hpvd" Sep 07 12:34:34.411212 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.409449 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5cf1801e-b694-49ad-9c7c-803229efc5f3-host-slash\") pod \"iptables-alerter-lj4gt\" (UID: \"5cf1801e-b694-49ad-9c7c-803229efc5f3\") " pod="openshift-network-operator/iptables-alerter-lj4gt" Sep 07 12:34:34.411212 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.409295 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/34989fc7-d971-4b4a-9b00-aef1cb59f2bf-cnibin\") pod \"multus-additional-cni-plugins-lgzj8\" (UID: \"34989fc7-d971-4b4a-9b00-aef1cb59f2bf\") " pod="openshift-multus/multus-additional-cni-plugins-lgzj8" Sep 07 12:34:34.411212 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.409613 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34989fc7-d971-4b4a-9b00-aef1cb59f2bf-system-cni-dir\") pod \"multus-additional-cni-plugins-lgzj8\" (UID: \"34989fc7-d971-4b4a-9b00-aef1cb59f2bf\") " pod="openshift-multus/multus-additional-cni-plugins-lgzj8" Sep 07 12:34:34.411212 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.409683 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/54e55813-9848-4014-bbc1-41700bba7900-host-run-k8s-cni-cncf-io\") pod \"multus-xpkzx\" (UID: \"54e55813-9848-4014-bbc1-41700bba7900\") " pod="openshift-multus/multus-xpkzx" Sep 07 12:34:34.411212 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.409722 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1abf056-5424-47f2-b0cc-9e4791a442e4-tmp-dir\") pod \"node-resolver-ctd66\" (UID: \"a1abf056-5424-47f2-b0cc-9e4791a442e4\") " pod="openshift-dns/node-resolver-ctd66" Sep 07 12:34:34.411212 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.409838 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/54e55813-9848-4014-bbc1-41700bba7900-host-run-multus-certs\") pod \"multus-xpkzx\" (UID: \"54e55813-9848-4014-bbc1-41700bba7900\") " pod="openshift-multus/multus-xpkzx" Sep 07 12:34:34.411212 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.409900 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/07c66148-19e3-41c1-91fe-c3591bb347e8-host\") pod \"tuned-7hpvd\" (UID: \"07c66148-19e3-41c1-91fe-c3591bb347e8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hpvd" Sep 07 12:34:34.411212 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.410094 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/34989fc7-d971-4b4a-9b00-aef1cb59f2bf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lgzj8\" (UID: \"34989fc7-d971-4b4a-9b00-aef1cb59f2bf\") " pod="openshift-multus/multus-additional-cni-plugins-lgzj8" Sep 07 12:34:34.411212 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.410109 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eb990ca0-9dd8-4a6a-9aea-385184d47b70-serviceca\") pod \"node-ca-xsqsc\" (UID: \"eb990ca0-9dd8-4a6a-9aea-385184d47b70\") " pod="openshift-image-registry/node-ca-xsqsc" Sep 07 12:34:34.411212 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:34.409391 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2350fd1e-ae4b-48d4-9ef6-e45cb3f83129-metrics-certs podName:2350fd1e-ae4b-48d4-9ef6-e45cb3f83129 nodeName:}" failed. No retries permitted until 2026-09-07 12:34:34.909345069 +0000 UTC m=+3.059774780 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2350fd1e-ae4b-48d4-9ef6-e45cb3f83129-metrics-certs") pod "network-metrics-daemon-lkvmb" (UID: "2350fd1e-ae4b-48d4-9ef6-e45cb3f83129") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 12:34:34.411212 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:34.410162 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4620ef7e-ba96-427e-ab48-a8aa3d7bc243-original-pull-secret podName:4620ef7e-ba96-427e-ab48-a8aa3d7bc243 nodeName:}" failed. No retries permitted until 2026-09-07 12:34:34.910146374 +0000 UTC m=+3.060576072 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4620ef7e-ba96-427e-ab48-a8aa3d7bc243-original-pull-secret") pod "global-pull-secret-syncer-b7nh4" (UID: "4620ef7e-ba96-427e-ab48-a8aa3d7bc243") : object "kube-system"/"original-pull-secret" not registered Sep 07 12:34:34.411212 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.410174 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/07c66148-19e3-41c1-91fe-c3591bb347e8-etc-kubernetes\") pod \"tuned-7hpvd\" (UID: \"07c66148-19e3-41c1-91fe-c3591bb347e8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hpvd" Sep 07 12:34:34.411212 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.410194 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/34989fc7-d971-4b4a-9b00-aef1cb59f2bf-cni-binary-copy\") pod \"multus-additional-cni-plugins-lgzj8\" (UID: \"34989fc7-d971-4b4a-9b00-aef1cb59f2bf\") " pod="openshift-multus/multus-additional-cni-plugins-lgzj8" Sep 07 12:34:34.411212 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.410211 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkc95\" (UniqueName: \"kubernetes.io/projected/34989fc7-d971-4b4a-9b00-aef1cb59f2bf-kube-api-access-dkc95\") pod \"multus-additional-cni-plugins-lgzj8\" (UID: \"34989fc7-d971-4b4a-9b00-aef1cb59f2bf\") " pod="openshift-multus/multus-additional-cni-plugins-lgzj8" Sep 07 12:34:34.411212 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.410227 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/07c66148-19e3-41c1-91fe-c3591bb347e8-etc-sysctl-conf\") pod \"tuned-7hpvd\" (UID: \"07c66148-19e3-41c1-91fe-c3591bb347e8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hpvd" Sep 07 12:34:34.411212 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.410256 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/54e55813-9848-4014-bbc1-41700bba7900-host-run-netns\") pod \"multus-xpkzx\" (UID: \"54e55813-9848-4014-bbc1-41700bba7900\") " pod="openshift-multus/multus-xpkzx" Sep 07 12:34:34.411831 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.410292 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/54e55813-9848-4014-bbc1-41700bba7900-hostroot\") pod \"multus-xpkzx\" (UID: \"54e55813-9848-4014-bbc1-41700bba7900\") " pod="openshift-multus/multus-xpkzx" Sep 07 12:34:34.411831 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.410306 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/34989fc7-d971-4b4a-9b00-aef1cb59f2bf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lgzj8\" (UID: \"34989fc7-d971-4b4a-9b00-aef1cb59f2bf\") " pod="openshift-multus/multus-additional-cni-plugins-lgzj8" Sep 07 12:34:34.411831 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.410316 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb990ca0-9dd8-4a6a-9aea-385184d47b70-host\") pod \"node-ca-xsqsc\" (UID: \"eb990ca0-9dd8-4a6a-9aea-385184d47b70\") " pod="openshift-image-registry/node-ca-xsqsc" Sep 07 12:34:34.411831 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.410362 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb990ca0-9dd8-4a6a-9aea-385184d47b70-host\") pod \"node-ca-xsqsc\" (UID: \"eb990ca0-9dd8-4a6a-9aea-385184d47b70\") " pod="openshift-image-registry/node-ca-xsqsc" Sep 07 12:34:34.411831 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.410368 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/54e55813-9848-4014-bbc1-41700bba7900-host-run-netns\") pod \"multus-xpkzx\" (UID: \"54e55813-9848-4014-bbc1-41700bba7900\") " pod="openshift-multus/multus-xpkzx" Sep 07 12:34:34.411831 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.410376 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/54e55813-9848-4014-bbc1-41700bba7900-cni-binary-copy\") pod \"multus-xpkzx\" (UID: \"54e55813-9848-4014-bbc1-41700bba7900\") " pod="openshift-multus/multus-xpkzx" Sep 07 12:34:34.411831 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.410406 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/54e55813-9848-4014-bbc1-41700bba7900-hostroot\") pod \"multus-xpkzx\" (UID: \"54e55813-9848-4014-bbc1-41700bba7900\") " pod="openshift-multus/multus-xpkzx" Sep 07 12:34:34.411831 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.410444 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/07c66148-19e3-41c1-91fe-c3591bb347e8-etc-kubernetes\") pod \"tuned-7hpvd\" (UID: \"07c66148-19e3-41c1-91fe-c3591bb347e8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hpvd" Sep 07 12:34:34.411831 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.410472 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/07c66148-19e3-41c1-91fe-c3591bb347e8-var-lib-kubelet\") pod \"tuned-7hpvd\" (UID: \"07c66148-19e3-41c1-91fe-c3591bb347e8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hpvd" Sep 07 12:34:34.411831 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.410537 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/07c66148-19e3-41c1-91fe-c3591bb347e8-var-lib-kubelet\") pod \"tuned-7hpvd\" (UID: \"07c66148-19e3-41c1-91fe-c3591bb347e8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hpvd" Sep 07 12:34:34.411831 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.410500 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/07c66148-19e3-41c1-91fe-c3591bb347e8-etc-sysctl-conf\") pod \"tuned-7hpvd\" (UID: \"07c66148-19e3-41c1-91fe-c3591bb347e8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hpvd" Sep 07 12:34:34.411831 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.410693 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4c11358c-536b-46d1-a3ad-1472e7f9ddd9-konnectivity-ca\") pod \"konnectivity-agent-cl7zg\" (UID: \"4c11358c-536b-46d1-a3ad-1472e7f9ddd9\") " pod="kube-system/konnectivity-agent-cl7zg" Sep 07 12:34:34.411831 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.411074 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/34989fc7-d971-4b4a-9b00-aef1cb59f2bf-cni-binary-copy\") pod \"multus-additional-cni-plugins-lgzj8\" (UID: \"34989fc7-d971-4b4a-9b00-aef1cb59f2bf\") " pod="openshift-multus/multus-additional-cni-plugins-lgzj8" Sep 07 12:34:34.411831 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.411528 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/07c66148-19e3-41c1-91fe-c3591bb347e8-etc-tuned\") pod \"tuned-7hpvd\" (UID: \"07c66148-19e3-41c1-91fe-c3591bb347e8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hpvd" Sep 07 12:34:34.412409 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.412310 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/07c66148-19e3-41c1-91fe-c3591bb347e8-tmp\") pod \"tuned-7hpvd\" (UID: \"07c66148-19e3-41c1-91fe-c3591bb347e8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hpvd" Sep 07 12:34:34.412868 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.412845 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4c11358c-536b-46d1-a3ad-1472e7f9ddd9-agent-certs\") pod \"konnectivity-agent-cl7zg\" (UID: \"4c11358c-536b-46d1-a3ad-1472e7f9ddd9\") " pod="kube-system/konnectivity-agent-cl7zg" Sep 07 12:34:34.423417 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.423383 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjskg\" (UniqueName: \"kubernetes.io/projected/a1abf056-5424-47f2-b0cc-9e4791a442e4-kube-api-access-xjskg\") pod \"node-resolver-ctd66\" (UID: \"a1abf056-5424-47f2-b0cc-9e4791a442e4\") " pod="openshift-dns/node-resolver-ctd66" Sep 07 12:34:34.425230 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.425205 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkc95\" (UniqueName: \"kubernetes.io/projected/34989fc7-d971-4b4a-9b00-aef1cb59f2bf-kube-api-access-dkc95\") pod \"multus-additional-cni-plugins-lgzj8\" (UID: \"34989fc7-d971-4b4a-9b00-aef1cb59f2bf\") " pod="openshift-multus/multus-additional-cni-plugins-lgzj8" Sep 07 12:34:34.425825 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.425796 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gt5r\" (UniqueName: \"kubernetes.io/projected/54e55813-9848-4014-bbc1-41700bba7900-kube-api-access-8gt5r\") pod \"multus-xpkzx\" (UID: \"54e55813-9848-4014-bbc1-41700bba7900\") " pod="openshift-multus/multus-xpkzx" Sep 07 12:34:34.426200 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.426174 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9r2sz\" (UniqueName: \"kubernetes.io/projected/2350fd1e-ae4b-48d4-9ef6-e45cb3f83129-kube-api-access-9r2sz\") pod \"network-metrics-daemon-lkvmb\" (UID: \"2350fd1e-ae4b-48d4-9ef6-e45cb3f83129\") " pod="openshift-multus/network-metrics-daemon-lkvmb" Sep 07 12:34:34.426469 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:34.426449 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 12:34:34.426541 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:34.426473 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 12:34:34.426541 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:34.426497 2584 projected.go:196] Error preparing data for projected volume kube-api-access-dlk72 for pod openshift-network-diagnostics/network-check-target-lclwd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 12:34:34.426658 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:34.426563 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7008051b-bbec-4967-b4ff-dc60f109a092-kube-api-access-dlk72 podName:7008051b-bbec-4967-b4ff-dc60f109a092 nodeName:}" failed. No retries permitted until 2026-09-07 12:34:34.926543504 +0000 UTC m=+3.076973222 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-dlk72" (UniqueName: "kubernetes.io/projected/7008051b-bbec-4967-b4ff-dc60f109a092-kube-api-access-dlk72") pod "network-check-target-lclwd" (UID: "7008051b-bbec-4967-b4ff-dc60f109a092") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 12:34:34.426996 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.426969 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqcwv\" (UniqueName: \"kubernetes.io/projected/5cf1801e-b694-49ad-9c7c-803229efc5f3-kube-api-access-wqcwv\") pod \"iptables-alerter-lj4gt\" (UID: \"5cf1801e-b694-49ad-9c7c-803229efc5f3\") " pod="openshift-network-operator/iptables-alerter-lj4gt" Sep 07 12:34:34.429604 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.429583 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttbbf\" (UniqueName: \"kubernetes.io/projected/07c66148-19e3-41c1-91fe-c3591bb347e8-kube-api-access-ttbbf\") pod \"tuned-7hpvd\" (UID: \"07c66148-19e3-41c1-91fe-c3591bb347e8\") " pod="openshift-cluster-node-tuning-operator/tuned-7hpvd" Sep 07 12:34:34.429728 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.429686 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7q56x\" (UniqueName: \"kubernetes.io/projected/eb990ca0-9dd8-4a6a-9aea-385184d47b70-kube-api-access-7q56x\") pod \"node-ca-xsqsc\" (UID: \"eb990ca0-9dd8-4a6a-9aea-385184d47b70\") " pod="openshift-image-registry/node-ca-xsqsc" Sep 07 12:34:34.506401 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.506351 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrv9f" Sep 07 12:34:34.510987 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.510964 2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 12:34:34.518139 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.518096 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:34:34.532155 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.532127 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lgzj8" Sep 07 12:34:34.536353 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.536329 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xsqsc" Sep 07 12:34:34.543588 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.543562 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7hpvd" Sep 07 12:34:34.551546 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.551522 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ctd66" Sep 07 12:34:34.559540 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.559514 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xpkzx" Sep 07 12:34:34.567444 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.567423 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lj4gt" Sep 07 12:34:34.573502 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.573481 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cl7zg" Sep 07 12:34:34.914884 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.914832 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4620ef7e-ba96-427e-ab48-a8aa3d7bc243-original-pull-secret\") pod \"global-pull-secret-syncer-b7nh4\" (UID: \"4620ef7e-ba96-427e-ab48-a8aa3d7bc243\") " pod="kube-system/global-pull-secret-syncer-b7nh4" Sep 07 12:34:34.915075 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:34.914941 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2350fd1e-ae4b-48d4-9ef6-e45cb3f83129-metrics-certs\") pod \"network-metrics-daemon-lkvmb\" (UID: \"2350fd1e-ae4b-48d4-9ef6-e45cb3f83129\") " pod="openshift-multus/network-metrics-daemon-lkvmb" Sep 07 12:34:34.915075 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:34.915022 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 12:34:34.915075 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:34.915065 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 12:34:34.915215 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:34.915106 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4620ef7e-ba96-427e-ab48-a8aa3d7bc243-original-pull-secret podName:4620ef7e-ba96-427e-ab48-a8aa3d7bc243 nodeName:}" failed. No retries permitted until 2026-09-07 12:34:35.915082898 +0000 UTC m=+4.065512616 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4620ef7e-ba96-427e-ab48-a8aa3d7bc243-original-pull-secret") pod "global-pull-secret-syncer-b7nh4" (UID: "4620ef7e-ba96-427e-ab48-a8aa3d7bc243") : object "kube-system"/"original-pull-secret" not registered Sep 07 12:34:34.915215 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:34.915132 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2350fd1e-ae4b-48d4-9ef6-e45cb3f83129-metrics-certs podName:2350fd1e-ae4b-48d4-9ef6-e45cb3f83129 nodeName:}" failed. No retries permitted until 2026-09-07 12:34:35.915119777 +0000 UTC m=+4.065549489 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2350fd1e-ae4b-48d4-9ef6-e45cb3f83129-metrics-certs") pod "network-metrics-daemon-lkvmb" (UID: "2350fd1e-ae4b-48d4-9ef6-e45cb3f83129") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 12:34:35.015530 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:35.015484 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlk72\" (UniqueName: \"kubernetes.io/projected/7008051b-bbec-4967-b4ff-dc60f109a092-kube-api-access-dlk72\") pod \"network-check-target-lclwd\" (UID: \"7008051b-bbec-4967-b4ff-dc60f109a092\") " pod="openshift-network-diagnostics/network-check-target-lclwd" Sep 07 12:34:35.015733 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:35.015714 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 12:34:35.015839 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:35.015742 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 12:34:35.015839 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:35.015758 2584 projected.go:196] Error preparing data for projected volume kube-api-access-dlk72 for pod openshift-network-diagnostics/network-check-target-lclwd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 12:34:35.015839 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:35.015819 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7008051b-bbec-4967-b4ff-dc60f109a092-kube-api-access-dlk72 podName:7008051b-bbec-4967-b4ff-dc60f109a092 nodeName:}" failed. No retries permitted until 2026-09-07 12:34:36.015801418 +0000 UTC m=+4.166231129 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-dlk72" (UniqueName: "kubernetes.io/projected/7008051b-bbec-4967-b4ff-dc60f109a092-kube-api-access-dlk72") pod "network-check-target-lclwd" (UID: "7008051b-bbec-4967-b4ff-dc60f109a092") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 12:34:35.269033 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:35.268831 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1abf056_5424_47f2_b0cc_9e4791a442e4.slice/crio-9d48424799d618cef87e9dd4ea98255e6a34d353c6db2425a30a8396a4a90c09 WatchSource:0}: Error finding container 9d48424799d618cef87e9dd4ea98255e6a34d353c6db2425a30a8396a4a90c09: Status 404 returned error can't find the container with id 9d48424799d618cef87e9dd4ea98255e6a34d353c6db2425a30a8396a4a90c09 Sep 07 12:34:35.280829 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:35.280787 2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-06 12:29:34 +0000 UTC" deadline="2028-02-25 10:41:06.131422914 +0000 UTC" Sep 07 12:34:35.280829 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:35.280825 2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12862h6m30.850601855s" Sep 07 12:34:35.292947 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:35.292899 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34989fc7_d971_4b4a_9b00_aef1cb59f2bf.slice/crio-b73bee04e6a046c1ea6b6c2c2942afaefae8f9ebbfa19990cb6ed60d262fa4ef WatchSource:0}: Error finding container b73bee04e6a046c1ea6b6c2c2942afaefae8f9ebbfa19990cb6ed60d262fa4ef: Status 404 returned error can't find the container with id b73bee04e6a046c1ea6b6c2c2942afaefae8f9ebbfa19990cb6ed60d262fa4ef Sep 07 12:34:35.296596 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:35.296460 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb93cc419_fdec_4e46_b3f4_61776f098e4d.slice/crio-16d5a04123907624493ae808b0cea06f907ee2df0b75c2c8c5b4b4018d0711ea WatchSource:0}: Error finding container 16d5a04123907624493ae808b0cea06f907ee2df0b75c2c8c5b4b4018d0711ea: Status 404 returned error can't find the container with id 16d5a04123907624493ae808b0cea06f907ee2df0b75c2c8c5b4b4018d0711ea Sep 07 12:34:35.300335 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:35.300300 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c11358c_536b_46d1_a3ad_1472e7f9ddd9.slice/crio-40872edf5720deec158bfbc4dbe4fd27499b5869894aa99021c2f4b0712cc685 WatchSource:0}: Error finding container 40872edf5720deec158bfbc4dbe4fd27499b5869894aa99021c2f4b0712cc685: Status 404 returned error can't find the container with id 40872edf5720deec158bfbc4dbe4fd27499b5869894aa99021c2f4b0712cc685 Sep 07 12:34:35.302517 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:35.302341 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07c66148_19e3_41c1_91fe_c3591bb347e8.slice/crio-8a84115eceeb122aa5421f65db21f41cb497333f81e6e72cdb30eec272f980b1 WatchSource:0}: Error finding container 8a84115eceeb122aa5421f65db21f41cb497333f81e6e72cdb30eec272f980b1: Status 404 returned error can't find the container with id 8a84115eceeb122aa5421f65db21f41cb497333f81e6e72cdb30eec272f980b1 Sep 07 12:34:35.303720 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:35.303652 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cf1801e_b694_49ad_9c7c_803229efc5f3.slice/crio-696a88322deecb2877815526e14199447658f5320b855c33ae03d136da910f75 WatchSource:0}: Error finding container 696a88322deecb2877815526e14199447658f5320b855c33ae03d136da910f75: Status 404 returned error can't find the container with id 696a88322deecb2877815526e14199447658f5320b855c33ae03d136da910f75 Sep 07 12:34:35.309328 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:34:35.309156 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb990ca0_9dd8_4a6a_9aea_385184d47b70.slice/crio-af6c9fa8c6d0338b91d655b0235b2d78bfc4a4f47b17ac93e42ffddc4984d0ac WatchSource:0}: Error finding container af6c9fa8c6d0338b91d655b0235b2d78bfc4a4f47b17ac93e42ffddc4984d0ac: Status 404 returned error can't find the container with id af6c9fa8c6d0338b91d655b0235b2d78bfc4a4f47b17ac93e42ffddc4984d0ac Sep 07 12:34:35.341646 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:35.341592 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xsqsc" event={"ID":"eb990ca0-9dd8-4a6a-9aea-385184d47b70","Type":"ContainerStarted","Data":"af6c9fa8c6d0338b91d655b0235b2d78bfc4a4f47b17ac93e42ffddc4984d0ac"} Sep 07 12:34:35.343141 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:35.343111 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lj4gt" event={"ID":"5cf1801e-b694-49ad-9c7c-803229efc5f3","Type":"ContainerStarted","Data":"696a88322deecb2877815526e14199447658f5320b855c33ae03d136da910f75"} Sep 07 12:34:35.344733 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:35.344702 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cl7zg" event={"ID":"4c11358c-536b-46d1-a3ad-1472e7f9ddd9","Type":"ContainerStarted","Data":"40872edf5720deec158bfbc4dbe4fd27499b5869894aa99021c2f4b0712cc685"} Sep 07 12:34:35.346142 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:35.346114 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lgzj8" event={"ID":"34989fc7-d971-4b4a-9b00-aef1cb59f2bf","Type":"ContainerStarted","Data":"b73bee04e6a046c1ea6b6c2c2942afaefae8f9ebbfa19990cb6ed60d262fa4ef"} Sep 07 12:34:35.347660 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:35.347613 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ctd66" event={"ID":"a1abf056-5424-47f2-b0cc-9e4791a442e4","Type":"ContainerStarted","Data":"9d48424799d618cef87e9dd4ea98255e6a34d353c6db2425a30a8396a4a90c09"} Sep 07 12:34:35.349061 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:35.349028 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xpkzx" event={"ID":"54e55813-9848-4014-bbc1-41700bba7900","Type":"ContainerStarted","Data":"d8db974f9925c17b976984f68bc36fe06077de51a8da6189de1d6a5bb0899e44"} Sep 07 12:34:35.350693 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:35.350666 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" event={"ID":"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3","Type":"ContainerStarted","Data":"60803002b0bb3b0d95439d0659bb0b36ae58ecac9f2ceaa3dac6f9a7f799fc74"} Sep 07 12:34:35.356402 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:35.356367 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrv9f" event={"ID":"b93cc419-fdec-4e46-b3f4-61776f098e4d","Type":"ContainerStarted","Data":"16d5a04123907624493ae808b0cea06f907ee2df0b75c2c8c5b4b4018d0711ea"} Sep 07 12:34:35.357823 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:35.357799 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7hpvd" event={"ID":"07c66148-19e3-41c1-91fe-c3591bb347e8","Type":"ContainerStarted","Data":"8a84115eceeb122aa5421f65db21f41cb497333f81e6e72cdb30eec272f980b1"} Sep 07 12:34:35.923234 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:35.922156 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2350fd1e-ae4b-48d4-9ef6-e45cb3f83129-metrics-certs\") pod \"network-metrics-daemon-lkvmb\" (UID: \"2350fd1e-ae4b-48d4-9ef6-e45cb3f83129\") " pod="openshift-multus/network-metrics-daemon-lkvmb" Sep 07 12:34:35.923234 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:35.922223 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4620ef7e-ba96-427e-ab48-a8aa3d7bc243-original-pull-secret\") pod \"global-pull-secret-syncer-b7nh4\" (UID: \"4620ef7e-ba96-427e-ab48-a8aa3d7bc243\") " pod="kube-system/global-pull-secret-syncer-b7nh4" Sep 07 12:34:35.923234 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:35.922381 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 12:34:35.923234 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:35.922452 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4620ef7e-ba96-427e-ab48-a8aa3d7bc243-original-pull-secret podName:4620ef7e-ba96-427e-ab48-a8aa3d7bc243 nodeName:}" failed. No retries permitted until 2026-09-07 12:34:37.922431759 +0000 UTC m=+6.072861464 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4620ef7e-ba96-427e-ab48-a8aa3d7bc243-original-pull-secret") pod "global-pull-secret-syncer-b7nh4" (UID: "4620ef7e-ba96-427e-ab48-a8aa3d7bc243") : object "kube-system"/"original-pull-secret" not registered Sep 07 12:34:35.923234 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:35.923152 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 12:34:35.923234 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:35.923196 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2350fd1e-ae4b-48d4-9ef6-e45cb3f83129-metrics-certs podName:2350fd1e-ae4b-48d4-9ef6-e45cb3f83129 nodeName:}" failed. No retries permitted until 2026-09-07 12:34:37.923183868 +0000 UTC m=+6.073613564 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2350fd1e-ae4b-48d4-9ef6-e45cb3f83129-metrics-certs") pod "network-metrics-daemon-lkvmb" (UID: "2350fd1e-ae4b-48d4-9ef6-e45cb3f83129") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 12:34:36.023366 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:36.022893 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlk72\" (UniqueName: \"kubernetes.io/projected/7008051b-bbec-4967-b4ff-dc60f109a092-kube-api-access-dlk72\") pod \"network-check-target-lclwd\" (UID: \"7008051b-bbec-4967-b4ff-dc60f109a092\") " pod="openshift-network-diagnostics/network-check-target-lclwd" Sep 07 12:34:36.023366 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:36.023082 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 12:34:36.023366 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:36.023108 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 12:34:36.023366 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:36.023122 2584 projected.go:196] Error preparing data for projected volume kube-api-access-dlk72 for pod openshift-network-diagnostics/network-check-target-lclwd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 12:34:36.023366 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:36.023186 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7008051b-bbec-4967-b4ff-dc60f109a092-kube-api-access-dlk72 podName:7008051b-bbec-4967-b4ff-dc60f109a092 nodeName:}" failed. No retries permitted until 2026-09-07 12:34:38.023167453 +0000 UTC m=+6.173597159 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-dlk72" (UniqueName: "kubernetes.io/projected/7008051b-bbec-4967-b4ff-dc60f109a092-kube-api-access-dlk72") pod "network-check-target-lclwd" (UID: "7008051b-bbec-4967-b4ff-dc60f109a092") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 12:34:36.281879 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:36.281756 2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-06 12:29:34 +0000 UTC" deadline="2028-02-05 19:33:20.151707854 +0000 UTC" Sep 07 12:34:36.281879 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:36.281822 2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12390h58m43.869889315s" Sep 07 12:34:36.333977 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:36.333944 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7nh4" Sep 07 12:34:36.334174 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:36.334084 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7nh4" podUID="4620ef7e-ba96-427e-ab48-a8aa3d7bc243" Sep 07 12:34:36.334551 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:36.334526 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lclwd" Sep 07 12:34:36.334704 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:36.334628 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lclwd" podUID="7008051b-bbec-4967-b4ff-dc60f109a092" Sep 07 12:34:36.335472 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:36.335412 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lkvmb" Sep 07 12:34:36.335589 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:36.335517 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lkvmb" podUID="2350fd1e-ae4b-48d4-9ef6-e45cb3f83129" Sep 07 12:34:36.367963 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:36.367923 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-7.ec2.internal" event={"ID":"abdd9ed4ef1ebcac8d95bd841ee6df0e","Type":"ContainerStarted","Data":"2a3f4b29b98b88fe226f77dcb319c4a80f2ebc70a3536e760311e31c4c2519cd"} Sep 07 12:34:36.386588 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:36.386509 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-7.ec2.internal" podStartSLOduration=3.38648191 podStartE2EDuration="3.38648191s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:34:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:34:36.385486115 +0000 UTC m=+4.535915860" watchObservedRunningTime="2026-09-07 12:34:36.38648191 +0000 UTC m=+4.536911633" Sep 07 12:34:37.383883 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:37.382510 2584 generic.go:356] "Generic (PLEG): container finished" podID="6271a59ad6d0df0c8b736d4338d59778" containerID="74f7f771bf61e755f67428030d9d45faecd6c53dfa8e850377b2d2265c01d45e" exitCode=0 Sep 07 12:34:37.383883 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:37.383543 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-7.ec2.internal" event={"ID":"6271a59ad6d0df0c8b736d4338d59778","Type":"ContainerDied","Data":"74f7f771bf61e755f67428030d9d45faecd6c53dfa8e850377b2d2265c01d45e"} Sep 07 12:34:37.939633 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:37.939536 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2350fd1e-ae4b-48d4-9ef6-e45cb3f83129-metrics-certs\") pod \"network-metrics-daemon-lkvmb\" (UID: \"2350fd1e-ae4b-48d4-9ef6-e45cb3f83129\") " pod="openshift-multus/network-metrics-daemon-lkvmb" Sep 07 12:34:37.939633 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:37.939606 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4620ef7e-ba96-427e-ab48-a8aa3d7bc243-original-pull-secret\") pod \"global-pull-secret-syncer-b7nh4\" (UID: \"4620ef7e-ba96-427e-ab48-a8aa3d7bc243\") " pod="kube-system/global-pull-secret-syncer-b7nh4" Sep 07 12:34:37.939894 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:37.939791 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 12:34:37.939894 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:37.939863 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4620ef7e-ba96-427e-ab48-a8aa3d7bc243-original-pull-secret podName:4620ef7e-ba96-427e-ab48-a8aa3d7bc243 nodeName:}" failed. No retries permitted until 2026-09-07 12:34:41.939842898 +0000 UTC m=+10.090272619 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4620ef7e-ba96-427e-ab48-a8aa3d7bc243-original-pull-secret") pod "global-pull-secret-syncer-b7nh4" (UID: "4620ef7e-ba96-427e-ab48-a8aa3d7bc243") : object "kube-system"/"original-pull-secret" not registered Sep 07 12:34:37.940029 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:37.939936 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 12:34:37.940029 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:37.940014 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2350fd1e-ae4b-48d4-9ef6-e45cb3f83129-metrics-certs podName:2350fd1e-ae4b-48d4-9ef6-e45cb3f83129 nodeName:}" failed. No retries permitted until 2026-09-07 12:34:41.940002286 +0000 UTC m=+10.090431998 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2350fd1e-ae4b-48d4-9ef6-e45cb3f83129-metrics-certs") pod "network-metrics-daemon-lkvmb" (UID: "2350fd1e-ae4b-48d4-9ef6-e45cb3f83129") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 12:34:38.040211 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:38.040165 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlk72\" (UniqueName: \"kubernetes.io/projected/7008051b-bbec-4967-b4ff-dc60f109a092-kube-api-access-dlk72\") pod \"network-check-target-lclwd\" (UID: \"7008051b-bbec-4967-b4ff-dc60f109a092\") " pod="openshift-network-diagnostics/network-check-target-lclwd" Sep 07 12:34:38.040430 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:38.040378 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 12:34:38.040430 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:38.040403 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 12:34:38.040430 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:38.040417 2584 projected.go:196] Error preparing data for projected volume kube-api-access-dlk72 for pod openshift-network-diagnostics/network-check-target-lclwd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 12:34:38.040614 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:38.040480 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7008051b-bbec-4967-b4ff-dc60f109a092-kube-api-access-dlk72 podName:7008051b-bbec-4967-b4ff-dc60f109a092 nodeName:}" failed. No retries permitted until 2026-09-07 12:34:42.040461353 +0000 UTC m=+10.190891054 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-dlk72" (UniqueName: "kubernetes.io/projected/7008051b-bbec-4967-b4ff-dc60f109a092-kube-api-access-dlk72") pod "network-check-target-lclwd" (UID: "7008051b-bbec-4967-b4ff-dc60f109a092") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 12:34:38.332689 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:38.332592 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lkvmb" Sep 07 12:34:38.332860 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:38.332778 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lkvmb" podUID="2350fd1e-ae4b-48d4-9ef6-e45cb3f83129" Sep 07 12:34:38.332920 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:38.332859 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7nh4" Sep 07 12:34:38.332974 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:38.332941 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7nh4" podUID="4620ef7e-ba96-427e-ab48-a8aa3d7bc243" Sep 07 12:34:38.333027 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:38.332985 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lclwd" Sep 07 12:34:38.336515 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:38.333079 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lclwd" podUID="7008051b-bbec-4967-b4ff-dc60f109a092" Sep 07 12:34:38.389397 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:38.389355 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-7.ec2.internal" event={"ID":"6271a59ad6d0df0c8b736d4338d59778","Type":"ContainerStarted","Data":"e88759f921f7686b1e5608345eb6ff4bccbc55a542f0452340a1087e02fa450d"} Sep 07 12:34:38.408078 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:38.408014 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-7.ec2.internal" podStartSLOduration=5.407992117 podStartE2EDuration="5.407992117s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:34:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:34:38.407170884 +0000 UTC m=+6.557600604" watchObservedRunningTime="2026-09-07 12:34:38.407992117 +0000 UTC m=+6.558421837" Sep 07 12:34:40.332153 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:40.332115 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lkvmb" Sep 07 12:34:40.332643 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:40.332267 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lkvmb" podUID="2350fd1e-ae4b-48d4-9ef6-e45cb3f83129" Sep 07 12:34:40.332743 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:40.332724 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7nh4" Sep 07 12:34:40.332811 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:40.332749 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lclwd" Sep 07 12:34:40.332865 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:40.332827 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7nh4" podUID="4620ef7e-ba96-427e-ab48-a8aa3d7bc243" Sep 07 12:34:40.332923 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:40.332905 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lclwd" podUID="7008051b-bbec-4967-b4ff-dc60f109a092" Sep 07 12:34:41.976639 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:41.976587 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2350fd1e-ae4b-48d4-9ef6-e45cb3f83129-metrics-certs\") pod \"network-metrics-daemon-lkvmb\" (UID: \"2350fd1e-ae4b-48d4-9ef6-e45cb3f83129\") " pod="openshift-multus/network-metrics-daemon-lkvmb" Sep 07 12:34:41.977150 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:41.976671 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4620ef7e-ba96-427e-ab48-a8aa3d7bc243-original-pull-secret\") pod \"global-pull-secret-syncer-b7nh4\" (UID: \"4620ef7e-ba96-427e-ab48-a8aa3d7bc243\") " pod="kube-system/global-pull-secret-syncer-b7nh4" Sep 07 12:34:41.977150 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:41.976823 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 12:34:41.977150 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:41.976891 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4620ef7e-ba96-427e-ab48-a8aa3d7bc243-original-pull-secret podName:4620ef7e-ba96-427e-ab48-a8aa3d7bc243 nodeName:}" failed. No retries permitted until 2026-09-07 12:34:49.976870956 +0000 UTC m=+18.127300651 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4620ef7e-ba96-427e-ab48-a8aa3d7bc243-original-pull-secret") pod "global-pull-secret-syncer-b7nh4" (UID: "4620ef7e-ba96-427e-ab48-a8aa3d7bc243") : object "kube-system"/"original-pull-secret" not registered Sep 07 12:34:41.977310 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:41.977217 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 12:34:41.977310 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:41.977260 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2350fd1e-ae4b-48d4-9ef6-e45cb3f83129-metrics-certs podName:2350fd1e-ae4b-48d4-9ef6-e45cb3f83129 nodeName:}" failed. No retries permitted until 2026-09-07 12:34:49.977247 +0000 UTC m=+18.127676697 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2350fd1e-ae4b-48d4-9ef6-e45cb3f83129-metrics-certs") pod "network-metrics-daemon-lkvmb" (UID: "2350fd1e-ae4b-48d4-9ef6-e45cb3f83129") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 12:34:42.077956 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:42.077908 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlk72\" (UniqueName: \"kubernetes.io/projected/7008051b-bbec-4967-b4ff-dc60f109a092-kube-api-access-dlk72\") pod \"network-check-target-lclwd\" (UID: \"7008051b-bbec-4967-b4ff-dc60f109a092\") " pod="openshift-network-diagnostics/network-check-target-lclwd" Sep 07 12:34:42.078121 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:42.078089 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 12:34:42.078121 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:42.078109 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 12:34:42.078200 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:42.078124 2584 projected.go:196] Error preparing data for projected volume kube-api-access-dlk72 for pod openshift-network-diagnostics/network-check-target-lclwd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 12:34:42.078200 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:42.078172 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7008051b-bbec-4967-b4ff-dc60f109a092-kube-api-access-dlk72 podName:7008051b-bbec-4967-b4ff-dc60f109a092 nodeName:}" failed. No retries permitted until 2026-09-07 12:34:50.078157741 +0000 UTC m=+18.228587434 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-dlk72" (UniqueName: "kubernetes.io/projected/7008051b-bbec-4967-b4ff-dc60f109a092-kube-api-access-dlk72") pod "network-check-target-lclwd" (UID: "7008051b-bbec-4967-b4ff-dc60f109a092") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 12:34:42.333641 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:42.333536 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7nh4" Sep 07 12:34:42.333798 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:42.333671 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7nh4" podUID="4620ef7e-ba96-427e-ab48-a8aa3d7bc243" Sep 07 12:34:42.334059 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:42.334035 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lclwd" Sep 07 12:34:42.334186 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:42.334129 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lclwd" podUID="7008051b-bbec-4967-b4ff-dc60f109a092" Sep 07 12:34:42.334248 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:42.334188 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lkvmb" Sep 07 12:34:42.334296 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:42.334274 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lkvmb" podUID="2350fd1e-ae4b-48d4-9ef6-e45cb3f83129" Sep 07 12:34:44.336271 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:44.336244 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7nh4" Sep 07 12:34:44.336805 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:44.336292 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lkvmb" Sep 07 12:34:44.336805 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:44.336292 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lclwd" Sep 07 12:34:44.336805 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:44.336364 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7nh4" podUID="4620ef7e-ba96-427e-ab48-a8aa3d7bc243" Sep 07 12:34:44.336805 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:44.336469 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lclwd" podUID="7008051b-bbec-4967-b4ff-dc60f109a092" Sep 07 12:34:44.336805 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:44.336575 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lkvmb" podUID="2350fd1e-ae4b-48d4-9ef6-e45cb3f83129" Sep 07 12:34:46.335526 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:46.335490 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lkvmb" Sep 07 12:34:46.335992 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:46.335634 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lkvmb" podUID="2350fd1e-ae4b-48d4-9ef6-e45cb3f83129" Sep 07 12:34:46.336056 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:46.336007 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7nh4" Sep 07 12:34:46.336110 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:46.336093 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7nh4" podUID="4620ef7e-ba96-427e-ab48-a8aa3d7bc243" Sep 07 12:34:46.336164 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:46.336140 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lclwd" Sep 07 12:34:46.336218 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:46.336201 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lclwd" podUID="7008051b-bbec-4967-b4ff-dc60f109a092" Sep 07 12:34:48.333179 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:48.332973 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7nh4" Sep 07 12:34:48.333666 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:48.333265 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7nh4" podUID="4620ef7e-ba96-427e-ab48-a8aa3d7bc243" Sep 07 12:34:48.333666 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:48.333011 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lkvmb" Sep 07 12:34:48.333666 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:48.333352 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lkvmb" podUID="2350fd1e-ae4b-48d4-9ef6-e45cb3f83129" Sep 07 12:34:48.333666 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:48.332973 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lclwd" Sep 07 12:34:48.333666 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:48.333420 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lclwd" podUID="7008051b-bbec-4967-b4ff-dc60f109a092" Sep 07 12:34:50.039506 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:50.039466 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2350fd1e-ae4b-48d4-9ef6-e45cb3f83129-metrics-certs\") pod \"network-metrics-daemon-lkvmb\" (UID: \"2350fd1e-ae4b-48d4-9ef6-e45cb3f83129\") " pod="openshift-multus/network-metrics-daemon-lkvmb" Sep 07 12:34:50.039506 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:50.039514 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4620ef7e-ba96-427e-ab48-a8aa3d7bc243-original-pull-secret\") pod \"global-pull-secret-syncer-b7nh4\" (UID: \"4620ef7e-ba96-427e-ab48-a8aa3d7bc243\") " pod="kube-system/global-pull-secret-syncer-b7nh4" Sep 07 12:34:50.040015 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:50.039607 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 12:34:50.040015 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:50.039641 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 12:34:50.040015 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:50.039680 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4620ef7e-ba96-427e-ab48-a8aa3d7bc243-original-pull-secret podName:4620ef7e-ba96-427e-ab48-a8aa3d7bc243 nodeName:}" failed. No retries permitted until 2026-09-07 12:35:06.039665652 +0000 UTC m=+34.190095345 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4620ef7e-ba96-427e-ab48-a8aa3d7bc243-original-pull-secret") pod "global-pull-secret-syncer-b7nh4" (UID: "4620ef7e-ba96-427e-ab48-a8aa3d7bc243") : object "kube-system"/"original-pull-secret" not registered Sep 07 12:34:50.040015 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:50.039709 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2350fd1e-ae4b-48d4-9ef6-e45cb3f83129-metrics-certs podName:2350fd1e-ae4b-48d4-9ef6-e45cb3f83129 nodeName:}" failed. No retries permitted until 2026-09-07 12:35:06.039687584 +0000 UTC m=+34.190117281 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2350fd1e-ae4b-48d4-9ef6-e45cb3f83129-metrics-certs") pod "network-metrics-daemon-lkvmb" (UID: "2350fd1e-ae4b-48d4-9ef6-e45cb3f83129") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 12:34:50.139978 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:50.139932 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlk72\" (UniqueName: \"kubernetes.io/projected/7008051b-bbec-4967-b4ff-dc60f109a092-kube-api-access-dlk72\") pod \"network-check-target-lclwd\" (UID: \"7008051b-bbec-4967-b4ff-dc60f109a092\") " pod="openshift-network-diagnostics/network-check-target-lclwd" Sep 07 12:34:50.140148 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:50.140093 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 12:34:50.140148 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:50.140116 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 12:34:50.140148 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:50.140126 2584 projected.go:196] Error preparing data for projected volume kube-api-access-dlk72 for pod openshift-network-diagnostics/network-check-target-lclwd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 12:34:50.140261 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:50.140176 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7008051b-bbec-4967-b4ff-dc60f109a092-kube-api-access-dlk72 podName:7008051b-bbec-4967-b4ff-dc60f109a092 nodeName:}" failed. No retries permitted until 2026-09-07 12:35:06.140163715 +0000 UTC m=+34.290593409 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-dlk72" (UniqueName: "kubernetes.io/projected/7008051b-bbec-4967-b4ff-dc60f109a092-kube-api-access-dlk72") pod "network-check-target-lclwd" (UID: "7008051b-bbec-4967-b4ff-dc60f109a092") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 12:34:50.335663 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:50.335535 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lkvmb" Sep 07 12:34:50.335663 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:50.335574 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lclwd" Sep 07 12:34:50.335663 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:50.335577 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7nh4" Sep 07 12:34:50.335942 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:50.335679 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lkvmb" podUID="2350fd1e-ae4b-48d4-9ef6-e45cb3f83129" Sep 07 12:34:50.335942 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:50.335808 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7nh4" podUID="4620ef7e-ba96-427e-ab48-a8aa3d7bc243" Sep 07 12:34:50.335942 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:50.335883 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lclwd" podUID="7008051b-bbec-4967-b4ff-dc60f109a092" Sep 07 12:34:52.333462 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:52.333422 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lkvmb" Sep 07 12:34:52.333959 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:52.333525 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lclwd" Sep 07 12:34:52.333959 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:52.333540 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lkvmb" podUID="2350fd1e-ae4b-48d4-9ef6-e45cb3f83129" Sep 07 12:34:52.333959 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:52.333565 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7nh4" Sep 07 12:34:52.333959 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:52.333672 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lclwd" podUID="7008051b-bbec-4967-b4ff-dc60f109a092" Sep 07 12:34:52.333959 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:52.333756 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7nh4" podUID="4620ef7e-ba96-427e-ab48-a8aa3d7bc243" Sep 07 12:34:54.333679 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:54.333386 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7nh4" Sep 07 12:34:54.334241 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:54.333755 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7nh4" podUID="4620ef7e-ba96-427e-ab48-a8aa3d7bc243" Sep 07 12:34:54.334241 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:54.333481 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lkvmb" Sep 07 12:34:54.334241 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:54.333859 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lkvmb" podUID="2350fd1e-ae4b-48d4-9ef6-e45cb3f83129" Sep 07 12:34:54.334241 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:54.333460 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lclwd" Sep 07 12:34:54.334241 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:54.333936 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lclwd" podUID="7008051b-bbec-4967-b4ff-dc60f109a092" Sep 07 12:34:54.425232 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:54.425199 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7hpvd" event={"ID":"07c66148-19e3-41c1-91fe-c3591bb347e8","Type":"ContainerStarted","Data":"802a2637fb55bfd2efa51d6356f41eb912f40b56de7e9afe1fd26b5910158757"} Sep 07 12:34:54.426868 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:54.426836 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xsqsc" event={"ID":"eb990ca0-9dd8-4a6a-9aea-385184d47b70","Type":"ContainerStarted","Data":"866a577b08dd0ab2661e214c35d90f74e6aa1532ff41bb3bfd9aa016a9806f37"} Sep 07 12:34:54.428399 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:54.428378 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cl7zg" event={"ID":"4c11358c-536b-46d1-a3ad-1472e7f9ddd9","Type":"ContainerStarted","Data":"bf5a2b297dd1ef044bc88fbd1b397648f1caca4a900e5888ab69d49f0eed88f3"} Sep 07 12:34:54.430149 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:54.430123 2584 generic.go:356] "Generic (PLEG): container finished" podID="34989fc7-d971-4b4a-9b00-aef1cb59f2bf" containerID="90b5bd9ef1394476c6acebe4756a85f9c26c88918650132055ef4fa2f4cb41eb" exitCode=0 Sep 07 12:34:54.430262 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:54.430201 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lgzj8" event={"ID":"34989fc7-d971-4b4a-9b00-aef1cb59f2bf","Type":"ContainerDied","Data":"90b5bd9ef1394476c6acebe4756a85f9c26c88918650132055ef4fa2f4cb41eb"} Sep 07 12:34:54.431994 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:54.431895 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ctd66" event={"ID":"a1abf056-5424-47f2-b0cc-9e4791a442e4","Type":"ContainerStarted","Data":"26da7470c149fd5fa9a7eb1247b22a9f6a8b0fda6983fd80d221b7dc69e2712e"} Sep 07 12:34:54.433563 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:54.433512 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xpkzx" event={"ID":"54e55813-9848-4014-bbc1-41700bba7900","Type":"ContainerStarted","Data":"1462a4b5e3ad55443712fabb028769b080cf366fe04e1c41f6f0ba20cab31356"} Sep 07 12:34:54.435907 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:54.435887 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" event={"ID":"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3","Type":"ContainerStarted","Data":"3f841d7d35fc6ea55784db28589f166286757874bf369f82e326a9b9f50551a3"} Sep 07 12:34:54.436008 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:54.435958 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" event={"ID":"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3","Type":"ContainerStarted","Data":"4f0eb5855c36290a9de38ba649e5c65e88903c83a837cb25320e737769519bdd"} Sep 07 12:34:54.436068 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:54.436009 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" event={"ID":"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3","Type":"ContainerStarted","Data":"dacfb6d24bfdfde2913fdde920bd4b4b519409d30e171c3239b34ef89471ec78"} Sep 07 12:34:54.436068 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:54.436057 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" event={"ID":"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3","Type":"ContainerStarted","Data":"68ee5dc42fe4bd66fb8db09f623f025b25c0d3d028763e7e004d04f31945195c"} Sep 07 12:34:54.437436 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:54.437414 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrv9f" event={"ID":"b93cc419-fdec-4e46-b3f4-61776f098e4d","Type":"ContainerStarted","Data":"115960ca59bfc0cb8cb3f76c1a2593d3cfe923da210e17bf6cc4bb457e9d78cf"} Sep 07 12:34:54.443553 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:54.443514 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7hpvd" podStartSLOduration=3.752771008 podStartE2EDuration="22.443501766s" totalImagesPullingTime="18.690730758s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:34:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:34:54.443236507 +0000 UTC m=+22.593666219" watchObservedRunningTime="2026-09-07 12:34:54.443501766 +0000 UTC m=+22.593931481" Sep 07 12:34:54.458959 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:54.458918 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-xpkzx" podStartSLOduration=3.744676064 podStartE2EDuration="22.458903216s" totalImagesPullingTime="18.714227152s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:34:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:34:54.458609602 +0000 UTC m=+22.609039352" watchObservedRunningTime="2026-09-07 12:34:54.458903216 +0000 UTC m=+22.609332931" Sep 07 12:34:54.472607 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:54.472566 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xsqsc" podStartSLOduration=3.818665943 podStartE2EDuration="22.472550631s" totalImagesPullingTime="18.653884688s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:34:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:34:54.472423982 +0000 UTC m=+22.622853717" watchObservedRunningTime="2026-09-07 12:34:54.472550631 +0000 UTC m=+22.622980347" Sep 07 12:34:54.487229 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:54.487181 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-cl7zg" podStartSLOduration=10.113649809 podStartE2EDuration="21.487166403s" totalImagesPullingTime="11.373516594s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:34:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:34:54.486699152 +0000 UTC m=+22.637128890" watchObservedRunningTime="2026-09-07 12:34:54.487166403 +0000 UTC m=+22.637596119" Sep 07 12:34:54.548659 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:54.548582 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-ctd66" podStartSLOduration=3.871887122 podStartE2EDuration="22.548563739s" totalImagesPullingTime="18.676676617s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:34:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:34:54.548012137 +0000 UTC m=+22.698441852" watchObservedRunningTime="2026-09-07 12:34:54.548563739 +0000 UTC m=+22.698993448" Sep 07 12:34:55.013213 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:55.013174 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-cl7zg" Sep 07 12:34:55.014123 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:55.014094 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-cl7zg" Sep 07 12:34:55.409553 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:55.409529 2584 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 07 12:34:55.443563 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:55.443526 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" event={"ID":"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3","Type":"ContainerStarted","Data":"2e07d37c0643557a6ae9e3c5e80fe8e07ec45a8939400d1026bc1b2d65c29b2b"} Sep 07 12:34:55.443773 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:55.443610 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" event={"ID":"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3","Type":"ContainerStarted","Data":"93fb94c244245270e50a03f39986214f5c83f4ff0e44a99760cf23e2a6e09a06"} Sep 07 12:34:55.445689 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:55.445660 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrv9f" event={"ID":"b93cc419-fdec-4e46-b3f4-61776f098e4d","Type":"ContainerStarted","Data":"cc0da9963a7e175499061f00da59395b22e2a224c85774169839ad93eda518aa"} Sep 07 12:34:55.447304 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:55.447259 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lj4gt" event={"ID":"5cf1801e-b694-49ad-9c7c-803229efc5f3","Type":"ContainerStarted","Data":"696bdfb5d982fd71ce13e25fb7fe59ac79dfc0eb4e2ebdbcbf2c4548583034fb"} Sep 07 12:34:55.448448 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:55.448042 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-cl7zg" Sep 07 12:34:55.448448 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:55.448416 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-cl7zg" Sep 07 12:34:55.463249 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:55.463189 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-lj4gt" podStartSLOduration=3.802279612 podStartE2EDuration="22.463169716s" totalImagesPullingTime="18.660890104s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:34:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:34:55.462883146 +0000 UTC m=+23.613312881" watchObservedRunningTime="2026-09-07 12:34:55.463169716 +0000 UTC m=+23.613599433" Sep 07 12:34:56.275672 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:56.275336 2584 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-07T12:34:55.409548179Z","UUID":"ec73ff4a-3d06-4119-8346-399e4f52e0f0","Handler":null,"Name":"","Endpoint":""} Sep 07 12:34:56.277136 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:56.277114 2584 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 07 12:34:56.277273 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:56.277152 2584 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 07 12:34:56.333808 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:56.333775 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7nh4" Sep 07 12:34:56.333987 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:56.333852 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lkvmb" Sep 07 12:34:56.333987 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:56.333861 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lclwd" Sep 07 12:34:56.334075 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:56.333976 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lkvmb" podUID="2350fd1e-ae4b-48d4-9ef6-e45cb3f83129" Sep 07 12:34:56.334212 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:56.334187 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7nh4" podUID="4620ef7e-ba96-427e-ab48-a8aa3d7bc243" Sep 07 12:34:56.334305 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:56.334282 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lclwd" podUID="7008051b-bbec-4967-b4ff-dc60f109a092" Sep 07 12:34:57.459540 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:57.459487 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" event={"ID":"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3","Type":"ContainerStarted","Data":"f79cb52825031c1cf5ee0015f6d90420066c1598e4785686e36f98958cc9016d"} Sep 07 12:34:57.462599 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:57.462559 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrv9f" event={"ID":"b93cc419-fdec-4e46-b3f4-61776f098e4d","Type":"ContainerStarted","Data":"28d82307032cc8a02831df81265cad2ac5e6de6872dff8e097be9f0a9511125c"} Sep 07 12:34:57.482103 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:57.482044 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nrv9f" podStartSLOduration=4.680111174 podStartE2EDuration="25.482028986s" totalImagesPullingTime="20.801917812s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:34:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:34:57.481647779 +0000 UTC m=+25.632077519" watchObservedRunningTime="2026-09-07 12:34:57.482028986 +0000 UTC m=+25.632458702" Sep 07 12:34:58.332784 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:58.332740 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lkvmb" Sep 07 12:34:58.333023 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:58.332816 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7nh4" Sep 07 12:34:58.333023 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:58.332782 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lclwd" Sep 07 12:34:58.333023 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:58.332928 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lkvmb" podUID="2350fd1e-ae4b-48d4-9ef6-e45cb3f83129" Sep 07 12:34:58.333023 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:58.332978 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lclwd" podUID="7008051b-bbec-4967-b4ff-dc60f109a092" Sep 07 12:34:58.333190 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:34:58.333071 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7nh4" podUID="4620ef7e-ba96-427e-ab48-a8aa3d7bc243" Sep 07 12:34:59.469218 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:59.469041 2584 generic.go:356] "Generic (PLEG): container finished" podID="34989fc7-d971-4b4a-9b00-aef1cb59f2bf" containerID="0157ace2964147e9a3e3d7ad46b62d9aa7f5d8371e74bfc067951e2961392218" exitCode=0 Sep 07 12:34:59.469689 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:59.469128 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lgzj8" event={"ID":"34989fc7-d971-4b4a-9b00-aef1cb59f2bf","Type":"ContainerDied","Data":"0157ace2964147e9a3e3d7ad46b62d9aa7f5d8371e74bfc067951e2961392218"} Sep 07 12:34:59.473443 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:59.473412 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" event={"ID":"a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3","Type":"ContainerStarted","Data":"e9d9372bc8a742ee01bed4c16adcf3084ebf1996f7ee32d038fd70162ab64f27"} Sep 07 12:34:59.473713 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:59.473691 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:34:59.490298 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:59.490264 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:34:59.520719 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:34:59.520667 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" podStartSLOduration=8.808260834 podStartE2EDuration="27.520650125s" totalImagesPullingTime="18.712389291s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:34:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:34:59.520018201 +0000 UTC m=+27.670447930" watchObservedRunningTime="2026-09-07 12:34:59.520650125 +0000 UTC m=+27.671079841" Sep 07 12:35:00.332399 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:00.332365 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lclwd" Sep 07 12:35:00.332640 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:00.332367 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7nh4" Sep 07 12:35:00.332640 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:35:00.332469 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lclwd" podUID="7008051b-bbec-4967-b4ff-dc60f109a092" Sep 07 12:35:00.332640 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:00.332373 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lkvmb" Sep 07 12:35:00.332640 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:35:00.332565 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7nh4" podUID="4620ef7e-ba96-427e-ab48-a8aa3d7bc243" Sep 07 12:35:00.332785 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:35:00.332685 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lkvmb" podUID="2350fd1e-ae4b-48d4-9ef6-e45cb3f83129" Sep 07 12:35:00.479641 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:00.479587 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lgzj8" event={"ID":"34989fc7-d971-4b4a-9b00-aef1cb59f2bf","Type":"ContainerStarted","Data":"13f8c322b10d024213856a60a34db0012b053e3a669e245c67d21502ed794f31"} Sep 07 12:35:00.480344 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:00.480228 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:35:00.480344 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:00.480303 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:35:00.500124 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:00.500102 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:35:00.719135 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:00.719105 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lkvmb"] Sep 07 12:35:00.719309 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:00.719242 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lkvmb" Sep 07 12:35:00.719386 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:35:00.719361 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lkvmb" podUID="2350fd1e-ae4b-48d4-9ef6-e45cb3f83129" Sep 07 12:35:00.722956 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:00.722902 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-b7nh4"] Sep 07 12:35:00.723098 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:00.722966 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lclwd"] Sep 07 12:35:00.723098 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:00.723035 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lclwd" Sep 07 12:35:00.723212 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:35:00.723132 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lclwd" podUID="7008051b-bbec-4967-b4ff-dc60f109a092" Sep 07 12:35:00.723212 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:00.723187 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7nh4" Sep 07 12:35:00.723327 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:35:00.723264 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7nh4" podUID="4620ef7e-ba96-427e-ab48-a8aa3d7bc243" Sep 07 12:35:01.484084 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:01.484049 2584 generic.go:356] "Generic (PLEG): container finished" podID="34989fc7-d971-4b4a-9b00-aef1cb59f2bf" containerID="13f8c322b10d024213856a60a34db0012b053e3a669e245c67d21502ed794f31" exitCode=0 Sep 07 12:35:01.484661 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:01.484132 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lgzj8" event={"ID":"34989fc7-d971-4b4a-9b00-aef1cb59f2bf","Type":"ContainerDied","Data":"13f8c322b10d024213856a60a34db0012b053e3a669e245c67d21502ed794f31"} Sep 07 12:35:02.333713 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:02.333513 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lclwd" Sep 07 12:35:02.333857 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:02.333591 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lkvmb" Sep 07 12:35:02.333857 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:35:02.333780 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lclwd" podUID="7008051b-bbec-4967-b4ff-dc60f109a092" Sep 07 12:35:02.333969 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:35:02.333892 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lkvmb" podUID="2350fd1e-ae4b-48d4-9ef6-e45cb3f83129" Sep 07 12:35:02.333969 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:02.333664 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7nh4" Sep 07 12:35:02.334027 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:35:02.333985 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7nh4" podUID="4620ef7e-ba96-427e-ab48-a8aa3d7bc243" Sep 07 12:35:02.489370 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:02.489339 2584 generic.go:356] "Generic (PLEG): container finished" podID="34989fc7-d971-4b4a-9b00-aef1cb59f2bf" containerID="1e6d6c89f74cb3c5af5797559b0bfc0e007e8dea122d6f6ea9c47a1e53a9d408" exitCode=0 Sep 07 12:35:02.489836 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:02.489430 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lgzj8" event={"ID":"34989fc7-d971-4b4a-9b00-aef1cb59f2bf","Type":"ContainerDied","Data":"1e6d6c89f74cb3c5af5797559b0bfc0e007e8dea122d6f6ea9c47a1e53a9d408"} Sep 07 12:35:04.336215 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:04.336185 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lkvmb" Sep 07 12:35:04.336685 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:04.336188 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7nh4" Sep 07 12:35:04.336685 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:04.336185 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lclwd" Sep 07 12:35:04.336685 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:35:04.336579 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lkvmb" podUID="2350fd1e-ae4b-48d4-9ef6-e45cb3f83129" Sep 07 12:35:04.336841 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:35:04.336711 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7nh4" podUID="4620ef7e-ba96-427e-ab48-a8aa3d7bc243" Sep 07 12:35:04.336841 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:35:04.336806 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lclwd" podUID="7008051b-bbec-4967-b4ff-dc60f109a092" Sep 07 12:35:06.054531 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:06.054494 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2350fd1e-ae4b-48d4-9ef6-e45cb3f83129-metrics-certs\") pod \"network-metrics-daemon-lkvmb\" (UID: \"2350fd1e-ae4b-48d4-9ef6-e45cb3f83129\") " pod="openshift-multus/network-metrics-daemon-lkvmb" Sep 07 12:35:06.054531 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:06.054539 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4620ef7e-ba96-427e-ab48-a8aa3d7bc243-original-pull-secret\") pod \"global-pull-secret-syncer-b7nh4\" (UID: \"4620ef7e-ba96-427e-ab48-a8aa3d7bc243\") " pod="kube-system/global-pull-secret-syncer-b7nh4" Sep 07 12:35:06.055158 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:35:06.054662 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 12:35:06.055158 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:35:06.054679 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 12:35:06.055158 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:35:06.054721 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4620ef7e-ba96-427e-ab48-a8aa3d7bc243-original-pull-secret podName:4620ef7e-ba96-427e-ab48-a8aa3d7bc243 nodeName:}" failed. No retries permitted until 2026-09-07 12:35:38.05470366 +0000 UTC m=+66.205133388 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4620ef7e-ba96-427e-ab48-a8aa3d7bc243-original-pull-secret") pod "global-pull-secret-syncer-b7nh4" (UID: "4620ef7e-ba96-427e-ab48-a8aa3d7bc243") : object "kube-system"/"original-pull-secret" not registered Sep 07 12:35:06.055158 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:35:06.054748 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2350fd1e-ae4b-48d4-9ef6-e45cb3f83129-metrics-certs podName:2350fd1e-ae4b-48d4-9ef6-e45cb3f83129 nodeName:}" failed. No retries permitted until 2026-09-07 12:35:38.054730934 +0000 UTC m=+66.205160635 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2350fd1e-ae4b-48d4-9ef6-e45cb3f83129-metrics-certs") pod "network-metrics-daemon-lkvmb" (UID: "2350fd1e-ae4b-48d4-9ef6-e45cb3f83129") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 12:35:06.155757 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:06.155713 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlk72\" (UniqueName: \"kubernetes.io/projected/7008051b-bbec-4967-b4ff-dc60f109a092-kube-api-access-dlk72\") pod \"network-check-target-lclwd\" (UID: \"7008051b-bbec-4967-b4ff-dc60f109a092\") " pod="openshift-network-diagnostics/network-check-target-lclwd" Sep 07 12:35:06.155960 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:35:06.155911 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 12:35:06.155960 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:35:06.155939 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 12:35:06.155960 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:35:06.155955 2584 projected.go:196] Error preparing data for projected volume kube-api-access-dlk72 for pod openshift-network-diagnostics/network-check-target-lclwd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 12:35:06.156116 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:35:06.156020 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7008051b-bbec-4967-b4ff-dc60f109a092-kube-api-access-dlk72 podName:7008051b-bbec-4967-b4ff-dc60f109a092 nodeName:}" failed. No retries permitted until 2026-09-07 12:35:38.156005455 +0000 UTC m=+66.306435148 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-dlk72" (UniqueName: "kubernetes.io/projected/7008051b-bbec-4967-b4ff-dc60f109a092-kube-api-access-dlk72") pod "network-check-target-lclwd" (UID: "7008051b-bbec-4967-b4ff-dc60f109a092") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 12:35:06.332949 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:06.332851 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lclwd" Sep 07 12:35:06.332949 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:06.332898 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lkvmb" Sep 07 12:35:06.333173 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:35:06.332995 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lclwd" podUID="7008051b-bbec-4967-b4ff-dc60f109a092" Sep 07 12:35:06.333173 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:35:06.333077 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lkvmb" podUID="2350fd1e-ae4b-48d4-9ef6-e45cb3f83129" Sep 07 12:35:06.333173 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:06.333134 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7nh4" Sep 07 12:35:06.333311 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:35:06.333211 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7nh4" podUID="4620ef7e-ba96-427e-ab48-a8aa3d7bc243" Sep 07 12:35:06.608956 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:06.608882 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-7.ec2.internal" event="NodeReady" Sep 07 12:35:06.609091 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:06.609003 2584 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 07 12:35:06.650401 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:06.650363 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-jv7nm"] Sep 07 12:35:06.662795 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:06.662761 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qsnps"] Sep 07 12:35:06.662956 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:06.662889 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jv7nm" Sep 07 12:35:06.665686 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:06.665659 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nvqb4\"" Sep 07 12:35:06.665686 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:06.665676 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 07 12:35:06.665900 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:06.665659 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 07 12:35:06.676991 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:06.676967 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jv7nm"] Sep 07 12:35:06.677106 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:06.677012 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qsnps"] Sep 07 12:35:06.677106 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:06.677059 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qsnps" Sep 07 12:35:06.680117 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:06.680090 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-nm49p\"" Sep 07 12:35:06.680274 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:06.680256 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 07 12:35:06.680349 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:06.680296 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 07 12:35:06.680349 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:06.680320 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 07 12:35:06.760481 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:06.760433 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c51fa57-4e30-481f-8ed2-c2ed61972d2e-metrics-tls\") pod \"dns-default-jv7nm\" (UID: \"7c51fa57-4e30-481f-8ed2-c2ed61972d2e\") " pod="openshift-dns/dns-default-jv7nm" Sep 07 12:35:06.760662 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:06.760495 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/07c2afb8-7cde-4925-9f93-13aaf570f1fa-cert\") pod \"ingress-canary-qsnps\" (UID: \"07c2afb8-7cde-4925-9f93-13aaf570f1fa\") " pod="openshift-ingress-canary/ingress-canary-qsnps" Sep 07 12:35:06.760662 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:06.760520 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7c51fa57-4e30-481f-8ed2-c2ed61972d2e-config-volume\") pod \"dns-default-jv7nm\" (UID: \"7c51fa57-4e30-481f-8ed2-c2ed61972d2e\") " pod="openshift-dns/dns-default-jv7nm" Sep 07 12:35:06.760662 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:06.760558 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9l4z\" (UniqueName: \"kubernetes.io/projected/7c51fa57-4e30-481f-8ed2-c2ed61972d2e-kube-api-access-k9l4z\") pod \"dns-default-jv7nm\" (UID: \"7c51fa57-4e30-481f-8ed2-c2ed61972d2e\") " pod="openshift-dns/dns-default-jv7nm" Sep 07 12:35:06.760662 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:06.760583 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c51fa57-4e30-481f-8ed2-c2ed61972d2e-tmp-dir\") pod \"dns-default-jv7nm\" (UID: \"7c51fa57-4e30-481f-8ed2-c2ed61972d2e\") " pod="openshift-dns/dns-default-jv7nm" Sep 07 12:35:06.760662 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:06.760611 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qr7q6\" (UniqueName: \"kubernetes.io/projected/07c2afb8-7cde-4925-9f93-13aaf570f1fa-kube-api-access-qr7q6\") pod \"ingress-canary-qsnps\" (UID: \"07c2afb8-7cde-4925-9f93-13aaf570f1fa\") " pod="openshift-ingress-canary/ingress-canary-qsnps" Sep 07 12:35:06.861820 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:06.861735 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qr7q6\" (UniqueName: \"kubernetes.io/projected/07c2afb8-7cde-4925-9f93-13aaf570f1fa-kube-api-access-qr7q6\") pod \"ingress-canary-qsnps\" (UID: \"07c2afb8-7cde-4925-9f93-13aaf570f1fa\") " pod="openshift-ingress-canary/ingress-canary-qsnps" Sep 07 12:35:06.861820 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:06.861813 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c51fa57-4e30-481f-8ed2-c2ed61972d2e-metrics-tls\") pod \"dns-default-jv7nm\" (UID: \"7c51fa57-4e30-481f-8ed2-c2ed61972d2e\") " pod="openshift-dns/dns-default-jv7nm" Sep 07 12:35:06.861985 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:06.861833 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/07c2afb8-7cde-4925-9f93-13aaf570f1fa-cert\") pod \"ingress-canary-qsnps\" (UID: \"07c2afb8-7cde-4925-9f93-13aaf570f1fa\") " pod="openshift-ingress-canary/ingress-canary-qsnps" Sep 07 12:35:06.861985 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:06.861853 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7c51fa57-4e30-481f-8ed2-c2ed61972d2e-config-volume\") pod \"dns-default-jv7nm\" (UID: \"7c51fa57-4e30-481f-8ed2-c2ed61972d2e\") " pod="openshift-dns/dns-default-jv7nm" Sep 07 12:35:06.861985 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:06.861876 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9l4z\" (UniqueName: \"kubernetes.io/projected/7c51fa57-4e30-481f-8ed2-c2ed61972d2e-kube-api-access-k9l4z\") pod \"dns-default-jv7nm\" (UID: \"7c51fa57-4e30-481f-8ed2-c2ed61972d2e\") " pod="openshift-dns/dns-default-jv7nm" Sep 07 12:35:06.861985 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:06.861901 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c51fa57-4e30-481f-8ed2-c2ed61972d2e-tmp-dir\") pod \"dns-default-jv7nm\" (UID: \"7c51fa57-4e30-481f-8ed2-c2ed61972d2e\") " pod="openshift-dns/dns-default-jv7nm" Sep 07 12:35:06.862136 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:35:06.861981 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 12:35:06.862136 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:35:06.862058 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c51fa57-4e30-481f-8ed2-c2ed61972d2e-metrics-tls podName:7c51fa57-4e30-481f-8ed2-c2ed61972d2e nodeName:}" failed. No retries permitted until 2026-09-07 12:35:07.362037765 +0000 UTC m=+35.512467458 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7c51fa57-4e30-481f-8ed2-c2ed61972d2e-metrics-tls") pod "dns-default-jv7nm" (UID: "7c51fa57-4e30-481f-8ed2-c2ed61972d2e") : secret "dns-default-metrics-tls" not found Sep 07 12:35:06.862266 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:06.862249 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c51fa57-4e30-481f-8ed2-c2ed61972d2e-tmp-dir\") pod \"dns-default-jv7nm\" (UID: \"7c51fa57-4e30-481f-8ed2-c2ed61972d2e\") " pod="openshift-dns/dns-default-jv7nm" Sep 07 12:35:06.862465 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:06.862444 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7c51fa57-4e30-481f-8ed2-c2ed61972d2e-config-volume\") pod \"dns-default-jv7nm\" (UID: \"7c51fa57-4e30-481f-8ed2-c2ed61972d2e\") " pod="openshift-dns/dns-default-jv7nm" Sep 07 12:35:06.866343 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:06.866322 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/07c2afb8-7cde-4925-9f93-13aaf570f1fa-cert\") pod \"ingress-canary-qsnps\" (UID: \"07c2afb8-7cde-4925-9f93-13aaf570f1fa\") " pod="openshift-ingress-canary/ingress-canary-qsnps" Sep 07 12:35:06.870750 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:06.870726 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qr7q6\" (UniqueName: \"kubernetes.io/projected/07c2afb8-7cde-4925-9f93-13aaf570f1fa-kube-api-access-qr7q6\") pod \"ingress-canary-qsnps\" (UID: \"07c2afb8-7cde-4925-9f93-13aaf570f1fa\") " pod="openshift-ingress-canary/ingress-canary-qsnps" Sep 07 12:35:06.870990 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:06.870969 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9l4z\" (UniqueName: \"kubernetes.io/projected/7c51fa57-4e30-481f-8ed2-c2ed61972d2e-kube-api-access-k9l4z\") pod \"dns-default-jv7nm\" (UID: \"7c51fa57-4e30-481f-8ed2-c2ed61972d2e\") " pod="openshift-dns/dns-default-jv7nm" Sep 07 12:35:06.988380 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:06.988345 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qsnps" Sep 07 12:35:07.315402 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:07.315148 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qsnps"] Sep 07 12:35:07.319323 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:35:07.319289 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07c2afb8_7cde_4925_9f93_13aaf570f1fa.slice/crio-465898f2f0cde0a42182b7b183611a4448877820c73451b09a133662f3dc9751 WatchSource:0}: Error finding container 465898f2f0cde0a42182b7b183611a4448877820c73451b09a133662f3dc9751: Status 404 returned error can't find the container with id 465898f2f0cde0a42182b7b183611a4448877820c73451b09a133662f3dc9751 Sep 07 12:35:07.365783 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:07.365755 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c51fa57-4e30-481f-8ed2-c2ed61972d2e-metrics-tls\") pod \"dns-default-jv7nm\" (UID: \"7c51fa57-4e30-481f-8ed2-c2ed61972d2e\") " pod="openshift-dns/dns-default-jv7nm" Sep 07 12:35:07.365890 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:35:07.365877 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 12:35:07.365942 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:35:07.365932 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c51fa57-4e30-481f-8ed2-c2ed61972d2e-metrics-tls podName:7c51fa57-4e30-481f-8ed2-c2ed61972d2e nodeName:}" failed. No retries permitted until 2026-09-07 12:35:08.36591756 +0000 UTC m=+36.516347258 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7c51fa57-4e30-481f-8ed2-c2ed61972d2e-metrics-tls") pod "dns-default-jv7nm" (UID: "7c51fa57-4e30-481f-8ed2-c2ed61972d2e") : secret "dns-default-metrics-tls" not found Sep 07 12:35:07.505903 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:07.505862 2584 generic.go:356] "Generic (PLEG): container finished" podID="34989fc7-d971-4b4a-9b00-aef1cb59f2bf" containerID="c4235f42949e27eedb2fbdf146f051f4fe82428828f9958837ffa739f8451cfc" exitCode=0 Sep 07 12:35:07.506090 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:07.505934 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lgzj8" event={"ID":"34989fc7-d971-4b4a-9b00-aef1cb59f2bf","Type":"ContainerDied","Data":"c4235f42949e27eedb2fbdf146f051f4fe82428828f9958837ffa739f8451cfc"} Sep 07 12:35:07.507069 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:07.507050 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qsnps" event={"ID":"07c2afb8-7cde-4925-9f93-13aaf570f1fa","Type":"ContainerStarted","Data":"465898f2f0cde0a42182b7b183611a4448877820c73451b09a133662f3dc9751"} Sep 07 12:35:08.336633 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:08.336585 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lclwd" Sep 07 12:35:08.337179 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:08.336641 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lkvmb" Sep 07 12:35:08.337179 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:08.336641 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7nh4" Sep 07 12:35:08.339469 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:08.339447 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 07 12:35:08.339611 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:08.339474 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 07 12:35:08.341066 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:08.340709 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vsbg4\"" Sep 07 12:35:08.341066 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:08.340791 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 07 12:35:08.341066 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:08.340821 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-npxpb\"" Sep 07 12:35:08.341066 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:08.340791 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 07 12:35:08.374313 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:08.374283 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c51fa57-4e30-481f-8ed2-c2ed61972d2e-metrics-tls\") pod \"dns-default-jv7nm\" (UID: \"7c51fa57-4e30-481f-8ed2-c2ed61972d2e\") " pod="openshift-dns/dns-default-jv7nm" Sep 07 12:35:08.374485 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:35:08.374468 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 12:35:08.374554 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:35:08.374540 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c51fa57-4e30-481f-8ed2-c2ed61972d2e-metrics-tls podName:7c51fa57-4e30-481f-8ed2-c2ed61972d2e nodeName:}" failed. No retries permitted until 2026-09-07 12:35:10.374522111 +0000 UTC m=+38.524951855 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7c51fa57-4e30-481f-8ed2-c2ed61972d2e-metrics-tls") pod "dns-default-jv7nm" (UID: "7c51fa57-4e30-481f-8ed2-c2ed61972d2e") : secret "dns-default-metrics-tls" not found Sep 07 12:35:08.513641 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:08.513587 2584 generic.go:356] "Generic (PLEG): container finished" podID="34989fc7-d971-4b4a-9b00-aef1cb59f2bf" containerID="9b4339cce25d6c6cf99116b74dd9873268c33976f96b295c1113f237fdaa8a5b" exitCode=0 Sep 07 12:35:08.513804 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:08.513667 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lgzj8" event={"ID":"34989fc7-d971-4b4a-9b00-aef1cb59f2bf","Type":"ContainerDied","Data":"9b4339cce25d6c6cf99116b74dd9873268c33976f96b295c1113f237fdaa8a5b"} Sep 07 12:35:09.519459 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:09.519421 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lgzj8" event={"ID":"34989fc7-d971-4b4a-9b00-aef1cb59f2bf","Type":"ContainerStarted","Data":"2ae39be927fe38f6b01b9144b8f1c197597eb0ca9f0fcfdede9c98547ae82ff3"} Sep 07 12:35:09.545835 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:09.545779 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-lgzj8" podStartSLOduration=8.640533381000001 podStartE2EDuration="37.545761856s" totalImagesPullingTime="28.905228475s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:34:32 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:35:09.545457064 +0000 UTC m=+37.695886806" watchObservedRunningTime="2026-09-07 12:35:09.545761856 +0000 UTC m=+37.696191571" Sep 07 12:35:10.389923 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:10.389882 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c51fa57-4e30-481f-8ed2-c2ed61972d2e-metrics-tls\") pod \"dns-default-jv7nm\" (UID: \"7c51fa57-4e30-481f-8ed2-c2ed61972d2e\") " pod="openshift-dns/dns-default-jv7nm" Sep 07 12:35:10.390085 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:35:10.390006 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 12:35:10.390085 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:35:10.390059 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c51fa57-4e30-481f-8ed2-c2ed61972d2e-metrics-tls podName:7c51fa57-4e30-481f-8ed2-c2ed61972d2e nodeName:}" failed. No retries permitted until 2026-09-07 12:35:14.390045282 +0000 UTC m=+42.540474976 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7c51fa57-4e30-481f-8ed2-c2ed61972d2e-metrics-tls") pod "dns-default-jv7nm" (UID: "7c51fa57-4e30-481f-8ed2-c2ed61972d2e") : secret "dns-default-metrics-tls" not found Sep 07 12:35:10.523608 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:10.523571 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qsnps" event={"ID":"07c2afb8-7cde-4925-9f93-13aaf570f1fa","Type":"ContainerStarted","Data":"484eb9da381bcd525585fc8005c080d282183d99a9e54ba76f4764ccd5e00d9f"} Sep 07 12:35:10.542523 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:10.542425 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qsnps" podStartSLOduration=2.05585044 podStartE2EDuration="4.542407122s" totalImagesPullingTime="2.486556682s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:35:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:35:10.541422301 +0000 UTC m=+38.691852037" watchObservedRunningTime="2026-09-07 12:35:10.542407122 +0000 UTC m=+38.692836832" Sep 07 12:35:14.418906 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:14.418865 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c51fa57-4e30-481f-8ed2-c2ed61972d2e-metrics-tls\") pod \"dns-default-jv7nm\" (UID: \"7c51fa57-4e30-481f-8ed2-c2ed61972d2e\") " pod="openshift-dns/dns-default-jv7nm" Sep 07 12:35:14.419308 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:35:14.419033 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 12:35:14.419308 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:35:14.419105 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c51fa57-4e30-481f-8ed2-c2ed61972d2e-metrics-tls podName:7c51fa57-4e30-481f-8ed2-c2ed61972d2e nodeName:}" failed. No retries permitted until 2026-09-07 12:35:22.419086762 +0000 UTC m=+50.569516459 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7c51fa57-4e30-481f-8ed2-c2ed61972d2e-metrics-tls") pod "dns-default-jv7nm" (UID: "7c51fa57-4e30-481f-8ed2-c2ed61972d2e") : secret "dns-default-metrics-tls" not found Sep 07 12:35:22.477041 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:22.476996 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c51fa57-4e30-481f-8ed2-c2ed61972d2e-metrics-tls\") pod \"dns-default-jv7nm\" (UID: \"7c51fa57-4e30-481f-8ed2-c2ed61972d2e\") " pod="openshift-dns/dns-default-jv7nm" Sep 07 12:35:22.477489 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:35:22.477132 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 12:35:22.477489 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:35:22.477185 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c51fa57-4e30-481f-8ed2-c2ed61972d2e-metrics-tls podName:7c51fa57-4e30-481f-8ed2-c2ed61972d2e nodeName:}" failed. No retries permitted until 2026-09-07 12:35:38.477170942 +0000 UTC m=+66.627600636 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7c51fa57-4e30-481f-8ed2-c2ed61972d2e-metrics-tls") pod "dns-default-jv7nm" (UID: "7c51fa57-4e30-481f-8ed2-c2ed61972d2e") : secret "dns-default-metrics-tls" not found Sep 07 12:35:32.500604 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:32.500576 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bk5j9" Sep 07 12:35:38.093079 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:38.093037 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4620ef7e-ba96-427e-ab48-a8aa3d7bc243-original-pull-secret\") pod \"global-pull-secret-syncer-b7nh4\" (UID: \"4620ef7e-ba96-427e-ab48-a8aa3d7bc243\") " pod="kube-system/global-pull-secret-syncer-b7nh4" Sep 07 12:35:38.093513 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:38.093108 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2350fd1e-ae4b-48d4-9ef6-e45cb3f83129-metrics-certs\") pod \"network-metrics-daemon-lkvmb\" (UID: \"2350fd1e-ae4b-48d4-9ef6-e45cb3f83129\") " pod="openshift-multus/network-metrics-daemon-lkvmb" Sep 07 12:35:38.096181 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:38.096156 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 07 12:35:38.096326 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:38.096195 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 07 12:35:38.103565 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:35:38.103548 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 07 12:35:38.103634 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:35:38.103607 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2350fd1e-ae4b-48d4-9ef6-e45cb3f83129-metrics-certs podName:2350fd1e-ae4b-48d4-9ef6-e45cb3f83129 nodeName:}" failed. No retries permitted until 2026-09-07 12:36:42.103589425 +0000 UTC m=+130.254019122 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2350fd1e-ae4b-48d4-9ef6-e45cb3f83129-metrics-certs") pod "network-metrics-daemon-lkvmb" (UID: "2350fd1e-ae4b-48d4-9ef6-e45cb3f83129") : secret "metrics-daemon-secret" not found Sep 07 12:35:38.106755 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:38.106733 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4620ef7e-ba96-427e-ab48-a8aa3d7bc243-original-pull-secret\") pod \"global-pull-secret-syncer-b7nh4\" (UID: \"4620ef7e-ba96-427e-ab48-a8aa3d7bc243\") " pod="kube-system/global-pull-secret-syncer-b7nh4" Sep 07 12:35:38.194297 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:38.194268 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlk72\" (UniqueName: \"kubernetes.io/projected/7008051b-bbec-4967-b4ff-dc60f109a092-kube-api-access-dlk72\") pod \"network-check-target-lclwd\" (UID: \"7008051b-bbec-4967-b4ff-dc60f109a092\") " pod="openshift-network-diagnostics/network-check-target-lclwd" Sep 07 12:35:38.197465 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:38.197446 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 07 12:35:38.207034 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:38.207015 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 07 12:35:38.217585 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:38.217562 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlk72\" (UniqueName: \"kubernetes.io/projected/7008051b-bbec-4967-b4ff-dc60f109a092-kube-api-access-dlk72\") pod \"network-check-target-lclwd\" (UID: \"7008051b-bbec-4967-b4ff-dc60f109a092\") " pod="openshift-network-diagnostics/network-check-target-lclwd" Sep 07 12:35:38.351471 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:38.351408 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-npxpb\"" Sep 07 12:35:38.359075 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:38.359052 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lclwd" Sep 07 12:35:38.362654 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:38.362639 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7nh4" Sep 07 12:35:38.496183 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:38.496152 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c51fa57-4e30-481f-8ed2-c2ed61972d2e-metrics-tls\") pod \"dns-default-jv7nm\" (UID: \"7c51fa57-4e30-481f-8ed2-c2ed61972d2e\") " pod="openshift-dns/dns-default-jv7nm" Sep 07 12:35:38.496349 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:35:38.496271 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 12:35:38.496349 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:35:38.496330 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c51fa57-4e30-481f-8ed2-c2ed61972d2e-metrics-tls podName:7c51fa57-4e30-481f-8ed2-c2ed61972d2e nodeName:}" failed. No retries permitted until 2026-09-07 12:36:10.496315757 +0000 UTC m=+98.646745451 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7c51fa57-4e30-481f-8ed2-c2ed61972d2e-metrics-tls") pod "dns-default-jv7nm" (UID: "7c51fa57-4e30-481f-8ed2-c2ed61972d2e") : secret "dns-default-metrics-tls" not found Sep 07 12:35:38.635128 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:38.635059 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-b7nh4"] Sep 07 12:35:38.638176 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:38.638149 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lclwd"] Sep 07 12:35:38.638475 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:35:38.638449 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4620ef7e_ba96_427e_ab48_a8aa3d7bc243.slice/crio-4ef5d836ccc563dd3668ad2c12a970b3e33b8156460fff6fbf4a73021ace55e9 WatchSource:0}: Error finding container 4ef5d836ccc563dd3668ad2c12a970b3e33b8156460fff6fbf4a73021ace55e9: Status 404 returned error can't find the container with id 4ef5d836ccc563dd3668ad2c12a970b3e33b8156460fff6fbf4a73021ace55e9 Sep 07 12:35:38.641119 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:35:38.641094 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7008051b_bbec_4967_b4ff_dc60f109a092.slice/crio-dab1b3ba217df64a2c8f5d7a9823a8d3c2607fef12b5fd54330ae66cc0e477e7 WatchSource:0}: Error finding container dab1b3ba217df64a2c8f5d7a9823a8d3c2607fef12b5fd54330ae66cc0e477e7: Status 404 returned error can't find the container with id dab1b3ba217df64a2c8f5d7a9823a8d3c2607fef12b5fd54330ae66cc0e477e7 Sep 07 12:35:39.593647 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:39.593542 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lclwd" event={"ID":"7008051b-bbec-4967-b4ff-dc60f109a092","Type":"ContainerStarted","Data":"dab1b3ba217df64a2c8f5d7a9823a8d3c2607fef12b5fd54330ae66cc0e477e7"} Sep 07 12:35:39.595392 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:39.595362 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-b7nh4" event={"ID":"4620ef7e-ba96-427e-ab48-a8aa3d7bc243","Type":"ContainerStarted","Data":"4ef5d836ccc563dd3668ad2c12a970b3e33b8156460fff6fbf4a73021ace55e9"} Sep 07 12:35:43.608481 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:43.608435 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-b7nh4" event={"ID":"4620ef7e-ba96-427e-ab48-a8aa3d7bc243","Type":"ContainerStarted","Data":"95b4d8418c4185d62d4d78a703c01307a8cab232350f8032824f2a246b941c91"} Sep 07 12:35:43.610014 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:43.609990 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lclwd" event={"ID":"7008051b-bbec-4967-b4ff-dc60f109a092","Type":"ContainerStarted","Data":"0984420978c96681c27092a2b4f176b252763eed73f0dd78228e827b893fea1a"} Sep 07 12:35:43.610132 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:43.610114 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-lclwd" Sep 07 12:35:43.623773 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:43.623734 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-b7nh4" podStartSLOduration=66.374822621 podStartE2EDuration="1m10.623721528s" totalImagesPullingTime="4.248898907s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:34:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:35:43.622816229 +0000 UTC m=+71.773245957" watchObservedRunningTime="2026-09-07 12:35:43.623721528 +0000 UTC m=+71.774151244" Sep 07 12:35:43.639014 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:43.638976 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-lclwd" podStartSLOduration=66.396069291 podStartE2EDuration="1m10.638964842s" totalImagesPullingTime="4.242895551s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:34:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:35:43.638720482 +0000 UTC m=+71.789150198" watchObservedRunningTime="2026-09-07 12:35:43.638964842 +0000 UTC m=+71.789394580" Sep 07 12:35:59.117707 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:59.117592 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5994bdfbb-d8qcw"] Sep 07 12:35:59.121633 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:59.121604 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5994bdfbb-d8qcw" Sep 07 12:35:59.124151 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:59.124126 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 07 12:35:59.124277 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:59.124200 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 07 12:35:59.125548 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:59.125532 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Sep 07 12:35:59.125607 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:59.125557 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 07 12:35:59.126549 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:59.126527 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/71ab5c02-be74-4c5a-ba86-7eac0d8a6406-klusterlet-config\") pod \"klusterlet-addon-workmgr-5994bdfbb-d8qcw\" (UID: \"71ab5c02-be74-4c5a-ba86-7eac0d8a6406\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5994bdfbb-d8qcw" Sep 07 12:35:59.126610 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:59.126571 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cq8fv\" (UniqueName: \"kubernetes.io/projected/71ab5c02-be74-4c5a-ba86-7eac0d8a6406-kube-api-access-cq8fv\") pod \"klusterlet-addon-workmgr-5994bdfbb-d8qcw\" (UID: \"71ab5c02-be74-4c5a-ba86-7eac0d8a6406\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5994bdfbb-d8qcw" Sep 07 12:35:59.126610 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:59.126597 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71ab5c02-be74-4c5a-ba86-7eac0d8a6406-tmp\") pod \"klusterlet-addon-workmgr-5994bdfbb-d8qcw\" (UID: \"71ab5c02-be74-4c5a-ba86-7eac0d8a6406\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5994bdfbb-d8qcw" Sep 07 12:35:59.129809 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:59.129786 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5994bdfbb-d8qcw"] Sep 07 12:35:59.226910 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:59.226877 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/71ab5c02-be74-4c5a-ba86-7eac0d8a6406-klusterlet-config\") pod \"klusterlet-addon-workmgr-5994bdfbb-d8qcw\" (UID: \"71ab5c02-be74-4c5a-ba86-7eac0d8a6406\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5994bdfbb-d8qcw" Sep 07 12:35:59.226910 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:59.226912 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cq8fv\" (UniqueName: \"kubernetes.io/projected/71ab5c02-be74-4c5a-ba86-7eac0d8a6406-kube-api-access-cq8fv\") pod \"klusterlet-addon-workmgr-5994bdfbb-d8qcw\" (UID: \"71ab5c02-be74-4c5a-ba86-7eac0d8a6406\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5994bdfbb-d8qcw" Sep 07 12:35:59.227118 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:59.226931 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71ab5c02-be74-4c5a-ba86-7eac0d8a6406-tmp\") pod \"klusterlet-addon-workmgr-5994bdfbb-d8qcw\" (UID: \"71ab5c02-be74-4c5a-ba86-7eac0d8a6406\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5994bdfbb-d8qcw" Sep 07 12:35:59.227332 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:59.227311 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71ab5c02-be74-4c5a-ba86-7eac0d8a6406-tmp\") pod \"klusterlet-addon-workmgr-5994bdfbb-d8qcw\" (UID: \"71ab5c02-be74-4c5a-ba86-7eac0d8a6406\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5994bdfbb-d8qcw" Sep 07 12:35:59.229665 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:59.229640 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/71ab5c02-be74-4c5a-ba86-7eac0d8a6406-klusterlet-config\") pod \"klusterlet-addon-workmgr-5994bdfbb-d8qcw\" (UID: \"71ab5c02-be74-4c5a-ba86-7eac0d8a6406\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5994bdfbb-d8qcw" Sep 07 12:35:59.235837 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:59.235817 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cq8fv\" (UniqueName: \"kubernetes.io/projected/71ab5c02-be74-4c5a-ba86-7eac0d8a6406-kube-api-access-cq8fv\") pod \"klusterlet-addon-workmgr-5994bdfbb-d8qcw\" (UID: \"71ab5c02-be74-4c5a-ba86-7eac0d8a6406\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5994bdfbb-d8qcw" Sep 07 12:35:59.431393 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:59.431307 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5994bdfbb-d8qcw" Sep 07 12:35:59.703441 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:35:59.703360 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5994bdfbb-d8qcw"] Sep 07 12:35:59.707317 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:35:59.707290 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71ab5c02_be74_4c5a_ba86_7eac0d8a6406.slice/crio-3a56b809d09bf48e6d9156836181dd4ff9f9cb0be34bcd494b71f4b499ba1f00 WatchSource:0}: Error finding container 3a56b809d09bf48e6d9156836181dd4ff9f9cb0be34bcd494b71f4b499ba1f00: Status 404 returned error can't find the container with id 3a56b809d09bf48e6d9156836181dd4ff9f9cb0be34bcd494b71f4b499ba1f00 Sep 07 12:36:00.650356 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:36:00.650317 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5994bdfbb-d8qcw" event={"ID":"71ab5c02-be74-4c5a-ba86-7eac0d8a6406","Type":"ContainerStarted","Data":"3a56b809d09bf48e6d9156836181dd4ff9f9cb0be34bcd494b71f4b499ba1f00"} Sep 07 12:36:04.661612 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:36:04.661576 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5994bdfbb-d8qcw" event={"ID":"71ab5c02-be74-4c5a-ba86-7eac0d8a6406","Type":"ContainerStarted","Data":"bb4ba4646da8a8058485faaf56f8be9572bf291f402e8c309d77eef3a20ca891"} Sep 07 12:36:04.662097 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:36:04.661789 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5994bdfbb-d8qcw" Sep 07 12:36:04.663438 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:36:04.663417 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5994bdfbb-d8qcw" Sep 07 12:36:04.678330 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:36:04.678289 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5994bdfbb-d8qcw" podStartSLOduration=1.513818209 podStartE2EDuration="5.678275602s" totalImagesPullingTime="4.164457393s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:35:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:36:04.677687154 +0000 UTC m=+92.828116880" watchObservedRunningTime="2026-09-07 12:36:04.678275602 +0000 UTC m=+92.828705368" Sep 07 12:36:10.508231 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:36:10.508199 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c51fa57-4e30-481f-8ed2-c2ed61972d2e-metrics-tls\") pod \"dns-default-jv7nm\" (UID: \"7c51fa57-4e30-481f-8ed2-c2ed61972d2e\") " pod="openshift-dns/dns-default-jv7nm" Sep 07 12:36:10.508572 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:36:10.508349 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 12:36:10.508572 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:36:10.508421 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c51fa57-4e30-481f-8ed2-c2ed61972d2e-metrics-tls podName:7c51fa57-4e30-481f-8ed2-c2ed61972d2e nodeName:}" failed. No retries permitted until 2026-09-07 12:37:14.508404793 +0000 UTC m=+162.658834491 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7c51fa57-4e30-481f-8ed2-c2ed61972d2e-metrics-tls") pod "dns-default-jv7nm" (UID: "7c51fa57-4e30-481f-8ed2-c2ed61972d2e") : secret "dns-default-metrics-tls" not found Sep 07 12:36:14.614764 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:36:14.614730 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-lclwd" Sep 07 12:36:42.118770 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:36:42.118722 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2350fd1e-ae4b-48d4-9ef6-e45cb3f83129-metrics-certs\") pod \"network-metrics-daemon-lkvmb\" (UID: \"2350fd1e-ae4b-48d4-9ef6-e45cb3f83129\") " pod="openshift-multus/network-metrics-daemon-lkvmb" Sep 07 12:36:42.119261 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:36:42.118884 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 07 12:36:42.119261 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:36:42.118950 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2350fd1e-ae4b-48d4-9ef6-e45cb3f83129-metrics-certs podName:2350fd1e-ae4b-48d4-9ef6-e45cb3f83129 nodeName:}" failed. No retries permitted until 2026-09-07 12:38:44.118933852 +0000 UTC m=+252.269363547 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2350fd1e-ae4b-48d4-9ef6-e45cb3f83129-metrics-certs") pod "network-metrics-daemon-lkvmb" (UID: "2350fd1e-ae4b-48d4-9ef6-e45cb3f83129") : secret "metrics-daemon-secret" not found Sep 07 12:37:09.673811 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:37:09.673755 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-jv7nm" podUID="7c51fa57-4e30-481f-8ed2-c2ed61972d2e" Sep 07 12:37:09.816785 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:37:09.816757 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jv7nm" Sep 07 12:37:11.356501 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:37:11.356447 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-lkvmb" podUID="2350fd1e-ae4b-48d4-9ef6-e45cb3f83129" Sep 07 12:37:14.533411 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:37:14.533372 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c51fa57-4e30-481f-8ed2-c2ed61972d2e-metrics-tls\") pod \"dns-default-jv7nm\" (UID: \"7c51fa57-4e30-481f-8ed2-c2ed61972d2e\") " pod="openshift-dns/dns-default-jv7nm" Sep 07 12:37:14.533918 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:37:14.533494 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 12:37:14.533918 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:37:14.533558 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c51fa57-4e30-481f-8ed2-c2ed61972d2e-metrics-tls podName:7c51fa57-4e30-481f-8ed2-c2ed61972d2e nodeName:}" failed. No retries permitted until 2026-09-07 12:39:16.533544102 +0000 UTC m=+284.683973796 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7c51fa57-4e30-481f-8ed2-c2ed61972d2e-metrics-tls") pod "dns-default-jv7nm" (UID: "7c51fa57-4e30-481f-8ed2-c2ed61972d2e") : secret "dns-default-metrics-tls" not found Sep 07 12:37:26.332265 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:37:26.332176 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lkvmb" Sep 07 12:38:04.662267 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:04.662217 2584 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5994bdfbb-d8qcw" podUID="71ab5c02-be74-4c5a-ba86-7eac0d8a6406" containerName="acm-agent" probeResult="failure" output="Get \"http://10.133.0.8:8000/readyz\": dial tcp 10.133.0.8:8000: connect: connection refused" Sep 07 12:38:04.946500 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:04.946468 2584 generic.go:356] "Generic (PLEG): container finished" podID="71ab5c02-be74-4c5a-ba86-7eac0d8a6406" containerID="bb4ba4646da8a8058485faaf56f8be9572bf291f402e8c309d77eef3a20ca891" exitCode=1 Sep 07 12:38:04.946676 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:04.946533 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5994bdfbb-d8qcw" event={"ID":"71ab5c02-be74-4c5a-ba86-7eac0d8a6406","Type":"ContainerDied","Data":"bb4ba4646da8a8058485faaf56f8be9572bf291f402e8c309d77eef3a20ca891"} Sep 07 12:38:04.946882 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:04.946868 2584 scope.go:117] "RemoveContainer" containerID="bb4ba4646da8a8058485faaf56f8be9572bf291f402e8c309d77eef3a20ca891" Sep 07 12:38:05.951235 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:05.951197 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5994bdfbb-d8qcw" event={"ID":"71ab5c02-be74-4c5a-ba86-7eac0d8a6406","Type":"ContainerStarted","Data":"d9510da85ec952bd9a9f60678d23a0bb1171e9ee640cdfbdcb88582681a23084"} Sep 07 12:38:05.951637 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:05.951478 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5994bdfbb-d8qcw" Sep 07 12:38:05.951997 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:05.951981 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5994bdfbb-d8qcw" Sep 07 12:38:44.121441 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:44.121386 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2350fd1e-ae4b-48d4-9ef6-e45cb3f83129-metrics-certs\") pod \"network-metrics-daemon-lkvmb\" (UID: \"2350fd1e-ae4b-48d4-9ef6-e45cb3f83129\") " pod="openshift-multus/network-metrics-daemon-lkvmb" Sep 07 12:38:44.121967 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:38:44.121540 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 07 12:38:44.121967 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:38:44.121643 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2350fd1e-ae4b-48d4-9ef6-e45cb3f83129-metrics-certs podName:2350fd1e-ae4b-48d4-9ef6-e45cb3f83129 nodeName:}" failed. No retries permitted until 2026-09-07 12:40:46.121602778 +0000 UTC m=+374.272032473 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2350fd1e-ae4b-48d4-9ef6-e45cb3f83129-metrics-certs") pod "network-metrics-daemon-lkvmb" (UID: "2350fd1e-ae4b-48d4-9ef6-e45cb3f83129") : secret "metrics-daemon-secret" not found Sep 07 12:38:54.224342 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.224253 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-57496dc5dc-n4ccq"] Sep 07 12:38:54.227483 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.226328 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57496dc5dc-n4ccq" Sep 07 12:38:54.228959 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.228937 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 07 12:38:54.229071 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.229013 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 07 12:38:54.229799 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.229785 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bfdzl\"" Sep 07 12:38:54.230114 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.230094 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 07 12:38:54.235802 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.235785 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 07 12:38:54.239697 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.239677 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57496dc5dc-n4ccq"] Sep 07 12:38:54.290814 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.290785 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e54bd75e-c79f-47e6-8adc-ca3ae580ef00-ca-trust-extracted\") pod \"image-registry-57496dc5dc-n4ccq\" (UID: \"e54bd75e-c79f-47e6-8adc-ca3ae580ef00\") " pod="openshift-image-registry/image-registry-57496dc5dc-n4ccq" Sep 07 12:38:54.290975 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.290823 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e54bd75e-c79f-47e6-8adc-ca3ae580ef00-trusted-ca\") pod \"image-registry-57496dc5dc-n4ccq\" (UID: \"e54bd75e-c79f-47e6-8adc-ca3ae580ef00\") " pod="openshift-image-registry/image-registry-57496dc5dc-n4ccq" Sep 07 12:38:54.290975 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.290842 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e54bd75e-c79f-47e6-8adc-ca3ae580ef00-image-registry-private-configuration\") pod \"image-registry-57496dc5dc-n4ccq\" (UID: \"e54bd75e-c79f-47e6-8adc-ca3ae580ef00\") " pod="openshift-image-registry/image-registry-57496dc5dc-n4ccq" Sep 07 12:38:54.290975 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.290920 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e54bd75e-c79f-47e6-8adc-ca3ae580ef00-installation-pull-secrets\") pod \"image-registry-57496dc5dc-n4ccq\" (UID: \"e54bd75e-c79f-47e6-8adc-ca3ae580ef00\") " pod="openshift-image-registry/image-registry-57496dc5dc-n4ccq" Sep 07 12:38:54.291083 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.290970 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e54bd75e-c79f-47e6-8adc-ca3ae580ef00-bound-sa-token\") pod \"image-registry-57496dc5dc-n4ccq\" (UID: \"e54bd75e-c79f-47e6-8adc-ca3ae580ef00\") " pod="openshift-image-registry/image-registry-57496dc5dc-n4ccq" Sep 07 12:38:54.291083 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.290998 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zb6xk\" (UniqueName: \"kubernetes.io/projected/e54bd75e-c79f-47e6-8adc-ca3ae580ef00-kube-api-access-zb6xk\") pod \"image-registry-57496dc5dc-n4ccq\" (UID: \"e54bd75e-c79f-47e6-8adc-ca3ae580ef00\") " pod="openshift-image-registry/image-registry-57496dc5dc-n4ccq" Sep 07 12:38:54.291083 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.291051 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e54bd75e-c79f-47e6-8adc-ca3ae580ef00-registry-tls\") pod \"image-registry-57496dc5dc-n4ccq\" (UID: \"e54bd75e-c79f-47e6-8adc-ca3ae580ef00\") " pod="openshift-image-registry/image-registry-57496dc5dc-n4ccq" Sep 07 12:38:54.291083 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.291077 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e54bd75e-c79f-47e6-8adc-ca3ae580ef00-registry-certificates\") pod \"image-registry-57496dc5dc-n4ccq\" (UID: \"e54bd75e-c79f-47e6-8adc-ca3ae580ef00\") " pod="openshift-image-registry/image-registry-57496dc5dc-n4ccq" Sep 07 12:38:54.323010 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.322979 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-mr8hn"] Sep 07 12:38:54.324827 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.324811 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-mr8hn" Sep 07 12:38:54.326226 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.326203 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-qlwkf"] Sep 07 12:38:54.327815 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.327799 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-s8cch\"" Sep 07 12:38:54.328938 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.328348 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-qlwkf" Sep 07 12:38:54.332360 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.331031 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Sep 07 12:38:54.332360 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.331062 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Sep 07 12:38:54.332360 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.331520 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-q9gtj\"" Sep 07 12:38:54.337944 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.337921 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-mr8hn"] Sep 07 12:38:54.341575 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.341552 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-qlwkf"] Sep 07 12:38:54.392162 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.392135 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e54bd75e-c79f-47e6-8adc-ca3ae580ef00-registry-tls\") pod \"image-registry-57496dc5dc-n4ccq\" (UID: \"e54bd75e-c79f-47e6-8adc-ca3ae580ef00\") " pod="openshift-image-registry/image-registry-57496dc5dc-n4ccq" Sep 07 12:38:54.392321 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.392172 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccqhw\" (UniqueName: \"kubernetes.io/projected/6d8d95ce-f1c7-4a00-a97b-952fe9e285a8-kube-api-access-ccqhw\") pod \"network-check-source-685456655f-mr8hn\" (UID: \"6d8d95ce-f1c7-4a00-a97b-952fe9e285a8\") " pod="openshift-network-diagnostics/network-check-source-685456655f-mr8hn" Sep 07 12:38:54.392321 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.392191 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e54bd75e-c79f-47e6-8adc-ca3ae580ef00-registry-certificates\") pod \"image-registry-57496dc5dc-n4ccq\" (UID: \"e54bd75e-c79f-47e6-8adc-ca3ae580ef00\") " pod="openshift-image-registry/image-registry-57496dc5dc-n4ccq" Sep 07 12:38:54.392321 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.392208 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e54bd75e-c79f-47e6-8adc-ca3ae580ef00-ca-trust-extracted\") pod \"image-registry-57496dc5dc-n4ccq\" (UID: \"e54bd75e-c79f-47e6-8adc-ca3ae580ef00\") " pod="openshift-image-registry/image-registry-57496dc5dc-n4ccq" Sep 07 12:38:54.392321 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.392229 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e54bd75e-c79f-47e6-8adc-ca3ae580ef00-trusted-ca\") pod \"image-registry-57496dc5dc-n4ccq\" (UID: \"e54bd75e-c79f-47e6-8adc-ca3ae580ef00\") " pod="openshift-image-registry/image-registry-57496dc5dc-n4ccq" Sep 07 12:38:54.392321 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.392254 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e54bd75e-c79f-47e6-8adc-ca3ae580ef00-image-registry-private-configuration\") pod \"image-registry-57496dc5dc-n4ccq\" (UID: \"e54bd75e-c79f-47e6-8adc-ca3ae580ef00\") " pod="openshift-image-registry/image-registry-57496dc5dc-n4ccq" Sep 07 12:38:54.392321 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:38:54.392297 2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 07 12:38:54.392321 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:38:54.392314 2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57496dc5dc-n4ccq: secret "image-registry-tls" not found Sep 07 12:38:54.392687 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.392326 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e54bd75e-c79f-47e6-8adc-ca3ae580ef00-installation-pull-secrets\") pod \"image-registry-57496dc5dc-n4ccq\" (UID: \"e54bd75e-c79f-47e6-8adc-ca3ae580ef00\") " pod="openshift-image-registry/image-registry-57496dc5dc-n4ccq" Sep 07 12:38:54.392687 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.392352 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhc2b\" (UniqueName: \"kubernetes.io/projected/b0aadd3e-6997-4856-ad61-71b4c6074fc0-kube-api-access-nhc2b\") pod \"volume-data-source-validator-695c895bd6-qlwkf\" (UID: \"b0aadd3e-6997-4856-ad61-71b4c6074fc0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-qlwkf" Sep 07 12:38:54.392687 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:38:54.392374 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e54bd75e-c79f-47e6-8adc-ca3ae580ef00-registry-tls podName:e54bd75e-c79f-47e6-8adc-ca3ae580ef00 nodeName:}" failed. No retries permitted until 2026-09-07 12:38:54.892356283 +0000 UTC m=+263.042785977 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e54bd75e-c79f-47e6-8adc-ca3ae580ef00-registry-tls") pod "image-registry-57496dc5dc-n4ccq" (UID: "e54bd75e-c79f-47e6-8adc-ca3ae580ef00") : secret "image-registry-tls" not found Sep 07 12:38:54.392687 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.392430 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e54bd75e-c79f-47e6-8adc-ca3ae580ef00-bound-sa-token\") pod \"image-registry-57496dc5dc-n4ccq\" (UID: \"e54bd75e-c79f-47e6-8adc-ca3ae580ef00\") " pod="openshift-image-registry/image-registry-57496dc5dc-n4ccq" Sep 07 12:38:54.392687 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.392487 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zb6xk\" (UniqueName: \"kubernetes.io/projected/e54bd75e-c79f-47e6-8adc-ca3ae580ef00-kube-api-access-zb6xk\") pod \"image-registry-57496dc5dc-n4ccq\" (UID: \"e54bd75e-c79f-47e6-8adc-ca3ae580ef00\") " pod="openshift-image-registry/image-registry-57496dc5dc-n4ccq" Sep 07 12:38:54.392687 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.392646 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e54bd75e-c79f-47e6-8adc-ca3ae580ef00-ca-trust-extracted\") pod \"image-registry-57496dc5dc-n4ccq\" (UID: \"e54bd75e-c79f-47e6-8adc-ca3ae580ef00\") " pod="openshift-image-registry/image-registry-57496dc5dc-n4ccq" Sep 07 12:38:54.392997 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.392887 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e54bd75e-c79f-47e6-8adc-ca3ae580ef00-registry-certificates\") pod \"image-registry-57496dc5dc-n4ccq\" (UID: \"e54bd75e-c79f-47e6-8adc-ca3ae580ef00\") " pod="openshift-image-registry/image-registry-57496dc5dc-n4ccq" Sep 07 12:38:54.393338 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.393319 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e54bd75e-c79f-47e6-8adc-ca3ae580ef00-trusted-ca\") pod \"image-registry-57496dc5dc-n4ccq\" (UID: \"e54bd75e-c79f-47e6-8adc-ca3ae580ef00\") " pod="openshift-image-registry/image-registry-57496dc5dc-n4ccq" Sep 07 12:38:54.394833 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.394813 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e54bd75e-c79f-47e6-8adc-ca3ae580ef00-installation-pull-secrets\") pod \"image-registry-57496dc5dc-n4ccq\" (UID: \"e54bd75e-c79f-47e6-8adc-ca3ae580ef00\") " pod="openshift-image-registry/image-registry-57496dc5dc-n4ccq" Sep 07 12:38:54.394995 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.394977 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e54bd75e-c79f-47e6-8adc-ca3ae580ef00-image-registry-private-configuration\") pod \"image-registry-57496dc5dc-n4ccq\" (UID: \"e54bd75e-c79f-47e6-8adc-ca3ae580ef00\") " pod="openshift-image-registry/image-registry-57496dc5dc-n4ccq" Sep 07 12:38:54.403292 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.403264 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zb6xk\" (UniqueName: \"kubernetes.io/projected/e54bd75e-c79f-47e6-8adc-ca3ae580ef00-kube-api-access-zb6xk\") pod \"image-registry-57496dc5dc-n4ccq\" (UID: \"e54bd75e-c79f-47e6-8adc-ca3ae580ef00\") " pod="openshift-image-registry/image-registry-57496dc5dc-n4ccq" Sep 07 12:38:54.403657 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.403640 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e54bd75e-c79f-47e6-8adc-ca3ae580ef00-bound-sa-token\") pod \"image-registry-57496dc5dc-n4ccq\" (UID: \"e54bd75e-c79f-47e6-8adc-ca3ae580ef00\") " pod="openshift-image-registry/image-registry-57496dc5dc-n4ccq" Sep 07 12:38:54.422723 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.422700 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-85b454874b-95d8r"] Sep 07 12:38:54.424937 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.424926 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-95d8r" Sep 07 12:38:54.427454 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.427432 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Sep 07 12:38:54.428151 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.428137 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Sep 07 12:38:54.428259 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.428242 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Sep 07 12:38:54.428357 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.428337 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-lxwnl\"" Sep 07 12:38:54.429136 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.429123 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Sep 07 12:38:54.434846 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.434829 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Sep 07 12:38:54.439595 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.439572 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-95d8r"] Sep 07 12:38:54.493641 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.493568 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhc2b\" (UniqueName: \"kubernetes.io/projected/b0aadd3e-6997-4856-ad61-71b4c6074fc0-kube-api-access-nhc2b\") pod \"volume-data-source-validator-695c895bd6-qlwkf\" (UID: \"b0aadd3e-6997-4856-ad61-71b4c6074fc0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-qlwkf" Sep 07 12:38:54.493641 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.493607 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ffbb335e-25ad-4f94-bd83-40889a6970b3-trusted-ca\") pod \"console-operator-85b454874b-95d8r\" (UID: \"ffbb335e-25ad-4f94-bd83-40889a6970b3\") " pod="openshift-console-operator/console-operator-85b454874b-95d8r" Sep 07 12:38:54.493773 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.493670 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccqhw\" (UniqueName: \"kubernetes.io/projected/6d8d95ce-f1c7-4a00-a97b-952fe9e285a8-kube-api-access-ccqhw\") pod \"network-check-source-685456655f-mr8hn\" (UID: \"6d8d95ce-f1c7-4a00-a97b-952fe9e285a8\") " pod="openshift-network-diagnostics/network-check-source-685456655f-mr8hn" Sep 07 12:38:54.493773 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.493694 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4d7jg\" (UniqueName: \"kubernetes.io/projected/ffbb335e-25ad-4f94-bd83-40889a6970b3-kube-api-access-4d7jg\") pod \"console-operator-85b454874b-95d8r\" (UID: \"ffbb335e-25ad-4f94-bd83-40889a6970b3\") " pod="openshift-console-operator/console-operator-85b454874b-95d8r" Sep 07 12:38:54.493773 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.493730 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ffbb335e-25ad-4f94-bd83-40889a6970b3-config\") pod \"console-operator-85b454874b-95d8r\" (UID: \"ffbb335e-25ad-4f94-bd83-40889a6970b3\") " pod="openshift-console-operator/console-operator-85b454874b-95d8r" Sep 07 12:38:54.493773 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.493753 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ffbb335e-25ad-4f94-bd83-40889a6970b3-serving-cert\") pod \"console-operator-85b454874b-95d8r\" (UID: \"ffbb335e-25ad-4f94-bd83-40889a6970b3\") " pod="openshift-console-operator/console-operator-85b454874b-95d8r" Sep 07 12:38:54.501448 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.501430 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhc2b\" (UniqueName: \"kubernetes.io/projected/b0aadd3e-6997-4856-ad61-71b4c6074fc0-kube-api-access-nhc2b\") pod \"volume-data-source-validator-695c895bd6-qlwkf\" (UID: \"b0aadd3e-6997-4856-ad61-71b4c6074fc0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-qlwkf" Sep 07 12:38:54.501530 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.501459 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccqhw\" (UniqueName: \"kubernetes.io/projected/6d8d95ce-f1c7-4a00-a97b-952fe9e285a8-kube-api-access-ccqhw\") pod \"network-check-source-685456655f-mr8hn\" (UID: \"6d8d95ce-f1c7-4a00-a97b-952fe9e285a8\") " pod="openshift-network-diagnostics/network-check-source-685456655f-mr8hn" Sep 07 12:38:54.594952 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.594918 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4d7jg\" (UniqueName: \"kubernetes.io/projected/ffbb335e-25ad-4f94-bd83-40889a6970b3-kube-api-access-4d7jg\") pod \"console-operator-85b454874b-95d8r\" (UID: \"ffbb335e-25ad-4f94-bd83-40889a6970b3\") " pod="openshift-console-operator/console-operator-85b454874b-95d8r" Sep 07 12:38:54.595054 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.594958 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ffbb335e-25ad-4f94-bd83-40889a6970b3-config\") pod \"console-operator-85b454874b-95d8r\" (UID: \"ffbb335e-25ad-4f94-bd83-40889a6970b3\") " pod="openshift-console-operator/console-operator-85b454874b-95d8r" Sep 07 12:38:54.595054 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.594980 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ffbb335e-25ad-4f94-bd83-40889a6970b3-serving-cert\") pod \"console-operator-85b454874b-95d8r\" (UID: \"ffbb335e-25ad-4f94-bd83-40889a6970b3\") " pod="openshift-console-operator/console-operator-85b454874b-95d8r" Sep 07 12:38:54.595131 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.595056 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ffbb335e-25ad-4f94-bd83-40889a6970b3-trusted-ca\") pod \"console-operator-85b454874b-95d8r\" (UID: \"ffbb335e-25ad-4f94-bd83-40889a6970b3\") " pod="openshift-console-operator/console-operator-85b454874b-95d8r" Sep 07 12:38:54.595670 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.595652 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ffbb335e-25ad-4f94-bd83-40889a6970b3-config\") pod \"console-operator-85b454874b-95d8r\" (UID: \"ffbb335e-25ad-4f94-bd83-40889a6970b3\") " pod="openshift-console-operator/console-operator-85b454874b-95d8r" Sep 07 12:38:54.595891 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.595875 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ffbb335e-25ad-4f94-bd83-40889a6970b3-trusted-ca\") pod \"console-operator-85b454874b-95d8r\" (UID: \"ffbb335e-25ad-4f94-bd83-40889a6970b3\") " pod="openshift-console-operator/console-operator-85b454874b-95d8r" Sep 07 12:38:54.597217 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.597201 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ffbb335e-25ad-4f94-bd83-40889a6970b3-serving-cert\") pod \"console-operator-85b454874b-95d8r\" (UID: \"ffbb335e-25ad-4f94-bd83-40889a6970b3\") " pod="openshift-console-operator/console-operator-85b454874b-95d8r" Sep 07 12:38:54.603265 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.603243 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4d7jg\" (UniqueName: \"kubernetes.io/projected/ffbb335e-25ad-4f94-bd83-40889a6970b3-kube-api-access-4d7jg\") pod \"console-operator-85b454874b-95d8r\" (UID: \"ffbb335e-25ad-4f94-bd83-40889a6970b3\") " pod="openshift-console-operator/console-operator-85b454874b-95d8r" Sep 07 12:38:54.637750 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.637725 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-mr8hn" Sep 07 12:38:54.642462 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.642443 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-qlwkf" Sep 07 12:38:54.733945 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.733920 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-95d8r" Sep 07 12:38:54.897785 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.897754 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e54bd75e-c79f-47e6-8adc-ca3ae580ef00-registry-tls\") pod \"image-registry-57496dc5dc-n4ccq\" (UID: \"e54bd75e-c79f-47e6-8adc-ca3ae580ef00\") " pod="openshift-image-registry/image-registry-57496dc5dc-n4ccq" Sep 07 12:38:54.897970 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:38:54.897930 2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 07 12:38:54.897970 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:38:54.897953 2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57496dc5dc-n4ccq: secret "image-registry-tls" not found Sep 07 12:38:54.898079 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:38:54.898068 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e54bd75e-c79f-47e6-8adc-ca3ae580ef00-registry-tls podName:e54bd75e-c79f-47e6-8adc-ca3ae580ef00 nodeName:}" failed. No retries permitted until 2026-09-07 12:38:55.898044849 +0000 UTC m=+264.048474563 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e54bd75e-c79f-47e6-8adc-ca3ae580ef00-registry-tls") pod "image-registry-57496dc5dc-n4ccq" (UID: "e54bd75e-c79f-47e6-8adc-ca3ae580ef00") : secret "image-registry-tls" not found Sep 07 12:38:54.910190 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.910161 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-mr8hn"] Sep 07 12:38:54.911007 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:54.910981 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-qlwkf"] Sep 07 12:38:54.913771 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:38:54.913743 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0aadd3e_6997_4856_ad61_71b4c6074fc0.slice/crio-33fd830e6bec3a1bf385819383298d3fa993d0df0747542be788c1037aee332b WatchSource:0}: Error finding container 33fd830e6bec3a1bf385819383298d3fa993d0df0747542be788c1037aee332b: Status 404 returned error can't find the container with id 33fd830e6bec3a1bf385819383298d3fa993d0df0747542be788c1037aee332b Sep 07 12:38:54.914321 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:38:54.914261 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d8d95ce_f1c7_4a00_a97b_952fe9e285a8.slice/crio-c84bdcd6c6d66915f6bde3e2ce6a780d6a5f4cccaf846549c101fb32fdc41587 WatchSource:0}: Error finding container c84bdcd6c6d66915f6bde3e2ce6a780d6a5f4cccaf846549c101fb32fdc41587: Status 404 returned error can't find the container with id c84bdcd6c6d66915f6bde3e2ce6a780d6a5f4cccaf846549c101fb32fdc41587 Sep 07 12:38:55.000257 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:55.000228 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-95d8r"] Sep 07 12:38:55.003301 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:38:55.003273 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffbb335e_25ad_4f94_bd83_40889a6970b3.slice/crio-be8cae17b71e8854e332e7bab2515c0a1fa48a9dcd6a927089445ad723568689 WatchSource:0}: Error finding container be8cae17b71e8854e332e7bab2515c0a1fa48a9dcd6a927089445ad723568689: Status 404 returned error can't find the container with id be8cae17b71e8854e332e7bab2515c0a1fa48a9dcd6a927089445ad723568689 Sep 07 12:38:55.072274 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:55.072192 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-95d8r" event={"ID":"ffbb335e-25ad-4f94-bd83-40889a6970b3","Type":"ContainerStarted","Data":"be8cae17b71e8854e332e7bab2515c0a1fa48a9dcd6a927089445ad723568689"} Sep 07 12:38:55.073353 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:55.073319 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-qlwkf" event={"ID":"b0aadd3e-6997-4856-ad61-71b4c6074fc0","Type":"ContainerStarted","Data":"33fd830e6bec3a1bf385819383298d3fa993d0df0747542be788c1037aee332b"} Sep 07 12:38:55.074829 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:55.074806 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-mr8hn" event={"ID":"6d8d95ce-f1c7-4a00-a97b-952fe9e285a8","Type":"ContainerStarted","Data":"51deff025e8d3714e56b7d651adb9ab93f138bf9746c4d88fba3325a10226f4f"} Sep 07 12:38:55.074923 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:55.074850 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-mr8hn" event={"ID":"6d8d95ce-f1c7-4a00-a97b-952fe9e285a8","Type":"ContainerStarted","Data":"c84bdcd6c6d66915f6bde3e2ce6a780d6a5f4cccaf846549c101fb32fdc41587"} Sep 07 12:38:55.090481 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:55.090443 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-685456655f-mr8hn" podStartSLOduration=1.090428693 podStartE2EDuration="1.090428693s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:38:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:38:55.089859827 +0000 UTC m=+263.240289542" watchObservedRunningTime="2026-09-07 12:38:55.090428693 +0000 UTC m=+263.240858408" Sep 07 12:38:55.907128 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:55.907082 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e54bd75e-c79f-47e6-8adc-ca3ae580ef00-registry-tls\") pod \"image-registry-57496dc5dc-n4ccq\" (UID: \"e54bd75e-c79f-47e6-8adc-ca3ae580ef00\") " pod="openshift-image-registry/image-registry-57496dc5dc-n4ccq" Sep 07 12:38:55.907553 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:38:55.907237 2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 07 12:38:55.907553 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:38:55.907259 2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57496dc5dc-n4ccq: secret "image-registry-tls" not found Sep 07 12:38:55.907553 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:38:55.907314 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e54bd75e-c79f-47e6-8adc-ca3ae580ef00-registry-tls podName:e54bd75e-c79f-47e6-8adc-ca3ae580ef00 nodeName:}" failed. No retries permitted until 2026-09-07 12:38:57.907299216 +0000 UTC m=+266.057728914 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e54bd75e-c79f-47e6-8adc-ca3ae580ef00-registry-tls") pod "image-registry-57496dc5dc-n4ccq" (UID: "e54bd75e-c79f-47e6-8adc-ca3ae580ef00") : secret "image-registry-tls" not found Sep 07 12:38:57.087532 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:57.087499 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-95d8r_ffbb335e-25ad-4f94-bd83-40889a6970b3/console-operator/0.log" Sep 07 12:38:57.087922 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:57.087554 2584 generic.go:356] "Generic (PLEG): container finished" podID="ffbb335e-25ad-4f94-bd83-40889a6970b3" containerID="2e412a5c962c389de021f35ab626bbe5e6c5b82fccae8462fc714a21f457089d" exitCode=255 Sep 07 12:38:57.087922 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:57.087590 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-95d8r" event={"ID":"ffbb335e-25ad-4f94-bd83-40889a6970b3","Type":"ContainerDied","Data":"2e412a5c962c389de021f35ab626bbe5e6c5b82fccae8462fc714a21f457089d"} Sep 07 12:38:57.087922 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:57.087879 2584 scope.go:117] "RemoveContainer" containerID="2e412a5c962c389de021f35ab626bbe5e6c5b82fccae8462fc714a21f457089d" Sep 07 12:38:57.926503 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:57.926418 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e54bd75e-c79f-47e6-8adc-ca3ae580ef00-registry-tls\") pod \"image-registry-57496dc5dc-n4ccq\" (UID: \"e54bd75e-c79f-47e6-8adc-ca3ae580ef00\") " pod="openshift-image-registry/image-registry-57496dc5dc-n4ccq" Sep 07 12:38:57.926670 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:38:57.926531 2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 07 12:38:57.926670 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:38:57.926542 2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57496dc5dc-n4ccq: secret "image-registry-tls" not found Sep 07 12:38:57.926670 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:38:57.926590 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e54bd75e-c79f-47e6-8adc-ca3ae580ef00-registry-tls podName:e54bd75e-c79f-47e6-8adc-ca3ae580ef00 nodeName:}" failed. No retries permitted until 2026-09-07 12:39:01.926575887 +0000 UTC m=+270.077005580 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e54bd75e-c79f-47e6-8adc-ca3ae580ef00-registry-tls") pod "image-registry-57496dc5dc-n4ccq" (UID: "e54bd75e-c79f-47e6-8adc-ca3ae580ef00") : secret "image-registry-tls" not found Sep 07 12:38:58.092783 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:58.092745 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-qlwkf" event={"ID":"b0aadd3e-6997-4856-ad61-71b4c6074fc0","Type":"ContainerStarted","Data":"6b6e3b0dba0b9ad1cf1fa675301391885b0c719f4b59bbc443e0a9024754e630"} Sep 07 12:38:58.094305 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:58.094286 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-95d8r_ffbb335e-25ad-4f94-bd83-40889a6970b3/console-operator/1.log" Sep 07 12:38:58.094726 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:58.094711 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-95d8r_ffbb335e-25ad-4f94-bd83-40889a6970b3/console-operator/0.log" Sep 07 12:38:58.094774 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:58.094744 2584 generic.go:356] "Generic (PLEG): container finished" podID="ffbb335e-25ad-4f94-bd83-40889a6970b3" containerID="57cf6a23203806b139fd3ba6daa74a1861bb1b2c7acd2772a839e7c200a2edd0" exitCode=255 Sep 07 12:38:58.094815 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:58.094771 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-95d8r" event={"ID":"ffbb335e-25ad-4f94-bd83-40889a6970b3","Type":"ContainerDied","Data":"57cf6a23203806b139fd3ba6daa74a1861bb1b2c7acd2772a839e7c200a2edd0"} Sep 07 12:38:58.094851 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:58.094826 2584 scope.go:117] "RemoveContainer" containerID="2e412a5c962c389de021f35ab626bbe5e6c5b82fccae8462fc714a21f457089d" Sep 07 12:38:58.094975 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:58.094960 2584 scope.go:117] "RemoveContainer" containerID="57cf6a23203806b139fd3ba6daa74a1861bb1b2c7acd2772a839e7c200a2edd0" Sep 07 12:38:58.095119 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:38:58.095097 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-95d8r_openshift-console-operator(ffbb335e-25ad-4f94-bd83-40889a6970b3)\"" pod="openshift-console-operator/console-operator-85b454874b-95d8r" podUID="ffbb335e-25ad-4f94-bd83-40889a6970b3" Sep 07 12:38:58.109487 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:58.109451 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-qlwkf" podStartSLOduration=1.364554596 podStartE2EDuration="4.109437597s" totalImagesPullingTime="2.744883001s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:38:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:38:58.107889422 +0000 UTC m=+266.258319170" watchObservedRunningTime="2026-09-07 12:38:58.109437597 +0000 UTC m=+266.259867313" Sep 07 12:38:59.099396 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:59.099369 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-95d8r_ffbb335e-25ad-4f94-bd83-40889a6970b3/console-operator/1.log" Sep 07 12:38:59.099846 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:59.099827 2584 scope.go:117] "RemoveContainer" containerID="57cf6a23203806b139fd3ba6daa74a1861bb1b2c7acd2772a839e7c200a2edd0" Sep 07 12:38:59.100008 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:38:59.099989 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-95d8r_openshift-console-operator(ffbb335e-25ad-4f94-bd83-40889a6970b3)\"" pod="openshift-console-operator/console-operator-85b454874b-95d8r" podUID="ffbb335e-25ad-4f94-bd83-40889a6970b3" Sep 07 12:38:59.931500 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:59.931461 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mvzqf"] Sep 07 12:38:59.934303 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:59.934285 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mvzqf" Sep 07 12:38:59.937459 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:59.937425 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 07 12:38:59.937689 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:59.937670 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-bxwzv\"" Sep 07 12:38:59.939273 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:59.939251 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 07 12:38:59.939366 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:59.939254 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 07 12:38:59.939366 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:59.939319 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 07 12:38:59.946088 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:38:59.946066 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mvzqf"] Sep 07 12:39:00.040514 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:00.040480 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mvzqf\" (UID: \"66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d\") " pod="openshift-insights/insights-runtime-extractor-mvzqf" Sep 07 12:39:00.040514 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:00.040515 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d-data-volume\") pod \"insights-runtime-extractor-mvzqf\" (UID: \"66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d\") " pod="openshift-insights/insights-runtime-extractor-mvzqf" Sep 07 12:39:00.040737 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:00.040545 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mvzqf\" (UID: \"66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d\") " pod="openshift-insights/insights-runtime-extractor-mvzqf" Sep 07 12:39:00.040737 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:00.040596 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d-crio-socket\") pod \"insights-runtime-extractor-mvzqf\" (UID: \"66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d\") " pod="openshift-insights/insights-runtime-extractor-mvzqf" Sep 07 12:39:00.040737 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:00.040642 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwl2s\" (UniqueName: \"kubernetes.io/projected/66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d-kube-api-access-fwl2s\") pod \"insights-runtime-extractor-mvzqf\" (UID: \"66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d\") " pod="openshift-insights/insights-runtime-extractor-mvzqf" Sep 07 12:39:00.141897 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:00.141858 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mvzqf\" (UID: \"66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d\") " pod="openshift-insights/insights-runtime-extractor-mvzqf" Sep 07 12:39:00.142311 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:00.141909 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d-crio-socket\") pod \"insights-runtime-extractor-mvzqf\" (UID: \"66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d\") " pod="openshift-insights/insights-runtime-extractor-mvzqf" Sep 07 12:39:00.142311 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:00.141928 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwl2s\" (UniqueName: \"kubernetes.io/projected/66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d-kube-api-access-fwl2s\") pod \"insights-runtime-extractor-mvzqf\" (UID: \"66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d\") " pod="openshift-insights/insights-runtime-extractor-mvzqf" Sep 07 12:39:00.142311 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:00.141985 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mvzqf\" (UID: \"66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d\") " pod="openshift-insights/insights-runtime-extractor-mvzqf" Sep 07 12:39:00.142311 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:00.141995 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d-crio-socket\") pod \"insights-runtime-extractor-mvzqf\" (UID: \"66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d\") " pod="openshift-insights/insights-runtime-extractor-mvzqf" Sep 07 12:39:00.142311 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:39:00.142008 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 12:39:00.142311 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:39:00.142040 2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 07 12:39:00.142311 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:00.142008 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d-data-volume\") pod \"insights-runtime-extractor-mvzqf\" (UID: \"66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d\") " pod="openshift-insights/insights-runtime-extractor-mvzqf" Sep 07 12:39:00.142311 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:39:00.142121 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d-kube-rbac-proxy-cm podName:66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d nodeName:}" failed. No retries permitted until 2026-09-07 12:39:00.64207933 +0000 UTC m=+268.792509027 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mvzqf" (UID: "66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d") : configmap "kube-rbac-proxy" not found Sep 07 12:39:00.142311 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:39:00.142163 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d-insights-runtime-extractor-tls podName:66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d nodeName:}" failed. No retries permitted until 2026-09-07 12:39:00.642155659 +0000 UTC m=+268.792585357 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mvzqf" (UID: "66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d") : secret "insights-runtime-extractor-tls" not found Sep 07 12:39:00.142311 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:00.142280 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d-data-volume\") pod \"insights-runtime-extractor-mvzqf\" (UID: \"66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d\") " pod="openshift-insights/insights-runtime-extractor-mvzqf" Sep 07 12:39:00.153814 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:00.153783 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwl2s\" (UniqueName: \"kubernetes.io/projected/66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d-kube-api-access-fwl2s\") pod \"insights-runtime-extractor-mvzqf\" (UID: \"66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d\") " pod="openshift-insights/insights-runtime-extractor-mvzqf" Sep 07 12:39:00.646897 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:00.646864 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mvzqf\" (UID: \"66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d\") " pod="openshift-insights/insights-runtime-extractor-mvzqf" Sep 07 12:39:00.647062 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:00.646915 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mvzqf\" (UID: \"66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d\") " pod="openshift-insights/insights-runtime-extractor-mvzqf" Sep 07 12:39:00.647062 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:39:00.646997 2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 07 12:39:00.647062 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:39:00.647021 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 12:39:00.647226 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:39:00.647067 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d-kube-rbac-proxy-cm podName:66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d nodeName:}" failed. No retries permitted until 2026-09-07 12:39:01.647051555 +0000 UTC m=+269.797481259 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mvzqf" (UID: "66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d") : configmap "kube-rbac-proxy" not found Sep 07 12:39:00.647226 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:39:00.647081 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d-insights-runtime-extractor-tls podName:66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d nodeName:}" failed. No retries permitted until 2026-09-07 12:39:01.647075651 +0000 UTC m=+269.797505355 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mvzqf" (UID: "66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d") : secret "insights-runtime-extractor-tls" not found Sep 07 12:39:00.848204 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:00.848169 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-6z2vx"] Sep 07 12:39:00.850409 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:00.850388 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-6z2vx" Sep 07 12:39:00.852977 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:00.852954 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Sep 07 12:39:00.854148 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:00.854128 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-54sq5\"" Sep 07 12:39:00.854230 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:00.854129 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Sep 07 12:39:00.861240 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:00.861219 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-6z2vx"] Sep 07 12:39:00.949092 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:00.949061 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h26xq\" (UniqueName: \"kubernetes.io/projected/b2d75c22-36b3-4dcf-b699-52a36f064985-kube-api-access-h26xq\") pod \"migrator-fdbb8fdff-6z2vx\" (UID: \"b2d75c22-36b3-4dcf-b699-52a36f064985\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-6z2vx" Sep 07 12:39:01.050239 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:01.050207 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h26xq\" (UniqueName: \"kubernetes.io/projected/b2d75c22-36b3-4dcf-b699-52a36f064985-kube-api-access-h26xq\") pod \"migrator-fdbb8fdff-6z2vx\" (UID: \"b2d75c22-36b3-4dcf-b699-52a36f064985\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-6z2vx" Sep 07 12:39:01.059576 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:01.059546 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h26xq\" (UniqueName: \"kubernetes.io/projected/b2d75c22-36b3-4dcf-b699-52a36f064985-kube-api-access-h26xq\") pod \"migrator-fdbb8fdff-6z2vx\" (UID: \"b2d75c22-36b3-4dcf-b699-52a36f064985\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-6z2vx" Sep 07 12:39:01.159168 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:01.159134 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-6z2vx" Sep 07 12:39:01.428163 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:01.428131 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-6z2vx"] Sep 07 12:39:01.431683 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:39:01.431648 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2d75c22_36b3_4dcf_b699_52a36f064985.slice/crio-a3cb3d159368f6a54fab1f5701b387b1caab1ceedff742feb2f143921e4ad03f WatchSource:0}: Error finding container a3cb3d159368f6a54fab1f5701b387b1caab1ceedff742feb2f143921e4ad03f: Status 404 returned error can't find the container with id a3cb3d159368f6a54fab1f5701b387b1caab1ceedff742feb2f143921e4ad03f Sep 07 12:39:01.655869 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:01.655763 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mvzqf\" (UID: \"66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d\") " pod="openshift-insights/insights-runtime-extractor-mvzqf" Sep 07 12:39:01.655869 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:01.655835 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mvzqf\" (UID: \"66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d\") " pod="openshift-insights/insights-runtime-extractor-mvzqf" Sep 07 12:39:01.656107 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:39:01.655902 2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 07 12:39:01.656107 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:39:01.655933 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 12:39:01.656107 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:39:01.655985 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d-kube-rbac-proxy-cm podName:66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d nodeName:}" failed. No retries permitted until 2026-09-07 12:39:03.655965246 +0000 UTC m=+271.806394939 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mvzqf" (UID: "66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d") : configmap "kube-rbac-proxy" not found Sep 07 12:39:01.656107 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:39:01.656004 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d-insights-runtime-extractor-tls podName:66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d nodeName:}" failed. No retries permitted until 2026-09-07 12:39:03.655995746 +0000 UTC m=+271.806425441 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mvzqf" (UID: "66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d") : secret "insights-runtime-extractor-tls" not found Sep 07 12:39:01.889995 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:01.889967 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ctd66_a1abf056-5424-47f2-b0cc-9e4791a442e4/dns-node-resolver/0.log" Sep 07 12:39:01.958886 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:01.958854 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e54bd75e-c79f-47e6-8adc-ca3ae580ef00-registry-tls\") pod \"image-registry-57496dc5dc-n4ccq\" (UID: \"e54bd75e-c79f-47e6-8adc-ca3ae580ef00\") " pod="openshift-image-registry/image-registry-57496dc5dc-n4ccq" Sep 07 12:39:01.959034 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:39:01.958997 2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 07 12:39:01.959034 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:39:01.959016 2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57496dc5dc-n4ccq: secret "image-registry-tls" not found Sep 07 12:39:01.959149 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:39:01.959074 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e54bd75e-c79f-47e6-8adc-ca3ae580ef00-registry-tls podName:e54bd75e-c79f-47e6-8adc-ca3ae580ef00 nodeName:}" failed. No retries permitted until 2026-09-07 12:39:09.959058553 +0000 UTC m=+278.109488247 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e54bd75e-c79f-47e6-8adc-ca3ae580ef00-registry-tls") pod "image-registry-57496dc5dc-n4ccq" (UID: "e54bd75e-c79f-47e6-8adc-ca3ae580ef00") : secret "image-registry-tls" not found Sep 07 12:39:02.110298 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:02.110257 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-6z2vx" event={"ID":"b2d75c22-36b3-4dcf-b699-52a36f064985","Type":"ContainerStarted","Data":"a3cb3d159368f6a54fab1f5701b387b1caab1ceedff742feb2f143921e4ad03f"} Sep 07 12:39:03.091190 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:03.091160 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xsqsc_eb990ca0-9dd8-4a6a-9aea-385184d47b70/node-ca/0.log" Sep 07 12:39:03.491940 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:03.491905 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qsnps_07c2afb8-7cde-4925-9f93-13aaf570f1fa/serve-healthcheck-canary/0.log" Sep 07 12:39:03.670711 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:03.670675 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mvzqf\" (UID: \"66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d\") " pod="openshift-insights/insights-runtime-extractor-mvzqf" Sep 07 12:39:03.670903 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:03.670737 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mvzqf\" (UID: \"66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d\") " pod="openshift-insights/insights-runtime-extractor-mvzqf" Sep 07 12:39:03.670903 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:39:03.670822 2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 07 12:39:03.670903 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:39:03.670845 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 12:39:03.670903 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:39:03.670904 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d-kube-rbac-proxy-cm podName:66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d nodeName:}" failed. No retries permitted until 2026-09-07 12:39:07.67088605 +0000 UTC m=+275.821315748 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mvzqf" (UID: "66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d") : configmap "kube-rbac-proxy" not found Sep 07 12:39:03.671096 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:39:03.670921 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d-insights-runtime-extractor-tls podName:66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d nodeName:}" failed. No retries permitted until 2026-09-07 12:39:07.670914416 +0000 UTC m=+275.821344111 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mvzqf" (UID: "66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d") : secret "insights-runtime-extractor-tls" not found Sep 07 12:39:04.118439 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:04.118360 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-6z2vx" event={"ID":"b2d75c22-36b3-4dcf-b699-52a36f064985","Type":"ContainerStarted","Data":"04c92e53f69658a71a8d3a48da309c5537710210c673cf9a70cb7c62d9c380e3"} Sep 07 12:39:04.118439 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:04.118419 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-6z2vx" event={"ID":"b2d75c22-36b3-4dcf-b699-52a36f064985","Type":"ContainerStarted","Data":"c9c589a1b0622a4919095ddf5d07018d429d2666b2e5e96fbdfaf59eabab60d3"} Sep 07 12:39:04.152263 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:04.152206 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-6z2vx" podStartSLOduration=1.7916451549999999 podStartE2EDuration="4.152189185s" totalImagesPullingTime="2.36054403s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:39:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:39:04.15114379 +0000 UTC m=+272.301580764" watchObservedRunningTime="2026-09-07 12:39:04.152189185 +0000 UTC m=+272.302618895" Sep 07 12:39:04.734467 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:04.734428 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-95d8r" Sep 07 12:39:04.734686 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:04.734521 2584 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-95d8r" Sep 07 12:39:04.734923 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:04.734906 2584 scope.go:117] "RemoveContainer" containerID="57cf6a23203806b139fd3ba6daa74a1861bb1b2c7acd2772a839e7c200a2edd0" Sep 07 12:39:04.735096 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:39:04.735075 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-95d8r_openshift-console-operator(ffbb335e-25ad-4f94-bd83-40889a6970b3)\"" pod="openshift-console-operator/console-operator-85b454874b-95d8r" podUID="ffbb335e-25ad-4f94-bd83-40889a6970b3" Sep 07 12:39:07.706212 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:07.706172 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mvzqf\" (UID: \"66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d\") " pod="openshift-insights/insights-runtime-extractor-mvzqf" Sep 07 12:39:07.706585 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:07.706245 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mvzqf\" (UID: \"66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d\") " pod="openshift-insights/insights-runtime-extractor-mvzqf" Sep 07 12:39:07.706585 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:39:07.706317 2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 07 12:39:07.706585 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:39:07.706317 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 12:39:07.706585 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:39:07.706368 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d-kube-rbac-proxy-cm podName:66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d nodeName:}" failed. No retries permitted until 2026-09-07 12:39:15.70635464 +0000 UTC m=+283.856784333 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mvzqf" (UID: "66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d") : configmap "kube-rbac-proxy" not found Sep 07 12:39:07.706585 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:39:07.706386 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d-insights-runtime-extractor-tls podName:66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d nodeName:}" failed. No retries permitted until 2026-09-07 12:39:15.706373777 +0000 UTC m=+283.856803470 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mvzqf" (UID: "66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d") : secret "insights-runtime-extractor-tls" not found Sep 07 12:39:10.022967 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:10.022923 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e54bd75e-c79f-47e6-8adc-ca3ae580ef00-registry-tls\") pod \"image-registry-57496dc5dc-n4ccq\" (UID: \"e54bd75e-c79f-47e6-8adc-ca3ae580ef00\") " pod="openshift-image-registry/image-registry-57496dc5dc-n4ccq" Sep 07 12:39:10.025522 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:10.025501 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e54bd75e-c79f-47e6-8adc-ca3ae580ef00-registry-tls\") pod \"image-registry-57496dc5dc-n4ccq\" (UID: \"e54bd75e-c79f-47e6-8adc-ca3ae580ef00\") " pod="openshift-image-registry/image-registry-57496dc5dc-n4ccq" Sep 07 12:39:10.136287 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:10.136253 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57496dc5dc-n4ccq" Sep 07 12:39:10.407637 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:10.407533 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57496dc5dc-n4ccq"] Sep 07 12:39:10.410576 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:39:10.410550 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode54bd75e_c79f_47e6_8adc_ca3ae580ef00.slice/crio-7cf85bf0eb4705d8ab564d93571cb22ed55140452fe38d40309ec9dad5d5f78b WatchSource:0}: Error finding container 7cf85bf0eb4705d8ab564d93571cb22ed55140452fe38d40309ec9dad5d5f78b: Status 404 returned error can't find the container with id 7cf85bf0eb4705d8ab564d93571cb22ed55140452fe38d40309ec9dad5d5f78b Sep 07 12:39:11.140110 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:11.140068 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57496dc5dc-n4ccq" event={"ID":"e54bd75e-c79f-47e6-8adc-ca3ae580ef00","Type":"ContainerStarted","Data":"d0cb23087c4eb0bfa80616f8a698a7a674c76a37a348dda07b3966b0884145ca"} Sep 07 12:39:11.140468 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:11.140119 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57496dc5dc-n4ccq" event={"ID":"e54bd75e-c79f-47e6-8adc-ca3ae580ef00","Type":"ContainerStarted","Data":"7cf85bf0eb4705d8ab564d93571cb22ed55140452fe38d40309ec9dad5d5f78b"} Sep 07 12:39:11.140468 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:11.140137 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-57496dc5dc-n4ccq" Sep 07 12:39:11.160257 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:11.160209 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-57496dc5dc-n4ccq" podStartSLOduration=17.160193726 podStartE2EDuration="17.160193726s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:38:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:39:11.15956673 +0000 UTC m=+279.309996466" watchObservedRunningTime="2026-09-07 12:39:11.160193726 +0000 UTC m=+279.310623441" Sep 07 12:39:12.818065 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:39:12.818005 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-jv7nm" podUID="7c51fa57-4e30-481f-8ed2-c2ed61972d2e" Sep 07 12:39:13.146539 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:13.146462 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jv7nm" Sep 07 12:39:15.761908 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:15.761844 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mvzqf\" (UID: \"66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d\") " pod="openshift-insights/insights-runtime-extractor-mvzqf" Sep 07 12:39:15.762432 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:15.761967 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mvzqf\" (UID: \"66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d\") " pod="openshift-insights/insights-runtime-extractor-mvzqf" Sep 07 12:39:15.762432 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:39:15.761974 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 12:39:15.762432 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:39:15.762046 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d-insights-runtime-extractor-tls podName:66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d nodeName:}" failed. No retries permitted until 2026-09-07 12:39:31.762028909 +0000 UTC m=+299.912458635 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mvzqf" (UID: "66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d") : secret "insights-runtime-extractor-tls" not found Sep 07 12:39:15.762767 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:15.762745 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mvzqf\" (UID: \"66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d\") " pod="openshift-insights/insights-runtime-extractor-mvzqf" Sep 07 12:39:16.567768 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:16.567734 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c51fa57-4e30-481f-8ed2-c2ed61972d2e-metrics-tls\") pod \"dns-default-jv7nm\" (UID: \"7c51fa57-4e30-481f-8ed2-c2ed61972d2e\") " pod="openshift-dns/dns-default-jv7nm" Sep 07 12:39:16.570159 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:16.570134 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c51fa57-4e30-481f-8ed2-c2ed61972d2e-metrics-tls\") pod \"dns-default-jv7nm\" (UID: \"7c51fa57-4e30-481f-8ed2-c2ed61972d2e\") " pod="openshift-dns/dns-default-jv7nm" Sep 07 12:39:16.749771 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:16.749740 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nvqb4\"" Sep 07 12:39:16.757918 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:16.757895 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jv7nm" Sep 07 12:39:17.030878 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:17.030850 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jv7nm"] Sep 07 12:39:17.034357 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:39:17.034330 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c51fa57_4e30_481f_8ed2_c2ed61972d2e.slice/crio-b03e93db7d9ddb45f598fcd1bf4979f55df1bc7030cd0a4f3d17668cbe986613 WatchSource:0}: Error finding container b03e93db7d9ddb45f598fcd1bf4979f55df1bc7030cd0a4f3d17668cbe986613: Status 404 returned error can't find the container with id b03e93db7d9ddb45f598fcd1bf4979f55df1bc7030cd0a4f3d17668cbe986613 Sep 07 12:39:17.160124 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:17.160093 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jv7nm" event={"ID":"7c51fa57-4e30-481f-8ed2-c2ed61972d2e","Type":"ContainerStarted","Data":"b03e93db7d9ddb45f598fcd1bf4979f55df1bc7030cd0a4f3d17668cbe986613"} Sep 07 12:39:18.333317 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:18.333289 2584 scope.go:117] "RemoveContainer" containerID="57cf6a23203806b139fd3ba6daa74a1861bb1b2c7acd2772a839e7c200a2edd0" Sep 07 12:39:19.168884 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:19.168858 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-95d8r_ffbb335e-25ad-4f94-bd83-40889a6970b3/console-operator/2.log" Sep 07 12:39:19.169266 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:19.169249 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-95d8r_ffbb335e-25ad-4f94-bd83-40889a6970b3/console-operator/1.log" Sep 07 12:39:19.169335 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:19.169282 2584 generic.go:356] "Generic (PLEG): container finished" podID="ffbb335e-25ad-4f94-bd83-40889a6970b3" containerID="224477afd205414fe3fa7b467a925c7d867cd2601f0024635af2f1c5b01f2b47" exitCode=255 Sep 07 12:39:19.169335 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:19.169326 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-95d8r" event={"ID":"ffbb335e-25ad-4f94-bd83-40889a6970b3","Type":"ContainerDied","Data":"224477afd205414fe3fa7b467a925c7d867cd2601f0024635af2f1c5b01f2b47"} Sep 07 12:39:19.169399 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:19.169370 2584 scope.go:117] "RemoveContainer" containerID="57cf6a23203806b139fd3ba6daa74a1861bb1b2c7acd2772a839e7c200a2edd0" Sep 07 12:39:19.169771 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:19.169755 2584 scope.go:117] "RemoveContainer" containerID="224477afd205414fe3fa7b467a925c7d867cd2601f0024635af2f1c5b01f2b47" Sep 07 12:39:19.169959 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:39:19.169937 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-85b454874b-95d8r_openshift-console-operator(ffbb335e-25ad-4f94-bd83-40889a6970b3)\"" pod="openshift-console-operator/console-operator-85b454874b-95d8r" podUID="ffbb335e-25ad-4f94-bd83-40889a6970b3" Sep 07 12:39:20.174332 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:20.174295 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jv7nm" event={"ID":"7c51fa57-4e30-481f-8ed2-c2ed61972d2e","Type":"ContainerStarted","Data":"1fdb41f37c50dd4437149d33b216eda6c08bb05dc229a3c808aed9545e0e0f88"} Sep 07 12:39:20.174832 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:20.174353 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jv7nm" event={"ID":"7c51fa57-4e30-481f-8ed2-c2ed61972d2e","Type":"ContainerStarted","Data":"1e0426cd097a1bce00883bb4ba673971e51bd2c4490a173a408f0fd3535ce029"} Sep 07 12:39:20.174832 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:20.174399 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-jv7nm" Sep 07 12:39:20.175857 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:20.175840 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-95d8r_ffbb335e-25ad-4f94-bd83-40889a6970b3/console-operator/2.log" Sep 07 12:39:20.195020 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:20.194973 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-jv7nm" podStartSLOduration=252.030564188 podStartE2EDuration="4m14.194956906s" totalImagesPullingTime="2.164392718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:35:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:39:20.19456252 +0000 UTC m=+288.344992261" watchObservedRunningTime="2026-09-07 12:39:20.194956906 +0000 UTC m=+288.345386624" Sep 07 12:39:24.734715 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:24.734680 2584 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-95d8r" Sep 07 12:39:24.735081 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:24.734730 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-95d8r" Sep 07 12:39:24.735081 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:24.734999 2584 scope.go:117] "RemoveContainer" containerID="224477afd205414fe3fa7b467a925c7d867cd2601f0024635af2f1c5b01f2b47" Sep 07 12:39:24.735149 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:39:24.735131 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-85b454874b-95d8r_openshift-console-operator(ffbb335e-25ad-4f94-bd83-40889a6970b3)\"" pod="openshift-console-operator/console-operator-85b454874b-95d8r" podUID="ffbb335e-25ad-4f94-bd83-40889a6970b3" Sep 07 12:39:27.486249 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:27.486216 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-57496dc5dc-n4ccq"] Sep 07 12:39:27.490658 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:27.490631 2584 patch_prober.go:28] interesting pod/image-registry-57496dc5dc-n4ccq container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 07 12:39:27.490776 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:27.490674 2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-57496dc5dc-n4ccq" podUID="e54bd75e-c79f-47e6-8adc-ca3ae580ef00" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 07 12:39:27.537132 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:27.537098 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7c5c654c5f-wrtnb"] Sep 07 12:39:27.539184 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:27.539169 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c5c654c5f-wrtnb" Sep 07 12:39:27.553758 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:27.553735 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c5c654c5f-wrtnb"] Sep 07 12:39:27.650867 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:27.650842 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njbwn\" (UniqueName: \"kubernetes.io/projected/2a9f187b-0ff2-496a-9656-8c2f24e4f6d9-kube-api-access-njbwn\") pod \"image-registry-7c5c654c5f-wrtnb\" (UID: \"2a9f187b-0ff2-496a-9656-8c2f24e4f6d9\") " pod="openshift-image-registry/image-registry-7c5c654c5f-wrtnb" Sep 07 12:39:27.650998 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:27.650874 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2a9f187b-0ff2-496a-9656-8c2f24e4f6d9-installation-pull-secrets\") pod \"image-registry-7c5c654c5f-wrtnb\" (UID: \"2a9f187b-0ff2-496a-9656-8c2f24e4f6d9\") " pod="openshift-image-registry/image-registry-7c5c654c5f-wrtnb" Sep 07 12:39:27.650998 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:27.650899 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2a9f187b-0ff2-496a-9656-8c2f24e4f6d9-bound-sa-token\") pod \"image-registry-7c5c654c5f-wrtnb\" (UID: \"2a9f187b-0ff2-496a-9656-8c2f24e4f6d9\") " pod="openshift-image-registry/image-registry-7c5c654c5f-wrtnb" Sep 07 12:39:27.650998 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:27.650919 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2a9f187b-0ff2-496a-9656-8c2f24e4f6d9-ca-trust-extracted\") pod \"image-registry-7c5c654c5f-wrtnb\" (UID: \"2a9f187b-0ff2-496a-9656-8c2f24e4f6d9\") " pod="openshift-image-registry/image-registry-7c5c654c5f-wrtnb" Sep 07 12:39:27.650998 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:27.650991 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2a9f187b-0ff2-496a-9656-8c2f24e4f6d9-registry-certificates\") pod \"image-registry-7c5c654c5f-wrtnb\" (UID: \"2a9f187b-0ff2-496a-9656-8c2f24e4f6d9\") " pod="openshift-image-registry/image-registry-7c5c654c5f-wrtnb" Sep 07 12:39:27.651175 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:27.651043 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2a9f187b-0ff2-496a-9656-8c2f24e4f6d9-image-registry-private-configuration\") pod \"image-registry-7c5c654c5f-wrtnb\" (UID: \"2a9f187b-0ff2-496a-9656-8c2f24e4f6d9\") " pod="openshift-image-registry/image-registry-7c5c654c5f-wrtnb" Sep 07 12:39:27.651175 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:27.651070 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2a9f187b-0ff2-496a-9656-8c2f24e4f6d9-trusted-ca\") pod \"image-registry-7c5c654c5f-wrtnb\" (UID: \"2a9f187b-0ff2-496a-9656-8c2f24e4f6d9\") " pod="openshift-image-registry/image-registry-7c5c654c5f-wrtnb" Sep 07 12:39:27.651175 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:27.651087 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2a9f187b-0ff2-496a-9656-8c2f24e4f6d9-registry-tls\") pod \"image-registry-7c5c654c5f-wrtnb\" (UID: \"2a9f187b-0ff2-496a-9656-8c2f24e4f6d9\") " pod="openshift-image-registry/image-registry-7c5c654c5f-wrtnb" Sep 07 12:39:27.752387 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:27.752317 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2a9f187b-0ff2-496a-9656-8c2f24e4f6d9-registry-certificates\") pod \"image-registry-7c5c654c5f-wrtnb\" (UID: \"2a9f187b-0ff2-496a-9656-8c2f24e4f6d9\") " pod="openshift-image-registry/image-registry-7c5c654c5f-wrtnb" Sep 07 12:39:27.752387 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:27.752362 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2a9f187b-0ff2-496a-9656-8c2f24e4f6d9-image-registry-private-configuration\") pod \"image-registry-7c5c654c5f-wrtnb\" (UID: \"2a9f187b-0ff2-496a-9656-8c2f24e4f6d9\") " pod="openshift-image-registry/image-registry-7c5c654c5f-wrtnb" Sep 07 12:39:27.752387 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:27.752385 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2a9f187b-0ff2-496a-9656-8c2f24e4f6d9-trusted-ca\") pod \"image-registry-7c5c654c5f-wrtnb\" (UID: \"2a9f187b-0ff2-496a-9656-8c2f24e4f6d9\") " pod="openshift-image-registry/image-registry-7c5c654c5f-wrtnb" Sep 07 12:39:27.752680 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:27.752403 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2a9f187b-0ff2-496a-9656-8c2f24e4f6d9-registry-tls\") pod \"image-registry-7c5c654c5f-wrtnb\" (UID: \"2a9f187b-0ff2-496a-9656-8c2f24e4f6d9\") " pod="openshift-image-registry/image-registry-7c5c654c5f-wrtnb" Sep 07 12:39:27.752680 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:27.752525 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njbwn\" (UniqueName: \"kubernetes.io/projected/2a9f187b-0ff2-496a-9656-8c2f24e4f6d9-kube-api-access-njbwn\") pod \"image-registry-7c5c654c5f-wrtnb\" (UID: \"2a9f187b-0ff2-496a-9656-8c2f24e4f6d9\") " pod="openshift-image-registry/image-registry-7c5c654c5f-wrtnb" Sep 07 12:39:27.752680 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:27.752566 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2a9f187b-0ff2-496a-9656-8c2f24e4f6d9-installation-pull-secrets\") pod \"image-registry-7c5c654c5f-wrtnb\" (UID: \"2a9f187b-0ff2-496a-9656-8c2f24e4f6d9\") " pod="openshift-image-registry/image-registry-7c5c654c5f-wrtnb" Sep 07 12:39:27.752680 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:27.752670 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2a9f187b-0ff2-496a-9656-8c2f24e4f6d9-bound-sa-token\") pod \"image-registry-7c5c654c5f-wrtnb\" (UID: \"2a9f187b-0ff2-496a-9656-8c2f24e4f6d9\") " pod="openshift-image-registry/image-registry-7c5c654c5f-wrtnb" Sep 07 12:39:27.752886 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:27.752730 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2a9f187b-0ff2-496a-9656-8c2f24e4f6d9-ca-trust-extracted\") pod \"image-registry-7c5c654c5f-wrtnb\" (UID: \"2a9f187b-0ff2-496a-9656-8c2f24e4f6d9\") " pod="openshift-image-registry/image-registry-7c5c654c5f-wrtnb" Sep 07 12:39:27.753203 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:27.753178 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2a9f187b-0ff2-496a-9656-8c2f24e4f6d9-ca-trust-extracted\") pod \"image-registry-7c5c654c5f-wrtnb\" (UID: \"2a9f187b-0ff2-496a-9656-8c2f24e4f6d9\") " pod="openshift-image-registry/image-registry-7c5c654c5f-wrtnb" Sep 07 12:39:27.753307 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:27.753292 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2a9f187b-0ff2-496a-9656-8c2f24e4f6d9-registry-certificates\") pod \"image-registry-7c5c654c5f-wrtnb\" (UID: \"2a9f187b-0ff2-496a-9656-8c2f24e4f6d9\") " pod="openshift-image-registry/image-registry-7c5c654c5f-wrtnb" Sep 07 12:39:27.753380 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:27.753348 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2a9f187b-0ff2-496a-9656-8c2f24e4f6d9-trusted-ca\") pod \"image-registry-7c5c654c5f-wrtnb\" (UID: \"2a9f187b-0ff2-496a-9656-8c2f24e4f6d9\") " pod="openshift-image-registry/image-registry-7c5c654c5f-wrtnb" Sep 07 12:39:27.754981 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:27.754960 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2a9f187b-0ff2-496a-9656-8c2f24e4f6d9-registry-tls\") pod \"image-registry-7c5c654c5f-wrtnb\" (UID: \"2a9f187b-0ff2-496a-9656-8c2f24e4f6d9\") " pod="openshift-image-registry/image-registry-7c5c654c5f-wrtnb" Sep 07 12:39:27.755441 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:27.755414 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2a9f187b-0ff2-496a-9656-8c2f24e4f6d9-image-registry-private-configuration\") pod \"image-registry-7c5c654c5f-wrtnb\" (UID: \"2a9f187b-0ff2-496a-9656-8c2f24e4f6d9\") " pod="openshift-image-registry/image-registry-7c5c654c5f-wrtnb" Sep 07 12:39:27.755517 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:27.755485 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2a9f187b-0ff2-496a-9656-8c2f24e4f6d9-installation-pull-secrets\") pod \"image-registry-7c5c654c5f-wrtnb\" (UID: \"2a9f187b-0ff2-496a-9656-8c2f24e4f6d9\") " pod="openshift-image-registry/image-registry-7c5c654c5f-wrtnb" Sep 07 12:39:27.761908 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:27.761885 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2a9f187b-0ff2-496a-9656-8c2f24e4f6d9-bound-sa-token\") pod \"image-registry-7c5c654c5f-wrtnb\" (UID: \"2a9f187b-0ff2-496a-9656-8c2f24e4f6d9\") " pod="openshift-image-registry/image-registry-7c5c654c5f-wrtnb" Sep 07 12:39:27.762281 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:27.762264 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njbwn\" (UniqueName: \"kubernetes.io/projected/2a9f187b-0ff2-496a-9656-8c2f24e4f6d9-kube-api-access-njbwn\") pod \"image-registry-7c5c654c5f-wrtnb\" (UID: \"2a9f187b-0ff2-496a-9656-8c2f24e4f6d9\") " pod="openshift-image-registry/image-registry-7c5c654c5f-wrtnb" Sep 07 12:39:27.847688 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:27.847663 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c5c654c5f-wrtnb" Sep 07 12:39:28.123057 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:28.122983 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c5c654c5f-wrtnb"] Sep 07 12:39:28.126027 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:39:28.126001 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a9f187b_0ff2_496a_9656_8c2f24e4f6d9.slice/crio-bb4a875a154a180e4f36d6c2b5db19cd9668558eb1de2c9381df806b497d2d4c WatchSource:0}: Error finding container bb4a875a154a180e4f36d6c2b5db19cd9668558eb1de2c9381df806b497d2d4c: Status 404 returned error can't find the container with id bb4a875a154a180e4f36d6c2b5db19cd9668558eb1de2c9381df806b497d2d4c Sep 07 12:39:28.204550 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:28.204512 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c5c654c5f-wrtnb" event={"ID":"2a9f187b-0ff2-496a-9656-8c2f24e4f6d9","Type":"ContainerStarted","Data":"bd5ac4e5673c8174241020244494d831ff621689357e2515b1a438eddb4f82e2"} Sep 07 12:39:28.204550 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:28.204557 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c5c654c5f-wrtnb" event={"ID":"2a9f187b-0ff2-496a-9656-8c2f24e4f6d9","Type":"ContainerStarted","Data":"bb4a875a154a180e4f36d6c2b5db19cd9668558eb1de2c9381df806b497d2d4c"} Sep 07 12:39:28.204762 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:28.204655 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7c5c654c5f-wrtnb" Sep 07 12:39:28.223313 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:28.223265 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7c5c654c5f-wrtnb" podStartSLOduration=1.223248803 podStartE2EDuration="1.223248803s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:39:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:39:28.222779818 +0000 UTC m=+296.373209533" watchObservedRunningTime="2026-09-07 12:39:28.223248803 +0000 UTC m=+296.373678518" Sep 07 12:39:29.333540 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:39:29.333507 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-lkvmb" podUID="2350fd1e-ae4b-48d4-9ef6-e45cb3f83129" Sep 07 12:39:30.181345 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:30.181317 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-jv7nm" Sep 07 12:39:31.781154 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:31.781111 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mvzqf\" (UID: \"66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d\") " pod="openshift-insights/insights-runtime-extractor-mvzqf" Sep 07 12:39:31.783508 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:31.783484 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mvzqf\" (UID: \"66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d\") " pod="openshift-insights/insights-runtime-extractor-mvzqf" Sep 07 12:39:32.043229 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:32.043130 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mvzqf" Sep 07 12:39:32.203502 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:32.203474 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-95d8r_ffbb335e-25ad-4f94-bd83-40889a6970b3/console-operator/2.log" Sep 07 12:39:32.203703 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:32.203584 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-95d8r_ffbb335e-25ad-4f94-bd83-40889a6970b3/console-operator/2.log" Sep 07 12:39:32.214690 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:32.214667 2584 kubelet.go:1648] "Image garbage collection succeeded" Sep 07 12:39:32.316141 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:32.315959 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mvzqf"] Sep 07 12:39:32.321699 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:39:32.319489 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66d1b7b5_af8a_4e2a_af8b_20047a1c1d6d.slice/crio-32b28c332c3ce31370b8730e242d7ad748a9ed29f9fdc3011e5839939558f634 WatchSource:0}: Error finding container 32b28c332c3ce31370b8730e242d7ad748a9ed29f9fdc3011e5839939558f634: Status 404 returned error can't find the container with id 32b28c332c3ce31370b8730e242d7ad748a9ed29f9fdc3011e5839939558f634 Sep 07 12:39:33.222048 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:33.222008 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mvzqf" event={"ID":"66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d","Type":"ContainerStarted","Data":"69d47baf11f9146b4f7a0ae40115d4f8aba1be73aabc5ad1a9e428fb09129e1e"} Sep 07 12:39:33.222405 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:33.222067 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mvzqf" event={"ID":"66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d","Type":"ContainerStarted","Data":"32b28c332c3ce31370b8730e242d7ad748a9ed29f9fdc3011e5839939558f634"} Sep 07 12:39:33.914428 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:33.914409 2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 07 12:39:34.227629 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:34.227594 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mvzqf" event={"ID":"66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d","Type":"ContainerStarted","Data":"d9fdb5340cfe7d949fea5f3fd4c8ff35039d3defc46c8f5370f6b56dc58240cb"} Sep 07 12:39:35.232916 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:35.232883 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mvzqf" event={"ID":"66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d","Type":"ContainerStarted","Data":"b5ffe671bc4d8f611bf8d8eef8db78c1dcc4b78368730c3b31d281ebfe6c3b49"} Sep 07 12:39:35.256176 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:35.256116 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-mvzqf" podStartSLOduration=33.545714527 podStartE2EDuration="36.256101246s" totalImagesPullingTime="2.710386719s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:38:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:39:35.254941461 +0000 UTC m=+303.405371168" watchObservedRunningTime="2026-09-07 12:39:35.256101246 +0000 UTC m=+303.406530955" Sep 07 12:39:35.394112 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:35.394073 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-dnnn9"] Sep 07 12:39:35.397199 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:35.397176 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-dnnn9" Sep 07 12:39:35.401587 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:35.400860 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 07 12:39:35.401587 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:35.401339 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 07 12:39:35.401587 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:35.401330 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 07 12:39:35.401860 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:35.401676 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 07 12:39:35.403739 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:35.403688 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 07 12:39:35.403886 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:35.403866 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-4nflr\"" Sep 07 12:39:35.414187 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:35.414164 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-dnnn9"] Sep 07 12:39:35.467385 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:35.467354 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-v9fcf"] Sep 07 12:39:35.470676 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:35.470657 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-v9fcf" Sep 07 12:39:35.473801 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:35.473778 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 07 12:39:35.473914 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:35.473830 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 07 12:39:35.473914 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:35.473867 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 07 12:39:35.474444 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:35.474426 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dnzl5\"" Sep 07 12:39:35.508938 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:35.508907 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b2f99789-a263-40a6-8746-5cbf29ceb9ac-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-dnnn9\" (UID: \"b2f99789-a263-40a6-8746-5cbf29ceb9ac\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-dnnn9" Sep 07 12:39:35.509084 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:35.508952 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b2f99789-a263-40a6-8746-5cbf29ceb9ac-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-dnnn9\" (UID: \"b2f99789-a263-40a6-8746-5cbf29ceb9ac\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-dnnn9" Sep 07 12:39:35.509084 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:35.508974 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2f99789-a263-40a6-8746-5cbf29ceb9ac-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-dnnn9\" (UID: \"b2f99789-a263-40a6-8746-5cbf29ceb9ac\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-dnnn9" Sep 07 12:39:35.509084 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:35.509017 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmvzp\" (UniqueName: \"kubernetes.io/projected/b2f99789-a263-40a6-8746-5cbf29ceb9ac-kube-api-access-rmvzp\") pod \"openshift-state-metrics-657fd6c54-dnnn9\" (UID: \"b2f99789-a263-40a6-8746-5cbf29ceb9ac\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-dnnn9" Sep 07 12:39:35.610248 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:35.610215 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/975c7a1a-4d2c-4ba7-be6c-4192ea6795d6-root\") pod \"node-exporter-v9fcf\" (UID: \"975c7a1a-4d2c-4ba7-be6c-4192ea6795d6\") " pod="openshift-monitoring/node-exporter-v9fcf" Sep 07 12:39:35.610390 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:35.610267 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/975c7a1a-4d2c-4ba7-be6c-4192ea6795d6-node-exporter-textfile\") pod \"node-exporter-v9fcf\" (UID: \"975c7a1a-4d2c-4ba7-be6c-4192ea6795d6\") " pod="openshift-monitoring/node-exporter-v9fcf" Sep 07 12:39:35.610390 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:35.610308 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/975c7a1a-4d2c-4ba7-be6c-4192ea6795d6-node-exporter-tls\") pod \"node-exporter-v9fcf\" (UID: \"975c7a1a-4d2c-4ba7-be6c-4192ea6795d6\") " pod="openshift-monitoring/node-exporter-v9fcf" Sep 07 12:39:35.610390 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:35.610357 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b2f99789-a263-40a6-8746-5cbf29ceb9ac-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-dnnn9\" (UID: \"b2f99789-a263-40a6-8746-5cbf29ceb9ac\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-dnnn9" Sep 07 12:39:35.610390 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:35.610381 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/975c7a1a-4d2c-4ba7-be6c-4192ea6795d6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v9fcf\" (UID: \"975c7a1a-4d2c-4ba7-be6c-4192ea6795d6\") " pod="openshift-monitoring/node-exporter-v9fcf" Sep 07 12:39:35.610695 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:35.610400 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/975c7a1a-4d2c-4ba7-be6c-4192ea6795d6-node-exporter-wtmp\") pod \"node-exporter-v9fcf\" (UID: \"975c7a1a-4d2c-4ba7-be6c-4192ea6795d6\") " pod="openshift-monitoring/node-exporter-v9fcf" Sep 07 12:39:35.610695 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:35.610455 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/975c7a1a-4d2c-4ba7-be6c-4192ea6795d6-node-exporter-accelerators-collector-config\") pod \"node-exporter-v9fcf\" (UID: \"975c7a1a-4d2c-4ba7-be6c-4192ea6795d6\") " pod="openshift-monitoring/node-exporter-v9fcf" Sep 07 12:39:35.610695 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:35.610502 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b2f99789-a263-40a6-8746-5cbf29ceb9ac-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-dnnn9\" (UID: \"b2f99789-a263-40a6-8746-5cbf29ceb9ac\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-dnnn9" Sep 07 12:39:35.610695 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:35.610539 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2f99789-a263-40a6-8746-5cbf29ceb9ac-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-dnnn9\" (UID: \"b2f99789-a263-40a6-8746-5cbf29ceb9ac\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-dnnn9" Sep 07 12:39:35.610695 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:35.610567 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmvzp\" (UniqueName: \"kubernetes.io/projected/b2f99789-a263-40a6-8746-5cbf29ceb9ac-kube-api-access-rmvzp\") pod \"openshift-state-metrics-657fd6c54-dnnn9\" (UID: \"b2f99789-a263-40a6-8746-5cbf29ceb9ac\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-dnnn9" Sep 07 12:39:35.610695 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:35.610596 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/975c7a1a-4d2c-4ba7-be6c-4192ea6795d6-metrics-client-ca\") pod \"node-exporter-v9fcf\" (UID: \"975c7a1a-4d2c-4ba7-be6c-4192ea6795d6\") " pod="openshift-monitoring/node-exporter-v9fcf" Sep 07 12:39:35.610695 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:39:35.610598 2584 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Sep 07 12:39:35.610695 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:35.610642 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2h57\" (UniqueName: \"kubernetes.io/projected/975c7a1a-4d2c-4ba7-be6c-4192ea6795d6-kube-api-access-p2h57\") pod \"node-exporter-v9fcf\" (UID: \"975c7a1a-4d2c-4ba7-be6c-4192ea6795d6\") " pod="openshift-monitoring/node-exporter-v9fcf" Sep 07 12:39:35.610695 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:35.610664 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/975c7a1a-4d2c-4ba7-be6c-4192ea6795d6-sys\") pod \"node-exporter-v9fcf\" (UID: \"975c7a1a-4d2c-4ba7-be6c-4192ea6795d6\") " pod="openshift-monitoring/node-exporter-v9fcf" Sep 07 12:39:35.610695 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:39:35.610686 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2f99789-a263-40a6-8746-5cbf29ceb9ac-openshift-state-metrics-tls podName:b2f99789-a263-40a6-8746-5cbf29ceb9ac nodeName:}" failed. No retries permitted until 2026-09-07 12:39:36.11066506 +0000 UTC m=+304.261094774 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/b2f99789-a263-40a6-8746-5cbf29ceb9ac-openshift-state-metrics-tls") pod "openshift-state-metrics-657fd6c54-dnnn9" (UID: "b2f99789-a263-40a6-8746-5cbf29ceb9ac") : secret "openshift-state-metrics-tls" not found Sep 07 12:39:35.611170 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:35.611153 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2f99789-a263-40a6-8746-5cbf29ceb9ac-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-dnnn9\" (UID: \"b2f99789-a263-40a6-8746-5cbf29ceb9ac\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-dnnn9" Sep 07 12:39:35.612954 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:35.612933 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b2f99789-a263-40a6-8746-5cbf29ceb9ac-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-dnnn9\" (UID: \"b2f99789-a263-40a6-8746-5cbf29ceb9ac\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-dnnn9" Sep 07 12:39:35.620176 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:35.620149 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmvzp\" (UniqueName: \"kubernetes.io/projected/b2f99789-a263-40a6-8746-5cbf29ceb9ac-kube-api-access-rmvzp\") pod \"openshift-state-metrics-657fd6c54-dnnn9\" (UID: \"b2f99789-a263-40a6-8746-5cbf29ceb9ac\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-dnnn9" Sep 07 12:39:35.711475 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:35.711446 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/975c7a1a-4d2c-4ba7-be6c-4192ea6795d6-node-exporter-textfile\") pod \"node-exporter-v9fcf\" (UID: \"975c7a1a-4d2c-4ba7-be6c-4192ea6795d6\") " pod="openshift-monitoring/node-exporter-v9fcf" Sep 07 12:39:35.711475 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:35.711480 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/975c7a1a-4d2c-4ba7-be6c-4192ea6795d6-node-exporter-tls\") pod \"node-exporter-v9fcf\" (UID: \"975c7a1a-4d2c-4ba7-be6c-4192ea6795d6\") " pod="openshift-monitoring/node-exporter-v9fcf" Sep 07 12:39:35.711688 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:35.711503 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/975c7a1a-4d2c-4ba7-be6c-4192ea6795d6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v9fcf\" (UID: \"975c7a1a-4d2c-4ba7-be6c-4192ea6795d6\") " pod="openshift-monitoring/node-exporter-v9fcf" Sep 07 12:39:35.711688 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:35.711665 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/975c7a1a-4d2c-4ba7-be6c-4192ea6795d6-node-exporter-wtmp\") pod \"node-exporter-v9fcf\" (UID: \"975c7a1a-4d2c-4ba7-be6c-4192ea6795d6\") " pod="openshift-monitoring/node-exporter-v9fcf" Sep 07 12:39:35.711773 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:35.711728 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/975c7a1a-4d2c-4ba7-be6c-4192ea6795d6-node-exporter-accelerators-collector-config\") pod \"node-exporter-v9fcf\" (UID: \"975c7a1a-4d2c-4ba7-be6c-4192ea6795d6\") " pod="openshift-monitoring/node-exporter-v9fcf" Sep 07 12:39:35.711819 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:35.711786 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/975c7a1a-4d2c-4ba7-be6c-4192ea6795d6-metrics-client-ca\") pod \"node-exporter-v9fcf\" (UID: \"975c7a1a-4d2c-4ba7-be6c-4192ea6795d6\") " pod="openshift-monitoring/node-exporter-v9fcf" Sep 07 12:39:35.711870 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:35.711817 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2h57\" (UniqueName: \"kubernetes.io/projected/975c7a1a-4d2c-4ba7-be6c-4192ea6795d6-kube-api-access-p2h57\") pod \"node-exporter-v9fcf\" (UID: \"975c7a1a-4d2c-4ba7-be6c-4192ea6795d6\") " pod="openshift-monitoring/node-exporter-v9fcf" Sep 07 12:39:35.711870 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:35.711843 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/975c7a1a-4d2c-4ba7-be6c-4192ea6795d6-sys\") pod \"node-exporter-v9fcf\" (UID: \"975c7a1a-4d2c-4ba7-be6c-4192ea6795d6\") " pod="openshift-monitoring/node-exporter-v9fcf" Sep 07 12:39:35.711987 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:35.711864 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/975c7a1a-4d2c-4ba7-be6c-4192ea6795d6-node-exporter-textfile\") pod \"node-exporter-v9fcf\" (UID: \"975c7a1a-4d2c-4ba7-be6c-4192ea6795d6\") " pod="openshift-monitoring/node-exporter-v9fcf" Sep 07 12:39:35.711987 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:35.711872 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/975c7a1a-4d2c-4ba7-be6c-4192ea6795d6-root\") pod \"node-exporter-v9fcf\" (UID: \"975c7a1a-4d2c-4ba7-be6c-4192ea6795d6\") " pod="openshift-monitoring/node-exporter-v9fcf" Sep 07 12:39:35.711987 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:35.711843 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/975c7a1a-4d2c-4ba7-be6c-4192ea6795d6-node-exporter-wtmp\") pod \"node-exporter-v9fcf\" (UID: \"975c7a1a-4d2c-4ba7-be6c-4192ea6795d6\") " pod="openshift-monitoring/node-exporter-v9fcf" Sep 07 12:39:35.711987 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:35.711946 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/975c7a1a-4d2c-4ba7-be6c-4192ea6795d6-sys\") pod \"node-exporter-v9fcf\" (UID: \"975c7a1a-4d2c-4ba7-be6c-4192ea6795d6\") " pod="openshift-monitoring/node-exporter-v9fcf" Sep 07 12:39:35.711987 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:35.711975 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/975c7a1a-4d2c-4ba7-be6c-4192ea6795d6-root\") pod \"node-exporter-v9fcf\" (UID: \"975c7a1a-4d2c-4ba7-be6c-4192ea6795d6\") " pod="openshift-monitoring/node-exporter-v9fcf" Sep 07 12:39:35.712347 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:35.712324 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/975c7a1a-4d2c-4ba7-be6c-4192ea6795d6-node-exporter-accelerators-collector-config\") pod \"node-exporter-v9fcf\" (UID: \"975c7a1a-4d2c-4ba7-be6c-4192ea6795d6\") " pod="openshift-monitoring/node-exporter-v9fcf" Sep 07 12:39:35.712347 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:35.712340 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/975c7a1a-4d2c-4ba7-be6c-4192ea6795d6-metrics-client-ca\") pod \"node-exporter-v9fcf\" (UID: \"975c7a1a-4d2c-4ba7-be6c-4192ea6795d6\") " pod="openshift-monitoring/node-exporter-v9fcf" Sep 07 12:39:35.713989 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:35.713969 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/975c7a1a-4d2c-4ba7-be6c-4192ea6795d6-node-exporter-tls\") pod \"node-exporter-v9fcf\" (UID: \"975c7a1a-4d2c-4ba7-be6c-4192ea6795d6\") " pod="openshift-monitoring/node-exporter-v9fcf" Sep 07 12:39:35.714104 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:35.714088 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/975c7a1a-4d2c-4ba7-be6c-4192ea6795d6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v9fcf\" (UID: \"975c7a1a-4d2c-4ba7-be6c-4192ea6795d6\") " pod="openshift-monitoring/node-exporter-v9fcf" Sep 07 12:39:35.720731 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:35.720706 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2h57\" (UniqueName: \"kubernetes.io/projected/975c7a1a-4d2c-4ba7-be6c-4192ea6795d6-kube-api-access-p2h57\") pod \"node-exporter-v9fcf\" (UID: \"975c7a1a-4d2c-4ba7-be6c-4192ea6795d6\") " pod="openshift-monitoring/node-exporter-v9fcf" Sep 07 12:39:35.779359 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:35.779328 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-v9fcf" Sep 07 12:39:35.790954 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:39:35.790923 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod975c7a1a_4d2c_4ba7_be6c_4192ea6795d6.slice/crio-e89673efaa5c4cafe12e28b995c564b8dd2f40306fd0fba1371d37ae6f63403a WatchSource:0}: Error finding container e89673efaa5c4cafe12e28b995c564b8dd2f40306fd0fba1371d37ae6f63403a: Status 404 returned error can't find the container with id e89673efaa5c4cafe12e28b995c564b8dd2f40306fd0fba1371d37ae6f63403a Sep 07 12:39:36.115365 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:36.115272 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b2f99789-a263-40a6-8746-5cbf29ceb9ac-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-dnnn9\" (UID: \"b2f99789-a263-40a6-8746-5cbf29ceb9ac\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-dnnn9" Sep 07 12:39:36.117709 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:36.117691 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b2f99789-a263-40a6-8746-5cbf29ceb9ac-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-dnnn9\" (UID: \"b2f99789-a263-40a6-8746-5cbf29ceb9ac\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-dnnn9" Sep 07 12:39:36.236986 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:36.236955 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v9fcf" event={"ID":"975c7a1a-4d2c-4ba7-be6c-4192ea6795d6","Type":"ContainerStarted","Data":"e89673efaa5c4cafe12e28b995c564b8dd2f40306fd0fba1371d37ae6f63403a"} Sep 07 12:39:36.309264 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:36.309231 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-dnnn9" Sep 07 12:39:36.603868 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:36.603793 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-dnnn9"] Sep 07 12:39:36.796657 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:39:36.796610 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2f99789_a263_40a6_8746_5cbf29ceb9ac.slice/crio-a404839a04adc83a35bed36e7d4e1ba378f0c3003a3e7cd8ced31f49539d71c3 WatchSource:0}: Error finding container a404839a04adc83a35bed36e7d4e1ba378f0c3003a3e7cd8ced31f49539d71c3: Status 404 returned error can't find the container with id a404839a04adc83a35bed36e7d4e1ba378f0c3003a3e7cd8ced31f49539d71c3 Sep 07 12:39:37.242272 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:37.242240 2584 generic.go:356] "Generic (PLEG): container finished" podID="975c7a1a-4d2c-4ba7-be6c-4192ea6795d6" containerID="e9371da92d5f0e89f892b94b4e18af8893c7f9e1fb0096d0b6e1dab8b39b174f" exitCode=0 Sep 07 12:39:37.242707 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:37.242316 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v9fcf" event={"ID":"975c7a1a-4d2c-4ba7-be6c-4192ea6795d6","Type":"ContainerDied","Data":"e9371da92d5f0e89f892b94b4e18af8893c7f9e1fb0096d0b6e1dab8b39b174f"} Sep 07 12:39:37.244330 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:37.244297 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-dnnn9" event={"ID":"b2f99789-a263-40a6-8746-5cbf29ceb9ac","Type":"ContainerStarted","Data":"7d23f3a4cb80e65f31902bb0484a1a5d561c281b7da641a67c70cb549135e53b"} Sep 07 12:39:37.244405 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:37.244344 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-dnnn9" event={"ID":"b2f99789-a263-40a6-8746-5cbf29ceb9ac","Type":"ContainerStarted","Data":"d6a8b429064891c045a40c0c53b06b596f40ba4656488b72c0f0e5e453c89a2a"} Sep 07 12:39:37.244405 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:37.244364 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-dnnn9" event={"ID":"b2f99789-a263-40a6-8746-5cbf29ceb9ac","Type":"ContainerStarted","Data":"a404839a04adc83a35bed36e7d4e1ba378f0c3003a3e7cd8ced31f49539d71c3"} Sep 07 12:39:37.491117 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:37.491089 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-57496dc5dc-n4ccq" Sep 07 12:39:38.250733 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:38.250693 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v9fcf" event={"ID":"975c7a1a-4d2c-4ba7-be6c-4192ea6795d6","Type":"ContainerStarted","Data":"00c7651e297c5308090e9974d7d76482dc36246366fc393a71627befd4f73e33"} Sep 07 12:39:38.251137 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:38.250754 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v9fcf" event={"ID":"975c7a1a-4d2c-4ba7-be6c-4192ea6795d6","Type":"ContainerStarted","Data":"90e51b0a0ca6ea7338ea56209c709d04b90dd399935287bfaa3c8796430f79a6"} Sep 07 12:39:38.252576 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:38.252553 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-dnnn9" event={"ID":"b2f99789-a263-40a6-8746-5cbf29ceb9ac","Type":"ContainerStarted","Data":"2ce00e0c34c1fecf8ed3c10b9cf17b6993cc34e9edcc88866e2d7fc263ba9420"} Sep 07 12:39:38.274969 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:38.274929 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-v9fcf" podStartSLOduration=2.152138355 podStartE2EDuration="3.274915852s" totalImagesPullingTime="1.051525059s" totalInitContainerRuntime="71.252438ms" isStatefulPod=true podCreationTimestamp="2026-09-07 12:39:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:39:38.273341217 +0000 UTC m=+306.423770932" watchObservedRunningTime="2026-09-07 12:39:38.274915852 +0000 UTC m=+306.425345647" Sep 07 12:39:38.292966 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:38.292924 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-dnnn9" podStartSLOduration=2.463282491 podStartE2EDuration="3.292911749s" totalImagesPullingTime="829.629258ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:39:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:39:38.292173925 +0000 UTC m=+306.442603661" watchObservedRunningTime="2026-09-07 12:39:38.292911749 +0000 UTC m=+306.443341465" Sep 07 12:39:38.332560 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:38.332534 2584 scope.go:117] "RemoveContainer" containerID="224477afd205414fe3fa7b467a925c7d867cd2601f0024635af2f1c5b01f2b47" Sep 07 12:39:38.332739 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:39:38.332720 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-85b454874b-95d8r_openshift-console-operator(ffbb335e-25ad-4f94-bd83-40889a6970b3)\"" pod="openshift-console-operator/console-operator-85b454874b-95d8r" podUID="ffbb335e-25ad-4f94-bd83-40889a6970b3" Sep 07 12:39:40.143323 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:40.143286 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-mzfld"] Sep 07 12:39:40.146431 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:40.146409 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-mzfld" Sep 07 12:39:40.150681 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:40.150662 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 07 12:39:40.150935 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:40.150921 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-dbclk\"" Sep 07 12:39:40.172629 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:40.172587 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-mzfld"] Sep 07 12:39:40.251331 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:40.251300 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2l42\" (UniqueName: \"kubernetes.io/projected/39d91be9-e619-4aeb-bdc4-0df472e63c07-kube-api-access-w2l42\") pod \"monitoring-plugin-85bbbbbf4-mzfld\" (UID: \"39d91be9-e619-4aeb-bdc4-0df472e63c07\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-mzfld" Sep 07 12:39:40.251477 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:40.251356 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/39d91be9-e619-4aeb-bdc4-0df472e63c07-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-mzfld\" (UID: \"39d91be9-e619-4aeb-bdc4-0df472e63c07\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-mzfld" Sep 07 12:39:40.352277 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:40.352240 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/39d91be9-e619-4aeb-bdc4-0df472e63c07-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-mzfld\" (UID: \"39d91be9-e619-4aeb-bdc4-0df472e63c07\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-mzfld" Sep 07 12:39:40.352436 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:40.352324 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2l42\" (UniqueName: \"kubernetes.io/projected/39d91be9-e619-4aeb-bdc4-0df472e63c07-kube-api-access-w2l42\") pod \"monitoring-plugin-85bbbbbf4-mzfld\" (UID: \"39d91be9-e619-4aeb-bdc4-0df472e63c07\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-mzfld" Sep 07 12:39:40.352436 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:39:40.352406 2584 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Sep 07 12:39:40.352558 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:39:40.352475 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39d91be9-e619-4aeb-bdc4-0df472e63c07-monitoring-plugin-cert podName:39d91be9-e619-4aeb-bdc4-0df472e63c07 nodeName:}" failed. No retries permitted until 2026-09-07 12:39:40.852459199 +0000 UTC m=+309.002888893 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/39d91be9-e619-4aeb-bdc4-0df472e63c07-monitoring-plugin-cert") pod "monitoring-plugin-85bbbbbf4-mzfld" (UID: "39d91be9-e619-4aeb-bdc4-0df472e63c07") : secret "monitoring-plugin-cert" not found Sep 07 12:39:40.364610 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:40.364579 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2l42\" (UniqueName: \"kubernetes.io/projected/39d91be9-e619-4aeb-bdc4-0df472e63c07-kube-api-access-w2l42\") pod \"monitoring-plugin-85bbbbbf4-mzfld\" (UID: \"39d91be9-e619-4aeb-bdc4-0df472e63c07\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-mzfld" Sep 07 12:39:40.858356 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:40.858314 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/39d91be9-e619-4aeb-bdc4-0df472e63c07-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-mzfld\" (UID: \"39d91be9-e619-4aeb-bdc4-0df472e63c07\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-mzfld" Sep 07 12:39:40.860868 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:40.860845 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/39d91be9-e619-4aeb-bdc4-0df472e63c07-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-mzfld\" (UID: \"39d91be9-e619-4aeb-bdc4-0df472e63c07\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-mzfld" Sep 07 12:39:41.055381 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.055349 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-mzfld" Sep 07 12:39:41.325410 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.325387 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-mzfld"] Sep 07 12:39:41.328010 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:39:41.327985 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39d91be9_e619_4aeb_bdc4_0df472e63c07.slice/crio-12b3e16515529d9c139c415d183f8dcdd70ec81e7501a44c5d7a35be73ad0487 WatchSource:0}: Error finding container 12b3e16515529d9c139c415d183f8dcdd70ec81e7501a44c5d7a35be73ad0487: Status 404 returned error can't find the container with id 12b3e16515529d9c139c415d183f8dcdd70ec81e7501a44c5d7a35be73ad0487 Sep 07 12:39:41.332659 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.332602 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lkvmb" Sep 07 12:39:41.714982 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.714943 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 12:39:41.719836 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.719813 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:39:41.723142 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.723116 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 07 12:39:41.723142 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.723133 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 07 12:39:41.723319 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.723121 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 07 12:39:41.724205 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.724188 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 07 12:39:41.724282 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.724210 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 07 12:39:41.724594 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.724574 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 07 12:39:41.724594 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.724591 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 07 12:39:41.724770 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.724646 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 07 12:39:41.724770 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.724704 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 07 12:39:41.724770 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.724737 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 07 12:39:41.724979 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.724799 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 07 12:39:41.724979 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.724842 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 07 12:39:41.724979 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.724850 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 07 12:39:41.724979 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.724854 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 07 12:39:41.725147 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.725123 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-wnb52\"" Sep 07 12:39:41.725206 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.725124 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-43ii4ohffr47m\"" Sep 07 12:39:41.727295 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.727272 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 07 12:39:41.733738 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.733720 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 12:39:41.867966 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.867927 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/26f9a2db-4e41-40bc-8e15-d9d0495689b3-web-config\") pod \"prometheus-k8s-0\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:39:41.868149 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.867967 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/26f9a2db-4e41-40bc-8e15-d9d0495689b3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:39:41.868149 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.867996 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/26f9a2db-4e41-40bc-8e15-d9d0495689b3-config\") pod \"prometheus-k8s-0\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:39:41.868149 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.868018 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/26f9a2db-4e41-40bc-8e15-d9d0495689b3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:39:41.868149 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.868050 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/26f9a2db-4e41-40bc-8e15-d9d0495689b3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:39:41.868149 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.868072 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26f9a2db-4e41-40bc-8e15-d9d0495689b3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:39:41.868149 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.868096 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/26f9a2db-4e41-40bc-8e15-d9d0495689b3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:39:41.868149 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.868118 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26f9a2db-4e41-40bc-8e15-d9d0495689b3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:39:41.868487 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.868207 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/26f9a2db-4e41-40bc-8e15-d9d0495689b3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:39:41.868487 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.868304 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/26f9a2db-4e41-40bc-8e15-d9d0495689b3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:39:41.868487 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.868371 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26f9a2db-4e41-40bc-8e15-d9d0495689b3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:39:41.868487 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.868407 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/26f9a2db-4e41-40bc-8e15-d9d0495689b3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:39:41.868487 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.868480 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/26f9a2db-4e41-40bc-8e15-d9d0495689b3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:39:41.868760 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.868502 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/26f9a2db-4e41-40bc-8e15-d9d0495689b3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:39:41.868760 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.868538 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/26f9a2db-4e41-40bc-8e15-d9d0495689b3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:39:41.868760 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.868561 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/26f9a2db-4e41-40bc-8e15-d9d0495689b3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:39:41.868760 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.868589 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/26f9a2db-4e41-40bc-8e15-d9d0495689b3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:39:41.868760 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.868656 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/26f9a2db-4e41-40bc-8e15-d9d0495689b3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:39:41.868760 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.868681 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/26f9a2db-4e41-40bc-8e15-d9d0495689b3-config-out\") pod \"prometheus-k8s-0\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:39:41.868760 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.868710 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dppv4\" (UniqueName: \"kubernetes.io/projected/26f9a2db-4e41-40bc-8e15-d9d0495689b3-kube-api-access-dppv4\") pod \"prometheus-k8s-0\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:39:41.970143 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.970055 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26f9a2db-4e41-40bc-8e15-d9d0495689b3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:39:41.970143 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.970098 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/26f9a2db-4e41-40bc-8e15-d9d0495689b3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:39:41.970361 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.970231 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/26f9a2db-4e41-40bc-8e15-d9d0495689b3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:39:41.970361 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.970271 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/26f9a2db-4e41-40bc-8e15-d9d0495689b3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:39:41.970464 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.970410 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/26f9a2db-4e41-40bc-8e15-d9d0495689b3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:39:41.970464 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.970456 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/26f9a2db-4e41-40bc-8e15-d9d0495689b3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:39:41.970562 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.970490 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/26f9a2db-4e41-40bc-8e15-d9d0495689b3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:39:41.970562 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.970540 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/26f9a2db-4e41-40bc-8e15-d9d0495689b3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:39:41.970684 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.970569 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/26f9a2db-4e41-40bc-8e15-d9d0495689b3-config-out\") pod \"prometheus-k8s-0\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:39:41.970684 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.970600 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dppv4\" (UniqueName: \"kubernetes.io/projected/26f9a2db-4e41-40bc-8e15-d9d0495689b3-kube-api-access-dppv4\") pod \"prometheus-k8s-0\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:39:41.970684 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.970674 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/26f9a2db-4e41-40bc-8e15-d9d0495689b3-web-config\") pod \"prometheus-k8s-0\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:39:41.970824 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.970700 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/26f9a2db-4e41-40bc-8e15-d9d0495689b3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:39:41.970824 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.970729 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/26f9a2db-4e41-40bc-8e15-d9d0495689b3-config\") pod \"prometheus-k8s-0\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:39:41.970824 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.970754 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/26f9a2db-4e41-40bc-8e15-d9d0495689b3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:39:41.970824 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.970792 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/26f9a2db-4e41-40bc-8e15-d9d0495689b3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:39:41.970824 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.970819 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26f9a2db-4e41-40bc-8e15-d9d0495689b3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:39:41.971054 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.970846 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/26f9a2db-4e41-40bc-8e15-d9d0495689b3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:39:41.971054 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.970869 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26f9a2db-4e41-40bc-8e15-d9d0495689b3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:39:41.971054 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.970898 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/26f9a2db-4e41-40bc-8e15-d9d0495689b3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:39:41.971054 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.970927 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/26f9a2db-4e41-40bc-8e15-d9d0495689b3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:39:41.971054 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.970959 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26f9a2db-4e41-40bc-8e15-d9d0495689b3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:39:41.972569 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.972247 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/26f9a2db-4e41-40bc-8e15-d9d0495689b3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:39:41.972569 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.972339 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26f9a2db-4e41-40bc-8e15-d9d0495689b3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:39:41.973412 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.973138 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/26f9a2db-4e41-40bc-8e15-d9d0495689b3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:39:41.973512 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.973447 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/26f9a2db-4e41-40bc-8e15-d9d0495689b3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:39:41.974066 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.974045 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/26f9a2db-4e41-40bc-8e15-d9d0495689b3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:39:41.974660 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.974643 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/26f9a2db-4e41-40bc-8e15-d9d0495689b3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:39:41.974788 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.974657 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/26f9a2db-4e41-40bc-8e15-d9d0495689b3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:39:41.975370 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.974994 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26f9a2db-4e41-40bc-8e15-d9d0495689b3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:39:41.975370 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.975137 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/26f9a2db-4e41-40bc-8e15-d9d0495689b3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:39:41.975370 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.975273 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/26f9a2db-4e41-40bc-8e15-d9d0495689b3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:39:41.976010 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.975986 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/26f9a2db-4e41-40bc-8e15-d9d0495689b3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:39:41.976115 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.976009 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/26f9a2db-4e41-40bc-8e15-d9d0495689b3-config-out\") pod \"prometheus-k8s-0\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:39:41.976822 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.976774 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/26f9a2db-4e41-40bc-8e15-d9d0495689b3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:39:41.977542 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.977516 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/26f9a2db-4e41-40bc-8e15-d9d0495689b3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:39:41.978086 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.978061 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/26f9a2db-4e41-40bc-8e15-d9d0495689b3-web-config\") pod \"prometheus-k8s-0\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:39:41.978174 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.978136 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/26f9a2db-4e41-40bc-8e15-d9d0495689b3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:39:41.978729 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.978702 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/26f9a2db-4e41-40bc-8e15-d9d0495689b3-config\") pod \"prometheus-k8s-0\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:39:41.979236 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.979220 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/26f9a2db-4e41-40bc-8e15-d9d0495689b3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:39:41.987447 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:41.987421 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dppv4\" (UniqueName: \"kubernetes.io/projected/26f9a2db-4e41-40bc-8e15-d9d0495689b3-kube-api-access-dppv4\") pod \"prometheus-k8s-0\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:39:42.030279 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:42.030248 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:39:42.268081 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:42.268005 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-mzfld" event={"ID":"39d91be9-e619-4aeb-bdc4-0df472e63c07","Type":"ContainerStarted","Data":"12b3e16515529d9c139c415d183f8dcdd70ec81e7501a44c5d7a35be73ad0487"} Sep 07 12:39:42.324208 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:42.324115 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 12:39:42.459442 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:39:42.459411 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26f9a2db_4e41_40bc_8e15_d9d0495689b3.slice/crio-c9a6d63ea0125b13c24657af6831ccc58cce2bad448fcb8bbfd6d013f881d4c3 WatchSource:0}: Error finding container c9a6d63ea0125b13c24657af6831ccc58cce2bad448fcb8bbfd6d013f881d4c3: Status 404 returned error can't find the container with id c9a6d63ea0125b13c24657af6831ccc58cce2bad448fcb8bbfd6d013f881d4c3 Sep 07 12:39:43.274263 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:43.274225 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-mzfld" event={"ID":"39d91be9-e619-4aeb-bdc4-0df472e63c07","Type":"ContainerStarted","Data":"394bb477859a98d411928e251b74cc91e4a72099248a70a7a983480efb37a66c"} Sep 07 12:39:43.274454 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:43.274383 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-mzfld" Sep 07 12:39:43.275904 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:43.275874 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"26f9a2db-4e41-40bc-8e15-d9d0495689b3","Type":"ContainerStarted","Data":"c9a6d63ea0125b13c24657af6831ccc58cce2bad448fcb8bbfd6d013f881d4c3"} Sep 07 12:39:43.279838 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:43.279788 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-mzfld" Sep 07 12:39:43.296888 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:43.296842 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-mzfld" podStartSLOduration=2.122238931 podStartE2EDuration="3.296829027s" totalImagesPullingTime="1.174590096s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:39:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:39:43.295011427 +0000 UTC m=+311.445441163" watchObservedRunningTime="2026-09-07 12:39:43.296829027 +0000 UTC m=+311.447258762" Sep 07 12:39:44.281174 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:44.281138 2584 generic.go:356] "Generic (PLEG): container finished" podID="26f9a2db-4e41-40bc-8e15-d9d0495689b3" containerID="42b1c03819b22815eda21ebce59db3660525a51178ed5b111411557b344ddf82" exitCode=0 Sep 07 12:39:44.281530 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:44.281222 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"26f9a2db-4e41-40bc-8e15-d9d0495689b3","Type":"ContainerDied","Data":"42b1c03819b22815eda21ebce59db3660525a51178ed5b111411557b344ddf82"} Sep 07 12:39:48.300494 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:48.300451 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"26f9a2db-4e41-40bc-8e15-d9d0495689b3","Type":"ContainerStarted","Data":"235f46984489cf5e4b9452b9e67eed4012ae98c642c77b46bf984a8cf249dbc5"} Sep 07 12:39:48.300897 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:48.300535 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"26f9a2db-4e41-40bc-8e15-d9d0495689b3","Type":"ContainerStarted","Data":"0c50ebf86e48f1ec2e872c97ad5fd05a4ec9864f24c27b621919f0a08fd9ebb3"} Sep 07 12:39:49.213088 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:49.213061 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7c5c654c5f-wrtnb" Sep 07 12:39:50.312254 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:50.312215 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"26f9a2db-4e41-40bc-8e15-d9d0495689b3","Type":"ContainerStarted","Data":"8dda16848af46b60194df75aed479db0ae7bfd407d335bd1247417e5e0ec1566"} Sep 07 12:39:50.312670 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:50.312303 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"26f9a2db-4e41-40bc-8e15-d9d0495689b3","Type":"ContainerStarted","Data":"5e5fae71bafd0038e485dfcd8214374d06be43d3b4baeeb072fc2bee88a8e53a"} Sep 07 12:39:50.312670 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:50.312330 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"26f9a2db-4e41-40bc-8e15-d9d0495689b3","Type":"ContainerStarted","Data":"dcbd2fd1a06176a7ba8ddeb82dda6a5d2ce0b6201b2115382f5aff270b3bbc43"} Sep 07 12:39:50.312670 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:50.312355 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"26f9a2db-4e41-40bc-8e15-d9d0495689b3","Type":"ContainerStarted","Data":"b1e2e7e9bd2543adf23b746f45dcb3bc6d58fa9d629dc3498caf6003a3a488f3"} Sep 07 12:39:50.344253 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:50.344197 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.239938378 podStartE2EDuration="9.344175643s" totalImagesPullingTime="6.086034657s" totalInitContainerRuntime="18.202608ms" isStatefulPod=false podCreationTimestamp="2026-09-07 12:39:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:39:50.341815958 +0000 UTC m=+318.492245710" watchObservedRunningTime="2026-09-07 12:39:50.344175643 +0000 UTC m=+318.494605360" Sep 07 12:39:52.030380 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:52.030348 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:39:52.334298 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:52.334227 2584 scope.go:117] "RemoveContainer" containerID="224477afd205414fe3fa7b467a925c7d867cd2601f0024635af2f1c5b01f2b47" Sep 07 12:39:52.506212 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:52.506164 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-57496dc5dc-n4ccq" podUID="e54bd75e-c79f-47e6-8adc-ca3ae580ef00" containerName="registry" containerID="cri-o://d0cb23087c4eb0bfa80616f8a698a7a674c76a37a348dda07b3966b0884145ca" gracePeriod=30 Sep 07 12:39:52.752041 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:52.752017 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57496dc5dc-n4ccq" Sep 07 12:39:52.861936 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:52.861904 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e54bd75e-c79f-47e6-8adc-ca3ae580ef00-trusted-ca\") pod \"e54bd75e-c79f-47e6-8adc-ca3ae580ef00\" (UID: \"e54bd75e-c79f-47e6-8adc-ca3ae580ef00\") " Sep 07 12:39:52.861936 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:52.861948 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e54bd75e-c79f-47e6-8adc-ca3ae580ef00-installation-pull-secrets\") pod \"e54bd75e-c79f-47e6-8adc-ca3ae580ef00\" (UID: \"e54bd75e-c79f-47e6-8adc-ca3ae580ef00\") " Sep 07 12:39:52.862162 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:52.861970 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e54bd75e-c79f-47e6-8adc-ca3ae580ef00-registry-tls\") pod \"e54bd75e-c79f-47e6-8adc-ca3ae580ef00\" (UID: \"e54bd75e-c79f-47e6-8adc-ca3ae580ef00\") " Sep 07 12:39:52.862162 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:52.861989 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zb6xk\" (UniqueName: \"kubernetes.io/projected/e54bd75e-c79f-47e6-8adc-ca3ae580ef00-kube-api-access-zb6xk\") pod \"e54bd75e-c79f-47e6-8adc-ca3ae580ef00\" (UID: \"e54bd75e-c79f-47e6-8adc-ca3ae580ef00\") " Sep 07 12:39:52.862162 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:52.862024 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e54bd75e-c79f-47e6-8adc-ca3ae580ef00-registry-certificates\") pod \"e54bd75e-c79f-47e6-8adc-ca3ae580ef00\" (UID: \"e54bd75e-c79f-47e6-8adc-ca3ae580ef00\") " Sep 07 12:39:52.862162 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:52.862050 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e54bd75e-c79f-47e6-8adc-ca3ae580ef00-image-registry-private-configuration\") pod \"e54bd75e-c79f-47e6-8adc-ca3ae580ef00\" (UID: \"e54bd75e-c79f-47e6-8adc-ca3ae580ef00\") " Sep 07 12:39:52.862162 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:52.862091 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e54bd75e-c79f-47e6-8adc-ca3ae580ef00-ca-trust-extracted\") pod \"e54bd75e-c79f-47e6-8adc-ca3ae580ef00\" (UID: \"e54bd75e-c79f-47e6-8adc-ca3ae580ef00\") " Sep 07 12:39:52.862162 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:52.862139 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e54bd75e-c79f-47e6-8adc-ca3ae580ef00-bound-sa-token\") pod \"e54bd75e-c79f-47e6-8adc-ca3ae580ef00\" (UID: \"e54bd75e-c79f-47e6-8adc-ca3ae580ef00\") " Sep 07 12:39:52.862524 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:52.862387 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e54bd75e-c79f-47e6-8adc-ca3ae580ef00-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e54bd75e-c79f-47e6-8adc-ca3ae580ef00" (UID: "e54bd75e-c79f-47e6-8adc-ca3ae580ef00"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 12:39:52.862976 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:52.862760 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e54bd75e-c79f-47e6-8adc-ca3ae580ef00-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e54bd75e-c79f-47e6-8adc-ca3ae580ef00" (UID: "e54bd75e-c79f-47e6-8adc-ca3ae580ef00"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 12:39:52.864710 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:52.864670 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e54bd75e-c79f-47e6-8adc-ca3ae580ef00-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e54bd75e-c79f-47e6-8adc-ca3ae580ef00" (UID: "e54bd75e-c79f-47e6-8adc-ca3ae580ef00"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 12:39:52.864710 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:52.864675 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e54bd75e-c79f-47e6-8adc-ca3ae580ef00-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e54bd75e-c79f-47e6-8adc-ca3ae580ef00" (UID: "e54bd75e-c79f-47e6-8adc-ca3ae580ef00"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 12:39:52.864865 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:52.864837 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e54bd75e-c79f-47e6-8adc-ca3ae580ef00-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e54bd75e-c79f-47e6-8adc-ca3ae580ef00" (UID: "e54bd75e-c79f-47e6-8adc-ca3ae580ef00"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 12:39:52.864944 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:52.864927 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e54bd75e-c79f-47e6-8adc-ca3ae580ef00-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e54bd75e-c79f-47e6-8adc-ca3ae580ef00" (UID: "e54bd75e-c79f-47e6-8adc-ca3ae580ef00"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 12:39:52.865062 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:52.865043 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e54bd75e-c79f-47e6-8adc-ca3ae580ef00-kube-api-access-zb6xk" (OuterVolumeSpecName: "kube-api-access-zb6xk") pod "e54bd75e-c79f-47e6-8adc-ca3ae580ef00" (UID: "e54bd75e-c79f-47e6-8adc-ca3ae580ef00"). InnerVolumeSpecName "kube-api-access-zb6xk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 12:39:52.870606 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:52.870585 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e54bd75e-c79f-47e6-8adc-ca3ae580ef00-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e54bd75e-c79f-47e6-8adc-ca3ae580ef00" (UID: "e54bd75e-c79f-47e6-8adc-ca3ae580ef00"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 07 12:39:52.962719 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:52.962693 2584 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e54bd75e-c79f-47e6-8adc-ca3ae580ef00-ca-trust-extracted\") on node \"ip-10-0-129-7.ec2.internal\" DevicePath \"\"" Sep 07 12:39:52.962719 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:52.962718 2584 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e54bd75e-c79f-47e6-8adc-ca3ae580ef00-bound-sa-token\") on node \"ip-10-0-129-7.ec2.internal\" DevicePath \"\"" Sep 07 12:39:52.962921 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:52.962727 2584 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e54bd75e-c79f-47e6-8adc-ca3ae580ef00-trusted-ca\") on node \"ip-10-0-129-7.ec2.internal\" DevicePath \"\"" Sep 07 12:39:52.962921 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:52.962735 2584 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e54bd75e-c79f-47e6-8adc-ca3ae580ef00-installation-pull-secrets\") on node \"ip-10-0-129-7.ec2.internal\" DevicePath \"\"" Sep 07 12:39:52.962921 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:52.962744 2584 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e54bd75e-c79f-47e6-8adc-ca3ae580ef00-registry-tls\") on node \"ip-10-0-129-7.ec2.internal\" DevicePath \"\"" Sep 07 12:39:52.962921 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:52.962752 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zb6xk\" (UniqueName: \"kubernetes.io/projected/e54bd75e-c79f-47e6-8adc-ca3ae580ef00-kube-api-access-zb6xk\") on node \"ip-10-0-129-7.ec2.internal\" DevicePath \"\"" Sep 07 12:39:52.962921 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:52.962759 2584 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e54bd75e-c79f-47e6-8adc-ca3ae580ef00-registry-certificates\") on node \"ip-10-0-129-7.ec2.internal\" DevicePath \"\"" Sep 07 12:39:52.962921 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:52.962770 2584 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e54bd75e-c79f-47e6-8adc-ca3ae580ef00-image-registry-private-configuration\") on node \"ip-10-0-129-7.ec2.internal\" DevicePath \"\"" Sep 07 12:39:53.325020 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:53.324930 2584 generic.go:356] "Generic (PLEG): container finished" podID="e54bd75e-c79f-47e6-8adc-ca3ae580ef00" containerID="d0cb23087c4eb0bfa80616f8a698a7a674c76a37a348dda07b3966b0884145ca" exitCode=0 Sep 07 12:39:53.325447 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:53.325014 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57496dc5dc-n4ccq" Sep 07 12:39:53.325447 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:53.325027 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57496dc5dc-n4ccq" event={"ID":"e54bd75e-c79f-47e6-8adc-ca3ae580ef00","Type":"ContainerDied","Data":"d0cb23087c4eb0bfa80616f8a698a7a674c76a37a348dda07b3966b0884145ca"} Sep 07 12:39:53.325447 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:53.325120 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57496dc5dc-n4ccq" event={"ID":"e54bd75e-c79f-47e6-8adc-ca3ae580ef00","Type":"ContainerDied","Data":"7cf85bf0eb4705d8ab564d93571cb22ed55140452fe38d40309ec9dad5d5f78b"} Sep 07 12:39:53.325447 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:53.325148 2584 scope.go:117] "RemoveContainer" containerID="d0cb23087c4eb0bfa80616f8a698a7a674c76a37a348dda07b3966b0884145ca" Sep 07 12:39:53.327854 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:53.327755 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-95d8r_ffbb335e-25ad-4f94-bd83-40889a6970b3/console-operator/2.log" Sep 07 12:39:53.327854 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:53.327818 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-95d8r" event={"ID":"ffbb335e-25ad-4f94-bd83-40889a6970b3","Type":"ContainerStarted","Data":"05623b1fec1a1f16849b6a4ab6cabd592304cafb6d7c22175f6c1c82e96ef4a4"} Sep 07 12:39:53.328105 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:53.328084 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-95d8r" Sep 07 12:39:53.334350 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:53.334329 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-85b454874b-95d8r" Sep 07 12:39:53.335590 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:53.335392 2584 scope.go:117] "RemoveContainer" containerID="d0cb23087c4eb0bfa80616f8a698a7a674c76a37a348dda07b3966b0884145ca" Sep 07 12:39:53.335724 ip-10-0-129-7 kubenswrapper[2584]: E0907 12:39:53.335702 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0cb23087c4eb0bfa80616f8a698a7a674c76a37a348dda07b3966b0884145ca\": container with ID starting with d0cb23087c4eb0bfa80616f8a698a7a674c76a37a348dda07b3966b0884145ca not found: ID does not exist" containerID="d0cb23087c4eb0bfa80616f8a698a7a674c76a37a348dda07b3966b0884145ca" Sep 07 12:39:53.335798 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:53.335732 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0cb23087c4eb0bfa80616f8a698a7a674c76a37a348dda07b3966b0884145ca"} err="failed to get container status \"d0cb23087c4eb0bfa80616f8a698a7a674c76a37a348dda07b3966b0884145ca\": rpc error: code = NotFound desc = could not find container \"d0cb23087c4eb0bfa80616f8a698a7a674c76a37a348dda07b3966b0884145ca\": container with ID starting with d0cb23087c4eb0bfa80616f8a698a7a674c76a37a348dda07b3966b0884145ca not found: ID does not exist" Sep 07 12:39:53.360547 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:53.360494 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-85b454874b-95d8r" podStartSLOduration=57.435163217 podStartE2EDuration="59.36047977s" totalImagesPullingTime="1.925316553s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:38:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:39:53.359168021 +0000 UTC m=+321.509597748" watchObservedRunningTime="2026-09-07 12:39:53.36047977 +0000 UTC m=+321.510909485" Sep 07 12:39:53.378757 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:53.378732 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-57496dc5dc-n4ccq"] Sep 07 12:39:53.386511 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:53.386483 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-57496dc5dc-n4ccq"] Sep 07 12:39:54.336182 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:39:54.336150 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e54bd75e-c79f-47e6-8adc-ca3ae580ef00" path="/var/lib/kubelet/pods/e54bd75e-c79f-47e6-8adc-ca3ae580ef00/volumes" Sep 07 12:40:42.030977 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:40:42.030941 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:40:42.051023 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:40:42.050995 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:40:42.525658 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:40:42.525612 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:40:46.199212 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:40:46.199173 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2350fd1e-ae4b-48d4-9ef6-e45cb3f83129-metrics-certs\") pod \"network-metrics-daemon-lkvmb\" (UID: \"2350fd1e-ae4b-48d4-9ef6-e45cb3f83129\") " pod="openshift-multus/network-metrics-daemon-lkvmb" Sep 07 12:40:46.201596 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:40:46.201576 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2350fd1e-ae4b-48d4-9ef6-e45cb3f83129-metrics-certs\") pod \"network-metrics-daemon-lkvmb\" (UID: \"2350fd1e-ae4b-48d4-9ef6-e45cb3f83129\") " pod="openshift-multus/network-metrics-daemon-lkvmb" Sep 07 12:40:46.436732 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:40:46.436698 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vsbg4\"" Sep 07 12:40:46.444579 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:40:46.444554 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lkvmb" Sep 07 12:40:46.735701 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:40:46.735593 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lkvmb"] Sep 07 12:40:46.742216 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:40:46.742191 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2350fd1e_ae4b_48d4_9ef6_e45cb3f83129.slice/crio-15e56f5ce29c43ef74191eaebc19dfd643b197546c55155457cb60db8b879243 WatchSource:0}: Error finding container 15e56f5ce29c43ef74191eaebc19dfd643b197546c55155457cb60db8b879243: Status 404 returned error can't find the container with id 15e56f5ce29c43ef74191eaebc19dfd643b197546c55155457cb60db8b879243 Sep 07 12:40:47.528877 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:40:47.528839 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lkvmb" event={"ID":"2350fd1e-ae4b-48d4-9ef6-e45cb3f83129","Type":"ContainerStarted","Data":"15e56f5ce29c43ef74191eaebc19dfd643b197546c55155457cb60db8b879243"} Sep 07 12:40:48.534064 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:40:48.534026 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lkvmb" event={"ID":"2350fd1e-ae4b-48d4-9ef6-e45cb3f83129","Type":"ContainerStarted","Data":"69b3ec5bf9618285569884030324f250d82ccdaf5cbb7dba09d25bd0445a65e4"} Sep 07 12:40:48.534503 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:40:48.534083 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lkvmb" event={"ID":"2350fd1e-ae4b-48d4-9ef6-e45cb3f83129","Type":"ContainerStarted","Data":"47e90575c5d38347d2788acc776daab731eb8badc57ced57c9bf216c5afb16bb"} Sep 07 12:40:48.562053 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:40:48.561997 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-lkvmb" podStartSLOduration=374.173841147 podStartE2EDuration="6m15.56198252s" totalImagesPullingTime="1.388141373s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:34:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:40:48.561185056 +0000 UTC m=+376.711614782" watchObservedRunningTime="2026-09-07 12:40:48.56198252 +0000 UTC m=+376.712412236" Sep 07 12:41:00.346438 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.346405 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 12:41:00.347111 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.346750 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="26f9a2db-4e41-40bc-8e15-d9d0495689b3" containerName="prometheus" containerID="cri-o://0c50ebf86e48f1ec2e872c97ad5fd05a4ec9864f24c27b621919f0a08fd9ebb3" gracePeriod=600 Sep 07 12:41:00.347111 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.346783 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="26f9a2db-4e41-40bc-8e15-d9d0495689b3" containerName="thanos-sidecar" containerID="cri-o://b1e2e7e9bd2543adf23b746f45dcb3bc6d58fa9d629dc3498caf6003a3a488f3" gracePeriod=600 Sep 07 12:41:00.347111 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.346798 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="26f9a2db-4e41-40bc-8e15-d9d0495689b3" containerName="kube-rbac-proxy" containerID="cri-o://5e5fae71bafd0038e485dfcd8214374d06be43d3b4baeeb072fc2bee88a8e53a" gracePeriod=600 Sep 07 12:41:00.347111 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.346855 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="26f9a2db-4e41-40bc-8e15-d9d0495689b3" containerName="kube-rbac-proxy-thanos" containerID="cri-o://8dda16848af46b60194df75aed479db0ae7bfd407d335bd1247417e5e0ec1566" gracePeriod=600 Sep 07 12:41:00.347111 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.346812 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="26f9a2db-4e41-40bc-8e15-d9d0495689b3" containerName="kube-rbac-proxy-web" containerID="cri-o://dcbd2fd1a06176a7ba8ddeb82dda6a5d2ce0b6201b2115382f5aff270b3bbc43" gracePeriod=600 Sep 07 12:41:00.347111 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.346812 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="26f9a2db-4e41-40bc-8e15-d9d0495689b3" containerName="config-reloader" containerID="cri-o://235f46984489cf5e4b9452b9e67eed4012ae98c642c77b46bf984a8cf249dbc5" gracePeriod=600 Sep 07 12:41:00.580812 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.580782 2584 generic.go:356] "Generic (PLEG): container finished" podID="26f9a2db-4e41-40bc-8e15-d9d0495689b3" containerID="8dda16848af46b60194df75aed479db0ae7bfd407d335bd1247417e5e0ec1566" exitCode=0 Sep 07 12:41:00.580812 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.580805 2584 generic.go:356] "Generic (PLEG): container finished" podID="26f9a2db-4e41-40bc-8e15-d9d0495689b3" containerID="5e5fae71bafd0038e485dfcd8214374d06be43d3b4baeeb072fc2bee88a8e53a" exitCode=0 Sep 07 12:41:00.580812 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.580812 2584 generic.go:356] "Generic (PLEG): container finished" podID="26f9a2db-4e41-40bc-8e15-d9d0495689b3" containerID="dcbd2fd1a06176a7ba8ddeb82dda6a5d2ce0b6201b2115382f5aff270b3bbc43" exitCode=0 Sep 07 12:41:00.580812 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.580820 2584 generic.go:356] "Generic (PLEG): container finished" podID="26f9a2db-4e41-40bc-8e15-d9d0495689b3" containerID="b1e2e7e9bd2543adf23b746f45dcb3bc6d58fa9d629dc3498caf6003a3a488f3" exitCode=0 Sep 07 12:41:00.581046 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.580825 2584 generic.go:356] "Generic (PLEG): container finished" podID="26f9a2db-4e41-40bc-8e15-d9d0495689b3" containerID="235f46984489cf5e4b9452b9e67eed4012ae98c642c77b46bf984a8cf249dbc5" exitCode=0 Sep 07 12:41:00.581046 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.580831 2584 generic.go:356] "Generic (PLEG): container finished" podID="26f9a2db-4e41-40bc-8e15-d9d0495689b3" containerID="0c50ebf86e48f1ec2e872c97ad5fd05a4ec9864f24c27b621919f0a08fd9ebb3" exitCode=0 Sep 07 12:41:00.581046 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.580849 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"26f9a2db-4e41-40bc-8e15-d9d0495689b3","Type":"ContainerDied","Data":"8dda16848af46b60194df75aed479db0ae7bfd407d335bd1247417e5e0ec1566"} Sep 07 12:41:00.581046 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.580912 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"26f9a2db-4e41-40bc-8e15-d9d0495689b3","Type":"ContainerDied","Data":"5e5fae71bafd0038e485dfcd8214374d06be43d3b4baeeb072fc2bee88a8e53a"} Sep 07 12:41:00.581046 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.580938 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"26f9a2db-4e41-40bc-8e15-d9d0495689b3","Type":"ContainerDied","Data":"dcbd2fd1a06176a7ba8ddeb82dda6a5d2ce0b6201b2115382f5aff270b3bbc43"} Sep 07 12:41:00.581046 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.580962 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"26f9a2db-4e41-40bc-8e15-d9d0495689b3","Type":"ContainerDied","Data":"b1e2e7e9bd2543adf23b746f45dcb3bc6d58fa9d629dc3498caf6003a3a488f3"} Sep 07 12:41:00.581046 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.580985 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"26f9a2db-4e41-40bc-8e15-d9d0495689b3","Type":"ContainerDied","Data":"235f46984489cf5e4b9452b9e67eed4012ae98c642c77b46bf984a8cf249dbc5"} Sep 07 12:41:00.581046 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.581010 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"26f9a2db-4e41-40bc-8e15-d9d0495689b3","Type":"ContainerDied","Data":"0c50ebf86e48f1ec2e872c97ad5fd05a4ec9864f24c27b621919f0a08fd9ebb3"} Sep 07 12:41:00.592717 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.592697 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:41:00.711137 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.711109 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26f9a2db-4e41-40bc-8e15-d9d0495689b3-prometheus-trusted-ca-bundle\") pod \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " Sep 07 12:41:00.711318 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.711150 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/26f9a2db-4e41-40bc-8e15-d9d0495689b3-web-config\") pod \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " Sep 07 12:41:00.711318 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.711173 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/26f9a2db-4e41-40bc-8e15-d9d0495689b3-secret-grpc-tls\") pod \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " Sep 07 12:41:00.711318 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.711208 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/26f9a2db-4e41-40bc-8e15-d9d0495689b3-config\") pod \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " Sep 07 12:41:00.711318 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.711229 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/26f9a2db-4e41-40bc-8e15-d9d0495689b3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " Sep 07 12:41:00.711318 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.711264 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/26f9a2db-4e41-40bc-8e15-d9d0495689b3-secret-prometheus-k8s-tls\") pod \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " Sep 07 12:41:00.711656 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.711402 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/26f9a2db-4e41-40bc-8e15-d9d0495689b3-prometheus-k8s-db\") pod \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " Sep 07 12:41:00.711656 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.711451 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/26f9a2db-4e41-40bc-8e15-d9d0495689b3-config-out\") pod \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " Sep 07 12:41:00.711656 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.711485 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26f9a2db-4e41-40bc-8e15-d9d0495689b3-configmap-serving-certs-ca-bundle\") pod \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " Sep 07 12:41:00.711656 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.711508 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26f9a2db-4e41-40bc-8e15-d9d0495689b3-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "26f9a2db-4e41-40bc-8e15-d9d0495689b3" (UID: "26f9a2db-4e41-40bc-8e15-d9d0495689b3"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 12:41:00.711656 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.711519 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/26f9a2db-4e41-40bc-8e15-d9d0495689b3-secret-kube-rbac-proxy\") pod \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " Sep 07 12:41:00.711656 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.711552 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/26f9a2db-4e41-40bc-8e15-d9d0495689b3-tls-assets\") pod \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " Sep 07 12:41:00.711656 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.711582 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/26f9a2db-4e41-40bc-8e15-d9d0495689b3-thanos-prometheus-http-client-file\") pod \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " Sep 07 12:41:00.711656 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.711642 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/26f9a2db-4e41-40bc-8e15-d9d0495689b3-prometheus-k8s-rulefiles-0\") pod \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " Sep 07 12:41:00.712207 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.711681 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dppv4\" (UniqueName: \"kubernetes.io/projected/26f9a2db-4e41-40bc-8e15-d9d0495689b3-kube-api-access-dppv4\") pod \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " Sep 07 12:41:00.712207 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.711727 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/26f9a2db-4e41-40bc-8e15-d9d0495689b3-prometheus-k8s-rulefiles-2\") pod \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " Sep 07 12:41:00.712207 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.711762 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/26f9a2db-4e41-40bc-8e15-d9d0495689b3-prometheus-k8s-rulefiles-1\") pod \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " Sep 07 12:41:00.712207 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.711784 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/26f9a2db-4e41-40bc-8e15-d9d0495689b3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " Sep 07 12:41:00.712207 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.711807 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/26f9a2db-4e41-40bc-8e15-d9d0495689b3-secret-metrics-client-certs\") pod \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " Sep 07 12:41:00.712207 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.711829 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/26f9a2db-4e41-40bc-8e15-d9d0495689b3-configmap-metrics-client-ca\") pod \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " Sep 07 12:41:00.712207 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.711863 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26f9a2db-4e41-40bc-8e15-d9d0495689b3-configmap-kubelet-serving-ca-bundle\") pod \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\" (UID: \"26f9a2db-4e41-40bc-8e15-d9d0495689b3\") " Sep 07 12:41:00.712207 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.712114 2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26f9a2db-4e41-40bc-8e15-d9d0495689b3-prometheus-trusted-ca-bundle\") on node \"ip-10-0-129-7.ec2.internal\" DevicePath \"\"" Sep 07 12:41:00.712207 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.712135 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26f9a2db-4e41-40bc-8e15-d9d0495689b3-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "26f9a2db-4e41-40bc-8e15-d9d0495689b3" (UID: "26f9a2db-4e41-40bc-8e15-d9d0495689b3"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 12:41:00.713109 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.712635 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26f9a2db-4e41-40bc-8e15-d9d0495689b3-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "26f9a2db-4e41-40bc-8e15-d9d0495689b3" (UID: "26f9a2db-4e41-40bc-8e15-d9d0495689b3"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 12:41:00.713553 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.713435 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26f9a2db-4e41-40bc-8e15-d9d0495689b3-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "26f9a2db-4e41-40bc-8e15-d9d0495689b3" (UID: "26f9a2db-4e41-40bc-8e15-d9d0495689b3"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 07 12:41:00.713874 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.713809 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26f9a2db-4e41-40bc-8e15-d9d0495689b3-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "26f9a2db-4e41-40bc-8e15-d9d0495689b3" (UID: "26f9a2db-4e41-40bc-8e15-d9d0495689b3"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 12:41:00.714558 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.714261 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26f9a2db-4e41-40bc-8e15-d9d0495689b3-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "26f9a2db-4e41-40bc-8e15-d9d0495689b3" (UID: "26f9a2db-4e41-40bc-8e15-d9d0495689b3"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 12:41:00.714558 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.714428 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26f9a2db-4e41-40bc-8e15-d9d0495689b3-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "26f9a2db-4e41-40bc-8e15-d9d0495689b3" (UID: "26f9a2db-4e41-40bc-8e15-d9d0495689b3"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 12:41:00.714558 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.714515 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26f9a2db-4e41-40bc-8e15-d9d0495689b3-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "26f9a2db-4e41-40bc-8e15-d9d0495689b3" (UID: "26f9a2db-4e41-40bc-8e15-d9d0495689b3"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 12:41:00.714900 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.714861 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26f9a2db-4e41-40bc-8e15-d9d0495689b3-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "26f9a2db-4e41-40bc-8e15-d9d0495689b3" (UID: "26f9a2db-4e41-40bc-8e15-d9d0495689b3"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 12:41:00.714976 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.714951 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26f9a2db-4e41-40bc-8e15-d9d0495689b3-config-out" (OuterVolumeSpecName: "config-out") pod "26f9a2db-4e41-40bc-8e15-d9d0495689b3" (UID: "26f9a2db-4e41-40bc-8e15-d9d0495689b3"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 07 12:41:00.715282 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.715250 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26f9a2db-4e41-40bc-8e15-d9d0495689b3-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "26f9a2db-4e41-40bc-8e15-d9d0495689b3" (UID: "26f9a2db-4e41-40bc-8e15-d9d0495689b3"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 12:41:00.715416 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.715391 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26f9a2db-4e41-40bc-8e15-d9d0495689b3-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "26f9a2db-4e41-40bc-8e15-d9d0495689b3" (UID: "26f9a2db-4e41-40bc-8e15-d9d0495689b3"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 12:41:00.715501 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.715392 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26f9a2db-4e41-40bc-8e15-d9d0495689b3-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "26f9a2db-4e41-40bc-8e15-d9d0495689b3" (UID: "26f9a2db-4e41-40bc-8e15-d9d0495689b3"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 12:41:00.716424 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.716398 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26f9a2db-4e41-40bc-8e15-d9d0495689b3-config" (OuterVolumeSpecName: "config") pod "26f9a2db-4e41-40bc-8e15-d9d0495689b3" (UID: "26f9a2db-4e41-40bc-8e15-d9d0495689b3"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 12:41:00.716424 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.716530 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26f9a2db-4e41-40bc-8e15-d9d0495689b3-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "26f9a2db-4e41-40bc-8e15-d9d0495689b3" (UID: "26f9a2db-4e41-40bc-8e15-d9d0495689b3"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 12:41:00.716788 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.716736 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26f9a2db-4e41-40bc-8e15-d9d0495689b3-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "26f9a2db-4e41-40bc-8e15-d9d0495689b3" (UID: "26f9a2db-4e41-40bc-8e15-d9d0495689b3"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 12:41:00.717377 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.717358 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26f9a2db-4e41-40bc-8e15-d9d0495689b3-kube-api-access-dppv4" (OuterVolumeSpecName: "kube-api-access-dppv4") pod "26f9a2db-4e41-40bc-8e15-d9d0495689b3" (UID: "26f9a2db-4e41-40bc-8e15-d9d0495689b3"). InnerVolumeSpecName "kube-api-access-dppv4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 12:41:00.717548 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.717531 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26f9a2db-4e41-40bc-8e15-d9d0495689b3-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "26f9a2db-4e41-40bc-8e15-d9d0495689b3" (UID: "26f9a2db-4e41-40bc-8e15-d9d0495689b3"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 12:41:00.717595 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.717563 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26f9a2db-4e41-40bc-8e15-d9d0495689b3-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "26f9a2db-4e41-40bc-8e15-d9d0495689b3" (UID: "26f9a2db-4e41-40bc-8e15-d9d0495689b3"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 12:41:00.725838 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.725816 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26f9a2db-4e41-40bc-8e15-d9d0495689b3-web-config" (OuterVolumeSpecName: "web-config") pod "26f9a2db-4e41-40bc-8e15-d9d0495689b3" (UID: "26f9a2db-4e41-40bc-8e15-d9d0495689b3"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 12:41:00.813349 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.813311 2584 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/26f9a2db-4e41-40bc-8e15-d9d0495689b3-web-config\") on node \"ip-10-0-129-7.ec2.internal\" DevicePath \"\"" Sep 07 12:41:00.813349 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.813342 2584 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/26f9a2db-4e41-40bc-8e15-d9d0495689b3-secret-grpc-tls\") on node \"ip-10-0-129-7.ec2.internal\" DevicePath \"\"" Sep 07 12:41:00.813349 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.813354 2584 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/26f9a2db-4e41-40bc-8e15-d9d0495689b3-config\") on node \"ip-10-0-129-7.ec2.internal\" DevicePath \"\"" Sep 07 12:41:00.813606 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.813369 2584 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/26f9a2db-4e41-40bc-8e15-d9d0495689b3-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-129-7.ec2.internal\" DevicePath \"\"" Sep 07 12:41:00.813606 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.813381 2584 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/26f9a2db-4e41-40bc-8e15-d9d0495689b3-secret-prometheus-k8s-tls\") on node \"ip-10-0-129-7.ec2.internal\" DevicePath \"\"" Sep 07 12:41:00.813606 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.813393 2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/26f9a2db-4e41-40bc-8e15-d9d0495689b3-prometheus-k8s-db\") on node \"ip-10-0-129-7.ec2.internal\" DevicePath \"\"" Sep 07 12:41:00.813606 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.813404 2584 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/26f9a2db-4e41-40bc-8e15-d9d0495689b3-config-out\") on node \"ip-10-0-129-7.ec2.internal\" DevicePath \"\"" Sep 07 12:41:00.813606 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.813415 2584 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26f9a2db-4e41-40bc-8e15-d9d0495689b3-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-129-7.ec2.internal\" DevicePath \"\"" Sep 07 12:41:00.813606 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.813426 2584 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/26f9a2db-4e41-40bc-8e15-d9d0495689b3-secret-kube-rbac-proxy\") on node \"ip-10-0-129-7.ec2.internal\" DevicePath \"\"" Sep 07 12:41:00.813606 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.813437 2584 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/26f9a2db-4e41-40bc-8e15-d9d0495689b3-tls-assets\") on node \"ip-10-0-129-7.ec2.internal\" DevicePath \"\"" Sep 07 12:41:00.813606 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.813449 2584 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/26f9a2db-4e41-40bc-8e15-d9d0495689b3-thanos-prometheus-http-client-file\") on node \"ip-10-0-129-7.ec2.internal\" DevicePath \"\"" Sep 07 12:41:00.813606 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.813460 2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/26f9a2db-4e41-40bc-8e15-d9d0495689b3-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-129-7.ec2.internal\" DevicePath \"\"" Sep 07 12:41:00.813606 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.813472 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dppv4\" (UniqueName: \"kubernetes.io/projected/26f9a2db-4e41-40bc-8e15-d9d0495689b3-kube-api-access-dppv4\") on node \"ip-10-0-129-7.ec2.internal\" DevicePath \"\"" Sep 07 12:41:00.813606 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.813483 2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/26f9a2db-4e41-40bc-8e15-d9d0495689b3-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-129-7.ec2.internal\" DevicePath \"\"" Sep 07 12:41:00.813606 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.813495 2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/26f9a2db-4e41-40bc-8e15-d9d0495689b3-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-129-7.ec2.internal\" DevicePath \"\"" Sep 07 12:41:00.813606 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.813508 2584 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/26f9a2db-4e41-40bc-8e15-d9d0495689b3-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-129-7.ec2.internal\" DevicePath \"\"" Sep 07 12:41:00.813606 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.813521 2584 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/26f9a2db-4e41-40bc-8e15-d9d0495689b3-secret-metrics-client-certs\") on node \"ip-10-0-129-7.ec2.internal\" DevicePath \"\"" Sep 07 12:41:00.813606 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.813534 2584 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/26f9a2db-4e41-40bc-8e15-d9d0495689b3-configmap-metrics-client-ca\") on node \"ip-10-0-129-7.ec2.internal\" DevicePath \"\"" Sep 07 12:41:00.813606 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:00.813549 2584 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26f9a2db-4e41-40bc-8e15-d9d0495689b3-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-129-7.ec2.internal\" DevicePath \"\"" Sep 07 12:41:01.587955 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.587915 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"26f9a2db-4e41-40bc-8e15-d9d0495689b3","Type":"ContainerDied","Data":"c9a6d63ea0125b13c24657af6831ccc58cce2bad448fcb8bbfd6d013f881d4c3"} Sep 07 12:41:01.588370 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.587998 2584 scope.go:117] "RemoveContainer" containerID="8dda16848af46b60194df75aed479db0ae7bfd407d335bd1247417e5e0ec1566" Sep 07 12:41:01.588370 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.587933 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:41:01.596669 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.596645 2584 scope.go:117] "RemoveContainer" containerID="5e5fae71bafd0038e485dfcd8214374d06be43d3b4baeeb072fc2bee88a8e53a" Sep 07 12:41:01.603588 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.603569 2584 scope.go:117] "RemoveContainer" containerID="dcbd2fd1a06176a7ba8ddeb82dda6a5d2ce0b6201b2115382f5aff270b3bbc43" Sep 07 12:41:01.610147 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.610103 2584 scope.go:117] "RemoveContainer" containerID="b1e2e7e9bd2543adf23b746f45dcb3bc6d58fa9d629dc3498caf6003a3a488f3" Sep 07 12:41:01.615233 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.615211 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 12:41:01.617119 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.617105 2584 scope.go:117] "RemoveContainer" containerID="235f46984489cf5e4b9452b9e67eed4012ae98c642c77b46bf984a8cf249dbc5" Sep 07 12:41:01.623382 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.623353 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 12:41:01.624140 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.624124 2584 scope.go:117] "RemoveContainer" containerID="0c50ebf86e48f1ec2e872c97ad5fd05a4ec9864f24c27b621919f0a08fd9ebb3" Sep 07 12:41:01.631074 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.631060 2584 scope.go:117] "RemoveContainer" containerID="42b1c03819b22815eda21ebce59db3660525a51178ed5b111411557b344ddf82" Sep 07 12:41:01.654436 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.654416 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 12:41:01.654698 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.654685 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26f9a2db-4e41-40bc-8e15-d9d0495689b3" containerName="thanos-sidecar" Sep 07 12:41:01.654745 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.654701 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="26f9a2db-4e41-40bc-8e15-d9d0495689b3" containerName="thanos-sidecar" Sep 07 12:41:01.654745 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.654712 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26f9a2db-4e41-40bc-8e15-d9d0495689b3" containerName="kube-rbac-proxy" Sep 07 12:41:01.654745 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.654720 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="26f9a2db-4e41-40bc-8e15-d9d0495689b3" containerName="kube-rbac-proxy" Sep 07 12:41:01.654745 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.654732 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e54bd75e-c79f-47e6-8adc-ca3ae580ef00" containerName="registry" Sep 07 12:41:01.654745 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.654738 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="e54bd75e-c79f-47e6-8adc-ca3ae580ef00" containerName="registry" Sep 07 12:41:01.654745 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.654745 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26f9a2db-4e41-40bc-8e15-d9d0495689b3" containerName="config-reloader" Sep 07 12:41:01.654947 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.654751 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="26f9a2db-4e41-40bc-8e15-d9d0495689b3" containerName="config-reloader" Sep 07 12:41:01.654947 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.654758 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26f9a2db-4e41-40bc-8e15-d9d0495689b3" containerName="kube-rbac-proxy-web" Sep 07 12:41:01.654947 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.654764 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="26f9a2db-4e41-40bc-8e15-d9d0495689b3" containerName="kube-rbac-proxy-web" Sep 07 12:41:01.654947 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.654770 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26f9a2db-4e41-40bc-8e15-d9d0495689b3" containerName="kube-rbac-proxy-thanos" Sep 07 12:41:01.654947 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.654775 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="26f9a2db-4e41-40bc-8e15-d9d0495689b3" containerName="kube-rbac-proxy-thanos" Sep 07 12:41:01.654947 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.654781 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26f9a2db-4e41-40bc-8e15-d9d0495689b3" containerName="prometheus" Sep 07 12:41:01.654947 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.654787 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="26f9a2db-4e41-40bc-8e15-d9d0495689b3" containerName="prometheus" Sep 07 12:41:01.654947 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.654796 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26f9a2db-4e41-40bc-8e15-d9d0495689b3" containerName="init-config-reloader" Sep 07 12:41:01.654947 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.654804 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="26f9a2db-4e41-40bc-8e15-d9d0495689b3" containerName="init-config-reloader" Sep 07 12:41:01.654947 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.654850 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="26f9a2db-4e41-40bc-8e15-d9d0495689b3" containerName="kube-rbac-proxy-thanos" Sep 07 12:41:01.654947 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.654859 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="26f9a2db-4e41-40bc-8e15-d9d0495689b3" containerName="kube-rbac-proxy-web" Sep 07 12:41:01.654947 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.654865 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="26f9a2db-4e41-40bc-8e15-d9d0495689b3" containerName="prometheus" Sep 07 12:41:01.654947 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.654870 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="e54bd75e-c79f-47e6-8adc-ca3ae580ef00" containerName="registry" Sep 07 12:41:01.654947 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.654875 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="26f9a2db-4e41-40bc-8e15-d9d0495689b3" containerName="config-reloader" Sep 07 12:41:01.654947 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.654883 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="26f9a2db-4e41-40bc-8e15-d9d0495689b3" containerName="kube-rbac-proxy" Sep 07 12:41:01.654947 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.654892 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="26f9a2db-4e41-40bc-8e15-d9d0495689b3" containerName="thanos-sidecar" Sep 07 12:41:01.660787 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.660771 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:41:01.665654 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.665606 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 07 12:41:01.665654 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.665606 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 07 12:41:01.665944 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.665929 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 07 12:41:01.666147 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.666130 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 07 12:41:01.666214 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.666160 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 07 12:41:01.666824 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.666809 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 07 12:41:01.667000 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.666987 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 07 12:41:01.667069 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.667055 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 07 12:41:01.667122 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.667091 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 07 12:41:01.667190 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.667175 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 07 12:41:01.668324 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.668302 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-wnb52\"" Sep 07 12:41:01.668531 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.668513 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 07 12:41:01.669004 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.668987 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 07 12:41:01.669103 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.669012 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 07 12:41:01.675036 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.675020 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-43ii4ohffr47m\"" Sep 07 12:41:01.675206 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.675191 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 07 12:41:01.683003 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.682983 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 07 12:41:01.683944 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.683925 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 12:41:01.720140 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.720117 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8fsx\" (UniqueName: \"kubernetes.io/projected/ad231aa5-5c9c-4770-81da-bc4ff1653abc-kube-api-access-t8fsx\") pod \"prometheus-k8s-0\" (UID: \"ad231aa5-5c9c-4770-81da-bc4ff1653abc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:41:01.720269 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.720145 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad231aa5-5c9c-4770-81da-bc4ff1653abc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ad231aa5-5c9c-4770-81da-bc4ff1653abc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:41:01.720269 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.720167 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ad231aa5-5c9c-4770-81da-bc4ff1653abc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ad231aa5-5c9c-4770-81da-bc4ff1653abc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:41:01.720269 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.720184 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ad231aa5-5c9c-4770-81da-bc4ff1653abc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ad231aa5-5c9c-4770-81da-bc4ff1653abc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:41:01.720269 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.720203 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad231aa5-5c9c-4770-81da-bc4ff1653abc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ad231aa5-5c9c-4770-81da-bc4ff1653abc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:41:01.720479 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.720274 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ad231aa5-5c9c-4770-81da-bc4ff1653abc-config\") pod \"prometheus-k8s-0\" (UID: \"ad231aa5-5c9c-4770-81da-bc4ff1653abc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:41:01.720479 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.720313 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ad231aa5-5c9c-4770-81da-bc4ff1653abc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ad231aa5-5c9c-4770-81da-bc4ff1653abc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:41:01.720479 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.720345 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ad231aa5-5c9c-4770-81da-bc4ff1653abc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ad231aa5-5c9c-4770-81da-bc4ff1653abc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:41:01.720479 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.720395 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ad231aa5-5c9c-4770-81da-bc4ff1653abc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ad231aa5-5c9c-4770-81da-bc4ff1653abc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:41:01.720479 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.720423 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ad231aa5-5c9c-4770-81da-bc4ff1653abc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ad231aa5-5c9c-4770-81da-bc4ff1653abc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:41:01.720479 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.720446 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad231aa5-5c9c-4770-81da-bc4ff1653abc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ad231aa5-5c9c-4770-81da-bc4ff1653abc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:41:01.720837 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.720494 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ad231aa5-5c9c-4770-81da-bc4ff1653abc-config-out\") pod \"prometheus-k8s-0\" (UID: \"ad231aa5-5c9c-4770-81da-bc4ff1653abc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:41:01.720837 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.720527 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ad231aa5-5c9c-4770-81da-bc4ff1653abc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ad231aa5-5c9c-4770-81da-bc4ff1653abc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:41:01.720837 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.720574 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ad231aa5-5c9c-4770-81da-bc4ff1653abc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ad231aa5-5c9c-4770-81da-bc4ff1653abc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:41:01.720837 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.720602 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad231aa5-5c9c-4770-81da-bc4ff1653abc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ad231aa5-5c9c-4770-81da-bc4ff1653abc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:41:01.720837 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.720653 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ad231aa5-5c9c-4770-81da-bc4ff1653abc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ad231aa5-5c9c-4770-81da-bc4ff1653abc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:41:01.720837 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.720679 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ad231aa5-5c9c-4770-81da-bc4ff1653abc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ad231aa5-5c9c-4770-81da-bc4ff1653abc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:41:01.720837 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.720710 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ad231aa5-5c9c-4770-81da-bc4ff1653abc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ad231aa5-5c9c-4770-81da-bc4ff1653abc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:41:01.720837 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.720763 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ad231aa5-5c9c-4770-81da-bc4ff1653abc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ad231aa5-5c9c-4770-81da-bc4ff1653abc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:41:01.720837 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.720796 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ad231aa5-5c9c-4770-81da-bc4ff1653abc-web-config\") pod \"prometheus-k8s-0\" (UID: \"ad231aa5-5c9c-4770-81da-bc4ff1653abc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:41:01.821640 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.821590 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ad231aa5-5c9c-4770-81da-bc4ff1653abc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ad231aa5-5c9c-4770-81da-bc4ff1653abc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:41:01.821640 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.821643 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ad231aa5-5c9c-4770-81da-bc4ff1653abc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ad231aa5-5c9c-4770-81da-bc4ff1653abc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:41:01.821863 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.821765 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad231aa5-5c9c-4770-81da-bc4ff1653abc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ad231aa5-5c9c-4770-81da-bc4ff1653abc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:41:01.821863 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.821807 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ad231aa5-5c9c-4770-81da-bc4ff1653abc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ad231aa5-5c9c-4770-81da-bc4ff1653abc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:41:01.821863 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.821833 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ad231aa5-5c9c-4770-81da-bc4ff1653abc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ad231aa5-5c9c-4770-81da-bc4ff1653abc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:41:01.822010 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.821891 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ad231aa5-5c9c-4770-81da-bc4ff1653abc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ad231aa5-5c9c-4770-81da-bc4ff1653abc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:41:01.822010 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.821922 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ad231aa5-5c9c-4770-81da-bc4ff1653abc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ad231aa5-5c9c-4770-81da-bc4ff1653abc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:41:01.822010 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.821954 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ad231aa5-5c9c-4770-81da-bc4ff1653abc-web-config\") pod \"prometheus-k8s-0\" (UID: \"ad231aa5-5c9c-4770-81da-bc4ff1653abc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:41:01.822010 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.821985 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8fsx\" (UniqueName: \"kubernetes.io/projected/ad231aa5-5c9c-4770-81da-bc4ff1653abc-kube-api-access-t8fsx\") pod \"prometheus-k8s-0\" (UID: \"ad231aa5-5c9c-4770-81da-bc4ff1653abc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:41:01.822202 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.822013 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad231aa5-5c9c-4770-81da-bc4ff1653abc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ad231aa5-5c9c-4770-81da-bc4ff1653abc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:41:01.822202 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.822046 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ad231aa5-5c9c-4770-81da-bc4ff1653abc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ad231aa5-5c9c-4770-81da-bc4ff1653abc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:41:01.822202 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.822071 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ad231aa5-5c9c-4770-81da-bc4ff1653abc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ad231aa5-5c9c-4770-81da-bc4ff1653abc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:41:01.822202 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.822133 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad231aa5-5c9c-4770-81da-bc4ff1653abc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ad231aa5-5c9c-4770-81da-bc4ff1653abc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:41:01.822202 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.822162 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ad231aa5-5c9c-4770-81da-bc4ff1653abc-config\") pod \"prometheus-k8s-0\" (UID: \"ad231aa5-5c9c-4770-81da-bc4ff1653abc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:41:01.822428 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.822190 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ad231aa5-5c9c-4770-81da-bc4ff1653abc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ad231aa5-5c9c-4770-81da-bc4ff1653abc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:41:01.822428 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.822241 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ad231aa5-5c9c-4770-81da-bc4ff1653abc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ad231aa5-5c9c-4770-81da-bc4ff1653abc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:41:01.822428 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.822274 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ad231aa5-5c9c-4770-81da-bc4ff1653abc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ad231aa5-5c9c-4770-81da-bc4ff1653abc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:41:01.822428 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.822299 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ad231aa5-5c9c-4770-81da-bc4ff1653abc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ad231aa5-5c9c-4770-81da-bc4ff1653abc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:41:01.822428 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.822322 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad231aa5-5c9c-4770-81da-bc4ff1653abc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ad231aa5-5c9c-4770-81da-bc4ff1653abc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:41:01.822428 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.822351 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ad231aa5-5c9c-4770-81da-bc4ff1653abc-config-out\") pod \"prometheus-k8s-0\" (UID: \"ad231aa5-5c9c-4770-81da-bc4ff1653abc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:41:01.822767 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.822744 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad231aa5-5c9c-4770-81da-bc4ff1653abc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ad231aa5-5c9c-4770-81da-bc4ff1653abc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:41:01.823017 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.822955 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ad231aa5-5c9c-4770-81da-bc4ff1653abc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ad231aa5-5c9c-4770-81da-bc4ff1653abc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:41:01.823895 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.823869 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad231aa5-5c9c-4770-81da-bc4ff1653abc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ad231aa5-5c9c-4770-81da-bc4ff1653abc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:41:01.824951 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.824863 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ad231aa5-5c9c-4770-81da-bc4ff1653abc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ad231aa5-5c9c-4770-81da-bc4ff1653abc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:41:01.825439 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.825044 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ad231aa5-5c9c-4770-81da-bc4ff1653abc-config-out\") pod \"prometheus-k8s-0\" (UID: \"ad231aa5-5c9c-4770-81da-bc4ff1653abc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:41:01.825439 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.825052 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ad231aa5-5c9c-4770-81da-bc4ff1653abc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ad231aa5-5c9c-4770-81da-bc4ff1653abc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:41:01.825439 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.825109 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad231aa5-5c9c-4770-81da-bc4ff1653abc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ad231aa5-5c9c-4770-81da-bc4ff1653abc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:41:01.825439 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.825307 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ad231aa5-5c9c-4770-81da-bc4ff1653abc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ad231aa5-5c9c-4770-81da-bc4ff1653abc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:41:01.825735 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.825714 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ad231aa5-5c9c-4770-81da-bc4ff1653abc-web-config\") pod \"prometheus-k8s-0\" (UID: \"ad231aa5-5c9c-4770-81da-bc4ff1653abc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:41:01.826084 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.826012 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ad231aa5-5c9c-4770-81da-bc4ff1653abc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ad231aa5-5c9c-4770-81da-bc4ff1653abc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:41:01.827279 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.826100 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ad231aa5-5c9c-4770-81da-bc4ff1653abc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ad231aa5-5c9c-4770-81da-bc4ff1653abc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:41:01.827279 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.826823 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ad231aa5-5c9c-4770-81da-bc4ff1653abc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ad231aa5-5c9c-4770-81da-bc4ff1653abc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:41:01.827279 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.826887 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ad231aa5-5c9c-4770-81da-bc4ff1653abc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ad231aa5-5c9c-4770-81da-bc4ff1653abc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:41:01.827279 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.827170 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad231aa5-5c9c-4770-81da-bc4ff1653abc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ad231aa5-5c9c-4770-81da-bc4ff1653abc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:41:01.827673 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.827651 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ad231aa5-5c9c-4770-81da-bc4ff1653abc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ad231aa5-5c9c-4770-81da-bc4ff1653abc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:41:01.827817 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.827798 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ad231aa5-5c9c-4770-81da-bc4ff1653abc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ad231aa5-5c9c-4770-81da-bc4ff1653abc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:41:01.828468 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.828435 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ad231aa5-5c9c-4770-81da-bc4ff1653abc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ad231aa5-5c9c-4770-81da-bc4ff1653abc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:41:01.828554 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.828492 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ad231aa5-5c9c-4770-81da-bc4ff1653abc-config\") pod \"prometheus-k8s-0\" (UID: \"ad231aa5-5c9c-4770-81da-bc4ff1653abc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:41:01.828770 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.828753 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ad231aa5-5c9c-4770-81da-bc4ff1653abc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ad231aa5-5c9c-4770-81da-bc4ff1653abc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:41:01.836894 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.836874 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8fsx\" (UniqueName: \"kubernetes.io/projected/ad231aa5-5c9c-4770-81da-bc4ff1653abc-kube-api-access-t8fsx\") pod \"prometheus-k8s-0\" (UID: \"ad231aa5-5c9c-4770-81da-bc4ff1653abc\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:41:01.970165 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:01.970130 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:41:02.266473 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:02.266446 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 12:41:02.268528 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:41:02.268502 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad231aa5_5c9c_4770_81da_bc4ff1653abc.slice/crio-f629d9e32d773e333d19c5122725248ec8a55c096be66b30ecc9e6486790a242 WatchSource:0}: Error finding container f629d9e32d773e333d19c5122725248ec8a55c096be66b30ecc9e6486790a242: Status 404 returned error can't find the container with id f629d9e32d773e333d19c5122725248ec8a55c096be66b30ecc9e6486790a242 Sep 07 12:41:02.337306 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:02.337276 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26f9a2db-4e41-40bc-8e15-d9d0495689b3" path="/var/lib/kubelet/pods/26f9a2db-4e41-40bc-8e15-d9d0495689b3/volumes" Sep 07 12:41:02.594871 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:02.594779 2584 generic.go:356] "Generic (PLEG): container finished" podID="ad231aa5-5c9c-4770-81da-bc4ff1653abc" containerID="7aa0734c412535ef10f9e93c0ef3f592b4850c81a7cb550045121374ad5e358d" exitCode=0 Sep 07 12:41:02.594871 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:02.594855 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ad231aa5-5c9c-4770-81da-bc4ff1653abc","Type":"ContainerDied","Data":"7aa0734c412535ef10f9e93c0ef3f592b4850c81a7cb550045121374ad5e358d"} Sep 07 12:41:02.595287 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:02.594921 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ad231aa5-5c9c-4770-81da-bc4ff1653abc","Type":"ContainerStarted","Data":"f629d9e32d773e333d19c5122725248ec8a55c096be66b30ecc9e6486790a242"} Sep 07 12:41:03.602428 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:03.602390 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ad231aa5-5c9c-4770-81da-bc4ff1653abc","Type":"ContainerStarted","Data":"fc101e4f9df6f4a7bdd03bf9984429720235e4c2f93b194296af4d40b1e08b9e"} Sep 07 12:41:03.602940 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:03.602455 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ad231aa5-5c9c-4770-81da-bc4ff1653abc","Type":"ContainerStarted","Data":"2d0358c992e0edb5ab46be37f89ea165e0440af5f2fb58674cb651b73fcc8763"} Sep 07 12:41:03.602940 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:03.602482 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ad231aa5-5c9c-4770-81da-bc4ff1653abc","Type":"ContainerStarted","Data":"db167268a519df8e1c1186140c4b734f1e09dc72174dc92a69daf3fee795fe5a"} Sep 07 12:41:03.602940 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:03.602505 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ad231aa5-5c9c-4770-81da-bc4ff1653abc","Type":"ContainerStarted","Data":"05d18598f68ce8fc7f16a50f33efc58ae5584c50ab18333efb99b1164d5588b7"} Sep 07 12:41:03.602940 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:03.602526 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ad231aa5-5c9c-4770-81da-bc4ff1653abc","Type":"ContainerStarted","Data":"a5b3fb1d7297ac584e19a853c012064ab5fb5daea03e8489c6a5bf60046610df"} Sep 07 12:41:03.602940 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:03.602547 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ad231aa5-5c9c-4770-81da-bc4ff1653abc","Type":"ContainerStarted","Data":"4472d7432a32a95939e95cdc0d913a65fcc965a985e7c1b5eeca4cd3579f7180"} Sep 07 12:41:03.661825 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:03.661776 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.641546678 podStartE2EDuration="2.661760297s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.213619ms" isStatefulPod=false podCreationTimestamp="2026-09-07 12:41:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:41:03.661084531 +0000 UTC m=+391.811514267" watchObservedRunningTime="2026-09-07 12:41:03.661760297 +0000 UTC m=+391.812190098" Sep 07 12:41:06.971087 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:41:06.971033 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:01.971086 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:42:01.971047 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:01.987059 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:42:01.987034 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:42:02.836418 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:42:02.836390 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:43:18.272735 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:43:18.272704 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-gpg56"] Sep 07 12:43:18.275509 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:43:18.275493 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-gpg56" Sep 07 12:43:18.278428 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:43:18.278402 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Sep 07 12:43:18.279564 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:43:18.279542 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-x5dvb\"" Sep 07 12:43:18.279668 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:43:18.279542 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Sep 07 12:43:18.287065 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:43:18.287041 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-gpg56"] Sep 07 12:43:18.358199 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:43:18.358161 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b79b3599-f7e6-4128-9136-2069e87ff649-tmp\") pod \"jobset-operator-5bc45f897-gpg56\" (UID: \"b79b3599-f7e6-4128-9136-2069e87ff649\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-gpg56" Sep 07 12:43:18.358387 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:43:18.358302 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhqx5\" (UniqueName: \"kubernetes.io/projected/b79b3599-f7e6-4128-9136-2069e87ff649-kube-api-access-lhqx5\") pod \"jobset-operator-5bc45f897-gpg56\" (UID: \"b79b3599-f7e6-4128-9136-2069e87ff649\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-gpg56" Sep 07 12:43:18.458720 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:43:18.458685 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b79b3599-f7e6-4128-9136-2069e87ff649-tmp\") pod \"jobset-operator-5bc45f897-gpg56\" (UID: \"b79b3599-f7e6-4128-9136-2069e87ff649\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-gpg56" Sep 07 12:43:18.458871 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:43:18.458740 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhqx5\" (UniqueName: \"kubernetes.io/projected/b79b3599-f7e6-4128-9136-2069e87ff649-kube-api-access-lhqx5\") pod \"jobset-operator-5bc45f897-gpg56\" (UID: \"b79b3599-f7e6-4128-9136-2069e87ff649\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-gpg56" Sep 07 12:43:18.459123 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:43:18.459100 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b79b3599-f7e6-4128-9136-2069e87ff649-tmp\") pod \"jobset-operator-5bc45f897-gpg56\" (UID: \"b79b3599-f7e6-4128-9136-2069e87ff649\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-gpg56" Sep 07 12:43:18.468381 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:43:18.468347 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhqx5\" (UniqueName: \"kubernetes.io/projected/b79b3599-f7e6-4128-9136-2069e87ff649-kube-api-access-lhqx5\") pod \"jobset-operator-5bc45f897-gpg56\" (UID: \"b79b3599-f7e6-4128-9136-2069e87ff649\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-gpg56" Sep 07 12:43:18.599564 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:43:18.599480 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-gpg56" Sep 07 12:43:18.890051 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:43:18.889971 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-gpg56"] Sep 07 12:43:18.894733 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:43:18.894706 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb79b3599_f7e6_4128_9136_2069e87ff649.slice/crio-e46512fadc501677c097213ae4d7eb59ac7d616b48605736ba659df63bdd1abe WatchSource:0}: Error finding container e46512fadc501677c097213ae4d7eb59ac7d616b48605736ba659df63bdd1abe: Status 404 returned error can't find the container with id e46512fadc501677c097213ae4d7eb59ac7d616b48605736ba659df63bdd1abe Sep 07 12:43:19.102006 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:43:19.101969 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-gpg56" event={"ID":"b79b3599-f7e6-4128-9136-2069e87ff649","Type":"ContainerStarted","Data":"e46512fadc501677c097213ae4d7eb59ac7d616b48605736ba659df63bdd1abe"} Sep 07 12:43:22.115554 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:43:22.115508 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-gpg56" event={"ID":"b79b3599-f7e6-4128-9136-2069e87ff649","Type":"ContainerStarted","Data":"bbaee619e2d2872a705ba9aef65f503e0120c96481686c0a5f584b9923412ffa"} Sep 07 12:43:22.139294 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:43:22.139242 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-5bc45f897-gpg56" podStartSLOduration=1.675487518 podStartE2EDuration="4.139226939s" totalImagesPullingTime="2.463739421s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:43:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:43:22.138071349 +0000 UTC m=+530.288501065" watchObservedRunningTime="2026-09-07 12:43:22.139226939 +0000 UTC m=+530.289656655" Sep 07 12:44:32.228411 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:44:32.228384 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-95d8r_ffbb335e-25ad-4f94-bd83-40889a6970b3/console-operator/2.log" Sep 07 12:44:32.228411 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:44:32.228404 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-95d8r_ffbb335e-25ad-4f94-bd83-40889a6970b3/console-operator/2.log" Sep 07 12:48:01.366857 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:48:01.366770 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-wcmbf"] Sep 07 12:48:01.370114 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:48:01.370093 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-wcmbf" Sep 07 12:48:01.373498 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:48:01.373479 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-ljxkw\"" Sep 07 12:48:01.374716 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:48:01.374701 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 07 12:48:01.374790 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:48:01.374754 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 07 12:48:01.381560 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:48:01.381536 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-wcmbf"] Sep 07 12:48:01.496350 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:48:01.496311 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4ncj\" (UniqueName: \"kubernetes.io/projected/c80e8307-491e-4f60-9847-90a04d1d8c8b-kube-api-access-f4ncj\") pod \"test-trainjob-workflow-node-0-0-wcmbf\" (UID: \"c80e8307-491e-4f60-9847-90a04d1d8c8b\") " pod="opendatahub/test-trainjob-workflow-node-0-0-wcmbf" Sep 07 12:48:01.597129 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:48:01.597095 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4ncj\" (UniqueName: \"kubernetes.io/projected/c80e8307-491e-4f60-9847-90a04d1d8c8b-kube-api-access-f4ncj\") pod \"test-trainjob-workflow-node-0-0-wcmbf\" (UID: \"c80e8307-491e-4f60-9847-90a04d1d8c8b\") " pod="opendatahub/test-trainjob-workflow-node-0-0-wcmbf" Sep 07 12:48:01.606811 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:48:01.606783 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4ncj\" (UniqueName: \"kubernetes.io/projected/c80e8307-491e-4f60-9847-90a04d1d8c8b-kube-api-access-f4ncj\") pod \"test-trainjob-workflow-node-0-0-wcmbf\" (UID: \"c80e8307-491e-4f60-9847-90a04d1d8c8b\") " pod="opendatahub/test-trainjob-workflow-node-0-0-wcmbf" Sep 07 12:48:01.679331 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:48:01.679248 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-wcmbf" Sep 07 12:48:01.955041 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:48:01.955014 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-wcmbf"] Sep 07 12:48:01.957871 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:48:01.957835 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc80e8307_491e_4f60_9847_90a04d1d8c8b.slice/crio-b8a788b4823a0e2475fcf2c6806b611899110452691d8f06f38680593f511cb6 WatchSource:0}: Error finding container b8a788b4823a0e2475fcf2c6806b611899110452691d8f06f38680593f511cb6: Status 404 returned error can't find the container with id b8a788b4823a0e2475fcf2c6806b611899110452691d8f06f38680593f511cb6 Sep 07 12:48:01.960015 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:48:01.959998 2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 07 12:48:02.168977 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:48:02.168941 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-wcmbf" event={"ID":"c80e8307-491e-4f60-9847-90a04d1d8c8b","Type":"ContainerStarted","Data":"b8a788b4823a0e2475fcf2c6806b611899110452691d8f06f38680593f511cb6"} Sep 07 12:49:06.476580 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:49:06.476544 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-wcmbf" event={"ID":"c80e8307-491e-4f60-9847-90a04d1d8c8b","Type":"ContainerStarted","Data":"1be3bd00965446cb4307bccd42305c29af5a4cf87fa5170f5f149baad6848add"} Sep 07 12:49:06.495853 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:49:06.495794 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-trainjob-workflow-node-0-0-wcmbf" podStartSLOduration=1.826184826 podStartE2EDuration="1m5.495778213s" totalImagesPullingTime="1m3.669593387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:48:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:49:06.493905342 +0000 UTC m=+874.644335058" watchObservedRunningTime="2026-09-07 12:49:06.495778213 +0000 UTC m=+874.646207930" Sep 07 12:49:08.486823 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:49:08.486789 2584 generic.go:356] "Generic (PLEG): container finished" podID="c80e8307-491e-4f60-9847-90a04d1d8c8b" containerID="1be3bd00965446cb4307bccd42305c29af5a4cf87fa5170f5f149baad6848add" exitCode=0 Sep 07 12:49:08.487279 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:49:08.486827 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-wcmbf" event={"ID":"c80e8307-491e-4f60-9847-90a04d1d8c8b","Type":"ContainerDied","Data":"1be3bd00965446cb4307bccd42305c29af5a4cf87fa5170f5f149baad6848add"} Sep 07 12:49:09.723369 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:49:09.723337 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-wcmbf" Sep 07 12:49:09.810141 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:49:09.810026 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f4ncj\" (UniqueName: \"kubernetes.io/projected/c80e8307-491e-4f60-9847-90a04d1d8c8b-kube-api-access-f4ncj\") pod \"c80e8307-491e-4f60-9847-90a04d1d8c8b\" (UID: \"c80e8307-491e-4f60-9847-90a04d1d8c8b\") " Sep 07 12:49:09.812343 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:49:09.812319 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c80e8307-491e-4f60-9847-90a04d1d8c8b-kube-api-access-f4ncj" (OuterVolumeSpecName: "kube-api-access-f4ncj") pod "c80e8307-491e-4f60-9847-90a04d1d8c8b" (UID: "c80e8307-491e-4f60-9847-90a04d1d8c8b"). InnerVolumeSpecName "kube-api-access-f4ncj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 12:49:09.911225 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:49:09.911193 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f4ncj\" (UniqueName: \"kubernetes.io/projected/c80e8307-491e-4f60-9847-90a04d1d8c8b-kube-api-access-f4ncj\") on node \"ip-10-0-129-7.ec2.internal\" DevicePath \"\"" Sep 07 12:49:10.495815 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:49:10.495789 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-wcmbf" Sep 07 12:49:10.495974 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:49:10.495779 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-wcmbf" event={"ID":"c80e8307-491e-4f60-9847-90a04d1d8c8b","Type":"ContainerDied","Data":"b8a788b4823a0e2475fcf2c6806b611899110452691d8f06f38680593f511cb6"} Sep 07 12:49:10.495974 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:49:10.495913 2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b8a788b4823a0e2475fcf2c6806b611899110452691d8f06f38680593f511cb6" Sep 07 12:49:11.512293 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:49:11.512261 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-wcmbf"] Sep 07 12:49:11.514662 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:49:11.514636 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-wcmbf"] Sep 07 12:49:12.337634 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:49:12.337592 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c80e8307-491e-4f60-9847-90a04d1d8c8b" path="/var/lib/kubelet/pods/c80e8307-491e-4f60-9847-90a04d1d8c8b/volumes" Sep 07 12:49:32.253975 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:49:32.253900 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-95d8r_ffbb335e-25ad-4f94-bd83-40889a6970b3/console-operator/2.log" Sep 07 12:49:32.255011 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:49:32.254983 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-95d8r_ffbb335e-25ad-4f94-bd83-40889a6970b3/console-operator/2.log" Sep 07 12:50:11.807798 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:11.807757 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wh6xq/must-gather-x245v"] Sep 07 12:50:11.808276 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:11.808046 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c80e8307-491e-4f60-9847-90a04d1d8c8b" containerName="node" Sep 07 12:50:11.808276 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:11.808057 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="c80e8307-491e-4f60-9847-90a04d1d8c8b" containerName="node" Sep 07 12:50:11.808276 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:11.808106 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="c80e8307-491e-4f60-9847-90a04d1d8c8b" containerName="node" Sep 07 12:50:11.810167 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:11.810149 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wh6xq/must-gather-x245v" Sep 07 12:50:11.812772 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:11.812751 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wh6xq\"/\"default-dockercfg-xsx9v\"" Sep 07 12:50:11.812914 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:11.812771 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wh6xq\"/\"kube-root-ca.crt\"" Sep 07 12:50:11.812914 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:11.812771 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wh6xq\"/\"openshift-service-ca.crt\"" Sep 07 12:50:11.820378 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:11.820348 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wh6xq/must-gather-x245v"] Sep 07 12:50:11.890160 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:11.890124 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dgn5\" (UniqueName: \"kubernetes.io/projected/390aa5f7-efdc-406a-a76c-b68ec81cbea6-kube-api-access-8dgn5\") pod \"must-gather-x245v\" (UID: \"390aa5f7-efdc-406a-a76c-b68ec81cbea6\") " pod="openshift-must-gather-wh6xq/must-gather-x245v" Sep 07 12:50:11.890355 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:11.890199 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/390aa5f7-efdc-406a-a76c-b68ec81cbea6-must-gather-output\") pod \"must-gather-x245v\" (UID: \"390aa5f7-efdc-406a-a76c-b68ec81cbea6\") " pod="openshift-must-gather-wh6xq/must-gather-x245v" Sep 07 12:50:11.991365 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:11.991336 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dgn5\" (UniqueName: \"kubernetes.io/projected/390aa5f7-efdc-406a-a76c-b68ec81cbea6-kube-api-access-8dgn5\") pod \"must-gather-x245v\" (UID: \"390aa5f7-efdc-406a-a76c-b68ec81cbea6\") " pod="openshift-must-gather-wh6xq/must-gather-x245v" Sep 07 12:50:11.991511 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:11.991383 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/390aa5f7-efdc-406a-a76c-b68ec81cbea6-must-gather-output\") pod \"must-gather-x245v\" (UID: \"390aa5f7-efdc-406a-a76c-b68ec81cbea6\") " pod="openshift-must-gather-wh6xq/must-gather-x245v" Sep 07 12:50:11.991678 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:11.991660 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/390aa5f7-efdc-406a-a76c-b68ec81cbea6-must-gather-output\") pod \"must-gather-x245v\" (UID: \"390aa5f7-efdc-406a-a76c-b68ec81cbea6\") " pod="openshift-must-gather-wh6xq/must-gather-x245v" Sep 07 12:50:11.999283 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:11.999265 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dgn5\" (UniqueName: \"kubernetes.io/projected/390aa5f7-efdc-406a-a76c-b68ec81cbea6-kube-api-access-8dgn5\") pod \"must-gather-x245v\" (UID: \"390aa5f7-efdc-406a-a76c-b68ec81cbea6\") " pod="openshift-must-gather-wh6xq/must-gather-x245v" Sep 07 12:50:12.119345 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:12.119269 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wh6xq/must-gather-x245v" Sep 07 12:50:12.391182 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:12.391111 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wh6xq/must-gather-x245v"] Sep 07 12:50:12.394186 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:50:12.394156 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod390aa5f7_efdc_406a_a76c_b68ec81cbea6.slice/crio-5b825f2175ef504ae8a8a5acb4711467932af8fd3e4e7d263b16cab34ca47a3c WatchSource:0}: Error finding container 5b825f2175ef504ae8a8a5acb4711467932af8fd3e4e7d263b16cab34ca47a3c: Status 404 returned error can't find the container with id 5b825f2175ef504ae8a8a5acb4711467932af8fd3e4e7d263b16cab34ca47a3c Sep 07 12:50:12.736719 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:12.736682 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wh6xq/must-gather-x245v" event={"ID":"390aa5f7-efdc-406a-a76c-b68ec81cbea6","Type":"ContainerStarted","Data":"5b825f2175ef504ae8a8a5acb4711467932af8fd3e4e7d263b16cab34ca47a3c"} Sep 07 12:50:13.743531 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:13.743495 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wh6xq/must-gather-x245v" event={"ID":"390aa5f7-efdc-406a-a76c-b68ec81cbea6","Type":"ContainerStarted","Data":"92ea650dff016dd9fa03f203a61c35010f6ad060744a57e1b56367df08c3eb44"} Sep 07 12:50:13.744036 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:13.743547 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wh6xq/must-gather-x245v" event={"ID":"390aa5f7-efdc-406a-a76c-b68ec81cbea6","Type":"ContainerStarted","Data":"94f9f32fcc37d257dd25f46dc36c3558e7041aa0d86e60850e1abc071088a898"} Sep 07 12:50:13.762530 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:13.762462 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wh6xq/must-gather-x245v" podStartSLOduration=2.185373383 podStartE2EDuration="2.762447186s" totalImagesPullingTime="577.073803ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:50:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:50:13.760175447 +0000 UTC m=+941.910605164" watchObservedRunningTime="2026-09-07 12:50:13.762447186 +0000 UTC m=+941.912876901" Sep 07 12:50:14.496272 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:14.496244 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-b7nh4_4620ef7e-ba96-427e-ab48-a8aa3d7bc243/global-pull-secret-syncer/0.log" Sep 07 12:50:14.601655 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:14.601601 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-cl7zg_4c11358c-536b-46d1-a3ad-1472e7f9ddd9/konnectivity-agent/0.log" Sep 07 12:50:14.678441 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:14.678411 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-7.ec2.internal_abdd9ed4ef1ebcac8d95bd841ee6df0e/haproxy/0.log" Sep 07 12:50:18.636512 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:18.636472 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-mzfld_39d91be9-e619-4aeb-bdc4-0df472e63c07/monitoring-plugin/0.log" Sep 07 12:50:18.747713 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:18.747680 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v9fcf_975c7a1a-4d2c-4ba7-be6c-4192ea6795d6/node-exporter/0.log" Sep 07 12:50:18.772946 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:18.772877 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v9fcf_975c7a1a-4d2c-4ba7-be6c-4192ea6795d6/kube-rbac-proxy/0.log" Sep 07 12:50:18.801671 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:18.801548 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v9fcf_975c7a1a-4d2c-4ba7-be6c-4192ea6795d6/init-textfile/0.log" Sep 07 12:50:18.919551 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:18.919476 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-dnnn9_b2f99789-a263-40a6-8746-5cbf29ceb9ac/kube-rbac-proxy-main/0.log" Sep 07 12:50:18.951978 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:18.951952 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-dnnn9_b2f99789-a263-40a6-8746-5cbf29ceb9ac/kube-rbac-proxy-self/0.log" Sep 07 12:50:18.979205 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:18.979173 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-dnnn9_b2f99789-a263-40a6-8746-5cbf29ceb9ac/openshift-state-metrics/0.log" Sep 07 12:50:19.015880 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:19.015844 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ad231aa5-5c9c-4770-81da-bc4ff1653abc/prometheus/0.log" Sep 07 12:50:19.043573 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:19.043534 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ad231aa5-5c9c-4770-81da-bc4ff1653abc/config-reloader/0.log" Sep 07 12:50:19.073755 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:19.073721 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ad231aa5-5c9c-4770-81da-bc4ff1653abc/thanos-sidecar/0.log" Sep 07 12:50:19.104702 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:19.104665 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ad231aa5-5c9c-4770-81da-bc4ff1653abc/kube-rbac-proxy-web/0.log" Sep 07 12:50:19.130215 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:19.130184 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ad231aa5-5c9c-4770-81da-bc4ff1653abc/kube-rbac-proxy/0.log" Sep 07 12:50:19.156921 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:19.156848 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ad231aa5-5c9c-4770-81da-bc4ff1653abc/kube-rbac-proxy-thanos/0.log" Sep 07 12:50:19.185052 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:19.184955 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ad231aa5-5c9c-4770-81da-bc4ff1653abc/init-config-reloader/0.log" Sep 07 12:50:21.306698 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:21.306669 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-95d8r_ffbb335e-25ad-4f94-bd83-40889a6970b3/console-operator/2.log" Sep 07 12:50:21.315822 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:21.315758 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-95d8r_ffbb335e-25ad-4f94-bd83-40889a6970b3/console-operator/3.log" Sep 07 12:50:22.130251 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:22.130147 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wh6xq/perf-node-gather-daemonset-ndm9v"] Sep 07 12:50:22.134368 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:22.134341 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wh6xq/perf-node-gather-daemonset-ndm9v" Sep 07 12:50:22.148204 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:22.148174 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wh6xq/perf-node-gather-daemonset-ndm9v"] Sep 07 12:50:22.183642 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:22.182895 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ee95804f-26ce-47d9-af1a-fee358a13b00-proc\") pod \"perf-node-gather-daemonset-ndm9v\" (UID: \"ee95804f-26ce-47d9-af1a-fee358a13b00\") " pod="openshift-must-gather-wh6xq/perf-node-gather-daemonset-ndm9v" Sep 07 12:50:22.183642 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:22.182948 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xktmk\" (UniqueName: \"kubernetes.io/projected/ee95804f-26ce-47d9-af1a-fee358a13b00-kube-api-access-xktmk\") pod \"perf-node-gather-daemonset-ndm9v\" (UID: \"ee95804f-26ce-47d9-af1a-fee358a13b00\") " pod="openshift-must-gather-wh6xq/perf-node-gather-daemonset-ndm9v" Sep 07 12:50:22.183642 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:22.182982 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ee95804f-26ce-47d9-af1a-fee358a13b00-podres\") pod \"perf-node-gather-daemonset-ndm9v\" (UID: \"ee95804f-26ce-47d9-af1a-fee358a13b00\") " pod="openshift-must-gather-wh6xq/perf-node-gather-daemonset-ndm9v" Sep 07 12:50:22.183642 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:22.183017 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ee95804f-26ce-47d9-af1a-fee358a13b00-sys\") pod \"perf-node-gather-daemonset-ndm9v\" (UID: \"ee95804f-26ce-47d9-af1a-fee358a13b00\") " pod="openshift-must-gather-wh6xq/perf-node-gather-daemonset-ndm9v" Sep 07 12:50:22.183642 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:22.183052 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ee95804f-26ce-47d9-af1a-fee358a13b00-lib-modules\") pod \"perf-node-gather-daemonset-ndm9v\" (UID: \"ee95804f-26ce-47d9-af1a-fee358a13b00\") " pod="openshift-must-gather-wh6xq/perf-node-gather-daemonset-ndm9v" Sep 07 12:50:22.270386 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:22.270345 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-695c895bd6-qlwkf_b0aadd3e-6997-4856-ad61-71b4c6074fc0/volume-data-source-validator/0.log" Sep 07 12:50:22.284019 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:22.283985 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ee95804f-26ce-47d9-af1a-fee358a13b00-proc\") pod \"perf-node-gather-daemonset-ndm9v\" (UID: \"ee95804f-26ce-47d9-af1a-fee358a13b00\") " pod="openshift-must-gather-wh6xq/perf-node-gather-daemonset-ndm9v" Sep 07 12:50:22.284019 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:22.284022 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xktmk\" (UniqueName: \"kubernetes.io/projected/ee95804f-26ce-47d9-af1a-fee358a13b00-kube-api-access-xktmk\") pod \"perf-node-gather-daemonset-ndm9v\" (UID: \"ee95804f-26ce-47d9-af1a-fee358a13b00\") " pod="openshift-must-gather-wh6xq/perf-node-gather-daemonset-ndm9v" Sep 07 12:50:22.284271 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:22.284042 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ee95804f-26ce-47d9-af1a-fee358a13b00-podres\") pod \"perf-node-gather-daemonset-ndm9v\" (UID: \"ee95804f-26ce-47d9-af1a-fee358a13b00\") " pod="openshift-must-gather-wh6xq/perf-node-gather-daemonset-ndm9v" Sep 07 12:50:22.284271 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:22.284064 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ee95804f-26ce-47d9-af1a-fee358a13b00-sys\") pod \"perf-node-gather-daemonset-ndm9v\" (UID: \"ee95804f-26ce-47d9-af1a-fee358a13b00\") " pod="openshift-must-gather-wh6xq/perf-node-gather-daemonset-ndm9v" Sep 07 12:50:22.284271 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:22.284098 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ee95804f-26ce-47d9-af1a-fee358a13b00-lib-modules\") pod \"perf-node-gather-daemonset-ndm9v\" (UID: \"ee95804f-26ce-47d9-af1a-fee358a13b00\") " pod="openshift-must-gather-wh6xq/perf-node-gather-daemonset-ndm9v" Sep 07 12:50:22.284271 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:22.284123 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ee95804f-26ce-47d9-af1a-fee358a13b00-proc\") pod \"perf-node-gather-daemonset-ndm9v\" (UID: \"ee95804f-26ce-47d9-af1a-fee358a13b00\") " pod="openshift-must-gather-wh6xq/perf-node-gather-daemonset-ndm9v" Sep 07 12:50:22.284271 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:22.284173 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ee95804f-26ce-47d9-af1a-fee358a13b00-sys\") pod \"perf-node-gather-daemonset-ndm9v\" (UID: \"ee95804f-26ce-47d9-af1a-fee358a13b00\") " pod="openshift-must-gather-wh6xq/perf-node-gather-daemonset-ndm9v" Sep 07 12:50:22.284271 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:22.284217 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ee95804f-26ce-47d9-af1a-fee358a13b00-podres\") pod \"perf-node-gather-daemonset-ndm9v\" (UID: \"ee95804f-26ce-47d9-af1a-fee358a13b00\") " pod="openshift-must-gather-wh6xq/perf-node-gather-daemonset-ndm9v" Sep 07 12:50:22.284271 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:22.284234 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ee95804f-26ce-47d9-af1a-fee358a13b00-lib-modules\") pod \"perf-node-gather-daemonset-ndm9v\" (UID: \"ee95804f-26ce-47d9-af1a-fee358a13b00\") " pod="openshift-must-gather-wh6xq/perf-node-gather-daemonset-ndm9v" Sep 07 12:50:22.293248 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:22.293222 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xktmk\" (UniqueName: \"kubernetes.io/projected/ee95804f-26ce-47d9-af1a-fee358a13b00-kube-api-access-xktmk\") pod \"perf-node-gather-daemonset-ndm9v\" (UID: \"ee95804f-26ce-47d9-af1a-fee358a13b00\") " pod="openshift-must-gather-wh6xq/perf-node-gather-daemonset-ndm9v" Sep 07 12:50:22.447555 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:22.447516 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wh6xq/perf-node-gather-daemonset-ndm9v" Sep 07 12:50:22.737027 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:22.736812 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wh6xq/perf-node-gather-daemonset-ndm9v"] Sep 07 12:50:22.739976 ip-10-0-129-7 kubenswrapper[2584]: W0907 12:50:22.739937 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podee95804f_26ce_47d9_af1a_fee358a13b00.slice/crio-dd1ef247d223d45a4be7b8e8f6477255e4cd48e4b89054bf8ff35bae9f8b0131 WatchSource:0}: Error finding container dd1ef247d223d45a4be7b8e8f6477255e4cd48e4b89054bf8ff35bae9f8b0131: Status 404 returned error can't find the container with id dd1ef247d223d45a4be7b8e8f6477255e4cd48e4b89054bf8ff35bae9f8b0131 Sep 07 12:50:22.796896 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:22.796862 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wh6xq/perf-node-gather-daemonset-ndm9v" event={"ID":"ee95804f-26ce-47d9-af1a-fee358a13b00","Type":"ContainerStarted","Data":"dd1ef247d223d45a4be7b8e8f6477255e4cd48e4b89054bf8ff35bae9f8b0131"} Sep 07 12:50:23.235493 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:23.235464 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jv7nm_7c51fa57-4e30-481f-8ed2-c2ed61972d2e/dns/0.log" Sep 07 12:50:23.258265 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:23.258228 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jv7nm_7c51fa57-4e30-481f-8ed2-c2ed61972d2e/kube-rbac-proxy/0.log" Sep 07 12:50:23.306997 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:23.306970 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ctd66_a1abf056-5424-47f2-b0cc-9e4791a442e4/dns-node-resolver/0.log" Sep 07 12:50:23.728601 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:23.728569 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7c5c654c5f-wrtnb_2a9f187b-0ff2-496a-9656-8c2f24e4f6d9/registry/0.log" Sep 07 12:50:23.798812 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:23.798789 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xsqsc_eb990ca0-9dd8-4a6a-9aea-385184d47b70/node-ca/0.log" Sep 07 12:50:23.802215 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:23.802188 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wh6xq/perf-node-gather-daemonset-ndm9v" event={"ID":"ee95804f-26ce-47d9-af1a-fee358a13b00","Type":"ContainerStarted","Data":"761c7da08db93df3c820c1da4b824aee39474b0d47789fcb5e2eebc00927f029"} Sep 07 12:50:23.802338 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:23.802248 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wh6xq/perf-node-gather-daemonset-ndm9v" Sep 07 12:50:23.821093 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:23.821031 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wh6xq/perf-node-gather-daemonset-ndm9v" podStartSLOduration=1.821011669 podStartE2EDuration="1.821011669s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:50:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:50:23.819996927 +0000 UTC m=+951.970426638" watchObservedRunningTime="2026-09-07 12:50:23.821011669 +0000 UTC m=+951.971441385" Sep 07 12:50:24.912939 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:24.912905 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qsnps_07c2afb8-7cde-4925-9f93-13aaf570f1fa/serve-healthcheck-canary/0.log" Sep 07 12:50:25.413609 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:25.413580 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mvzqf_66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d/kube-rbac-proxy/0.log" Sep 07 12:50:25.436388 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:25.436351 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mvzqf_66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d/exporter/0.log" Sep 07 12:50:25.461330 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:25.461295 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mvzqf_66d1b7b5-af8a-4e2a-af8b-20047a1c1d6d/extractor/0.log" Sep 07 12:50:27.194923 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:27.194892 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-operator-5bc45f897-gpg56_b79b3599-f7e6-4128-9136-2069e87ff649/jobset-operator/0.log" Sep 07 12:50:29.818978 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:29.818945 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wh6xq/perf-node-gather-daemonset-ndm9v" Sep 07 12:50:30.547224 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:30.547190 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-6z2vx_b2d75c22-36b3-4dcf-b699-52a36f064985/migrator/0.log" Sep 07 12:50:30.577363 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:30.577330 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-6z2vx_b2d75c22-36b3-4dcf-b699-52a36f064985/graceful-termination/0.log" Sep 07 12:50:32.373079 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:32.373054 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lgzj8_34989fc7-d971-4b4a-9b00-aef1cb59f2bf/kube-multus-additional-cni-plugins/0.log" Sep 07 12:50:32.409029 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:32.409001 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lgzj8_34989fc7-d971-4b4a-9b00-aef1cb59f2bf/egress-router-binary-copy/0.log" Sep 07 12:50:32.438933 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:32.438893 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lgzj8_34989fc7-d971-4b4a-9b00-aef1cb59f2bf/cni-plugins/0.log" Sep 07 12:50:32.466556 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:32.466526 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lgzj8_34989fc7-d971-4b4a-9b00-aef1cb59f2bf/bond-cni-plugin/0.log" Sep 07 12:50:32.490138 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:32.490106 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lgzj8_34989fc7-d971-4b4a-9b00-aef1cb59f2bf/routeoverride-cni/0.log" Sep 07 12:50:32.517155 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:32.517127 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lgzj8_34989fc7-d971-4b4a-9b00-aef1cb59f2bf/whereabouts-cni-bincopy/0.log" Sep 07 12:50:32.541995 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:32.541962 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lgzj8_34989fc7-d971-4b4a-9b00-aef1cb59f2bf/whereabouts-cni/0.log" Sep 07 12:50:32.642377 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:32.642290 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-xpkzx_54e55813-9848-4014-bbc1-41700bba7900/kube-multus/0.log" Sep 07 12:50:32.722707 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:32.722681 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-lkvmb_2350fd1e-ae4b-48d4-9ef6-e45cb3f83129/network-metrics-daemon/0.log" Sep 07 12:50:32.752934 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:32.752908 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-lkvmb_2350fd1e-ae4b-48d4-9ef6-e45cb3f83129/kube-rbac-proxy/0.log" Sep 07 12:50:33.809857 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:33.809778 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bk5j9_a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3/ovn-controller/0.log" Sep 07 12:50:33.861570 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:33.861532 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bk5j9_a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3/ovn-acl-logging/0.log" Sep 07 12:50:33.919222 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:33.919189 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bk5j9_a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3/kube-rbac-proxy-node/0.log" Sep 07 12:50:33.961347 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:33.961315 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bk5j9_a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3/kube-rbac-proxy-ovn-metrics/0.log" Sep 07 12:50:34.006152 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:34.006123 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bk5j9_a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3/northd/0.log" Sep 07 12:50:34.053855 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:34.053821 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bk5j9_a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3/nbdb/0.log" Sep 07 12:50:34.101732 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:34.101674 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bk5j9_a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3/sbdb/0.log" Sep 07 12:50:34.178148 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:34.178117 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bk5j9_a48ff8fd-a28e-46b2-8b02-3366dbd7bfc3/ovnkube-controller/0.log" Sep 07 12:50:35.422671 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:35.422631 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-685456655f-mr8hn_6d8d95ce-f1c7-4a00-a97b-952fe9e285a8/check-endpoints/0.log" Sep 07 12:50:35.500843 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:35.500812 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-lclwd_7008051b-bbec-4967-b4ff-dc60f109a092/network-check-target-container/0.log" Sep 07 12:50:36.449914 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:36.449887 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-lj4gt_5cf1801e-b694-49ad-9c7c-803229efc5f3/iptables-alerter/0.log" Sep 07 12:50:37.114114 ip-10-0-129-7 kubenswrapper[2584]: I0907 12:50:37.114081 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-7hpvd_07c66148-19e3-41c1-91fe-c3591bb347e8/tuned/0.log"